[S 03/12 20:36] PVFS2 Server on node da3 version 2.7.1pre1-2008-03-12-025908 starting... [D 20:36:19.889762] BMI_ib_initialize: init. [D 20:36:19.889791] openib_ib_initialize: init. [D 20:36:19.892100] openib_ib_initialize: max 65408 completion queue entries. [D 20:36:19.892534] BMI_ib_initialize: done. [D 20:36:19.892558] [BMI CONTROL]: BMI_set_info: set_info: 0 option: 11 [D 20:36:19.892570] [BMI CONTROL]: BMI_set_info: set_info: 0 option: 12 [S 03/12 20:36] PVFS2 Server ready. [D 20:41:02.153960] [BMI CONTROL]: BMI_set_info: set_info: 6662784 option: 5 [D 20:41:02.154021] [BMI CONTROL]: BMI_set_info: searching for ref 6662784 [D 20:41:02.154031] [BMI CONTROL]: BMI_set_info: incremented ref 6662784 to: 1 [D 20:41:02.154250] BMI_post_send_list: addr: 6662784, count: 1, total_size: 1104, tag: 4 [D 20:41:02.154268] element 0: offset: 0x66e880, size: 1104 [D 20:41:02.154281] openib_post_sr: 10.1.4.240:38246 bh 0 len 1120 wr 0/70. [D 20:41:02.156644] [BMI CONTROL]: BMI_set_info: set_info: 6662784 option: 6 [D 20:41:02.156658] [BMI CONTROL]: BMI_set_info: searching for ref 6662784 [D 20:41:02.156667] [BMI CONTROL]: BMI_set_info: decremented ref 6662784 to: 0 [D 20:41:07.124989] [BMI CONTROL]: BMI_set_info: set_info: 6661680 option: 5 [D 20:41:07.125059] [BMI CONTROL]: BMI_set_info: searching for ref 6661680 [D 20:41:07.125073] [BMI CONTROL]: BMI_set_info: incremented ref 6661680 to: 1 [D 20:41:07.125120] BMI_post_send_list: addr: 6661680, count: 1, total_size: 1104, tag: 4 [D 20:41:07.125139] element 0: offset: 0x66e880, size: 1104 [D 20:41:07.125154] openib_post_sr: 10.1.4.240:38249 bh 0 len 1120 wr 1/70. [D 20:41:07.130236] [BMI CONTROL]: BMI_set_info: set_info: 6661680 option: 6 [D 20:41:07.130356] [BMI CONTROL]: BMI_set_info: searching for ref 6661680 [D 20:41:07.130371] [BMI CONTROL]: BMI_set_info: decremented ref 6661680 to: 0 [D 20:41:09.896959] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 5 [D 20:41:09.897018] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.897029] [BMI CONTROL]: BMI_set_info: incremented ref 6653168 to: 1 [D 20:41:09.897061] BMI_post_send_list: addr: 6653168, count: 1, total_size: 1104, tag: 4 [D 20:41:09.897072] element 0: offset: 0x66e880, size: 1104 [D 20:41:09.897085] openib_post_sr: 10.1.4.240:38252 bh 0 len 1120 wr 2/70. [D 20:41:09.897267] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 6 [D 20:41:09.897281] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.897290] [BMI CONTROL]: BMI_set_info: decremented ref 6653168 to: 0 [D 20:41:09.899371] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 5 [D 20:41:09.899384] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.899393] [BMI CONTROL]: BMI_set_info: incremented ref 6653168 to: 1 [D 20:41:09.899758] BMI_post_send_list: addr: 6653168, count: 1, total_size: 72, tag: 9 [D 20:41:09.899792] element 0: offset: 0x65d000, size: 72 [D 20:41:09.899806] openib_post_sr: 10.1.4.240:38252 bh 1 len 88 wr 3/70. [D 20:41:09.901875] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 6 [D 20:41:09.901889] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.901900] [BMI CONTROL]: BMI_set_info: decremented ref 6653168 to: 0 [D 20:41:15.046671] [BMI CONTROL]: BMI_set_info: set_info: 6658032 option: 5 [D 20:41:15.046720] [BMI CONTROL]: BMI_set_info: searching for ref 6658032 [D 20:41:15.046730] [BMI CONTROL]: BMI_set_info: incremented ref 6658032 to: 1 [D 20:41:15.046756] BMI_post_send_list: addr: 6658032, count: 1, total_size: 1104, tag: 4 [D 20:41:15.046767] element 0: offset: 0x66e880, size: 1104 [D 20:41:15.046781] openib_post_sr: 10.1.4.240:38255 bh 0 len 1120 wr 4/70. [D 20:41:15.046907] [BMI CONTROL]: BMI_set_info: set_info: 6658032 option: 6 [D 20:41:15.046917] [BMI CONTROL]: BMI_set_info: searching for ref 6658032 [D 20:41:15.046926] [BMI CONTROL]: BMI_set_info: decremented ref 6658032 to: 0 [D 20:41:26.991775] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:26.991814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:26.991825] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:26.991899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 4 [D 20:41:26.991910] element 0: offset: 0x61e700, size: 104 [D 20:41:26.991923] openib_post_sr: 10.1.4.240:38258 bh 0 len 120 wr 5/70. [D 20:41:26.992035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:26.992046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:26.992054] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:26.994806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:26.994816] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:26.994824] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:26.994846] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 10 [D 20:41:26.994855] element 0: offset: 0x6231d0, size: 104 [D 20:41:26.994865] openib_post_sr: 10.1.4.240:38258 bh 1 len 120 wr 6/70. [D 20:41:26.995021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:26.995033] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:26.995041] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.008434] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.008448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.008456] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.008790] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 19 [D 20:41:27.008802] element 0: offset: 0x61f100, size: 24 [D 20:41:27.008812] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 7/70. [D 20:41:27.008868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.008878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.008887] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.020494] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.020506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.020515] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.020535] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 23 [D 20:41:27.020545] element 0: offset: 0x659860, size: 24 [D 20:41:27.020555] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 8/70. [D 20:41:27.022293] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 23 [D 20:41:27.022344] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 9/70. [D 20:41:27.023453] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 23 [D 20:41:27.023469] element 0: offset: 0x659860, size: 24 [D 20:41:27.023481] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 10/70. [D 20:41:27.023572] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.023586] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.023601] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.086172] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.086186] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.086194] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.086290] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 30 [D 20:41:27.086301] element 0: offset: 0x65d000, size: 72 [D 20:41:27.086311] openib_post_sr: 10.1.4.240:38258 bh 6 len 88 wr 11/70. [D 20:41:27.086395] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.086407] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.086416] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.091877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.091891] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.091899] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.091917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 33 [D 20:41:27.091927] element 0: offset: 0x6151c0, size: 24 [D 20:41:27.091937] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 12/70. [D 20:41:27.092137] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 33 [D 20:41:27.092164] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 13/70. [D 20:41:27.092254] openib_post_sr_rdmaw: ibv_post_send wr_id 61f970 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.092409] openib_check_cq: completed rdma wr_id 61f970, nic_wr_credit 70. [D 20:41:27.092421] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 14/70. [D 20:41:27.092472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.092486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.092494] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.092695] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.092705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.092713] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.092729] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 34 [D 20:41:27.092738] element 0: offset: 0x61f0b0, size: 24 [D 20:41:27.092748] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 15/70. [D 20:41:27.092918] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 34 [D 20:41:27.092934] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 16/70. [D 20:41:27.092996] openib_post_sr_rdmaw: ibv_post_send wr_id 61f970 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.093116] openib_check_cq: completed rdma wr_id 61f970, nic_wr_credit 70. [D 20:41:27.093127] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 17/70. [D 20:41:27.093170] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.093184] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.093193] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.095598] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.095610] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.095619] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.095633] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 38 [D 20:41:27.095642] element 0: offset: 0x659860, size: 24 [D 20:41:27.095652] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 18/70. [D 20:41:27.097770] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 38 [D 20:41:27.097786] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 19/70. [D 20:41:27.097840] openib_post_sr_rdmaw: ibv_post_send wr_id 629f60 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.097916] openib_check_cq: completed rdma wr_id 629f60, nic_wr_credit 70. [D 20:41:27.097929] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 20/70. [D 20:41:27.097971] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.097982] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.097990] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.098078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.098090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098100] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.098116] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 40 [D 20:41:27.098128] element 0: offset: 0x65d000, size: 72 [D 20:41:27.098138] openib_post_sr: 10.1.4.240:38258 bh 16 len 88 wr 21/70. [D 20:41:27.098176] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.098188] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098197] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.098444] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.098456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.098480] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 41 [D 20:41:27.098489] element 0: offset: 0x6151c0, size: 24 [D 20:41:27.098499] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 22/70. [D 20:41:27.098544] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.098557] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098567] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.098652] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.098664] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098674] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.098689] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 43 [D 20:41:27.098702] element 0: offset: 0x65d000, size: 72 [D 20:41:27.098712] openib_post_sr: 10.1.4.240:38258 bh 18 len 88 wr 23/70. [D 20:41:27.098746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.098756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098765] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.185192] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.185244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.185254] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.185288] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 50 [D 20:41:27.185298] element 0: offset: 0x65d000, size: 72 [D 20:41:27.185310] openib_post_sr: 10.1.4.240:38258 bh 19 len 88 wr 24/70. [D 20:41:27.189210] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.189253] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.189262] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.201888] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.201903] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.201917] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.201946] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 57 [D 20:41:27.201956] element 0: offset: 0x659860, size: 24 [D 20:41:27.201968] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 25/70. [D 20:41:27.204391] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 57 [D 20:41:27.204408] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 26/70. [D 20:41:27.204561] openib_post_sr_rdmaw: ibv_post_send wr_id 62e9d0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.205326] openib_check_cq: completed rdma wr_id 62e9d0, nic_wr_credit 70. [D 20:41:27.205341] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 27/70. [D 20:41:27.207354] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.207368] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.207382] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.207396] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.207405] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.207418] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.207432] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 59 [D 20:41:27.207442] element 0: offset: 0x61ee20, size: 24 [D 20:41:27.208430] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 28/70. [D 20:41:27.208689] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 59 [D 20:41:27.208705] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 29/70. [D 20:41:27.208884] openib_post_sr_rdmaw: ibv_post_send wr_id 61f590 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.209742] openib_check_cq: completed rdma wr_id 61f590, nic_wr_credit 70. [D 20:41:27.209760] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 30/70. [D 20:41:27.209911] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.209924] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.209933] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.217169] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.217183] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.217191] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.217207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 63 [D 20:41:27.217216] element 0: offset: 0x6151c0, size: 24 [D 20:41:27.217227] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 31/70. [D 20:41:27.217417] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 63 [D 20:41:27.217431] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 32/70. [D 20:41:27.217593] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.218310] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 70. [D 20:41:27.218328] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 33/70. [D 20:41:27.218482] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.218495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.218503] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.218568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.218578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.218586] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.218605] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 65 [D 20:41:27.218614] element 0: offset: 0x65d000, size: 72 [D 20:41:27.218625] openib_post_sr: 10.1.4.240:38258 bh 9 len 88 wr 34/70. [D 20:41:27.218754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.218766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.218774] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.220916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.220926] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.220934] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.220949] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 67 [D 20:41:27.220958] element 0: offset: 0x659860, size: 24 [D 20:41:27.220968] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 35/70. [D 20:41:27.223213] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.223227] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.223235] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:27.223251] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.223261] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.223270] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:27.223286] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 69 [D 20:41:27.223296] element 0: offset: 0x65d000, size: 72 [D 20:41:27.223315] openib_post_sr: 10.1.4.240:38258 bh 11 len 88 wr 36/70. [D 20:41:27.223472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.223482] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.225821] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.235352] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.235366] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.235374] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.235391] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 76 [D 20:41:27.235400] element 0: offset: 0x65d000, size: 72 [D 20:41:27.235410] openib_post_sr: 10.1.4.240:38258 bh 12 len 88 wr 37/70. [D 20:41:27.235571] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.235581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.235590] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.245513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.245527] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.245536] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.245551] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 80 [D 20:41:27.245561] element 0: offset: 0x61f0b0, size: 24 [D 20:41:27.245571] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 38/70. [D 20:41:27.245782] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 80 [D 20:41:27.245795] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 39/70. [D 20:41:27.245974] openib_post_sr_rdmaw: ibv_post_send wr_id 637fb0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.246735] openib_check_cq: completed rdma wr_id 637fb0, nic_wr_credit 70. [D 20:41:27.246750] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 40/70. [D 20:41:27.246921] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.246934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.246942] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.247097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.247107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.247115] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.247131] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 81 [D 20:41:27.247140] element 0: offset: 0x61ee20, size: 24 [D 20:41:27.247151] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 41/70. [D 20:41:27.248642] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 81 [D 20:41:27.248655] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 42/70. [D 20:41:27.248841] openib_post_sr_rdmaw: ibv_post_send wr_id 636b50 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.249688] openib_check_cq: completed rdma wr_id 636b50, nic_wr_credit 70. [D 20:41:27.249703] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 43/70. [D 20:41:27.249857] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.249870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.249878] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.256141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.256155] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.256164] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.256179] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 85 [D 20:41:27.256189] element 0: offset: 0x6151c0, size: 24 [D 20:41:27.256199] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 44/70. [D 20:41:27.256575] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 85 [D 20:41:27.256599] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 45/70. [D 20:41:27.256769] openib_post_sr_rdmaw: ibv_post_send wr_id 61f4e0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.257366] openib_check_cq: completed rdma wr_id 61f4e0, nic_wr_credit 70. [D 20:41:27.257385] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 46/70. [D 20:41:27.257532] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.257544] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.257553] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.257623] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.257632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.257641] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.257657] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 87 [D 20:41:27.257667] element 0: offset: 0x65d000, size: 72 [D 20:41:27.257677] openib_post_sr: 10.1.4.240:38258 bh 2 len 88 wr 47/70. [D 20:41:27.257833] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.257844] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.257853] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.258133] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.258143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.258151] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.258165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 88 [D 20:41:27.258174] element 0: offset: 0x659860, size: 24 [D 20:41:27.258185] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 48/70. [D 20:41:27.258229] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.258239] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.258247] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.258323] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.258333] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.258341] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.258356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 90 [D 20:41:27.258366] element 0: offset: 0x65d000, size: 72 [D 20:41:27.258376] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 49/70. [D 20:41:27.258424] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.258435] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.258443] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:30.026527] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:30.026575] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:30.026585] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:30.026637] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 94 [D 20:41:30.026648] element 0: offset: 0x6400c0, size: 104 [D 20:41:30.026661] openib_post_sr: 10.1.4.240:38258 bh 5 len 120 wr 50/70. [D 20:41:30.026706] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:30.026716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:30.026725] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.846181] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.846219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.846230] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.846282] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 100 [D 20:41:36.846292] element 0: offset: 0x63ea70, size: 104 [D 20:41:36.846305] openib_post_sr: 10.1.4.240:38258 bh 6 len 120 wr 51/70. [D 20:41:36.846353] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.846363] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.846371] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.852212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.852225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.852234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.852257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 106 [D 20:41:36.852266] element 0: offset: 0x65d000, size: 72 [D 20:41:36.852277] openib_post_sr: 10.1.4.240:38258 bh 7 len 88 wr 52/70. [D 20:41:36.852331] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.852341] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.852349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.853186] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.853196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.853204] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.855480] BMI_post_send_list: addr: 6416064, count: 1, total_size: 16, tag: 108 [D 20:41:36.855491] element 0: offset: 0x630f20, size: 16 [D 20:41:36.855501] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 53/70. [D 20:41:36.855570] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.855582] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.855590] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.860911] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.860923] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.860931] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.860946] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 112 [D 20:41:36.860955] element 0: offset: 0x65d000, size: 72 [D 20:41:36.860965] openib_post_sr: 10.1.4.240:38258 bh 9 len 88 wr 54/70. [D 20:41:36.861017] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.861027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.861036] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.861941] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.861951] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.861959] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.861976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 114 [D 20:41:36.861985] element 0: offset: 0x659860, size: 24 [D 20:41:36.861997] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 55/70. [D 20:41:36.862092] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 114 [D 20:41:36.862112] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 56/70. [D 20:41:36.862938] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 114 [D 20:41:36.862950] element 0: offset: 0x659860, size: 24 [D 20:41:36.862961] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 57/70. [D 20:41:36.863043] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.863056] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.863065] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.930036] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.930050] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.930058] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.932322] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 121 [D 20:41:36.932335] element 0: offset: 0x65d000, size: 72 [D 20:41:36.932346] openib_post_sr: 10.1.4.240:38258 bh 13 len 88 wr 58/70. [D 20:41:36.932409] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.932421] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.932429] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.941087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.941100] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.941108] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.941123] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 127 [D 20:41:36.941133] element 0: offset: 0x65d000, size: 72 [D 20:41:36.941142] openib_post_sr: 10.1.4.240:38258 bh 14 len 88 wr 59/70. [D 20:41:36.941195] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.941205] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.941213] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.943100] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.943110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.943119] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.943133] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 130 [D 20:41:36.943142] element 0: offset: 0x61ee20, size: 24 [D 20:41:36.943152] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 60/70. [D 20:41:36.943327] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 130 [D 20:41:36.943345] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 0/70. [D 20:41:36.943415] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecc0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:36.943596] openib_check_cq: completed rdma wr_id 63ecc0, nic_wr_credit 70. [D 20:41:36.943610] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 1/70. [D 20:41:36.943656] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.943669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.943677] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.943867] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.943877] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.943886] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.943901] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 131 [D 20:41:36.943910] element 0: offset: 0x61f0b0, size: 24 [D 20:41:36.943922] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 2/70. [D 20:41:36.944113] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 131 [D 20:41:36.944131] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 3/70. [D 20:41:36.944194] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecf0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:36.944315] openib_check_cq: completed rdma wr_id 63ecf0, nic_wr_credit 70. [D 20:41:36.944326] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 4/70. [D 20:41:36.944364] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.944377] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.944386] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.945954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.945964] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.945972] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.945987] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 134 [D 20:41:36.945996] element 0: offset: 0x6151c0, size: 24 [D 20:41:36.946007] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 5/70. [D 20:41:36.946161] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 134 [D 20:41:36.946176] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 6/70. [D 20:41:36.946238] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecf0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:36.946325] openib_check_cq: completed rdma wr_id 63ecf0, nic_wr_credit 70. [D 20:41:36.946336] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 7/70. [D 20:41:36.946374] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.946387] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.946396] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.946461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.946471] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.946479] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.946495] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 136 [D 20:41:36.946504] element 0: offset: 0x65d000, size: 72 [D 20:41:36.946515] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 8/70. [D 20:41:36.946613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.946625] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.946634] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.949299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.949311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.949319] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.949333] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 138 [D 20:41:36.949342] element 0: offset: 0x630f20, size: 24 [D 20:41:36.949352] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 9/70. [D 20:41:36.951515] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.951528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.951538] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:36.951554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.951566] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.951575] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:36.951591] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 140 [D 20:41:36.951601] element 0: offset: 0x65d000, size: 72 [D 20:41:36.951610] openib_post_sr: 10.1.4.240:38258 bh 6 len 88 wr 10/70. [D 20:41:36.951658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.951670] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.951680] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.047654] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.047705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.047715] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.047748] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 147 [D 20:41:37.047759] element 0: offset: 0x65d000, size: 72 [D 20:41:37.047772] openib_post_sr: 10.1.4.240:38258 bh 7 len 88 wr 11/70. [D 20:41:37.047961] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.047971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.047980] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.068593] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.068627] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.068636] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.068663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 153 [D 20:41:37.068674] element 0: offset: 0x65d000, size: 72 [D 20:41:37.068686] openib_post_sr: 10.1.4.240:38258 bh 8 len 88 wr 12/70. [D 20:41:37.070931] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.070944] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.070954] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.081735] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.081749] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.081757] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.081776] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 157 [D 20:41:37.081785] element 0: offset: 0x62ea30, size: 24 [D 20:41:37.081795] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 13/70. [D 20:41:37.081963] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 157 [D 20:41:37.081978] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 14/70. [D 20:41:37.082067] openib_post_sr_rdmaw: ibv_post_send wr_id 63eb20 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.082552] openib_check_cq: completed rdma wr_id 63eb20, nic_wr_credit 70. [D 20:41:37.082589] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 15/70. [D 20:41:37.082744] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.082757] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.082766] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.088603] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.088617] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.088626] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.088642] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 159 [D 20:41:37.088652] element 0: offset: 0x62a060, size: 24 [D 20:41:37.088662] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 16/70. [D 20:41:37.088873] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 159 [D 20:41:37.088886] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 17/70. [D 20:41:37.089047] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecf0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.089806] openib_check_cq: completed rdma wr_id 63ecf0, nic_wr_credit 70. [D 20:41:37.089820] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 18/70. [D 20:41:37.089972] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.089986] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.089994] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.123852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.123900] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.123910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.123939] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 164 [D 20:41:37.123949] element 0: offset: 0x61f9b0, size: 24 [D 20:41:37.123971] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 19/70. [D 20:41:37.124222] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 164 [D 20:41:37.124237] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 20/70. [D 20:41:37.124405] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecf0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.124855] openib_check_cq: completed rdma wr_id 63ecf0, nic_wr_credit 70. [D 20:41:37.124868] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 21/70. [D 20:41:37.125030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.125043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.125054] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.125103] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.125113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.125121] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.125141] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 166 [D 20:41:37.125150] element 0: offset: 0x65d000, size: 72 [D 20:41:37.125159] openib_post_sr: 10.1.4.240:38258 bh 18 len 88 wr 22/70. [D 20:41:37.125274] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.125286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.125345] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.128623] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.128636] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.128644] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.128659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 167 [D 20:41:37.128668] element 0: offset: 0x61f0b0, size: 24 [D 20:41:37.128677] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 23/70. [D 20:41:37.128871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.128884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.128892] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.128939] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.128948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.128956] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.128971] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 169 [D 20:41:37.128980] element 0: offset: 0x65d000, size: 72 [D 20:41:37.128990] openib_post_sr: 10.1.4.240:38258 bh 0 len 88 wr 24/70. [D 20:41:37.129128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.129138] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.129146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.157516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.157532] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.157541] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.157557] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 176 [D 20:41:37.157566] element 0: offset: 0x65d000, size: 72 [D 20:41:37.157576] openib_post_sr: 10.1.4.240:38258 bh 1 len 88 wr 25/70. [D 20:41:37.157728] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.157738] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.157746] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.172988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.173003] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.173012] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.173027] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 183 [D 20:41:37.173036] element 0: offset: 0x691f20, size: 24 [D 20:41:37.173061] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 26/70. [D 20:41:37.173283] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 183 [D 20:41:37.173298] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 27/70. [D 20:41:37.173493] openib_post_sr_rdmaw: ibv_post_send wr_id 662a40 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.174304] openib_check_cq: completed rdma wr_id 662a40, nic_wr_credit 70. [D 20:41:37.174322] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 28/70. [D 20:41:37.174491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.174505] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.174513] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.174683] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.174693] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.174701] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.174716] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 184 [D 20:41:37.174725] element 0: offset: 0x623260, size: 24 [D 20:41:37.174736] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 29/70. [D 20:41:37.174951] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 184 [D 20:41:37.174967] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 30/70. [D 20:41:37.175135] openib_post_sr_rdmaw: ibv_post_send wr_id 662a40 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.175899] openib_check_cq: completed rdma wr_id 662a40, nic_wr_credit 70. [D 20:41:37.175922] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 31/70. [D 20:41:37.176074] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.176088] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.176096] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.183013] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.183026] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.183035] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.183050] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 189 [D 20:41:37.183059] element 0: offset: 0x630f20, size: 24 [D 20:41:37.183069] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 32/70. [D 20:41:37.183175] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 189 [D 20:41:37.183188] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 33/70. [D 20:41:37.183229] openib_post_sr_rdmaw: ibv_post_send wr_id 662a40 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.183308] openib_check_cq: completed rdma wr_id 662a40, nic_wr_credit 70. [D 20:41:37.183319] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 34/70. [D 20:41:37.183357] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.183370] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.183378] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.183441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.183450] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.183459] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.183474] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 191 [D 20:41:37.183484] element 0: offset: 0x65d000, size: 72 [D 20:41:37.183494] openib_post_sr: 10.1.4.240:38258 bh 11 len 88 wr 35/70. [D 20:41:37.183568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.183578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.183586] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.183904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.183914] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.183922] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.183936] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 192 [D 20:41:37.183945] element 0: offset: 0x63ead0, size: 24 [D 20:41:37.183954] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 36/70. [D 20:41:37.184035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.184046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.184054] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.184106] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.184116] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.184124] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.184139] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 194 [D 20:41:37.184148] element 0: offset: 0x65d000, size: 72 [D 20:41:37.184158] openib_post_sr: 10.1.4.240:38258 bh 13 len 88 wr 37/70. [D 20:41:37.186267] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.186280] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.186290] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.313405] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.313456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.313466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.313499] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 201 [D 20:41:37.313509] element 0: offset: 0x65d000, size: 72 [D 20:41:37.313522] openib_post_sr: 10.1.4.240:38258 bh 14 len 88 wr 38/70. [D 20:41:37.313688] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.313699] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.313707] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.333797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.333811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.333820] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.333838] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 209 [D 20:41:37.333848] element 0: offset: 0x62ea30, size: 24 [D 20:41:37.333858] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 39/70. [D 20:41:37.334194] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 209 [D 20:41:37.334211] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 40/70. [D 20:41:37.334384] openib_post_sr_rdmaw: ibv_post_send wr_id 662a40 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.335369] openib_check_cq: completed rdma wr_id 662a40, nic_wr_credit 70. [D 20:41:37.335401] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 41/70. [D 20:41:37.335588] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.335602] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.335611] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.335787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.335797] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.335805] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.335821] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 210 [D 20:41:37.335830] element 0: offset: 0x61f9b0, size: 24 [D 20:41:37.335841] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 42/70. [D 20:41:37.337326] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 210 [D 20:41:37.337343] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 43/70. [D 20:41:37.337512] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecf0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.338332] openib_check_cq: completed rdma wr_id 63ecf0, nic_wr_credit 70. [D 20:41:37.338350] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 44/70. [D 20:41:37.338554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.338568] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.338577] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.344705] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.344719] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.344727] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.344743] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 215 [D 20:41:37.344753] element 0: offset: 0x61f570, size: 24 [D 20:41:37.344763] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 45/70. [D 20:41:37.344986] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 215 [D 20:41:37.345000] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 46/70. [D 20:41:37.345178] openib_post_sr_rdmaw: ibv_post_send wr_id 62a120 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.345614] openib_check_cq: completed rdma wr_id 62a120, nic_wr_credit 70. [D 20:41:37.345631] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 47/70. [D 20:41:37.345772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.345786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.345794] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.345855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.345864] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.345872] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.345889] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 217 [D 20:41:37.345899] element 0: offset: 0x65d000, size: 72 [D 20:41:37.345909] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 48/70. [D 20:41:37.346041] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.346053] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.346062] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.346346] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.346356] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.346365] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.346380] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 218 [D 20:41:37.346389] element 0: offset: 0x659860, size: 24 [D 20:41:37.346399] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 49/70. [D 20:41:37.346803] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.346813] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.346822] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:37.346848] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.346857] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.346873] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:37.346891] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 220 [D 20:41:37.346900] element 0: offset: 0x65d000, size: 72 [D 20:41:37.346911] openib_post_sr: 10.1.4.240:38258 bh 6 len 88 wr 50/70. [D 20:41:37.347613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.347623] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.347631] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.443021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.443071] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.443080] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.443113] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 237 [D 20:41:37.443123] element 0: offset: 0x65d000, size: 72 [D 20:41:37.443144] openib_post_sr: 10.1.4.240:38258 bh 7 len 88 wr 51/70. [D 20:41:37.443263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.443273] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.443282] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.445467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.445478] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.445486] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.445505] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 239 [D 20:41:37.445514] element 0: offset: 0x61f7d0, size: 24 [D 20:41:37.445524] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 52/70. [D 20:41:37.447945] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 239 [D 20:41:37.447963] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 53/70. [D 20:41:37.448142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.448158] openib_post_sr_rdmaw: ibv_post_send wr_id 62b240 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 71. [D 20:41:37.450286] openib_check_cq: completed rdma wr_id 62b240, nic_wr_credit 71. [D 20:41:37.450299] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 54/70. [D 20:41:37.450460] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.450470] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.450479] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.460049] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.460063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.460209] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.460319] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 242 [D 20:41:37.460331] element 0: offset: 0x61f2e0, size: 24 [D 20:41:37.460352] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 55/70. [D 20:41:37.462634] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 242 [D 20:41:37.462653] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 56/70. [D 20:41:37.462697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 71. [D 20:41:37.462710] openib_post_sr_rdmaw: ibv_post_send wr_id 62b240 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 72. [D 20:41:37.462966] openib_check_cq: completed rdma wr_id 62b240, nic_wr_credit 72. [D 20:41:37.462978] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 57/70. [D 20:41:37.463032] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.463050] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.463059] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.488872] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.488946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.488968] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.489013] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 245 [D 20:41:37.489027] element 0: offset: 0x63ead0, size: 24 [D 20:41:37.489048] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 58/70. [D 20:41:37.491643] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.491657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.491666] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.494666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.494704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.494713] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.494742] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 248 [D 20:41:37.494753] element 0: offset: 0x61f0e0, size: 24 [D 20:41:37.494765] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 59/70. [D 20:41:37.498915] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 248 [D 20:41:37.498975] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 60/70. [D 20:41:37.499296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 72. [D 20:41:37.499416] openib_post_sr_rdmaw: ibv_post_send wr_id 62b240 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 73. [D 20:41:37.501229] openib_check_cq: completed rdma wr_id 62b240, nic_wr_credit 73. [D 20:41:37.501247] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 0/70. [D 20:41:37.504645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.504666] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.504688] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.518508] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.518630] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.518644] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.518686] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 251 [D 20:41:37.518701] element 0: offset: 0x61ee50, size: 24 [D 20:41:37.518718] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 1/70. [D 20:41:37.523219] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.523320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.523332] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.527134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.527185] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.527222] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.527300] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 254 [D 20:41:37.527314] element 0: offset: 0x6151c0, size: 24 [D 20:41:37.527331] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 2/70. [D 20:41:37.530870] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 254 [D 20:41:37.530924] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 3/70. [D 20:41:37.531871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 73. [D 20:41:37.531968] openib_post_sr_rdmaw: ibv_post_send wr_id 62b240 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 74. [D 20:41:37.533770] openib_check_cq: completed rdma wr_id 62b240, nic_wr_credit 74. [D 20:41:37.533792] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 4/70. [D 20:41:37.536895] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.536915] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.536925] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.550712] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.550794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.550809] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.550855] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 257 [D 20:41:37.550867] element 0: offset: 0x61f570, size: 24 [D 20:41:37.550899] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 5/70. [D 20:41:37.556102] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.556148] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.556157] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:37.556191] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.556201] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.556209] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:37.556232] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 260 [D 20:41:37.556242] element 0: offset: 0x61f570, size: 24 [D 20:41:37.556255] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 6/70. [D 20:41:37.557419] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 260 [D 20:41:37.557446] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 7/70. [D 20:41:37.557637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 74. [D 20:41:37.557749] openib_post_sr_rdmaw: ibv_post_send wr_id 6333c0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 75. [D 20:41:37.559804] openib_check_cq: completed rdma wr_id 6333c0, nic_wr_credit 75. [D 20:41:37.559836] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 8/70. [D 20:41:37.560000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.560016] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.560025] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.575906] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.575956] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.575966] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.575997] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 263 [D 20:41:37.576008] element 0: offset: 0x623260, size: 24 [D 20:41:37.576020] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 9/70. [D 20:41:37.579208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.579331] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.579348] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.583523] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.583612] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.583623] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.583676] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 265 [D 20:41:37.584455] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.584493] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 10/70. [D 20:41:37.587985] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 265 [D 20:41:37.588007] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 11/70. [D 20:41:37.588167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 75. [D 20:41:37.588194] openib_post_sr_rdmaw: ibv_post_send wr_id 635890 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 76. [D 20:41:37.590386] openib_check_cq: completed rdma wr_id 635890, nic_wr_credit 76. [D 20:41:37.590415] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 12/70. [D 20:41:37.592484] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.592505] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.592515] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.606472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.606548] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.606564] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.606604] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 268 [D 20:41:37.606614] element 0: offset: 0x61f7d0, size: 24 [D 20:41:37.606628] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 13/70. [D 20:41:37.609412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.609428] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.609439] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.612079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.612125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.612134] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.612164] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 271 [D 20:41:37.612174] element 0: offset: 0x61f2e0, size: 24 [D 20:41:37.612188] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 14/70. [D 20:41:37.612499] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 271 [D 20:41:37.612518] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 15/70. [D 20:41:37.612583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 76. [D 20:41:37.612651] openib_post_sr_rdmaw: ibv_post_send wr_id 62e8a0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 77. [D 20:41:37.614777] openib_check_cq: completed rdma wr_id 62e8a0, nic_wr_credit 77. [D 20:41:37.614833] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 16/70. [D 20:41:37.615021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.615037] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.615046] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.630739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.630792] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.630801] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.630832] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 274 [D 20:41:37.630843] element 0: offset: 0x63ead0, size: 24 [D 20:41:37.630856] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 17/70. [D 20:41:37.631057] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.631078] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.631087] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.682078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.682135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.682145] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.735652] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 282 [D 20:41:37.735704] element 0: offset: 0x61ee50, size: 24 [D 20:41:37.735719] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 18/70. [D 20:41:37.735925] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.735940] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.735953] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.749690] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.749741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.749750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.749781] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 287 [D 20:41:37.749791] element 0: offset: 0x6151c0, size: 24 [D 20:41:37.749804] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 19/70. [D 20:41:37.750141] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 287 [D 20:41:37.750158] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 20/70. [D 20:41:37.750387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 77. [D 20:41:37.750463] openib_post_sr_rdmaw: ibv_post_send wr_id 629f30 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 78. [D 20:41:37.752591] openib_check_cq: completed rdma wr_id 629f30, nic_wr_credit 78. [D 20:41:37.752622] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 21/70. [D 20:41:37.752802] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.752818] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.752827] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.778075] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.778126] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.778135] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.778165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 290 [D 20:41:37.778175] element 0: offset: 0x61f9e0, size: 24 [D 20:41:37.778188] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 22/70. [D 20:41:37.778373] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.778386] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.778394] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.789338] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.789370] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.789379] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.789404] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 293 [D 20:41:37.789414] element 0: offset: 0x61f570, size: 24 [D 20:41:37.789426] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 23/70. [D 20:41:37.789761] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 293 [D 20:41:37.789779] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 24/70. [D 20:41:37.789938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 78. [D 20:41:37.790042] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 79. [D 20:41:37.791895] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 79. [D 20:41:37.791916] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 25/70. [D 20:41:37.792137] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.792154] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.792162] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.818204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.818258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.818267] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.818298] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 296 [D 20:41:37.818309] element 0: offset: 0x623260, size: 24 [D 20:41:37.818322] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 26/70. [D 20:41:37.821508] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.821593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.821603] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.830858] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.830983] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.831000] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.831046] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 299 [D 20:41:37.831063] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.831077] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 27/70. [D 20:41:37.835545] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 299 [D 20:41:37.835597] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 28/70. [D 20:41:37.836223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 79. [D 20:41:37.836316] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 80. [D 20:41:37.838283] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 80. [D 20:41:37.838305] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 29/70. [D 20:41:37.840091] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.840109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.840117] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.856423] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.856474] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.856483] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.856513] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 302 [D 20:41:37.856523] element 0: offset: 0x61f7d0, size: 24 [D 20:41:37.856536] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 30/70. [D 20:41:37.857255] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.857269] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.857278] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.866878] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.866892] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.866901] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.866916] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 305 [D 20:41:37.866926] element 0: offset: 0x622f70, size: 24 [D 20:41:37.866936] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 31/70. [D 20:41:37.867249] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 305 [D 20:41:37.867266] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 32/70. [D 20:41:37.867425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 80. [D 20:41:37.867514] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 81. [D 20:41:37.869450] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 81. [D 20:41:37.869467] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 33/70. [D 20:41:37.869586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.869618] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.869633] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.899830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.899882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.899891] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.899922] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 308 [D 20:41:37.899932] element 0: offset: 0x657210, size: 24 [D 20:41:37.899945] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 34/70. [D 20:41:37.903771] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 308 [D 20:41:37.903790] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 35/70. [D 20:41:37.904026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 81. [D 20:41:37.904150] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 82. [D 20:41:37.906191] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 82. [D 20:41:37.906210] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 36/70. [D 20:41:37.906404] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.906420] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.906429] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.930339] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.930390] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.930400] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.930429] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 311 [D 20:41:37.930439] element 0: offset: 0x61ee50, size: 24 [D 20:41:37.930452] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 37/70. [D 20:41:37.930652] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.930666] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.930675] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.944769] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.944784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.944792] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.944807] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 314 [D 20:41:37.944816] element 0: offset: 0x6151c0, size: 24 [D 20:41:37.944827] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 38/70. [D 20:41:37.945117] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 314 [D 20:41:37.945134] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 39/70. [D 20:41:37.945307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 82. [D 20:41:37.945384] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 83. [D 20:41:37.947410] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 83. [D 20:41:37.947444] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 40/70. [D 20:41:37.947655] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.947670] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.947679] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.966569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.966622] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.966630] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.966660] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 317 [D 20:41:37.966670] element 0: offset: 0x61f9e0, size: 24 [D 20:41:37.966683] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 41/70. [D 20:41:37.966870] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.966882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.966891] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.976010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.976024] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.976033] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.976048] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 320 [D 20:41:37.976057] element 0: offset: 0x61f570, size: 24 [D 20:41:37.976067] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 42/70. [D 20:41:37.976373] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 320 [D 20:41:37.976391] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 43/70. [D 20:41:37.976607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 83. [D 20:41:37.976701] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 84. [D 20:41:37.978817] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 84. [D 20:41:37.978861] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 44/70. [D 20:41:37.979029] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.979044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.979053] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.000691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.000741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.000751] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.000780] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 323 [D 20:41:38.000790] element 0: offset: 0x623260, size: 24 [D 20:41:38.000803] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 45/70. [D 20:41:38.000981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.000994] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.001002] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.004236] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.004281] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.004290] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.004320] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 325 [D 20:41:38.004330] element 0: offset: 0x691fe0, size: 24 [D 20:41:38.004343] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 46/70. [D 20:41:38.004697] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 325 [D 20:41:38.004715] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 47/70. [D 20:41:38.004900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 84. [D 20:41:38.004974] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 85. [D 20:41:38.007094] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 85. [D 20:41:38.007128] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 48/70. [D 20:41:38.007364] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.007399] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.007409] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.027626] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.027677] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.027686] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.027716] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 328 [D 20:41:38.027726] element 0: offset: 0x657210, size: 24 [D 20:41:38.027739] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 49/70. [D 20:41:38.027948] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.027961] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.027969] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.030946] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.030960] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.030968] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.030984] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 330 [D 20:41:38.030994] element 0: offset: 0x61f0e0, size: 24 [D 20:41:38.031005] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 50/70. [D 20:41:38.031289] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 330 [D 20:41:38.031322] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 51/70. [D 20:41:38.031507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 85. [D 20:41:38.031587] openib_post_sr_rdmaw: ibv_post_send wr_id 629fb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 86. [D 20:41:38.033819] openib_check_cq: completed rdma wr_id 629fb0, nic_wr_credit 86. [D 20:41:38.033909] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 52/70. [D 20:41:38.034085] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.034101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.034110] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.055500] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.055552] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.055561] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.055590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 333 [D 20:41:38.055600] element 0: offset: 0x61ee50, size: 24 [D 20:41:38.055614] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 53/70. [D 20:41:38.055795] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.055808] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.055817] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.058495] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.058509] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.058518] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.058533] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 335 [D 20:41:38.058543] element 0: offset: 0x6151c0, size: 24 [D 20:41:38.058553] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 54/70. [D 20:41:38.059632] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 335 [D 20:41:38.059650] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 55/70. [D 20:41:38.059827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 86. [D 20:41:38.059917] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 87. [D 20:41:38.061927] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 87. [D 20:41:38.061949] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 56/70. [D 20:41:38.062138] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.062154] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.062163] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.082583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.082636] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.082645] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.082676] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 338 [D 20:41:38.082687] element 0: offset: 0x659890, size: 24 [D 20:41:38.082700] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 57/70. [D 20:41:38.083348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.083362] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.083371] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.094003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.094017] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.094025] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.094041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 341 [D 20:41:38.094050] element 0: offset: 0x61f9e0, size: 24 [D 20:41:38.094060] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 58/70. [D 20:41:38.094383] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 341 [D 20:41:38.094400] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 59/70. [D 20:41:38.094619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 87. [D 20:41:38.094745] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 88. [D 20:41:38.096581] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 88. [D 20:41:38.096601] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 60/70. [D 20:41:38.096757] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.096773] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.096781] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.117651] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.117692] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.117701] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.117730] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 344 [D 20:41:38.117741] element 0: offset: 0x61f310, size: 24 [D 20:41:38.117754] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 0/70. [D 20:41:38.117932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.117949] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.117958] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.126863] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.126898] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.126906] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.126934] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 347 [D 20:41:38.126944] element 0: offset: 0x623260, size: 24 [D 20:41:38.126956] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 1/70. [D 20:41:38.127258] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 347 [D 20:41:38.127277] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 2/70. [D 20:41:38.127441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 88. [D 20:41:38.127535] openib_post_sr_rdmaw: ibv_post_send wr_id 629fb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 89. [D 20:41:38.129466] openib_check_cq: completed rdma wr_id 629fb0, nic_wr_credit 89. [D 20:41:38.129487] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 3/70. [D 20:41:38.129660] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.129689] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.129704] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.150244] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.150258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.150266] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.150284] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 350 [D 20:41:38.150293] element 0: offset: 0x622f70, size: 24 [D 20:41:38.150304] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 4/70. [D 20:41:38.150364] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.150376] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.150384] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.639817] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.639866] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.639876] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.639906] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 353 [D 20:41:39.639917] element 0: offset: 0x61f800, size: 24 [D 20:41:39.639930] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 5/70. [D 20:41:39.640257] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 353 [D 20:41:39.640275] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 6/70. [D 20:41:39.640328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 89. [D 20:41:39.640395] openib_post_sr_rdmaw: ibv_post_send wr_id 629fb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 90. [D 20:41:39.640722] openib_check_cq: completed rdma wr_id 629fb0, nic_wr_credit 90. [D 20:41:39.640738] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 7/70. [D 20:41:39.640805] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.640819] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.640828] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.663205] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.663235] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.663244] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.663272] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 356 [D 20:41:39.663282] element 0: offset: 0x63eb00, size: 24 [D 20:41:39.663293] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 8/70. [D 20:41:39.663441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.663454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.663463] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.671402] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.671416] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.671424] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.671440] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 359 [D 20:41:39.671449] element 0: offset: 0x62e870, size: 24 [D 20:41:39.671462] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 9/70. [D 20:41:39.671682] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 359 [D 20:41:39.671699] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 10/70. [D 20:41:39.671744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 90. [D 20:41:39.671788] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 91. [D 20:41:39.672104] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 91. [D 20:41:39.672119] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 11/70. [D 20:41:39.672182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.672196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.672205] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.694050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.694063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.694072] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.694087] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 362 [D 20:41:39.694097] element 0: offset: 0x62ea60, size: 24 [D 20:41:39.694107] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 12/70. [D 20:41:39.694164] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.694175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.694184] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.702350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.702363] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.702372] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.702387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 365 [D 20:41:39.702396] element 0: offset: 0x6151c0, size: 24 [D 20:41:39.702408] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 13/70. [D 20:41:39.702566] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 365 [D 20:41:39.702582] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 14/70. [D 20:41:39.702626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 91. [D 20:41:39.702645] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 92. [D 20:41:39.702961] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 92. [D 20:41:39.702975] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 15/70. [D 20:41:39.703020] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.703035] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.703043] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.721828] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.721843] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.721851] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.721869] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 368 [D 20:41:39.721879] element 0: offset: 0x64b8e0, size: 24 [D 20:41:39.721889] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 16/70. [D 20:41:39.721950] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.721962] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.721970] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.729424] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.729438] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.729446] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.729461] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 371 [D 20:41:39.729471] element 0: offset: 0x61f310, size: 24 [D 20:41:39.729481] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 17/70. [D 20:41:39.729644] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 371 [D 20:41:39.729661] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 18/70. [D 20:41:39.729703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 92. [D 20:41:39.729728] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 93. [D 20:41:39.730056] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 93. [D 20:41:39.730070] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 19/70. [D 20:41:39.730127] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.730141] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.730150] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.748687] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.748700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.748708] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.748724] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 374 [D 20:41:39.748733] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.748743] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 20/70. [D 20:41:39.748800] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.748812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.748820] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.756620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.756634] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.756643] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.756658] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 377 [D 20:41:39.756668] element 0: offset: 0x657310, size: 24 [D 20:41:39.756678] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 21/70. [D 20:41:39.756834] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 377 [D 20:41:39.756851] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 22/70. [D 20:41:39.756895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 93. [D 20:41:39.756913] openib_post_sr_rdmaw: ibv_post_send wr_id 640300 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 94. [D 20:41:39.757243] openib_check_cq: completed rdma wr_id 640300, nic_wr_credit 94. [D 20:41:39.757256] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 23/70. [D 20:41:39.757301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.757315] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.757324] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.774348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.774362] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.774370] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.774386] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 380 [D 20:41:39.774395] element 0: offset: 0x61f800, size: 24 [D 20:41:39.774406] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 24/70. [D 20:41:39.774462] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.774474] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.774482] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.779355] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.779369] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.779377] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.779393] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 382 [D 20:41:39.779402] element 0: offset: 0x62e870, size: 24 [D 20:41:39.779412] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 25/70. [D 20:41:39.779562] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 382 [D 20:41:39.779578] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 26/70. [D 20:41:39.779624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 94. [D 20:41:39.779643] openib_post_sr_rdmaw: ibv_post_send wr_id 62eb20 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 95. [D 20:41:39.779975] openib_check_cq: completed rdma wr_id 62eb20, nic_wr_credit 95. [D 20:41:39.779988] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 27/70. [D 20:41:39.780033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.780048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.780057] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.794214] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.794228] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.794236] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.794252] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 385 [D 20:41:39.794261] element 0: offset: 0x64b8e0, size: 24 [D 20:41:39.794271] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 28/70. [D 20:41:39.794328] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.794339] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.794348] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.796998] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.797011] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.797019] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.797034] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 387 [D 20:41:39.797044] element 0: offset: 0x61f310, size: 24 [D 20:41:39.797054] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 29/70. [D 20:41:39.797208] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 387 [D 20:41:39.797225] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 30/70. [D 20:41:39.797267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 95. [D 20:41:39.797285] openib_post_sr_rdmaw: ibv_post_send wr_id 62eb20 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 96. [D 20:41:39.797630] openib_check_cq: completed rdma wr_id 62eb20, nic_wr_credit 96. [D 20:41:39.797644] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 31/70. [D 20:41:39.797689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.797704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.797712] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.812016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.812065] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.812075] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.812105] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 390 [D 20:41:39.812116] element 0: offset: 0x61fad0, size: 24 [D 20:41:39.812129] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 32/70. [D 20:41:39.815212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.815290] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.815301] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.820957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.820973] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.820983] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.821015] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 393 [D 20:41:39.821027] element 0: offset: 0x63a360, size: 24 [D 20:41:39.821040] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 33/70. [D 20:41:39.821282] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 393 [D 20:41:39.821303] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 34/70. [D 20:41:39.821348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 96. [D 20:41:39.821369] openib_post_sr_rdmaw: ibv_post_send wr_id 62fb80 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 97. [D 20:41:39.821709] openib_check_cq: completed rdma wr_id 62fb80, nic_wr_credit 97. [D 20:41:39.821724] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 35/70. [D 20:41:39.821762] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.821772] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.821782] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.837773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.837790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.837802] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.837820] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 396 [D 20:41:39.837831] element 0: offset: 0x657310, size: 24 [D 20:41:39.837841] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 36/70. [D 20:41:39.837920] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.837934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.837944] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.843013] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.843028] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.843039] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.843055] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 399 [D 20:41:39.843066] element 0: offset: 0x655ea0, size: 24 [D 20:41:39.843077] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 37/70. [D 20:41:39.844384] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 399 [D 20:41:39.844405] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 38/70. [D 20:41:39.844447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 97. [D 20:41:39.844476] openib_post_sr_rdmaw: ibv_post_send wr_id 62fb80 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 98. [D 20:41:39.844789] openib_check_cq: completed rdma wr_id 62fb80, nic_wr_credit 98. [D 20:41:39.844802] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 39/70. [D 20:41:39.844844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.844854] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.844864] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.861075] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.861109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.861119] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.861151] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 402 [D 20:41:39.861162] element 0: offset: 0x61f800, size: 24 [D 20:41:39.861174] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 40/70. [D 20:41:39.861257] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.861271] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.861281] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.865919] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.865933] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.865943] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.865958] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 404 [D 20:41:39.865971] element 0: offset: 0x623260, size: 24 [D 20:41:39.865981] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 41/70. [D 20:41:39.866191] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 404 [D 20:41:39.866243] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 42/70. [D 20:41:39.866291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 98. [D 20:41:39.866311] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 99. [D 20:41:39.866644] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 99. [D 20:41:39.866658] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 43/70. [D 20:41:39.866696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.866707] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.866716] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.883595] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.883609] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.883620] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.883635] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 407 [D 20:41:39.883646] element 0: offset: 0x61f0e0, size: 24 [D 20:41:39.883655] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 44/70. [D 20:41:39.883709] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.883721] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.883748] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.888569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.888583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.888594] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.888608] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 409 [D 20:41:39.888619] element 0: offset: 0x64b8e0, size: 24 [D 20:41:39.888628] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 45/70. [D 20:41:39.888753] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 409 [D 20:41:39.888774] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 46/70. [D 20:41:39.888950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 99. [D 20:41:39.888968] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 100. [D 20:41:39.889467] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 100. [D 20:41:39.889480] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 47/70. [D 20:41:39.889518] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.889528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.889538] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.906195] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.906279] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.906294] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.906374] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 412 [D 20:41:39.906389] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.906404] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 48/70. [D 20:41:39.912303] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.912328] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.912345] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:39.912444] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.912485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.912494] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:39.912518] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 415 [D 20:41:39.912528] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.912542] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 49/70. [D 20:41:39.912853] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 415 [D 20:41:39.912873] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 50/70. [D 20:41:39.912924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 100. [D 20:41:39.912958] openib_post_sr_rdmaw: ibv_post_send wr_id 6548d0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 101. [D 20:41:39.913279] openib_check_cq: completed rdma wr_id 6548d0, nic_wr_credit 101. [D 20:41:39.913295] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 51/70. [D 20:41:39.913360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.913374] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.913383] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.926557] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.926571] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.926579] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.926596] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 418 [D 20:41:39.926605] element 0: offset: 0x61fad0, size: 24 [D 20:41:39.926616] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 52/70. [D 20:41:39.926675] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.926686] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.926695] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.931212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.931225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.931234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.933710] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 425 [D 20:41:39.933725] element 0: offset: 0x657310, size: 24 [D 20:41:39.933735] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 53/70. [D 20:41:39.933796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.933808] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.933817] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.935715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.935728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.935737] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.938005] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 430 [D 20:41:39.938019] element 0: offset: 0x61f800, size: 24 [D 20:41:39.938030] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 54/70. [D 20:41:39.938091] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.938103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.938111] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.940121] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.940135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.940143] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.942356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 438 [D 20:41:39.942371] element 0: offset: 0x62e870, size: 24 [D 20:41:39.942381] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 55/70. [D 20:41:39.942440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.942453] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.942461] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.944229] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.944243] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.944254] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.946474] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 444 [D 20:41:39.946488] element 0: offset: 0x64b8e0, size: 24 [D 20:41:39.946498] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 56/70. [D 20:41:39.946560] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.946579] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.946588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.948924] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.948938] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.948948] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.948976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 449 [D 20:41:39.948987] element 0: offset: 0x61f310, size: 24 [D 20:41:39.948998] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 57/70. [D 20:41:39.951233] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 449 [D 20:41:39.951251] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 58/70. [D 20:41:39.952228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 449 [D 20:41:39.952243] element 0: offset: 0x61f310, size: 24 [D 20:41:39.952258] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 59/70. [D 20:41:39.954729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.954743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.954753] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.954767] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.954776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.954785] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.954842] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 451 [D 20:41:39.954856] element 0: offset: 0x61fad0, size: 24 [D 20:41:39.954867] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 60/70. [D 20:41:39.955050] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 131072, tag: 451 [D 20:41:39.955071] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 0/70. [D 20:41:39.955111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fe4030 rkey 4a40042 nic_wr_credit 101. [D 20:41:39.955127] openib_post_sr_rdmaw: ibv_post_send wr_id 655e20 to 10.1.4.240:38258 remote addr f4004030 rkey 4a40044 nic_wr_credit 102. [D 20:41:39.956056] openib_check_cq: completed rdma wr_id 655e20, nic_wr_credit 102. [D 20:41:39.956069] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 1/70. [D 20:41:39.956107] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.956118] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.956126] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.964263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.964277] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.964288] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.964304] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 454 [D 20:41:39.964317] element 0: offset: 0x657310, size: 24 [D 20:41:39.966149] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 2/70. [D 20:41:39.966200] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 454 [D 20:41:39.966225] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 3/70. [D 20:41:39.968045] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 454 [D 20:41:39.968059] element 0: offset: 0x657310, size: 24 [D 20:41:39.969790] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 4/70. [D 20:41:39.969840] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.969852] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.969862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.059722] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.059741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.059750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.059855] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 459 [D 20:41:40.059867] element 0: offset: 0x630f60, size: 24 [D 20:41:40.059878] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 5/70. [D 20:41:40.059927] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 459 [D 20:41:40.059953] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 6/70. [D 20:41:40.060978] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 459 [D 20:41:40.060993] element 0: offset: 0x630f60, size: 24 [D 20:41:40.061003] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 7/70. [D 20:41:40.063120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.063134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.063143] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.068148] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.068162] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.068172] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.068231] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 463 [D 20:41:40.068245] element 0: offset: 0x64b8e0, size: 24 [D 20:41:40.068255] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 8/70. [D 20:41:40.068318] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 463 [D 20:41:40.068334] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 9/70. [D 20:41:40.069300] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 463 [D 20:41:40.069314] element 0: offset: 0x64b8e0, size: 24 [D 20:41:40.069326] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 10/70. [D 20:41:40.069361] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.069372] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.069381] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.070874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.070887] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.070897] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.070956] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 466 [D 20:41:40.070969] element 0: offset: 0x6151c0, size: 24 [D 20:41:40.070979] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 11/70. [D 20:41:40.071016] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 466 [D 20:41:40.071048] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 12/70. [D 20:41:40.072156] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 466 [D 20:41:40.072170] element 0: offset: 0x6151c0, size: 24 [D 20:41:40.072182] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 13/70. [D 20:41:40.072216] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.072226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.072236] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.073227] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.073241] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.073251] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.073266] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 469 [D 20:41:40.073280] element 0: offset: 0x61ee50, size: 24 [D 20:41:40.073289] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 14/70. [D 20:41:40.075528] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 469 [D 20:41:40.075578] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 15/70. [D 20:41:40.075622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 102. [D 20:41:40.075640] openib_post_sr_rdmaw: ibv_post_send wr_id 643470 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 103. [D 20:41:40.076145] openib_check_cq: completed rdma wr_id 643470, nic_wr_credit 103. [D 20:41:40.076158] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 16/70. [D 20:41:40.076197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.076208] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.076217] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.091220] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.091235] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.091246] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.091261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 472 [D 20:41:40.091271] element 0: offset: 0x62c430, size: 24 [D 20:41:40.091281] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 17/70. [D 20:41:40.091334] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.091347] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.091371] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.096860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.096874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.096884] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.096899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 475 [D 20:41:40.096909] element 0: offset: 0x657310, size: 24 [D 20:41:40.096918] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 18/70. [D 20:41:40.097035] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 475 [D 20:41:40.097054] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 19/70. [D 20:41:40.097097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 103. [D 20:41:40.097115] openib_post_sr_rdmaw: ibv_post_send wr_id 643470 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 104. [D 20:41:40.097360] openib_check_cq: completed rdma wr_id 643470, nic_wr_credit 104. [D 20:41:40.097373] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 20/70. [D 20:41:40.097411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.097422] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.097431] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.112174] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.112188] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.112199] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.112214] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 478 [D 20:41:40.112224] element 0: offset: 0x623260, size: 24 [D 20:41:40.112234] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 21/70. [D 20:41:40.112299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.112327] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.112336] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.118246] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.118260] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.118270] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.118331] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 482 [D 20:41:40.118345] element 0: offset: 0x630f60, size: 24 [D 20:41:40.118355] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 22/70. [D 20:41:40.118656] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 262144, tag: 482 [D 20:41:40.118683] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 23/70. [D 20:41:40.118728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fe4630 rkey 4a40042 nic_wr_credit 104. [D 20:41:40.118745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4004630 rkey 4a40044 nic_wr_credit 105. [D 20:41:40.118755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4024630 rkey 4a40044 nic_wr_credit 106. [D 20:41:40.118765] openib_post_sr_rdmaw: ibv_post_send wr_id 654c20 to 10.1.4.240:38258 remote addr f4044630 rkey 4a40044 nic_wr_credit 107. [D 20:41:40.119714] openib_check_cq: completed rdma wr_id 654c20, nic_wr_credit 107. [D 20:41:40.119727] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 24/70. [D 20:41:40.119766] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.119776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.119785] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.125725] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.125739] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.125749] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.125765] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 485 [D 20:41:40.125778] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.125788] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 25/70. [D 20:41:40.126420] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 655360, tag: 485 [D 20:41:40.126472] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 26/70. [D 20:41:40.126515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc1e0 rkey 4a40042 nic_wr_credit 107. [D 20:41:40.126531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc1e0 rkey 4a40042 nic_wr_credit 108. [D 20:41:40.126542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c1e0 rkey 4a40044 nic_wr_credit 109. [D 20:41:40.126552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c1e0 rkey 4a40044 nic_wr_credit 110. [D 20:41:40.126562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c1e0 rkey 4a40044 nic_wr_credit 111. [D 20:41:40.126572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c1e0 rkey 4a40044 nic_wr_credit 112. [D 20:41:40.126582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c1e0 rkey 4a40044 nic_wr_credit 113. [D 20:41:40.126592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc1e0 rkey 4a40044 nic_wr_credit 114. [D 20:41:40.126605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc1e0 rkey 4a40044 nic_wr_credit 115. [D 20:41:40.126615] openib_post_sr_rdmaw: ibv_post_send wr_id 643680 to 10.1.4.240:38258 remote addr f40fc1e0 rkey 4a40044 nic_wr_credit 116. [D 20:41:40.129226] openib_check_cq: completed rdma wr_id 643680, nic_wr_credit 116. [D 20:41:40.129240] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 27/70. [D 20:41:40.131419] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.131433] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.131443] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.326568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.326583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.326594] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.326609] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 488 [D 20:41:40.326619] element 0: offset: 0x63fda0, size: 24 [D 20:41:40.326630] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 28/70. [D 20:41:40.326676] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 488 [D 20:41:40.326706] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 29/70. [D 20:41:40.328620] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 488 [D 20:41:40.328635] element 0: offset: 0x63fda0, size: 24 [D 20:41:40.330334] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 30/70. [D 20:41:40.330382] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.330395] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.330405] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.330904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.330917] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.330927] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.330942] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 491 [D 20:41:40.330955] element 0: offset: 0x61ee50, size: 24 [D 20:41:40.330965] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 31/70. [D 20:41:40.332397] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 491 [D 20:41:40.332419] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 32/70. [D 20:41:40.332460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 116. [D 20:41:40.332476] openib_post_sr_rdmaw: ibv_post_send wr_id 643470 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 117. [D 20:41:40.332912] openib_check_cq: completed rdma wr_id 643470, nic_wr_credit 117. [D 20:41:40.332925] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 33/70. [D 20:41:40.332963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.332973] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.332983] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.510152] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.510167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.510177] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.510239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 495 [D 20:41:40.510254] element 0: offset: 0x62c430, size: 24 [D 20:41:40.510264] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 34/70. [D 20:41:40.510312] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 495 [D 20:41:40.510336] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 35/70. [D 20:41:40.511694] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 495 [D 20:41:40.511709] element 0: offset: 0x62c430, size: 24 [D 20:41:40.511721] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 36/70. [D 20:41:40.513852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.513865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.513876] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.514089] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.514102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.514115] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.514173] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 499 [D 20:41:40.514186] element 0: offset: 0x630f60, size: 24 [D 20:41:40.516427] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 37/70. [D 20:41:40.516477] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 499 [D 20:41:40.516502] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 38/70. [D 20:41:40.517870] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 499 [D 20:41:40.517884] element 0: offset: 0x630f60, size: 24 [D 20:41:40.517896] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 39/70. [D 20:41:40.520327] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.520341] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.520351] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.520365] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.520375] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.520384] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.520442] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 503 [D 20:41:40.520470] element 0: offset: 0x6151c0, size: 24 [D 20:41:40.520481] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 40/70. [D 20:41:40.523126] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 461824, tag: 503 [D 20:41:40.523173] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 41/70. [D 20:41:40.523303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 117. [D 20:41:40.523320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fecc00 rkey 4a40044 nic_wr_credit 118. [D 20:41:40.523332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400cc00 rkey 4a40044 nic_wr_credit 119. [D 20:41:40.523342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402cc00 rkey 4a40044 nic_wr_credit 120. [D 20:41:40.523356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404cc00 rkey 4a40044 nic_wr_credit 121. [D 20:41:40.523366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406cc00 rkey 4a40044 nic_wr_credit 122. [D 20:41:40.523376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408cc00 rkey 4a40044 nic_wr_credit 123. [D 20:41:40.523386] openib_post_sr_rdmaw: ibv_post_send wr_id 63dfc0 to 10.1.4.240:38258 remote addr f40acc00 rkey 4a40044 nic_wr_credit 124. [D 20:41:40.525481] openib_check_cq: completed rdma wr_id 63dfc0, nic_wr_credit 124. [D 20:41:40.525495] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 42/70. [D 20:41:40.525535] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.525546] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.525557] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.608307] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.608324] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.608335] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.608350] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 506 [D 20:41:40.608360] element 0: offset: 0x61ee50, size: 24 [D 20:41:40.608370] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 43/70. [D 20:41:40.608419] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 506 [D 20:41:40.608445] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 44/70. [D 20:41:40.609688] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 506 [D 20:41:40.609702] element 0: offset: 0x61ee50, size: 24 [D 20:41:40.609714] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 45/70. [D 20:41:40.609748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.609759] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.609768] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.616050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.616064] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.616073] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.616142] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 509 [D 20:41:40.616156] element 0: offset: 0x657310, size: 24 [D 20:41:40.616166] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 46/70. [D 20:41:40.616570] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 461824, tag: 509 [D 20:41:40.616615] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 47/70. [D 20:41:40.616659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 124. [D 20:41:40.616677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fecc00 rkey 4a40042 nic_wr_credit 125. [D 20:41:40.616687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400cc00 rkey 4a40044 nic_wr_credit 126. [D 20:41:40.616697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402cc00 rkey 4a40044 nic_wr_credit 127. [D 20:41:40.616707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404cc00 rkey 4a40044 nic_wr_credit 128. [D 20:41:40.616717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406cc00 rkey 4a40044 nic_wr_credit 129. [D 20:41:40.616727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408cc00 rkey 4a40044 nic_wr_credit 130. [D 20:41:40.616737] openib_post_sr_rdmaw: ibv_post_send wr_id 654d10 to 10.1.4.240:38258 remote addr f40acc00 rkey 4a40044 nic_wr_credit 131. [D 20:41:40.618863] openib_check_cq: completed rdma wr_id 654d10, nic_wr_credit 131. [D 20:41:40.618877] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 48/70. [D 20:41:40.619026] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.619038] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.619058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.628322] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.628336] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.628346] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.628361] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 512 [D 20:41:40.628371] element 0: offset: 0x623260, size: 24 [D 20:41:40.628381] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 49/70. [D 20:41:40.631522] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 983040, tag: 512 [D 20:41:40.631576] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 50/70. [D 20:41:40.631716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fe4630 rkey 4a40042 nic_wr_credit 131. [D 20:41:40.631734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4004630 rkey 4a40044 nic_wr_credit 132. [D 20:41:40.631746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4024630 rkey 4a40044 nic_wr_credit 133. [D 20:41:40.631760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4044630 rkey 4a40044 nic_wr_credit 134. [D 20:41:40.631770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4064630 rkey 4a40044 nic_wr_credit 135. [D 20:41:40.631792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4084630 rkey 4a40044 nic_wr_credit 136. [D 20:41:40.631803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40a4630 rkey 4a40044 nic_wr_credit 137. [D 20:41:40.631813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40c4630 rkey 4a40044 nic_wr_credit 138. [D 20:41:40.631823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40e4630 rkey 4a40044 nic_wr_credit 139. [D 20:41:40.631835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4104630 rkey 4a40044 nic_wr_credit 140. [D 20:41:40.631852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4124630 rkey 4a40044 nic_wr_credit 141. [D 20:41:40.631862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4144630 rkey 4a40044 nic_wr_credit 142. [D 20:41:40.631872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4164630 rkey 4a40044 nic_wr_credit 143. [D 20:41:40.631882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4184630 rkey 4a40044 nic_wr_credit 144. [D 20:41:40.631892] openib_post_sr_rdmaw: ibv_post_send wr_id 655d70 to 10.1.4.240:38258 remote addr f41a4630 rkey 4a40044 nic_wr_credit 145. [D 20:41:40.637871] openib_check_cq: completed rdma wr_id 655d70, nic_wr_credit 145. [D 20:41:40.637886] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 51/70. [D 20:41:40.640128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.640142] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.640151] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.651211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.651226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.651237] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.651252] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 515 [D 20:41:40.651262] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.651272] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 52/70. [D 20:41:40.651316] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 515 [D 20:41:40.651340] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 53/70. [D 20:41:40.651671] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 515 [D 20:41:40.651685] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.651697] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 54/70. [D 20:41:40.653838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.653852] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.653862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.696244] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.696258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.696269] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.696339] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 519 [D 20:41:40.696353] element 0: offset: 0x61f670, size: 24 [D 20:41:40.696364] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 55/70. [D 20:41:40.698709] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 519 [D 20:41:40.698724] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 56/70. [D 20:41:40.699954] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 519 [D 20:41:40.699968] element 0: offset: 0x61f670, size: 24 [D 20:41:40.701884] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 57/70. [D 20:41:40.701933] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.701945] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.701955] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.702787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.702800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.702810] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.702869] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 522 [D 20:41:40.702883] element 0: offset: 0x63b5b0, size: 24 [D 20:41:40.702893] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 58/70. [D 20:41:40.702930] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 522 [D 20:41:40.702962] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 59/70. [D 20:41:40.704044] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 522 [D 20:41:40.704057] element 0: offset: 0x63b5b0, size: 24 [D 20:41:40.704070] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 60/70. [D 20:41:40.704104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.704114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.704123] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.705922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.705935] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.705945] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.706004] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 524 [D 20:41:40.706018] element 0: offset: 0x62c430, size: 24 [D 20:41:40.706028] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 0/70. [D 20:41:40.708389] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 524 [D 20:41:40.708406] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 1/70. [D 20:41:40.708692] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 524 [D 20:41:40.708706] element 0: offset: 0x62c430, size: 24 [D 20:41:40.708718] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 2/70. [D 20:41:40.710840] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.710853] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.710862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.775165] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.775180] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.775190] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.775213] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 530 [D 20:41:40.775224] element 0: offset: 0x65d000, size: 72 [D 20:41:40.775234] openib_post_sr: 10.1.4.240:38258 bh 3 len 88 wr 3/70. [D 20:41:40.775249] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.775259] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.775271] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:40.777378] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 532 [D 20:41:40.777392] element 0: offset: 0x662670, size: 72 [D 20:41:40.777404] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 4/70. [D 20:41:40.777419] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.777435] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.777444] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:40.779664] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 533 [D 20:41:40.779679] element 0: offset: 0x665b20, size: 72 [D 20:41:40.779689] openib_post_sr: 10.1.4.240:38258 bh 5 len 88 wr 5/70. [D 20:41:40.779704] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.779721] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.779730] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:40.780348] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 536 [D 20:41:40.780363] element 0: offset: 0x668fd0, size: 72 [D 20:41:40.780374] openib_post_sr: 10.1.4.240:38258 bh 6 len 88 wr 6/70. [D 20:41:40.780394] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.780403] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.780412] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:40.780426] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.780436] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.780444] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:40.780455] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.780468] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.782680] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:40.782696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.782705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.782717] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.823426] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.823440] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.823451] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.823515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 540 [D 20:41:40.823529] element 0: offset: 0x630f60, size: 24 [D 20:41:40.823539] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 7/70. [D 20:41:40.825922] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 540 [D 20:41:40.838442] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 540 [D 20:41:40.838456] element 0: offset: 0x630f60, size: 24 [D 20:41:40.838468] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 8/70. [D 20:41:40.838513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.838525] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.838535] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:41.576344] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.576360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.576371] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:41.576387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 543 [D 20:41:41.576401] element 0: offset: 0x657310, size: 24 [D 20:41:41.576411] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 9/70. [D 20:41:41.576508] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 543 [D 20:41:41.576583] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 10/70. [D 20:41:41.592574] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 543 [D 20:41:41.592589] element 0: offset: 0x657310, size: 24 [D 20:41:41.592599] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 11/70. [D 20:41:41.594867] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.594880] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.594891] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:41.602943] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.602957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.602968] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:41.602984] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 546 [D 20:41:41.602997] element 0: offset: 0x61fad0, size: 24 [D 20:41:41.603007] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 12/70. [D 20:41:41.603059] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 546 [D 20:41:41.605070] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.605084] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.605093] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:41.605153] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 549 [D 20:41:41.605167] element 0: offset: 0x61f800, size: 24 [D 20:41:41.606548] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 13/70. [D 20:41:41.608737] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 14/70. [D 20:41:41.612472] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 549 [D 20:41:41.619842] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 15/70. [D 20:41:41.622363] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.622379] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.622389] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.622424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 552 [D 20:41:41.622435] element 0: offset: 0x62c430, size: 24 [D 20:41:41.622447] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 16/70. [D 20:41:41.626603] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 552 [D 20:41:41.626691] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 546 [D 20:41:41.626703] element 0: offset: 0x61fad0, size: 24 [D 20:41:41.626717] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 17/70. [D 20:41:41.629017] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.629033] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.629044] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.632853] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 18/70. [D 20:41:41.635103] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.635117] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.635126] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.635155] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 555 [D 20:41:41.635165] element 0: offset: 0x643500, size: 24 [D 20:41:41.635175] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 19/70. [D 20:41:41.635275] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 555 [D 20:41:41.635986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 549 [D 20:41:41.635999] element 0: offset: 0x61f800, size: 24 [D 20:41:41.636009] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 20/70. [D 20:41:41.636098] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.636110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.636120] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.642795] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 21/70. [D 20:41:41.645846] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 552 [D 20:41:41.645862] element 0: offset: 0x62c430, size: 24 [D 20:41:41.645873] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 22/70. [D 20:41:41.648249] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.648263] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.648273] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:41.659914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.659928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.659936] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:41.659957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.659967] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.659975] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.660062] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 557 [D 20:41:41.660073] element 0: offset: 0x6151c0, size: 24 [D 20:41:41.660083] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 23/70. [D 20:41:41.660096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 561 [D 20:41:41.660106] element 0: offset: 0x657310, size: 24 [D 20:41:41.660115] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 24/70. [D 20:41:41.662672] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 557 [D 20:41:41.662688] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 25/70. [D 20:41:41.662713] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 561 [D 20:41:41.662724] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 26/70. [D 20:41:41.662738] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 555 [D 20:41:41.662748] element 0: offset: 0x643500, size: 24 [D 20:41:41.662758] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 27/70. [D 20:41:41.662860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.662881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.662891] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.685715] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 557 [D 20:41:41.685742] element 0: offset: 0x6151c0, size: 24 [D 20:41:41.685754] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 28/70. [D 20:41:41.687843] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.687857] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.687867] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:41.690127] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 561 [D 20:41:41.690183] element 0: offset: 0x657310, size: 24 [D 20:41:41.690200] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 29/70. [D 20:41:41.692378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.692393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.692403] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:41.857042] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.857058] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.857069] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:41.857196] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 564 [D 20:41:41.857210] element 0: offset: 0x61f310, size: 24 [D 20:41:41.857222] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 30/70. [D 20:41:41.859661] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 564 [D 20:41:41.859679] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 31/70. [D 20:41:41.876289] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.876304] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.876313] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:41.877187] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 567 [D 20:41:41.877200] element 0: offset: 0x64dde0, size: 24 [D 20:41:41.877210] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 32/70. [D 20:41:41.877224] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 564 [D 20:41:41.877233] element 0: offset: 0x61f310, size: 24 [D 20:41:41.877246] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 33/70. [D 20:41:41.879612] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 567 [D 20:41:41.879628] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 34/70. [D 20:41:41.879644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.879657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.879667] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:41.897080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.897094] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.897105] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:41.897123] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.897136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.897145] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.900038] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 567 [D 20:41:41.900093] element 0: offset: 0x64dde0, size: 24 [D 20:41:41.900107] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 35/70. [D 20:41:41.900133] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 569 [D 20:41:41.900144] element 0: offset: 0x623260, size: 24 [D 20:41:41.900154] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 36/70. [D 20:41:41.902412] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 573 [D 20:41:41.902426] element 0: offset: 0x61f670, size: 24 [D 20:41:41.902438] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 37/70. [D 20:41:41.902464] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.902475] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.902483] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.902529] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 569 [D 20:41:41.902560] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 38/70. [D 20:41:41.904818] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 573 [D 20:41:41.904834] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 39/70. [D 20:41:41.929315] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.929331] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.929339] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.929365] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.929375] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.929384] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:41.930296] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 569 [D 20:41:41.930345] element 0: offset: 0x623260, size: 24 [D 20:41:41.930361] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 40/70. [D 20:41:41.932393] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 573 [D 20:41:41.932408] element 0: offset: 0x61f670, size: 24 [D 20:41:41.932418] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 41/70. [D 20:41:41.932506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.932519] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.932528] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:41.932543] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.932551] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.932560] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.934652] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 576 [D 20:41:41.934666] element 0: offset: 0x61f670, size: 24 [D 20:41:41.934677] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 42/70. [D 20:41:41.934690] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 579 [D 20:41:41.934699] element 0: offset: 0x623260, size: 24 [D 20:41:41.934709] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 43/70. [D 20:41:41.934803] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 576 [D 20:41:41.934844] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 579 [D 20:41:41.934854] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 44/70. [D 20:41:41.934940] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 45/70. [D 20:41:41.962516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.962564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.962574] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.962610] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.962619] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.962628] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:41.962705] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 576 [D 20:41:41.962717] element 0: offset: 0x61f670, size: 24 [D 20:41:41.962729] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 46/70. [D 20:41:41.964636] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 581 [D 20:41:41.964651] element 0: offset: 0x2aaaab2008d0, size: 24 [D 20:41:41.964661] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 47/70. [D 20:41:41.964692] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.964702] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.964710] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:41.964750] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 585 [D 20:41:41.964760] element 0: offset: 0x2aaaab200b80, size: 24 [D 20:41:41.964769] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 48/70. [D 20:41:41.965096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 579 [D 20:41:41.965109] element 0: offset: 0x2aaaab200ba0, size: 24 [D 20:41:41.965120] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 49/70. [D 20:41:41.965164] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 581 [D 20:41:41.965178] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 50/70. [D 20:41:41.965210] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 585 [D 20:41:41.965222] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 51/70. [D 20:41:41.965246] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.965255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.965264] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.993969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.994020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.994030] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.994066] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.994075] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.994083] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:41.994199] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 588 [D 20:41:41.994210] element 0: offset: 0x64dde0, size: 24 [D 20:41:41.994223] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 52/70. [D 20:41:41.994241] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 591 [D 20:41:41.994250] element 0: offset: 0x63b5b0, size: 24 [D 20:41:41.994259] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 53/70. [D 20:41:41.994308] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 581 [D 20:41:41.994318] element 0: offset: 0x61f310, size: 24 [D 20:41:41.994328] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 54/70. [D 20:41:41.994372] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 588 [D 20:41:41.994387] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 55/70. [D 20:41:41.994420] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 591 [D 20:41:41.994453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.994463] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.994466] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 56/70. [D 20:41:41.994472] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:41.998977] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 585 [D 20:41:41.998991] element 0: offset: 0x2aaaab200b80, size: 24 [D 20:41:41.999002] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 57/70. [D 20:41:41.999122] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.999136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.999144] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.024657] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.024705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.024715] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.024750] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.024759] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.024767] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:42.024877] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 593 [D 20:41:42.024888] element 0: offset: 0x2aaaab203890, size: 24 [D 20:41:42.024901] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 58/70. [D 20:41:42.024919] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 597 [D 20:41:42.024928] element 0: offset: 0x2aaaab209250, size: 24 [D 20:41:42.024938] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 59/70. [D 20:41:42.025126] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 593 [D 20:41:42.025145] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 60/70. [D 20:41:42.026976] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 597 [D 20:41:42.027028] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 0/70. [D 20:41:42.028928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 591 [D 20:41:42.028943] element 0: offset: 0x2aaaab203af0, size: 24 [D 20:41:42.028955] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 1/70. [D 20:41:42.028973] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 588 [D 20:41:42.028982] element 0: offset: 0x2aaaab203c10, size: 24 [D 20:41:42.028992] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 2/70. [D 20:41:42.029077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.029090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.029099] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:42.029119] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.029128] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.029137] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.053287] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.053339] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.053349] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.053383] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.053392] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.053400] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:42.053508] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 600 [D 20:41:42.053520] element 0: offset: 0x2aaaab207c50, size: 24 [D 20:41:42.053532] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 3/70. [D 20:41:42.053550] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 603 [D 20:41:42.053559] element 0: offset: 0x2aaaab203800, size: 24 [D 20:41:42.053568] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 4/70. [D 20:41:42.053616] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 593 [D 20:41:42.053627] element 0: offset: 0x2aaaab203890, size: 24 [D 20:41:42.053637] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 5/70. [D 20:41:42.053687] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 600 [D 20:41:42.053702] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 6/70. [D 20:41:42.053739] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 603 [D 20:41:42.053770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.053780] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.053783] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 7/70. [D 20:41:42.053788] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:42.058201] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 597 [D 20:41:42.058215] element 0: offset: 0x61ee50, size: 24 [D 20:41:42.058226] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 8/70. [D 20:41:42.058345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.058359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.058368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.082167] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.082214] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.082223] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.082258] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.082268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.082276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:42.082387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 605 [D 20:41:42.082399] element 0: offset: 0x623260, size: 24 [D 20:41:42.082412] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 9/70. [D 20:41:42.082430] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 609 [D 20:41:42.082440] element 0: offset: 0x61f670, size: 24 [D 20:41:42.082449] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 10/70. [D 20:41:42.082498] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 600 [D 20:41:42.082510] element 0: offset: 0x61fad0, size: 24 [D 20:41:42.082520] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 11/70. [D 20:41:42.082563] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 605 [D 20:41:42.082579] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 12/70. [D 20:41:42.082613] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 609 [D 20:41:42.082646] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.082655] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.082663] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:42.082665] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 13/70. [D 20:41:42.086859] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 603 [D 20:41:42.086874] element 0: offset: 0x655e00, size: 24 [D 20:41:42.086884] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 14/70. [D 20:41:42.086996] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.087010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.087018] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.109964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.110011] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.110020] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.112844] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 609 [D 20:41:42.112898] element 0: offset: 0x61f670, size: 24 [D 20:41:42.112915] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 15/70. [D 20:41:42.112962] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 612 [D 20:41:42.112973] element 0: offset: 0x61f800, size: 24 [D 20:41:42.112983] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 16/70. [D 20:41:42.117019] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 605 [D 20:41:42.117033] element 0: offset: 0x623260, size: 24 [D 20:41:42.117045] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 17/70. [D 20:41:42.117076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.117086] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.117096] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.117138] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 612 [D 20:41:42.117171] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 18/70. [D 20:41:42.117194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.117204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.117228] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.119456] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.119469] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.119479] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.119490] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 615 [D 20:41:42.119500] element 0: offset: 0x623260, size: 24 [D 20:41:42.119512] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 19/70. [D 20:41:42.119605] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 615 [D 20:41:42.129839] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 20/70. [D 20:41:42.132663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 612 [D 20:41:42.132678] element 0: offset: 0x61f800, size: 24 [D 20:41:42.132689] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 21/70. [D 20:41:42.135069] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.135082] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.135092] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:42.148313] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.148327] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.148336] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:42.148361] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.148371] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.148379] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.148394] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 615 [D 20:41:42.148403] element 0: offset: 0x623260, size: 24 [D 20:41:42.148413] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 22/70. [D 20:41:42.148524] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.148543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.148551] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.148563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 617 [D 20:41:42.150699] element 0: offset: 0x623260, size: 24 [D 20:41:42.150711] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 23/70. [D 20:41:42.150724] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 621 [D 20:41:42.150737] element 0: offset: 0x643500, size: 24 [D 20:41:42.150747] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 24/70. [D 20:41:42.150803] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 617 [D 20:41:42.150880] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 25/70. [D 20:41:42.153348] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 621 [D 20:41:42.153363] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 26/70. [D 20:41:42.176116] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.176131] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.176140] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.176252] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 624 [D 20:41:42.176263] element 0: offset: 0x61ee50, size: 24 [D 20:41:42.176273] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 27/70. [D 20:41:42.178608] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 624 [D 20:41:42.178624] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 28/70. [D 20:41:42.178640] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.178650] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.178659] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:42.178678] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 617 [D 20:41:42.178688] element 0: offset: 0x623260, size: 24 [D 20:41:42.178703] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 29/70. [D 20:41:42.178721] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 627 [D 20:41:42.178730] element 0: offset: 0x2aaaab200af0, size: 24 [D 20:41:42.178740] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 30/70. [D 20:41:42.185627] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 621 [D 20:41:42.185701] element 0: offset: 0x2aaaab200c90, size: 24 [D 20:41:42.185717] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 31/70. [D 20:41:42.185753] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.185764] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.185774] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:42.185825] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 627 [D 20:41:42.188107] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.188122] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.188132] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.192538] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 32/70. [D 20:41:42.195376] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 624 [D 20:41:42.195390] element 0: offset: 0x2aaaab201060, size: 24 [D 20:41:42.195401] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 33/70. [D 20:41:42.197771] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.197784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.197795] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:42.208511] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.208527] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.208537] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:42.208679] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 629 [D 20:41:42.208693] element 0: offset: 0x2aaaab208ff0, size: 24 [D 20:41:42.208704] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 34/70. [D 20:41:42.211188] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 629 [D 20:41:42.211204] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 35/70. [D 20:41:42.216332] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 627 [D 20:41:42.216395] element 0: offset: 0x2aaaab200af0, size: 24 [D 20:41:42.216410] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 36/70. [D 20:41:42.218700] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.218714] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.218725] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:42.226153] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 629 [D 20:41:42.226170] element 0: offset: 0x2aaaab208ff0, size: 24 [D 20:41:42.226182] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 37/70. [D 20:41:42.228371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.228385] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.228395] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:42.232499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.232545] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.232554] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:42.232586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.232596] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.232604] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:42.232700] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 633 [D 20:41:42.232712] element 0: offset: 0x2aaaab2024e0, size: 24 [D 20:41:42.232725] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 38/70. [D 20:41:42.232746] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 636 [D 20:41:42.232755] element 0: offset: 0x2aaaab203b20, size: 24 [D 20:41:42.232766] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 39/70. [D 20:41:42.232815] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 633 [D 20:41:42.232839] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 40/70. [D 20:41:42.232853] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 636 [D 20:41:42.232923] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 41/70. [D 20:41:42.264005] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 633 [D 20:41:42.264053] element 0: offset: 0x64dde0, size: 24 [D 20:41:42.264068] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 42/70. [D 20:41:42.264217] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.264230] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.264239] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:42.264349] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 636 [D 20:41:42.264362] element 0: offset: 0x629cb0, size: 24 [D 20:41:42.264373] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 43/70. [D 20:41:42.264415] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.264426] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.264435] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:42.998871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.998885] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.998894] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:42.999003] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 639 [D 20:41:42.999013] element 0: offset: 0x61f800, size: 24 [D 20:41:42.999023] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 44/70. [D 20:41:42.999088] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 639 [D 20:41:42.999162] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 45/70. [D 20:41:43.012854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.012871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.012880] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:43.012933] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 641 [D 20:41:43.012944] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.012954] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 46/70. [D 20:41:43.015724] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 641 [D 20:41:43.015768] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 47/70. [D 20:41:43.015987] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 639 [D 20:41:43.016003] element 0: offset: 0x61f800, size: 24 [D 20:41:43.016014] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 48/70. [D 20:41:43.016748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.016762] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.016771] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:43.031028] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.031042] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.031051] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:43.031078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.031088] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.031096] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.033976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 641 [D 20:41:43.034014] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.034026] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 49/70. [D 20:41:43.034047] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 645 [D 20:41:43.034056] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.034067] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 50/70. [D 20:41:43.034084] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 648 [D 20:41:43.034094] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.034104] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 51/70. [D 20:41:43.034138] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.034148] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.034157] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.034192] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 645 [D 20:41:43.034207] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 52/70. [D 20:41:43.034239] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 648 [D 20:41:43.034260] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 53/70. [D 20:41:43.061588] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.061643] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.061653] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.061773] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 650 [D 20:41:43.061786] element 0: offset: 0x629cb0, size: 24 [D 20:41:43.061799] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 54/70. [D 20:41:43.061857] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 645 [D 20:41:43.061868] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.061878] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 55/70. [D 20:41:43.061943] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 650 [D 20:41:43.061981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.061990] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.061999] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.062017] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 56/70. [D 20:41:43.066647] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 648 [D 20:41:43.066662] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.066673] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 57/70. [D 20:41:43.066788] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.066802] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.066810] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:43.073931] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.073945] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.073953] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:43.076873] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 650 [D 20:41:43.076909] element 0: offset: 0x629cb0, size: 24 [D 20:41:43.076922] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 58/70. [D 20:41:43.076948] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 654 [D 20:41:43.076958] element 0: offset: 0x657310, size: 24 [D 20:41:43.076968] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 59/70. [D 20:41:43.076999] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.077009] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.077017] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:43.077058] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 654 [D 20:41:43.077072] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 60/70. [D 20:41:43.094029] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.094044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.094052] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:43.094204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.094218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.094226] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.096255] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 658 [D 20:41:43.096269] element 0: offset: 0x64dea0, size: 24 [D 20:41:43.096280] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 0/70. [D 20:41:43.096293] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 660 [D 20:41:43.096302] element 0: offset: 0x623260, size: 24 [D 20:41:43.096312] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 1/70. [D 20:41:43.096392] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 658 [D 20:41:43.096430] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 660 [D 20:41:43.096436] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 2/70. [D 20:41:43.096548] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 3/70. [D 20:41:43.101538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 654 [D 20:41:43.101553] element 0: offset: 0x657310, size: 24 [D 20:41:43.101563] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 4/70. [D 20:41:43.101665] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.101678] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.101686] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.124574] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.124623] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.124632] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.128472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.128538] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.128548] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.128628] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 662 [D 20:41:43.128643] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.128656] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 5/70. [D 20:41:43.128681] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 658 [D 20:41:43.128691] element 0: offset: 0x64dea0, size: 24 [D 20:41:43.128701] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 6/70. [D 20:41:43.131161] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 666 [D 20:41:43.131175] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.131186] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 7/70. [D 20:41:43.131222] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 662 [D 20:41:43.131236] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 8/70. [D 20:41:43.131268] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.131278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.131287] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.133693] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 666 [D 20:41:43.133710] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 9/70. [D 20:41:43.133761] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 660 [D 20:41:43.133773] element 0: offset: 0x623260, size: 24 [D 20:41:43.133788] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 10/70. [D 20:41:43.133868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.133882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.133892] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.160618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.160639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.160649] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.160677] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.160687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.160696] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.162114] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 662 [D 20:41:43.162133] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.162147] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 11/70. [D 20:41:43.162164] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 669 [D 20:41:43.162173] element 0: offset: 0x62c430, size: 24 [D 20:41:43.162183] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 12/70. [D 20:41:43.167979] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 672 [D 20:41:43.168028] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.168042] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 13/70. [D 20:41:43.168068] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 666 [D 20:41:43.168084] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.168097] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 14/70. [D 20:41:43.168125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.168136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.168145] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.168188] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 669 [D 20:41:43.168204] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 15/70. [D 20:41:43.170466] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 672 [D 20:41:43.170482] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 16/70. [D 20:41:43.170498] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.170516] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.170525] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.194308] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.194324] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.194333] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.194366] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.194376] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.194385] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.194462] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 674 [D 20:41:43.194474] element 0: offset: 0x623260, size: 24 [D 20:41:43.194483] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 17/70. [D 20:41:43.194497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 678 [D 20:41:43.194506] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.194516] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 18/70. [D 20:41:43.196947] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 674 [D 20:41:43.196963] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 19/70. [D 20:41:43.196987] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 678 [D 20:41:43.196999] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 20/70. [D 20:41:43.197013] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 669 [D 20:41:43.197023] element 0: offset: 0x62c430, size: 24 [D 20:41:43.197033] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 21/70. [D 20:41:43.197132] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.197158] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.197167] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.202509] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 672 [D 20:41:43.202565] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.202588] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 22/70. [D 20:41:43.204561] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.204576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.204586] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.223797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.223812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.223821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.223854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.223864] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.223872] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.225408] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 681 [D 20:41:43.225425] element 0: offset: 0x691fe0, size: 24 [D 20:41:43.225443] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 23/70. [D 20:41:43.225457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 684 [D 20:41:43.225467] element 0: offset: 0x61f670, size: 24 [D 20:41:43.225477] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 24/70. [D 20:41:43.225494] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 674 [D 20:41:43.225508] element 0: offset: 0x623260, size: 24 [D 20:41:43.227905] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 25/70. [D 20:41:43.227949] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 681 [D 20:41:43.227963] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 26/70. [D 20:41:43.227991] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 684 [D 20:41:43.228004] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 27/70. [D 20:41:43.231837] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.231855] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.231864] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.231882] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 678 [D 20:41:43.231892] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.231901] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 28/70. [D 20:41:43.231992] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.232005] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.232014] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.259048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.259063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.259072] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.259099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.259109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.259118] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.260602] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 687 [D 20:41:43.260629] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.260643] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 29/70. [D 20:41:43.260661] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 689 [D 20:41:43.260673] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.260683] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 30/70. [D 20:41:43.265553] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 681 [D 20:41:43.265596] element 0: offset: 0x691fe0, size: 24 [D 20:41:43.265610] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 31/70. [D 20:41:43.265633] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 684 [D 20:41:43.265643] element 0: offset: 0x61f670, size: 24 [D 20:41:43.265653] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 32/70. [D 20:41:43.265703] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 687 [D 20:41:43.265721] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 33/70. [D 20:41:43.265747] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 689 [D 20:41:43.265759] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 34/70. [D 20:41:43.268026] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.268041] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.268051] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.268067] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.268077] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.268085] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.295042] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.295057] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.295095] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.295129] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.295138] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.295147] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.295257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 693 [D 20:41:43.295276] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.295286] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 35/70. [D 20:41:43.295298] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 696 [D 20:41:43.295312] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.295321] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 36/70. [D 20:41:43.297665] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 693 [D 20:41:43.297681] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 37/70. [D 20:41:43.297706] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 696 [D 20:41:43.297718] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 38/70. [D 20:41:43.297731] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 687 [D 20:41:43.297741] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.297750] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 39/70. [D 20:41:43.297846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.297872] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.297882] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.303106] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 689 [D 20:41:43.303164] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.303181] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 40/70. [D 20:41:43.305640] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.305654] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.305664] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.328498] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.328513] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.328544] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.328583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.328592] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.328601] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.328751] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 699 [D 20:41:43.328767] element 0: offset: 0x61f310, size: 24 [D 20:41:43.328777] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 41/70. [D 20:41:43.328790] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 701 [D 20:41:43.328804] element 0: offset: 0x63e0a0, size: 24 [D 20:41:43.328813] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 42/70. [D 20:41:43.331249] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 699 [D 20:41:43.331267] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 43/70. [D 20:41:43.331292] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 701 [D 20:41:43.331304] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 44/70. [D 20:41:43.331317] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 693 [D 20:41:43.331327] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.331337] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 45/70. [D 20:41:43.331440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.331454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.331464] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.336330] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 696 [D 20:41:43.336390] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.336406] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 46/70. [D 20:41:43.336580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.336594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.336604] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.358013] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.358029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.358038] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.358071] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.358081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.358089] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.358239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 705 [D 20:41:43.358253] element 0: offset: 0x623260, size: 24 [D 20:41:43.358262] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 47/70. [D 20:41:43.358276] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 708 [D 20:41:43.358289] element 0: offset: 0x62c430, size: 24 [D 20:41:43.358298] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 48/70. [D 20:41:43.360746] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 705 [D 20:41:43.360764] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 49/70. [D 20:41:43.360789] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 708 [D 20:41:43.360800] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 50/70. [D 20:41:43.360814] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 699 [D 20:41:43.360824] element 0: offset: 0x61f310, size: 24 [D 20:41:43.360902] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 51/70. [D 20:41:43.361030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.361045] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.361054] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.366077] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 701 [D 20:41:43.366091] element 0: offset: 0x63e0a0, size: 24 [D 20:41:43.366102] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 52/70. [D 20:41:43.366213] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.366226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.366235] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.387143] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.387157] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.387166] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.387194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.387204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.387213] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.387272] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 711 [D 20:41:43.387283] element 0: offset: 0x61f670, size: 24 [D 20:41:43.387294] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 53/70. [D 20:41:43.387311] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 713 [D 20:41:43.387321] element 0: offset: 0x691fe0, size: 24 [D 20:41:43.387330] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 54/70. [D 20:41:43.387443] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 711 [D 20:41:43.387461] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 55/70. [D 20:41:43.387491] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 713 [D 20:41:43.387532] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 56/70. [D 20:41:43.390573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 708 [D 20:41:43.390624] element 0: offset: 0x62c430, size: 24 [D 20:41:43.390638] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 57/70. [D 20:41:43.390778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.390791] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.390800] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.395170] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 705 [D 20:41:43.395184] element 0: offset: 0x623260, size: 24 [D 20:41:43.395195] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 58/70. [D 20:41:43.395299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.395313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.395321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.414086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.414100] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.414108] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.414142] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.414152] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.414161] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.414250] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 717 [D 20:41:43.414260] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.414271] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 59/70. [D 20:41:43.414288] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 720 [D 20:41:43.414298] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.414308] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 60/70. [D 20:41:43.414420] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 717 [D 20:41:43.414437] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 0/70. [D 20:41:43.414467] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 720 [D 20:41:43.414508] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 1/70. [D 20:41:43.417561] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 713 [D 20:41:43.417610] element 0: offset: 0x691fe0, size: 24 [D 20:41:43.417624] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 2/70. [D 20:41:43.418922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.418937] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.418946] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.424066] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 711 [D 20:41:43.424080] element 0: offset: 0x61f670, size: 24 [D 20:41:43.424090] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 3/70. [D 20:41:43.424209] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.424225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.424234] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.442790] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.442803] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.442812] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.442846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.442856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.442864] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.442952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 722 [D 20:41:43.442963] element 0: offset: 0x633550, size: 24 [D 20:41:43.442973] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 4/70. [D 20:41:43.442991] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 726 [D 20:41:43.443000] element 0: offset: 0x657310, size: 24 [D 20:41:43.443010] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 5/70. [D 20:41:43.443121] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 722 [D 20:41:43.443139] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 6/70. [D 20:41:43.443169] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 726 [D 20:41:43.443215] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 7/70. [D 20:41:43.446275] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 720 [D 20:41:43.446327] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.446341] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 8/70. [D 20:41:43.446481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.446494] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.446502] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.451083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 717 [D 20:41:43.451097] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.451107] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 9/70. [D 20:41:43.451226] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.451240] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.451249] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.471824] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.471838] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.471846] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.471937] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 729 [D 20:41:43.471948] element 0: offset: 0x61f670, size: 24 [D 20:41:43.471959] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 10/70. [D 20:41:43.472054] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 729 [D 20:41:43.472109] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 11/70. [D 20:41:43.475000] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 722 [D 20:41:43.475049] element 0: offset: 0x633550, size: 24 [D 20:41:43.475063] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 12/70. [D 20:41:43.475207] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.475219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.475228] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.479648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 726 [D 20:41:43.479662] element 0: offset: 0x657310, size: 24 [D 20:41:43.479673] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 13/70. [D 20:41:43.479783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.479797] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.479805] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:43.484417] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 729 [D 20:41:43.484461] element 0: offset: 0x61f670, size: 24 [D 20:41:43.484476] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 14/70. [D 20:41:43.484586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.484598] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.484606] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:43.496977] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.496992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.497000] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:43.497095] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 732 [D 20:41:43.497106] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.497116] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 15/70. [D 20:41:43.497181] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 732 [D 20:41:43.497230] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 16/70. [D 20:41:43.516757] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 732 [D 20:41:43.516772] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.516782] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 17/70. [D 20:41:43.516860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.516873] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.516882] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:44.172728] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.172742] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.172750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:44.172799] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 735 [D 20:41:44.172810] element 0: offset: 0x61ee50, size: 24 [D 20:41:44.172820] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 18/70. [D 20:41:44.172874] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 735 [D 20:41:44.172945] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 19/70. [D 20:41:44.186526] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 735 [D 20:41:44.186573] element 0: offset: 0x61ee50, size: 24 [D 20:41:44.186586] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 20/70. [D 20:41:44.186727] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.186740] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.186748] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:44.204836] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.204849] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.204858] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:44.204951] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 738 [D 20:41:44.204962] element 0: offset: 0x61f310, size: 24 [D 20:41:44.204972] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 21/70. [D 20:41:44.205035] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 738 [D 20:41:44.205085] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 22/70. [D 20:41:44.220947] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 738 [D 20:41:44.220962] element 0: offset: 0x61f310, size: 24 [D 20:41:44.220972] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 23/70. [D 20:41:44.221092] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.221106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.221114] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:44.240014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.240027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.240036] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:44.240086] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 741 [D 20:41:44.240096] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.240108] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 24/70. [D 20:41:44.240144] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.240155] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.240163] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.240191] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 741 [D 20:41:44.240238] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 25/70. [D 20:41:44.240241] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 744 [D 20:41:44.240312] element 0: offset: 0x629de0, size: 24 [D 20:41:44.240324] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 26/70. [D 20:41:44.240417] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 744 [D 20:41:44.254850] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 27/70. [D 20:41:44.257720] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 741 [D 20:41:44.257767] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.257782] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 28/70. [D 20:41:44.257922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.257934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.257943] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.271837] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.271851] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.271860] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.271961] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 747 [D 20:41:44.271972] element 0: offset: 0x61f310, size: 24 [D 20:41:44.271981] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 29/70. [D 20:41:44.274398] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 747 [D 20:41:44.274415] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 30/70. [D 20:41:44.276648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 744 [D 20:41:44.276659] element 0: offset: 0x629de0, size: 24 [D 20:41:44.276669] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 31/70. [D 20:41:44.276787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.276800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.276815] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.288352] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.288396] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.288405] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.288515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 749 [D 20:41:44.288527] element 0: offset: 0x6151c0, size: 24 [D 20:41:44.288540] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 32/70. [D 20:41:44.288645] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 749 [D 20:41:44.288716] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 33/70. [D 20:41:44.290244] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 747 [D 20:41:44.290285] element 0: offset: 0x61f310, size: 24 [D 20:41:44.290298] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 34/70. [D 20:41:44.291425] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.291439] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.291448] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.300032] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.300046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.300055] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.300085] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.300094] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.300102] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.300190] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 753 [D 20:41:44.300201] element 0: offset: 0x657310, size: 24 [D 20:41:44.300211] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 35/70. [D 20:41:44.300228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 756 [D 20:41:44.300238] element 0: offset: 0x61ee50, size: 24 [D 20:41:44.300249] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 36/70. [D 20:41:44.300287] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 753 [D 20:41:44.300313] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 37/70. [D 20:41:44.300341] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 756 [D 20:41:44.300469] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 38/70. [D 20:41:44.305614] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 749 [D 20:41:44.305628] element 0: offset: 0x2aaaab200af0, size: 24 [D 20:41:44.305638] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 39/70. [D 20:41:44.305764] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.305778] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.305787] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.329168] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.329182] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.329190] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.329245] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 759 [D 20:41:44.329256] element 0: offset: 0x2aaaab209430, size: 24 [D 20:41:44.329266] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 40/70. [D 20:41:44.329364] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 759 [D 20:41:44.329423] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 41/70. [D 20:41:44.332290] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 756 [D 20:41:44.332328] element 0: offset: 0x2aaaab209410, size: 24 [D 20:41:44.332341] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 42/70. [D 20:41:44.332445] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.332459] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.332468] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.337051] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 753 [D 20:41:44.337066] element 0: offset: 0x2aaaab209410, size: 24 [D 20:41:44.337075] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 43/70. [D 20:41:44.337183] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.337197] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.337205] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.342551] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.342565] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.342574] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.342668] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 761 [D 20:41:44.342679] element 0: offset: 0x2aaaab209410, size: 24 [D 20:41:44.342689] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 44/70. [D 20:41:44.342742] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 761 [D 20:41:44.342806] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 45/70. [D 20:41:44.345898] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 759 [D 20:41:44.345937] element 0: offset: 0x2aaaab209430, size: 24 [D 20:41:44.345951] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 46/70. [D 20:41:44.348218] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.348238] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.348249] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.362883] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.362942] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.362952] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.362992] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.363002] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.363011] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.363874] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 766 [D 20:41:44.363896] element 0: offset: 0x2aaaab209430, size: 24 [D 20:41:44.363910] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 47/70. [D 20:41:44.363929] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 768 [D 20:41:44.363940] element 0: offset: 0x2aaaab202210, size: 24 [D 20:41:44.363949] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 48/70. [D 20:41:44.363969] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 761 [D 20:41:44.363979] element 0: offset: 0x2aaaab209410, size: 24 [D 20:41:44.366536] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 49/70. [D 20:41:44.366581] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 766 [D 20:41:44.366597] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 50/70. [D 20:41:44.366628] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 768 [D 20:41:44.366640] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 51/70. [D 20:41:44.369012] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.369027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.369037] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.395870] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.395885] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.395894] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.395919] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.395928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.395936] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.396014] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 771 [D 20:41:44.396026] element 0: offset: 0x2aaaab2035b0, size: 24 [D 20:41:44.396035] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 52/70. [D 20:41:44.396048] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 773 [D 20:41:44.396058] element 0: offset: 0x2aaaab2009d0, size: 24 [D 20:41:44.396071] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 53/70. [D 20:41:44.396666] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 766 [D 20:41:44.396682] element 0: offset: 0x2aaaab209430, size: 24 [D 20:41:44.396697] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 54/70. [D 20:41:44.399017] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 771 [D 20:41:44.399032] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 55/70. [D 20:41:44.399058] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 773 [D 20:41:44.399074] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 56/70. [D 20:41:44.399093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.399103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.399112] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.403638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 768 [D 20:41:44.403683] element 0: offset: 0x2aaaab202210, size: 24 [D 20:41:44.403698] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 57/70. [D 20:41:44.403798] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.403812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.403836] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.428353] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.428368] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.428377] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.428412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.428421] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.428430] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.431456] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 777 [D 20:41:44.431517] element 0: offset: 0x2aaaab2093c0, size: 24 [D 20:41:44.431533] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 58/70. [D 20:41:44.431555] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 780 [D 20:41:44.431573] element 0: offset: 0x2aaaab20bc30, size: 24 [D 20:41:44.431584] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 59/70. [D 20:41:44.431599] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 771 [D 20:41:44.431609] element 0: offset: 0x2aaaab2035b0, size: 24 [D 20:41:44.431619] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 60/70. [D 20:41:44.432689] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 777 [D 20:41:44.434075] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 0/70. [D 20:41:44.434119] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 780 [D 20:41:44.434134] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 1/70. [D 20:41:44.434161] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.434173] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.434182] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.436497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 773 [D 20:41:44.436511] element 0: offset: 0x2aaaab2009d0, size: 24 [D 20:41:44.436523] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 2/70. [D 20:41:44.436605] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.436618] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.436627] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.462279] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.462294] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.462303] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.462333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.462342] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.462351] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.462428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 782 [D 20:41:44.462440] element 0: offset: 0x2aaaab207700, size: 24 [D 20:41:44.462450] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 3/70. [D 20:41:44.462463] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 786 [D 20:41:44.462472] element 0: offset: 0x2aaaab2009d0, size: 24 [D 20:41:44.462486] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 4/70. [D 20:41:44.463106] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 777 [D 20:41:44.463122] element 0: offset: 0x2aaaab2093c0, size: 24 [D 20:41:44.463139] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 5/70. [D 20:41:44.467712] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 780 [D 20:41:44.467758] element 0: offset: 0x2aaaab20bc30, size: 24 [D 20:41:44.467771] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 6/70. [D 20:41:44.467820] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 782 [D 20:41:44.467836] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 7/70. [D 20:41:44.467870] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 786 [D 20:41:44.467882] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 8/70. [D 20:41:44.467910] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.467922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.467931] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.470408] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.470422] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.470433] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.495919] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.495933] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.495942] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.495983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.495993] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.496001] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.499075] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 789 [D 20:41:44.499135] element 0: offset: 0x2aaaab2035b0, size: 24 [D 20:41:44.499150] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 9/70. [D 20:41:44.499171] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 792 [D 20:41:44.499182] element 0: offset: 0x2aaaab2093c0, size: 24 [D 20:41:44.499191] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 10/70. [D 20:41:44.499210] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 782 [D 20:41:44.499221] element 0: offset: 0x2aaaab207700, size: 24 [D 20:41:44.499237] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 11/70. [D 20:41:44.501650] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 789 [D 20:41:44.501670] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 12/70. [D 20:41:44.501708] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 792 [D 20:41:44.501721] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 13/70. [D 20:41:44.501757] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.501768] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.501820] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.504017] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 786 [D 20:41:44.504032] element 0: offset: 0x2aaaab2009d0, size: 24 [D 20:41:44.504046] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 14/70. [D 20:41:44.504149] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.504163] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.504171] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.528995] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.529009] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.529017] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.529048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.529057] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.529066] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.529128] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 794 [D 20:41:44.529140] element 0: offset: 0x2aaaab210c10, size: 24 [D 20:41:44.529150] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 15/70. [D 20:41:44.529168] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 798 [D 20:41:44.529178] element 0: offset: 0x2aaaab2009d0, size: 24 [D 20:41:44.529188] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 16/70. [D 20:41:44.529309] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 794 [D 20:41:44.529328] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 17/70. [D 20:41:44.529364] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 798 [D 20:41:44.529377] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 18/70. [D 20:41:44.532270] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 792 [D 20:41:44.532316] element 0: offset: 0x2aaaab2093c0, size: 24 [D 20:41:44.532330] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 19/70. [D 20:41:44.532473] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.532485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.532494] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.536721] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 789 [D 20:41:44.536735] element 0: offset: 0x2aaaab2035b0, size: 24 [D 20:41:44.536745] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 20/70. [D 20:41:44.536864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.536877] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.536886] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.556048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.556062] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.556071] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.556104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.556113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.556121] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.556207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 801 [D 20:41:44.556217] element 0: offset: 0x2aaaab207700, size: 24 [D 20:41:44.556227] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 21/70. [D 20:41:44.556245] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 804 [D 20:41:44.556255] element 0: offset: 0x2aaaab2035b0, size: 24 [D 20:41:44.556267] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 22/70. [D 20:41:44.556309] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 801 [D 20:41:44.556341] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 23/70. [D 20:41:44.556347] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 804 [D 20:41:44.556430] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 24/70. [D 20:41:44.559293] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 794 [D 20:41:44.559338] element 0: offset: 0x61f670, size: 24 [D 20:41:44.559353] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 25/70. [D 20:41:44.559492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.559506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.559514] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.563993] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 798 [D 20:41:44.564007] element 0: offset: 0x61f670, size: 24 [D 20:41:44.564018] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 26/70. [D 20:41:44.564134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.564148] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.564157] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.583512] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.583526] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.583535] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.583563] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.583572] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.583580] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.583667] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 806 [D 20:41:44.583678] element 0: offset: 0x629de0, size: 24 [D 20:41:44.583689] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 27/70. [D 20:41:44.583707] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 810 [D 20:41:44.583716] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.583726] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 28/70. [D 20:41:44.583787] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 806 [D 20:41:44.583825] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 810 [D 20:41:44.583855] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 29/70. [D 20:41:44.583926] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 30/70. [D 20:41:44.587014] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 801 [D 20:41:44.587052] element 0: offset: 0x657310, size: 24 [D 20:41:44.587066] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 31/70. [D 20:41:44.587182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.587196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.587205] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.591711] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 804 [D 20:41:44.591725] element 0: offset: 0x657310, size: 24 [D 20:41:44.591736] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 32/70. [D 20:41:44.591852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.591865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.591874] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.609977] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.609996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.610005] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.610099] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 813 [D 20:41:44.610110] element 0: offset: 0x643500, size: 24 [D 20:41:44.610120] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 33/70. [D 20:41:44.612723] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 806 [D 20:41:44.612756] element 0: offset: 0x629de0, size: 24 [D 20:41:44.612769] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 34/70. [D 20:41:44.612813] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 813 [D 20:41:44.612828] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 35/70. [D 20:41:44.612864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.612874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.612883] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.615783] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 810 [D 20:41:44.615797] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.615808] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 36/70. [D 20:41:44.615905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.615918] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.615927] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.628752] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 813 [D 20:41:44.628796] element 0: offset: 0x643500, size: 24 [D 20:41:44.628810] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 37/70. [D 20:41:44.628972] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.628985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.628994] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:44.633780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.633794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.633802] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:44.633899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 815 [D 20:41:44.633910] element 0: offset: 0x61f800, size: 24 [D 20:41:44.633920] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 38/70. [D 20:41:44.633985] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 815 [D 20:41:44.634034] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 39/70. [D 20:41:44.646567] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.646583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.646591] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.646642] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 819 [D 20:41:44.646653] element 0: offset: 0x61ee50, size: 24 [D 20:41:44.646663] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 40/70. [D 20:41:44.649701] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 815 [D 20:41:44.649715] element 0: offset: 0x61f800, size: 24 [D 20:41:44.649728] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 41/70. [D 20:41:44.649757] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 819 [D 20:41:44.649770] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 42/70. [D 20:41:44.649844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.649856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.649864] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.663776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.663790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.663798] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.663852] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 822 [D 20:41:44.663863] element 0: offset: 0x61fad0, size: 24 [D 20:41:44.663873] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 43/70. [D 20:41:44.663969] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 822 [D 20:41:44.664066] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 44/70. [D 20:41:44.666983] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 819 [D 20:41:44.667026] element 0: offset: 0x61ee50, size: 24 [D 20:41:44.667040] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 45/70. [D 20:41:44.669439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.669458] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.669468] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.683384] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 822 [D 20:41:44.683447] element 0: offset: 0x61fad0, size: 24 [D 20:41:44.683463] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 46/70. [D 20:41:44.685596] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.685611] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.685621] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:44.692560] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.692574] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.692584] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:44.692717] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 825 [D 20:41:44.692731] element 0: offset: 0x61f310, size: 24 [D 20:41:44.692741] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 47/70. [D 20:41:44.695107] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 825 [D 20:41:44.695125] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 48/70. [D 20:41:44.710432] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.710447] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.710456] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.710553] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 828 [D 20:41:44.710563] element 0: offset: 0x643500, size: 24 [D 20:41:44.710573] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 49/70. [D 20:41:44.712977] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 828 [D 20:41:44.712993] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 50/70. [D 20:41:44.713008] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 825 [D 20:41:44.713017] element 0: offset: 0x61f310, size: 24 [D 20:41:44.713046] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 51/70. [D 20:41:44.713140] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.713153] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.713162] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.739287] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 828 [D 20:41:44.739349] element 0: offset: 0x643500, size: 24 [D 20:41:44.739366] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 52/70. [D 20:41:44.741667] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.741681] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.741692] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.246040] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.246106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.246116] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.246204] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 831 [D 20:41:45.246218] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.246232] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 53/70. [D 20:41:45.248737] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 831 [D 20:41:45.248756] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 54/70. [D 20:41:45.264846] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 831 [D 20:41:45.264876] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.264887] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 55/70. [D 20:41:45.267263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.267278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.267288] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.274161] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.274175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.274185] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.274300] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 834 [D 20:41:45.274317] element 0: offset: 0x66db70, size: 24 [D 20:41:45.274328] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 56/70. [D 20:41:45.274390] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 834 [D 20:41:45.274446] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 57/70. [D 20:41:45.293577] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 834 [D 20:41:45.293640] element 0: offset: 0x66db70, size: 24 [D 20:41:45.293655] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 58/70. [D 20:41:45.295899] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.295914] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.295924] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.304725] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.304752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.304762] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.306853] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 837 [D 20:41:45.306867] element 0: offset: 0x61f800, size: 24 [D 20:41:45.306879] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 59/70. [D 20:41:45.306950] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 837 [D 20:41:45.306999] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 60/70. [D 20:41:45.323376] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 837 [D 20:41:45.323393] element 0: offset: 0x61f800, size: 24 [D 20:41:45.323403] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 0/70. [D 20:41:45.325715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.325728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.325739] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.335954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.335968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.335979] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.336062] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 840 [D 20:41:45.336080] element 0: offset: 0x61fad0, size: 24 [D 20:41:45.336090] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 1/70. [D 20:41:45.336140] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 840 [D 20:41:45.336204] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 2/70. [D 20:41:45.352878] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 840 [D 20:41:45.352940] element 0: offset: 0x61fad0, size: 24 [D 20:41:45.352954] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 3/70. [D 20:41:45.355134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.355149] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.355159] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.365293] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.365308] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.365319] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.365402] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 843 [D 20:41:45.365415] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.365426] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 4/70. [D 20:41:45.365493] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 843 [D 20:41:45.365539] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 5/70. [D 20:41:45.380683] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 843 [D 20:41:45.380699] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.380709] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 6/70. [D 20:41:45.382987] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.383001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.383011] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.390087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.390102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.390110] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.392144] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 846 [D 20:41:45.392158] element 0: offset: 0x657310, size: 24 [D 20:41:45.392168] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 7/70. [D 20:41:45.392225] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 846 [D 20:41:45.392284] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 8/70. [D 20:41:45.411546] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 846 [D 20:41:45.411615] element 0: offset: 0x657310, size: 24 [D 20:41:45.411630] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 9/70. [D 20:41:45.412739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.412753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.412764] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.419984] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.419999] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.420009] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.420089] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 849 [D 20:41:45.420102] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.420112] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 10/70. [D 20:41:45.420179] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 849 [D 20:41:45.420222] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 11/70. [D 20:41:45.435722] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 849 [D 20:41:45.435737] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.435747] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 12/70. [D 20:41:45.439536] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.439550] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.439560] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.439575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.439585] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.439594] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.439711] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 851 [D 20:41:45.439725] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.439748] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 13/70. [D 20:41:45.439801] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 851 [D 20:41:45.443693] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 14/70. [D 20:41:45.460379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.460394] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.460404] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.463486] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 855 [D 20:41:45.463547] element 0: offset: 0x66db70, size: 24 [D 20:41:45.463561] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 15/70. [D 20:41:45.463589] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 851 [D 20:41:45.463599] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.463610] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 16/70. [D 20:41:45.465905] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 855 [D 20:41:45.465922] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 17/70. [D 20:41:45.465951] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.465962] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.465971] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.483608] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.483641] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.483651] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.483685] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.483695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.483703] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.484198] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 855 [D 20:41:45.484210] element 0: offset: 0x66db70, size: 24 [D 20:41:45.484228] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 18/70. [D 20:41:45.484244] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 857 [D 20:41:45.484253] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.484267] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 19/70. [D 20:41:45.484280] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 861 [D 20:41:45.484290] element 0: offset: 0x61f800, size: 24 [D 20:41:45.484299] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 20/70. [D 20:41:45.486668] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.486683] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.486693] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.486725] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 857 [D 20:41:45.486751] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 861 [D 20:41:45.487593] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 21/70. [D 20:41:45.487638] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 22/70. [D 20:41:45.519731] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.519749] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.519758] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.520463] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 864 [D 20:41:45.520478] element 0: offset: 0x629e10, size: 24 [D 20:41:45.520491] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 23/70. [D 20:41:45.520758] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 864 [D 20:41:45.524767] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 24/70. [D 20:41:45.524858] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 857 [D 20:41:45.524872] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.524885] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 25/70. [D 20:41:45.527145] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.527160] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.527170] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.527543] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 861 [D 20:41:45.527557] element 0: offset: 0x61f800, size: 24 [D 20:41:45.527570] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 26/70. [D 20:41:45.529939] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.529952] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.529963] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.539730] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.539745] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.539754] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.539788] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.539797] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.539806] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.540424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 864 [D 20:41:45.540436] element 0: offset: 0x629e10, size: 24 [D 20:41:45.540457] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 27/70. [D 20:41:45.540472] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 866 [D 20:41:45.540482] element 0: offset: 0x66db70, size: 24 [D 20:41:45.540492] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 28/70. [D 20:41:45.540504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 870 [D 20:41:45.540514] element 0: offset: 0x61f310, size: 24 [D 20:41:45.540523] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 29/70. [D 20:41:45.542883] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.542897] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.542908] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.542943] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 866 [D 20:41:45.542968] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 870 [D 20:41:45.544699] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 30/70. [D 20:41:45.544765] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 31/70. [D 20:41:45.571790] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.571805] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.571814] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.572445] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 873 [D 20:41:45.572460] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.572471] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 32/70. [D 20:41:45.572489] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 866 [D 20:41:45.572503] element 0: offset: 0x66db70, size: 24 [D 20:41:45.572518] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 33/70. [D 20:41:45.577034] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 873 [D 20:41:45.577098] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 34/70. [D 20:41:45.577136] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.577147] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.577158] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.577180] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 870 [D 20:41:45.577198] element 0: offset: 0x61f310, size: 24 [D 20:41:45.577210] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 35/70. [D 20:41:45.579480] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.579494] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.579504] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.592155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.592169] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.592178] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.592208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.592218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.592226] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.592907] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 873 [D 20:41:45.592919] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.592929] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 36/70. [D 20:41:45.592945] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 875 [D 20:41:45.592960] element 0: offset: 0x629e10, size: 24 [D 20:41:45.592970] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 37/70. [D 20:41:45.592986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 879 [D 20:41:45.592995] element 0: offset: 0x657310, size: 24 [D 20:41:45.593008] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 38/70. [D 20:41:45.595620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.595634] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.595644] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.595666] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 875 [D 20:41:45.595678] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 39/70. [D 20:41:45.595702] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 879 [D 20:41:45.595714] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 40/70. [D 20:41:45.623471] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.623485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.623494] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.624319] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 882 [D 20:41:45.624336] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.624347] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 41/70. [D 20:41:45.624365] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 875 [D 20:41:45.624375] element 0: offset: 0x629e10, size: 24 [D 20:41:45.624392] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 42/70. [D 20:41:45.626734] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 882 [D 20:41:45.626750] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 43/70. [D 20:41:45.626772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.626783] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.626793] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.631258] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 879 [D 20:41:45.631312] element 0: offset: 0x657310, size: 24 [D 20:41:45.631328] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 44/70. [D 20:41:45.631435] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.631475] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.631485] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.641379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.641394] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.641402] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.641435] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.641445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.641454] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.641545] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 884 [D 20:41:45.641557] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.641575] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 45/70. [D 20:41:45.641588] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 888 [D 20:41:45.641597] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.641607] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 46/70. [D 20:41:45.641682] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 884 [D 20:41:45.641734] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 47/70. [D 20:41:45.644066] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 888 [D 20:41:45.644081] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 48/70. [D 20:41:45.644096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 882 [D 20:41:45.644105] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.644116] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 49/70. [D 20:41:45.644184] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.644197] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.644206] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.669439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.669454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.669463] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.669573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 891 [D 20:41:45.669585] element 0: offset: 0x629e10, size: 24 [D 20:41:45.669594] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 50/70. [D 20:41:45.671948] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 891 [D 20:41:45.671964] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 51/70. [D 20:41:45.671979] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 884 [D 20:41:45.671988] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.671998] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 52/70. [D 20:41:45.676895] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 888 [D 20:41:45.676948] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.676963] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 53/70. [D 20:41:45.676997] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.677010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.677020] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.679251] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.679265] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.679275] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.688920] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.688935] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.688951] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.689065] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 893 [D 20:41:45.689079] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.689088] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 54/70. [D 20:41:45.689129] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.689139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.689147] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.691632] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 893 [D 20:41:45.691650] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 55/70. [D 20:41:45.691665] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 897 [D 20:41:45.691674] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.691684] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 56/70. [D 20:41:45.691698] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 891 [D 20:41:45.691707] element 0: offset: 0x629e10, size: 24 [D 20:41:45.691724] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 57/70. [D 20:41:45.691783] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 897 [D 20:41:45.692754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.692768] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.692777] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.705906] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 58/70. [D 20:41:45.708974] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.708990] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.709002] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.709060] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 900 [D 20:41:45.709072] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.709083] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 59/70. [D 20:41:45.714443] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 893 [D 20:41:45.714502] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.714517] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 60/70. [D 20:41:45.714567] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 900 [D 20:41:45.716912] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.716927] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.716938] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.718403] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 0/70. [D 20:41:45.721554] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 897 [D 20:41:45.721569] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.721579] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 1/70. [D 20:41:45.724008] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.724022] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.724038] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.732748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.732763] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.732774] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.732805] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.732815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.732823] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.733016] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 902 [D 20:41:45.733030] element 0: offset: 0x61f310, size: 24 [D 20:41:45.733040] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 2/70. [D 20:41:45.733053] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 906 [D 20:41:45.733063] element 0: offset: 0x629e10, size: 24 [D 20:41:45.733076] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 3/70. [D 20:41:45.738414] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 900 [D 20:41:45.738462] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.738476] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 4/70. [D 20:41:45.738530] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 902 [D 20:41:45.738547] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 5/70. [D 20:41:45.738574] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 906 [D 20:41:45.738587] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 6/70. [D 20:41:45.740904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.740919] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.740929] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.767886] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.767901] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.767910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.768040] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 909 [D 20:41:45.768052] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.768061] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 7/70. [D 20:41:45.770524] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 909 [D 20:41:45.770541] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 8/70. [D 20:41:45.770556] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 902 [D 20:41:45.770565] element 0: offset: 0x61f310, size: 24 [D 20:41:45.772820] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 9/70. [D 20:41:45.775105] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.775120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.775129] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.775647] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 906 [D 20:41:45.775662] element 0: offset: 0x629e10, size: 24 [D 20:41:45.775675] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 10/70. [D 20:41:45.776747] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.776761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.776772] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.784120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.784134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.784143] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.784177] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.784187] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.784195] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.784271] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 911 [D 20:41:45.784282] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.784291] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 11/70. [D 20:41:45.784304] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 915 [D 20:41:45.784313] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.784323] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 12/70. [D 20:41:45.784409] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 911 [D 20:41:45.784447] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 13/70. [D 20:41:45.787537] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 915 [D 20:41:45.787554] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 14/70. [D 20:41:45.787570] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 909 [D 20:41:45.787579] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.787589] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 15/70. [D 20:41:45.789998] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.790012] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.790022] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.814767] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.814784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.814793] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.814918] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 918 [D 20:41:45.814930] element 0: offset: 0x61f310, size: 24 [D 20:41:45.814940] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 16/70. [D 20:41:45.815208] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 911 [D 20:41:45.815222] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.815250] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 17/70. [D 20:41:45.820406] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 915 [D 20:41:45.820462] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.820476] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 18/70. [D 20:41:45.820529] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 918 [D 20:41:45.820546] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 19/70. [D 20:41:45.820576] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.820587] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.820596] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.822822] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.822837] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.822846] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.832586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.832600] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.832609] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.832734] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 921 [D 20:41:45.832748] element 0: offset: 0x633550, size: 24 [D 20:41:45.832758] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 20/70. [D 20:41:45.832854] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 921 [D 20:41:45.832950] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 918 [D 20:41:45.832963] element 0: offset: 0x61f310, size: 24 [D 20:41:45.832976] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 21/70. [D 20:41:45.832996] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 22/70. [D 20:41:45.833099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.833112] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.833135] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.847685] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.847699] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.847711] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.850538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 924 [D 20:41:45.850597] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.850612] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 23/70. [D 20:41:45.850636] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 921 [D 20:41:45.850646] element 0: offset: 0x633550, size: 24 [D 20:41:45.850656] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 24/70. [D 20:41:45.852787] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 924 [D 20:41:45.852994] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 25/70. [D 20:41:45.853026] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.853039] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.853048] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.868826] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 924 [D 20:41:45.868841] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.868852] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 26/70. [D 20:41:45.871134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.871147] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.871157] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.170151] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.170215] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.170225] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.170368] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 927 [D 20:41:46.170383] element 0: offset: 0x629e10, size: 24 [D 20:41:46.170397] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 27/70. [D 20:41:46.172852] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 927 [D 20:41:46.172870] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 28/70. [D 20:41:46.189465] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 927 [D 20:41:46.189530] element 0: offset: 0x629e10, size: 24 [D 20:41:46.189544] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 29/70. [D 20:41:46.191912] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.191927] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.191938] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.204080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.204095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.204106] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.204190] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 930 [D 20:41:46.204203] element 0: offset: 0x691fe0, size: 24 [D 20:41:46.204214] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 30/70. [D 20:41:46.204281] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 930 [D 20:41:46.204350] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 31/70. [D 20:41:46.219924] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 930 [D 20:41:46.219946] element 0: offset: 0x691fe0, size: 24 [D 20:41:46.219957] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 32/70. [D 20:41:46.220785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.220799] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.220810] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.233745] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.233760] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.233770] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.233866] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 933 [D 20:41:46.233878] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.233887] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 33/70. [D 20:41:46.233942] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 933 [D 20:41:46.233997] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 34/70. [D 20:41:46.250503] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 933 [D 20:41:46.250567] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.250582] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 35/70. [D 20:41:46.252821] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.252836] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.252847] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.263341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.263355] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.263367] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.263449] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 936 [D 20:41:46.263462] element 0: offset: 0x633550, size: 24 [D 20:41:46.263473] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 36/70. [D 20:41:46.263553] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 936 [D 20:41:46.263584] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 37/70. [D 20:41:46.280676] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 936 [D 20:41:46.280713] element 0: offset: 0x633550, size: 24 [D 20:41:46.280725] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 38/70. [D 20:41:46.280788] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.280800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.280808] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.292467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.292482] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.292493] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.292611] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 939 [D 20:41:46.292625] element 0: offset: 0x61f310, size: 24 [D 20:41:46.292635] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 39/70. [D 20:41:46.295096] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 939 [D 20:41:46.295113] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 40/70. [D 20:41:46.311875] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 939 [D 20:41:46.311936] element 0: offset: 0x61f310, size: 24 [D 20:41:46.311951] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 41/70. [D 20:41:46.312805] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.312820] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.312831] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.320412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.320426] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.320436] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.320516] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 942 [D 20:41:46.320529] element 0: offset: 0x657310, size: 24 [D 20:41:46.320540] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 42/70. [D 20:41:46.322946] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 942 [D 20:41:46.322964] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 43/70. [D 20:41:46.337899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 942 [D 20:41:46.337915] element 0: offset: 0x657310, size: 24 [D 20:41:46.337926] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 44/70. [D 20:41:46.340079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.340092] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.340103] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.344787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.344801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.344812] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.346430] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 945 [D 20:41:46.346443] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.346454] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 45/70. [D 20:41:46.346506] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 945 [D 20:41:46.346558] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 46/70. [D 20:41:46.364148] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 945 [D 20:41:46.364212] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.364227] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 47/70. [D 20:41:46.366422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.366436] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.366446] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.372796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.372811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.372823] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.373581] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 948 [D 20:41:46.373595] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.373606] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 48/70. [D 20:41:46.373671] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 948 [D 20:41:46.373713] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 49/70. [D 20:41:46.388272] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 948 [D 20:41:46.388304] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.388317] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 50/70. [D 20:41:46.390712] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.390727] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.390738] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.510461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.510515] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.510525] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.510654] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 951 [D 20:41:46.510669] element 0: offset: 0x6151c0, size: 24 [D 20:41:46.510683] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 51/70. [D 20:41:46.512825] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 951 [D 20:41:46.512843] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 52/70. [D 20:41:46.527826] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.527841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.527852] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.530733] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 953 [D 20:41:46.530792] element 0: offset: 0x61f310, size: 24 [D 20:41:46.530806] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 53/70. [D 20:41:46.530830] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 951 [D 20:41:46.530840] element 0: offset: 0x6151c0, size: 24 [D 20:41:46.530850] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 54/70. [D 20:41:46.533156] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 953 [D 20:41:46.533174] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 55/70. [D 20:41:46.533231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.533244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.533258] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.548146] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.548161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.548170] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.548659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 953 [D 20:41:46.548671] element 0: offset: 0x61f310, size: 24 [D 20:41:46.548687] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 56/70. [D 20:41:46.548700] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 957 [D 20:41:46.548709] element 0: offset: 0x657310, size: 24 [D 20:41:46.548722] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 57/70. [D 20:41:46.551227] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.551241] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.551251] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.551274] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 957 [D 20:41:46.551286] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 58/70. [D 20:41:46.567599] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.567613] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.567624] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.570427] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 959 [D 20:41:46.570486] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.570501] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 59/70. [D 20:41:46.570524] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 957 [D 20:41:46.570534] element 0: offset: 0x657310, size: 24 [D 20:41:46.570543] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 60/70. [D 20:41:46.572873] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 959 [D 20:41:46.572892] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 0/70. [D 20:41:46.572920] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.572931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.572940] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.584809] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.584823] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.584832] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.586388] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 963 [D 20:41:46.586401] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.586412] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 1/70. [D 20:41:46.586428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 959 [D 20:41:46.586443] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.586453] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 2/70. [D 20:41:46.588759] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 963 [D 20:41:46.588774] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 3/70. [D 20:41:46.588791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.588804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.588813] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.602377] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.602391] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.602403] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.602422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.602432] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.602441] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.602463] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 967 [D 20:41:46.602474] element 0: offset: 0x61f800, size: 24 [D 20:41:46.602483] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 4/70. [D 20:41:46.607620] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 968 [D 20:41:46.607669] element 0: offset: 0x63dae0, size: 24 [D 20:41:46.607683] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 5/70. [D 20:41:46.607704] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 963 [D 20:41:46.607715] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.607724] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 6/70. [D 20:41:46.607770] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 967 [D 20:41:46.607785] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 7/70. [D 20:41:46.610076] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 968 [D 20:41:46.610092] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 8/70. [D 20:41:46.610120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.610133] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.610144] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.637936] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.637951] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.637960] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.638769] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 972 [D 20:41:46.638794] element 0: offset: 0x61f310, size: 24 [D 20:41:46.638804] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 9/70. [D 20:41:46.640827] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 972 [D 20:41:46.643375] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 10/70. [D 20:41:46.643452] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 967 [D 20:41:46.643467] element 0: offset: 0x61f800, size: 24 [D 20:41:46.643479] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 11/70. [D 20:41:46.643501] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 968 [D 20:41:46.643512] element 0: offset: 0x63dae0, size: 24 [D 20:41:46.643522] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 12/70. [D 20:41:46.645807] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.645822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.645832] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.645849] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.645861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.645869] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.656211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.656226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.656234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.656266] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.656276] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.656284] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.656362] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 974 [D 20:41:46.656373] element 0: offset: 0x657310, size: 24 [D 20:41:46.656382] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 13/70. [D 20:41:46.656395] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 978 [D 20:41:46.656404] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.656413] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 14/70. [D 20:41:46.659027] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 974 [D 20:41:46.659043] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 15/70. [D 20:41:46.659068] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 978 [D 20:41:46.659080] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 16/70. [D 20:41:46.659094] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 972 [D 20:41:46.659125] element 0: offset: 0x61f310, size: 24 [D 20:41:46.659137] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 17/70. [D 20:41:46.659214] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.659228] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.659237] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.687825] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.687839] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.687848] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.687960] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 981 [D 20:41:46.687971] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.687981] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 18/70. [D 20:41:46.688826] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 981 [D 20:41:46.688845] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 19/70. [D 20:41:46.688859] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 974 [D 20:41:46.688869] element 0: offset: 0x657310, size: 24 [D 20:41:46.688879] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 20/70. [D 20:41:46.691137] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.691151] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.691160] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.694143] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 978 [D 20:41:46.694195] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.694211] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 21/70. [D 20:41:46.696486] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.696501] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.696511] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.702711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.702725] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.702733] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.702766] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.702776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.702785] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.702866] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 983 [D 20:41:46.702876] element 0: offset: 0x61f800, size: 24 [D 20:41:46.702885] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 22/70. [D 20:41:46.702898] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 987 [D 20:41:46.702907] element 0: offset: 0x66e860, size: 24 [D 20:41:46.702916] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 23/70. [D 20:41:46.705514] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 983 [D 20:41:46.705532] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 24/70. [D 20:41:46.705557] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 987 [D 20:41:46.705569] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 25/70. [D 20:41:46.705583] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 981 [D 20:41:46.705593] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.705603] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 26/70. [D 20:41:46.705692] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.705705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.705726] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.734729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.734744] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.734753] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.734873] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 990 [D 20:41:46.734885] element 0: offset: 0x61fad0, size: 24 [D 20:41:46.734895] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 27/70. [D 20:41:46.735628] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 983 [D 20:41:46.735646] element 0: offset: 0x61f800, size: 24 [D 20:41:46.735662] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 28/70. [D 20:41:46.739097] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 990 [D 20:41:46.739138] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 29/70. [D 20:41:46.739178] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.739190] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.739207] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.740839] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 987 [D 20:41:46.740872] element 0: offset: 0x66e860, size: 24 [D 20:41:46.742784] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 30/70. [D 20:41:46.742885] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.742898] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.742912] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.753894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.753928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.753937] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.753971] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.753981] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.753989] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.754064] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 992 [D 20:41:46.754075] element 0: offset: 0x657310, size: 24 [D 20:41:46.754086] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 31/70. [D 20:41:46.754100] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 996 [D 20:41:46.754109] element 0: offset: 0x629ed0, size: 24 [D 20:41:46.754123] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 32/70. [D 20:41:46.756824] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 992 [D 20:41:46.756843] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 33/70. [D 20:41:46.756869] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 996 [D 20:41:46.756881] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 34/70. [D 20:41:46.756896] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 990 [D 20:41:46.756906] element 0: offset: 0x61fad0, size: 24 [D 20:41:46.756919] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 35/70. [D 20:41:46.757016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.757048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.757058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.785557] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.785576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.785585] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.785709] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 999 [D 20:41:46.785721] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.785731] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 36/70. [D 20:41:46.787287] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 992 [D 20:41:46.787377] element 0: offset: 0x657310, size: 24 [D 20:41:46.787392] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 37/70. [D 20:41:46.791163] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 996 [D 20:41:46.791219] element 0: offset: 0x629ed0, size: 24 [D 20:41:46.791233] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 38/70. [D 20:41:46.791286] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 999 [D 20:41:46.791303] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 39/70. [D 20:41:46.791333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.791344] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.791353] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.793702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.793715] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.793726] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.806076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.806091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.806100] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.806133] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.806143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.806151] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.806220] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1001 [D 20:41:46.806231] element 0: offset: 0x61f800, size: 24 [D 20:41:46.806240] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 40/70. [D 20:41:46.806253] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1005 [D 20:41:46.806263] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.806276] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 41/70. [D 20:41:46.809001] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1001 [D 20:41:46.809017] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 42/70. [D 20:41:46.809041] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1005 [D 20:41:46.809058] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 43/70. [D 20:41:46.809071] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 999 [D 20:41:46.809082] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.809095] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 44/70. [D 20:41:46.809193] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.809206] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.809216] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.836302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.836317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.836326] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.836455] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1008 [D 20:41:46.836466] element 0: offset: 0x629ed0, size: 24 [D 20:41:46.836476] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 45/70. [D 20:41:46.837539] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1001 [D 20:41:46.837569] element 0: offset: 0x61f800, size: 24 [D 20:41:46.837585] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 46/70. [D 20:41:46.845041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1005 [D 20:41:46.845100] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.845114] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 47/70. [D 20:41:46.845163] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1008 [D 20:41:46.845179] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 48/70. [D 20:41:46.845262] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.845276] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.845286] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.845318] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.845329] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.845357] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.845484] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.845495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.845504] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.845522] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1010 [D 20:41:46.845531] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.845544] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 49/70. [D 20:41:46.845677] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1010 [D 20:41:46.859648] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 50/70. [D 20:41:46.859713] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.859728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.859737] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.859788] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1014 [D 20:41:46.859799] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.859809] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 51/70. [D 20:41:46.859891] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1014 [D 20:41:46.863396] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1008 [D 20:41:46.863433] element 0: offset: 0x629ed0, size: 24 [D 20:41:46.863446] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 52/70. [D 20:41:46.865787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.865805] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.865816] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.872066] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 53/70. [D 20:41:46.877334] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1010 [D 20:41:46.877391] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.877407] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 54/70. [D 20:41:46.879811] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.879826] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.879836] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.884382] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1014 [D 20:41:46.884397] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.884408] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 55/70. [D 20:41:46.886686] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.886700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.886710] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.912107] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.912121] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.912133] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.912252] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1017 [D 20:41:46.912271] element 0: offset: 0x61f800, size: 24 [D 20:41:46.912281] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 56/70. [D 20:41:46.914702] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1017 [D 20:41:46.914720] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 57/70. [D 20:41:46.931102] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1017 [D 20:41:46.931167] element 0: offset: 0x61f800, size: 24 [D 20:41:46.931182] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 58/70. [D 20:41:46.933406] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.933421] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.933433] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.939234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.939260] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.939270] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.939353] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1020 [D 20:41:46.939366] element 0: offset: 0x657310, size: 24 [D 20:41:46.939379] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 59/70. [D 20:41:46.939519] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1020 [D 20:41:46.939550] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 60/70. [D 20:41:46.955460] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1020 [D 20:41:46.955480] element 0: offset: 0x657310, size: 24 [D 20:41:46.955491] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 0/70. [D 20:41:46.956847] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.956861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.956871] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.282253] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.282319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.282329] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.282495] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1023 [D 20:41:47.282511] element 0: offset: 0x63e0a0, size: 24 [D 20:41:47.282525] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 1/70. [D 20:41:47.285029] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1023 [D 20:41:47.285048] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 2/70. [D 20:41:47.301446] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1023 [D 20:41:47.301507] element 0: offset: 0x63e0a0, size: 24 [D 20:41:47.301521] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 3/70. [D 20:41:47.303695] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.303711] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.303721] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.312873] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.312888] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.312898] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.314599] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1026 [D 20:41:47.314612] element 0: offset: 0x61fad0, size: 24 [D 20:41:47.314623] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 4/70. [D 20:41:47.314737] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1026 [D 20:41:47.314772] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 5/70. [D 20:41:47.331041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1026 [D 20:41:47.331059] element 0: offset: 0x61fad0, size: 24 [D 20:41:47.331069] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 6/70. [D 20:41:47.333267] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.333280] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.333291] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.339922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.339936] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.339947] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.340029] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1029 [D 20:41:47.340046] element 0: offset: 0x61f800, size: 24 [D 20:41:47.340055] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 7/70. [D 20:41:47.340156] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1029 [D 20:41:47.340218] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 8/70. [D 20:41:47.357364] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1029 [D 20:41:47.357426] element 0: offset: 0x61f800, size: 24 [D 20:41:47.357441] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 9/70. [D 20:41:47.359618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.359632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.359642] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.365904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.365918] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.365929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.366010] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1032 [D 20:41:47.366022] element 0: offset: 0x657310, size: 24 [D 20:41:47.366033] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 10/70. [D 20:41:47.366140] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1032 [D 20:41:47.366204] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 11/70. [D 20:41:47.382373] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1032 [D 20:41:47.382389] element 0: offset: 0x657310, size: 24 [D 20:41:47.382400] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 12/70. [D 20:41:47.384624] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.384638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.384648] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.388872] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.388886] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.388898] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.390776] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1035 [D 20:41:47.390790] element 0: offset: 0x63e0a0, size: 24 [D 20:41:47.390801] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 13/70. [D 20:41:47.390899] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1035 [D 20:41:47.390960] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 14/70. [D 20:41:47.409587] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1035 [D 20:41:47.409651] element 0: offset: 0x63e0a0, size: 24 [D 20:41:47.409667] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 15/70. [D 20:41:47.411974] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.411989] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.411999] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.417916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.417929] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.417940] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.418021] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1038 [D 20:41:47.418034] element 0: offset: 0x61fad0, size: 24 [D 20:41:47.418044] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 16/70. [D 20:41:47.418155] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1038 [D 20:41:47.418203] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 17/70. [D 20:41:47.434484] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1038 [D 20:41:47.434500] element 0: offset: 0x61fad0, size: 24 [D 20:41:47.434510] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 18/70. [D 20:41:47.436681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.436695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.436705] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.442529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.442542] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.442553] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.442637] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1041 [D 20:41:47.442656] element 0: offset: 0x61f800, size: 24 [D 20:41:47.442665] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 19/70. [D 20:41:47.442759] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1041 [D 20:41:47.442829] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 20/70. [D 20:41:47.463508] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1041 [D 20:41:47.463579] element 0: offset: 0x61f800, size: 24 [D 20:41:47.463594] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 21/70. [D 20:41:47.465855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.465870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.465881] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.471556] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.471571] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.471582] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.471663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1044 [D 20:41:47.471676] element 0: offset: 0x657310, size: 24 [D 20:41:47.471686] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 22/70. [D 20:41:47.471802] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1044 [D 20:41:47.471850] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 23/70. [D 20:41:47.488041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1044 [D 20:41:47.488060] element 0: offset: 0x657310, size: 24 [D 20:41:47.488071] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 24/70. [D 20:41:47.490365] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.490379] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.490390] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.562046] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.562064] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.562075] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.562202] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1046 [D 20:41:47.562215] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.562227] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 25/70. [D 20:41:47.564671] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1046 [D 20:41:47.564688] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 26/70. [D 20:41:47.582002] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1046 [D 20:41:47.582065] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.582080] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 27/70. [D 20:41:47.582156] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.582170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.582180] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.590422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.590437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.590448] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.590484] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.590494] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.590502] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:47.590544] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1050 [D 20:41:47.590557] element 0: offset: 0x5b0030, size: 24 [D 20:41:47.590566] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 28/70. [D 20:41:47.590585] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1052 [D 20:41:47.590595] element 0: offset: 0x61f800, size: 24 [D 20:41:47.592925] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 29/70. [D 20:41:47.592968] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1050 [D 20:41:47.592982] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 30/70. [D 20:41:47.595369] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1052 [D 20:41:47.595385] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 31/70. [D 20:41:47.623319] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1050 [D 20:41:47.623363] element 0: offset: 0x5b0030, size: 24 [D 20:41:47.623375] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 32/70. [D 20:41:47.625571] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.625585] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.625596] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:47.627595] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1052 [D 20:41:47.627644] element 0: offset: 0x61f800, size: 24 [D 20:41:47.627659] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 33/70. [D 20:41:47.629838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.629853] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.629863] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.643607] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.643622] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.643633] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.643669] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.643679] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.643687] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:47.643760] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1057 [D 20:41:47.643773] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.643782] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 34/70. [D 20:41:47.643800] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1058 [D 20:41:47.646226] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.646240] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 35/70. [D 20:41:47.646281] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1057 [D 20:41:47.646295] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 36/70. [D 20:41:47.648687] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1058 [D 20:41:47.648702] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 37/70. [D 20:41:47.676254] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1057 [D 20:41:47.676290] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.676302] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 38/70. [D 20:41:47.678453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.678467] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.678478] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:47.680544] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1058 [D 20:41:47.680596] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.680611] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 39/70. [D 20:41:47.682789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.682803] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.682814] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.688904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.688919] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.688929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.688965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.688975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.688984] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:47.689584] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1062 [D 20:41:47.689598] element 0: offset: 0x5b0030, size: 24 [D 20:41:47.689609] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 40/70. [D 20:41:47.689622] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1064 [D 20:41:47.689635] element 0: offset: 0x657310, size: 24 [D 20:41:47.689645] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 41/70. [D 20:41:47.689721] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1062 [D 20:41:47.689780] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 42/70. [D 20:41:47.692187] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1064 [D 20:41:47.692202] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 43/70. [D 20:41:47.719543] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1062 [D 20:41:47.719581] element 0: offset: 0x5b0030, size: 24 [D 20:41:47.719593] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 44/70. [D 20:41:47.721798] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.721812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.721824] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:47.723898] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1064 [D 20:41:47.723945] element 0: offset: 0x657310, size: 24 [D 20:41:47.723959] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 45/70. [D 20:41:47.724916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.724930] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.724941] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.731153] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.731167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.731178] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.731270] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.731281] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.731290] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:47.731323] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1068 [D 20:41:47.731333] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.731343] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 46/70. [D 20:41:47.731361] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1071 [D 20:41:47.731373] element 0: offset: 0x61f800, size: 24 [D 20:41:47.731382] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 47/70. [D 20:41:47.733819] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1068 [D 20:41:47.733836] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 48/70. [D 20:41:47.733865] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1071 [D 20:41:47.733878] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 49/70. [D 20:41:47.764371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.764386] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.764394] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.764513] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1073 [D 20:41:47.764525] element 0: offset: 0x691fe0, size: 24 [D 20:41:47.764534] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 50/70. [D 20:41:47.766880] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1073 [D 20:41:47.766896] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 51/70. [D 20:41:47.766910] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1068 [D 20:41:47.766920] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.766929] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 52/70. [D 20:41:47.771152] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.771203] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.771213] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.780936] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.780987] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.780997] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.781091] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1077 [D 20:41:47.781105] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.781126] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 53/70. [D 20:41:47.783452] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1077 [D 20:41:47.783470] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 54/70. [D 20:41:47.815127] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1071 [D 20:41:47.815192] element 0: offset: 0x61f800, size: 24 [D 20:41:47.815207] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 55/70. [D 20:41:47.816927] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.816942] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.816953] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.823773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.823788] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.823798] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.823931] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1080 [D 20:41:47.823942] element 0: offset: 0x61f310, size: 24 [D 20:41:47.823951] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 56/70. [D 20:41:47.826305] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1080 [D 20:41:47.826323] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 57/70. [D 20:41:47.845001] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1080 [D 20:41:47.845065] element 0: offset: 0x61f310, size: 24 [D 20:41:47.845081] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 58/70. [D 20:41:47.847197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.847211] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.847221] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.852921] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.852935] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.852945] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.854873] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1083 [D 20:41:47.854888] element 0: offset: 0x657310, size: 24 [D 20:41:47.854899] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 59/70. [D 20:41:47.854966] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1083 [D 20:41:47.855005] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 60/70. [D 20:41:47.872714] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1083 [D 20:41:47.872773] element 0: offset: 0x657310, size: 24 [D 20:41:47.872788] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 0/70. [D 20:41:47.874914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.874928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.874939] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.881701] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.881715] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.881726] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.881805] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1086 [D 20:41:47.881818] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.881829] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 1/70. [D 20:41:47.881938] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1086 [D 20:41:47.881983] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 2/70. [D 20:41:47.900575] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1086 [D 20:41:47.900640] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.900655] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 3/70. [D 20:41:47.903008] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.903023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.903035] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.908789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.908804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.908814] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.908937] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1089 [D 20:41:47.908966] element 0: offset: 0x61f800, size: 24 [D 20:41:47.908977] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 4/70. [D 20:41:47.911473] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1089 [D 20:41:47.911491] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 5/70. [D 20:41:47.927835] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1089 [D 20:41:47.927899] element 0: offset: 0x61f800, size: 24 [D 20:41:47.927914] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 6/70. [D 20:41:47.930216] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.930231] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.930242] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.936082] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.936095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.936106] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.936186] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1092 [D 20:41:47.936199] element 0: offset: 0x61f310, size: 24 [D 20:41:47.936209] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 7/70. [D 20:41:47.936319] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1092 [D 20:41:47.936370] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 8/70. [D 20:41:47.951936] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1073 [D 20:41:47.951998] element 0: offset: 0x691fe0, size: 24 [D 20:41:47.952013] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 9/70. [D 20:41:47.954263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.954278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.954289] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.960620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.960676] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.960686] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.960938] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1094 [D 20:41:47.960954] element 0: offset: 0x63e0d0, size: 24 [D 20:41:47.960969] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 10/70. [D 20:41:47.963555] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1094 [D 20:41:47.963573] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 11/70. [D 20:41:47.978302] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1094 [D 20:41:47.978353] element 0: offset: 0x63e0d0, size: 24 [D 20:41:47.978367] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 12/70. [D 20:41:47.978433] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.978445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.978454] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.986309] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.986373] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.986383] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.986543] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1077 [D 20:41:47.986558] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.986572] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 13/70. [D 20:41:47.986593] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1097 [D 20:41:47.986604] element 0: offset: 0x63e0d0, size: 24 [D 20:41:47.986613] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 14/70. [D 20:41:47.989051] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.989065] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.989075] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.989115] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1097 [D 20:41:47.992104] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 15/70. [D 20:41:48.008119] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.008135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.008143] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:48.008250] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1101 [D 20:41:48.008261] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.008270] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 16/70. [D 20:41:48.008326] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1101 [D 20:41:48.008369] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 17/70. [D 20:41:48.010631] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1097 [D 20:41:48.010646] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.010657] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 18/70. [D 20:41:48.010747] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.010760] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.010770] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:48.020137] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.020152] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.020160] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:48.020265] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1103 [D 20:41:48.020275] element 0: offset: 0x61ee50, size: 24 [D 20:41:48.020284] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 19/70. [D 20:41:48.022702] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1103 [D 20:41:48.022717] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 20/70. [D 20:41:48.022731] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1101 [D 20:41:48.022741] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.022773] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 21/70. [D 20:41:48.022852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.022881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.022900] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:48.035978] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.035992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.036004] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:48.036063] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1107 [D 20:41:48.036077] element 0: offset: 0x6151c0, size: 24 [D 20:41:48.036087] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 22/70. [D 20:41:48.036176] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1107 [D 20:41:48.036229] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 23/70. [D 20:41:48.200864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.200878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.200890] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:48.200955] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1110 [D 20:41:48.200967] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.200976] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 24/70. [D 20:41:48.201044] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1110 [D 20:41:48.201080] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 25/70. [D 20:41:48.249504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1092 [D 20:41:48.249566] element 0: offset: 0x61f310, size: 24 [D 20:41:48.249581] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 26/70. [D 20:41:48.252179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.252195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.252204] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:48.257720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.257735] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.257746] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:48.257966] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1113 [D 20:41:48.257980] element 0: offset: 0x657310, size: 24 [D 20:41:48.257992] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 27/70. [D 20:41:48.260483] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1113 [D 20:41:48.260501] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 28/70. [D 20:41:48.277165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1113 [D 20:41:48.277230] element 0: offset: 0x657310, size: 24 [D 20:41:48.277245] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 29/70. [D 20:41:48.279601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.279616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.279625] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:48.285083] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.285098] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.285109] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:48.285236] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1116 [D 20:41:48.285249] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.285260] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 30/70. [D 20:41:48.287786] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1116 [D 20:41:48.287805] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 31/70. [D 20:41:48.304409] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1116 [D 20:41:48.304472] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.304487] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 32/70. [D 20:41:48.306836] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.306851] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.306862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:48.386003] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1103 [D 20:41:48.386039] element 0: offset: 0x61ee50, size: 24 [D 20:41:48.386053] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 33/70. [D 20:41:48.388598] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.388613] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.388623] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:48.453260] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1107 [D 20:41:48.453275] element 0: offset: 0x6151c0, size: 24 [D 20:41:48.453286] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 34/70. [D 20:41:48.455699] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.455713] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.455724] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:48.461806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.461822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.461833] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:48.461952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1119 [D 20:41:48.461970] element 0: offset: 0x61f310, size: 24 [D 20:41:48.461981] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 35/70. [D 20:41:48.464422] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1119 [D 20:41:48.464440] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 36/70. [D 20:41:48.478254] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1110 [D 20:41:48.478272] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.478283] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 37/70. [D 20:41:48.483578] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.483628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.483638] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:48.483897] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1119 [D 20:41:48.483913] element 0: offset: 0x61f310, size: 24 [D 20:41:48.483927] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 38/70. [D 20:41:48.484964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.484979] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.484988] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.496303] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.496320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.496331] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.496532] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1122 [D 20:41:48.496546] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.496558] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 39/70. [D 20:41:48.499088] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1122 [D 20:41:48.499106] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 40/70. [D 20:41:48.514224] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1122 [D 20:41:48.514239] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.514250] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 41/70. [D 20:41:48.516543] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.516556] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.516566] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.523127] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.523142] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.523153] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.523238] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1125 [D 20:41:48.523254] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.523263] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 42/70. [D 20:41:48.525645] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1125 [D 20:41:48.525660] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 43/70. [D 20:41:48.540601] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1125 [D 20:41:48.540617] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.540628] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 44/70. [D 20:41:48.542880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.542894] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.542904] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.549033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.549048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.549059] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.549177] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1128 [D 20:41:48.549191] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.549201] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 45/70. [D 20:41:48.551824] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1128 [D 20:41:48.551840] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 46/70. [D 20:41:48.567209] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1128 [D 20:41:48.567229] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.567240] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 47/70. [D 20:41:48.569602] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.569616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.569627] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.575559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.575574] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.575585] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.575722] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1131 [D 20:41:48.575736] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.575747] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 48/70. [D 20:41:48.578301] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1131 [D 20:41:48.578318] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 49/70. [D 20:41:48.594427] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1131 [D 20:41:48.594489] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.594504] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 50/70. [D 20:41:48.596684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.596699] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.596709] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.602743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.602757] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.602767] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.602848] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1134 [D 20:41:48.602861] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.602872] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 51/70. [D 20:41:48.602982] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1134 [D 20:41:48.603028] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 52/70. [D 20:41:48.619719] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1134 [D 20:41:48.619736] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.619746] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 53/70. [D 20:41:48.621957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.621971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.621982] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.627874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.627889] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.627900] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.627985] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1137 [D 20:41:48.627999] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.628009] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 54/70. [D 20:41:48.628060] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1137 [D 20:41:48.628118] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 55/70. [D 20:41:48.645620] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1137 [D 20:41:48.645637] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.645648] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 56/70. [D 20:41:48.648044] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.648058] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.648068] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.655976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.655991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.656002] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.656097] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1140 [D 20:41:48.656112] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.656121] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 57/70. [D 20:41:48.656228] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1140 [D 20:41:48.656271] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 58/70. [D 20:41:48.672091] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1140 [D 20:41:48.672111] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.672122] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 59/70. [D 20:41:48.674477] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.674491] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.674502] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.078141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.078190] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.078200] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.078364] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1143 [D 20:41:49.078379] element 0: offset: 0x629f90, size: 24 [D 20:41:49.078392] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 60/70. [D 20:41:49.080879] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1143 [D 20:41:49.080897] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 0/70. [D 20:41:49.097928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1143 [D 20:41:49.097989] element 0: offset: 0x629f90, size: 24 [D 20:41:49.098004] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 1/70. [D 20:41:49.100186] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.100200] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.100210] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.109094] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.109108] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.109119] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.109202] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1146 [D 20:41:49.109230] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.109250] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 2/70. [D 20:41:49.111758] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1146 [D 20:41:49.111776] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 3/70. [D 20:41:49.126728] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1146 [D 20:41:49.126742] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.126753] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 4/70. [D 20:41:49.128908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.128921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.128932] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.137029] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.137043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.137053] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.138616] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1149 [D 20:41:49.138630] element 0: offset: 0x61f310, size: 24 [D 20:41:49.138640] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 5/70. [D 20:41:49.138733] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1149 [D 20:41:49.138798] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 6/70. [D 20:41:49.155471] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1149 [D 20:41:49.155487] element 0: offset: 0x61f310, size: 24 [D 20:41:49.155497] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 7/70. [D 20:41:49.157705] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.157718] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.157729] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.164027] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.164040] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.164051] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.164134] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1152 [D 20:41:49.164152] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.164162] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 8/70. [D 20:41:49.164256] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1152 [D 20:41:49.164320] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 9/70. [D 20:41:49.181394] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1152 [D 20:41:49.181410] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.181421] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 10/70. [D 20:41:49.183739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.183752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.183762] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.189771] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.189785] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.189796] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.189881] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1155 [D 20:41:49.189899] element 0: offset: 0x629f90, size: 24 [D 20:41:49.189909] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 11/70. [D 20:41:49.189960] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1155 [D 20:41:49.190013] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 12/70. [D 20:41:49.207101] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1155 [D 20:41:49.207166] element 0: offset: 0x629f90, size: 24 [D 20:41:49.207183] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 13/70. [D 20:41:49.209401] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.209416] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.209427] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.219746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.219761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.219773] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.219874] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1158 [D 20:41:49.219887] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.219898] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 14/70. [D 20:41:49.220040] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1158 [D 20:41:49.220106] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 15/70. [D 20:41:49.234373] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.234387] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.234396] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.235917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1160 [D 20:41:49.235929] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.235938] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 16/70. [D 20:41:49.237080] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1160 [D 20:41:49.237132] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 17/70. [D 20:41:49.237159] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1158 [D 20:41:49.237170] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.237181] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 18/70. [D 20:41:49.237273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.237287] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.237296] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.251874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.251888] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.251896] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.255540] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1164 [D 20:41:49.255581] element 0: offset: 0x66e860, size: 24 [D 20:41:49.255594] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 19/70. [D 20:41:49.255614] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1160 [D 20:41:49.255623] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.255635] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 20/70. [D 20:41:49.255678] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1164 [D 20:41:49.255701] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 21/70. [D 20:41:49.255716] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.255728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.255737] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.268549] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.268564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.268573] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.272424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1164 [D 20:41:49.272463] element 0: offset: 0x66e860, size: 24 [D 20:41:49.272476] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 22/70. [D 20:41:49.272498] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1166 [D 20:41:49.272507] element 0: offset: 0x61f310, size: 24 [D 20:41:49.272517] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 23/70. [D 20:41:49.272550] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.272560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.272568] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.272609] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1166 [D 20:41:49.272624] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 24/70. [D 20:41:49.284869] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.284884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.284892] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.284953] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1170 [D 20:41:49.284964] element 0: offset: 0x629f90, size: 24 [D 20:41:49.284974] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 25/70. [D 20:41:49.285089] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1170 [D 20:41:49.285144] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 26/70. [D 20:41:49.290359] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1166 [D 20:41:49.290374] element 0: offset: 0x61f310, size: 24 [D 20:41:49.290384] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 27/70. [D 20:41:49.290511] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.290524] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.290533] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.299134] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1170 [D 20:41:49.299179] element 0: offset: 0x629f90, size: 24 [D 20:41:49.299193] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 28/70. [D 20:41:49.299353] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.299366] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.299375] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.302303] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.302317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.302326] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.302424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1172 [D 20:41:49.302434] element 0: offset: 0x61fad0, size: 24 [D 20:41:49.302445] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 29/70. [D 20:41:49.302545] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1172 [D 20:41:49.302612] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 30/70. [D 20:41:49.319021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.319070] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.319080] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.319196] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1172 [D 20:41:49.319208] element 0: offset: 0x61fad0, size: 24 [D 20:41:49.319220] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 31/70. [D 20:41:49.319239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1176 [D 20:41:49.319249] element 0: offset: 0x66e860, size: 24 [D 20:41:49.319258] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 32/70. [D 20:41:49.321072] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.321091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.321103] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.321148] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1176 [D 20:41:49.321165] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 33/70. [D 20:41:49.336178] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.336193] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.336204] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.336288] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1178 [D 20:41:49.336301] element 0: offset: 0x63e0d0, size: 24 [D 20:41:49.336328] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 34/70. [D 20:41:49.336431] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1178 [D 20:41:49.336493] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 35/70. [D 20:41:49.351429] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1178 [D 20:41:49.351491] element 0: offset: 0x63e0d0, size: 24 [D 20:41:49.351506] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 36/70. [D 20:41:49.353846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.353860] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.353872] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.369407] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.369422] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.369433] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.369515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1181 [D 20:41:49.369528] element 0: offset: 0x620d50, size: 24 [D 20:41:49.369538] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 37/70. [D 20:41:49.371892] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1181 [D 20:41:49.371910] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 38/70. [D 20:41:49.387387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1181 [D 20:41:49.387402] element 0: offset: 0x620d50, size: 24 [D 20:41:49.387412] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 39/70. [D 20:41:49.389564] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.389578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.389588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.395452] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.395465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.395476] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.395557] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1184 [D 20:41:49.395574] element 0: offset: 0x6151c0, size: 24 [D 20:41:49.395583] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 40/70. [D 20:41:49.395679] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1184 [D 20:41:49.395738] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 41/70. [D 20:41:49.412397] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1184 [D 20:41:49.412412] element 0: offset: 0x6151c0, size: 24 [D 20:41:49.412422] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 42/70. [D 20:41:49.413055] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.413069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.413079] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.420125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.420139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.420149] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.420232] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1187 [D 20:41:49.420251] element 0: offset: 0x63c930, size: 24 [D 20:41:49.420260] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 43/70. [D 20:41:49.422581] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1187 [D 20:41:49.422596] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 44/70. [D 20:41:49.439509] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1187 [D 20:41:49.439570] element 0: offset: 0x63c930, size: 24 [D 20:41:49.439585] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 45/70. [D 20:41:49.441770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.441785] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.441795] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.447223] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.447238] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.447249] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.447329] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1190 [D 20:41:49.447342] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.447353] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 46/70. [D 20:41:49.447461] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1190 [D 20:41:49.447506] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 47/70. [D 20:41:49.463441] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1190 [D 20:41:49.463457] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.463467] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 48/70. [D 20:41:49.465626] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.465639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.465649] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.492441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.492455] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.492466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.492552] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1194 [D 20:41:49.492571] element 0: offset: 0x61ee50, size: 24 [D 20:41:49.492580] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 49/70. [D 20:41:49.494957] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1194 [D 20:41:49.494972] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 50/70. [D 20:41:49.721324] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1176 [D 20:41:49.721354] element 0: offset: 0x66e860, size: 24 [D 20:41:49.721365] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 51/70. [D 20:41:49.724020] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.724034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.724045] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.729097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.729128] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.729139] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.731649] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1197 [D 20:41:49.731672] element 0: offset: 0x657310, size: 24 [D 20:41:49.731685] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 52/70. [D 20:41:49.734247] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1197 [D 20:41:49.734265] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 53/70. [D 20:41:49.750345] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1197 [D 20:41:49.750409] element 0: offset: 0x657310, size: 24 [D 20:41:49.750423] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 54/70. [D 20:41:49.752555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.752570] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.752581] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.758719] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.758733] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.758744] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.758826] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1200 [D 20:41:49.758852] element 0: offset: 0x63e0d0, size: 24 [D 20:41:49.758871] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 55/70. [D 20:41:49.761338] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1200 [D 20:41:49.761356] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 56/70. [D 20:41:49.777022] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1200 [D 20:41:49.777037] element 0: offset: 0x63e0d0, size: 24 [D 20:41:49.777048] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 57/70. [D 20:41:49.779326] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.779340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.779349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.785093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.785106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.785117] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.785301] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1203 [D 20:41:49.785317] element 0: offset: 0x61fad0, size: 24 [D 20:41:49.785328] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 58/70. [D 20:41:49.785422] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1203 [D 20:41:49.785476] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 59/70. [D 20:41:49.994845] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.994860] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.994872] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:49.994927] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1206 [D 20:41:49.994940] element 0: offset: 0x62aff0, size: 24 [D 20:41:49.994950] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 60/70. [D 20:41:49.995051] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1206 [D 20:41:49.995101] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 0/70. [D 20:41:50.059486] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1194 [D 20:41:50.059554] element 0: offset: 0x61ee50, size: 24 [D 20:41:50.059722] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 1/70. [D 20:41:50.061137] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.061152] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.061164] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:50.068565] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.068581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.068592] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:50.069125] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1209 [D 20:41:50.069140] element 0: offset: 0x61f310, size: 24 [D 20:41:50.069153] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 2/70. [D 20:41:50.071665] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1209 [D 20:41:50.071683] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 3/70. [D 20:41:50.087374] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1209 [D 20:41:50.087404] element 0: offset: 0x61f310, size: 24 [D 20:41:50.087415] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 4/70. [D 20:41:50.089638] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.089653] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.089664] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:50.095691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.095705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.095716] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:50.095839] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1212 [D 20:41:50.095852] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.095863] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 5/70. [D 20:41:50.098239] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1212 [D 20:41:50.098254] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 6/70. [D 20:41:50.115165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1212 [D 20:41:50.115229] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.115244] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 7/70. [D 20:41:50.117429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.117444] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.117454] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:50.123684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.123698] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.123708] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:50.123792] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1215 [D 20:41:50.123805] element 0: offset: 0x63c930, size: 24 [D 20:41:50.123816] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 8/70. [D 20:41:50.123881] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1215 [D 20:41:50.123922] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 9/70. [D 20:41:50.138492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.138507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.138515] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.140072] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1217 [D 20:41:50.140084] element 0: offset: 0x61ee50, size: 24 [D 20:41:50.140095] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 10/70. [D 20:41:50.142432] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1217 [D 20:41:50.142447] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 11/70. [D 20:41:50.483290] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1203 [D 20:41:50.483359] element 0: offset: 0x61fad0, size: 24 [D 20:41:50.483374] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 12/70. [D 20:41:50.485726] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.485742] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.485753] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.489170] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.489185] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.489196] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.491647] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1221 [D 20:41:50.491661] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.491671] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 13/70. [D 20:41:50.491740] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1221 [D 20:41:50.491772] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 14/70. [D 20:41:50.508889] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1221 [D 20:41:50.508955] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.508970] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 15/70. [D 20:41:50.511221] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.511236] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.511247] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.521125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.521139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.521150] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.521254] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1224 [D 20:41:50.521266] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.521277] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 16/70. [D 20:41:50.523738] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1224 [D 20:41:50.523756] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 17/70. [D 20:41:50.540541] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1224 [D 20:41:50.540606] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.540621] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 18/70. [D 20:41:50.542756] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.542771] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.542782] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.548395] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.548409] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.548420] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.548500] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1227 [D 20:41:50.548513] element 0: offset: 0x657310, size: 24 [D 20:41:50.548524] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 19/70. [D 20:41:50.550882] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1227 [D 20:41:50.550899] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 20/70. [D 20:41:50.567098] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1227 [D 20:41:50.567160] element 0: offset: 0x657310, size: 24 [D 20:41:50.567175] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 21/70. [D 20:41:50.569189] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.569204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.569213] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.574957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.574971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.574982] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.575064] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1230 [D 20:41:50.575077] element 0: offset: 0x61fad0, size: 24 [D 20:41:50.575088] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 22/70. [D 20:41:50.577376] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1230 [D 20:41:50.577394] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 23/70. [D 20:41:50.882885] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1206 [D 20:41:50.882954] element 0: offset: 0x62aff0, size: 24 [D 20:41:50.882970] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 24/70. [D 20:41:50.885318] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.885334] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.885345] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.891417] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.891431] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.891442] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.891521] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1233 [D 20:41:50.891533] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.891544] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 25/70. [D 20:41:50.891658] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1233 [D 20:41:50.891695] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 26/70. [D 20:41:50.909835] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1233 [D 20:41:50.909897] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.909912] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 27/70. [D 20:41:50.912088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.912102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.912112] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.918010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.918023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.918034] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.918112] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1236 [D 20:41:50.918125] element 0: offset: 0x620d50, size: 24 [D 20:41:50.918135] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 28/70. [D 20:41:50.918201] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1236 [D 20:41:50.918241] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 29/70. [D 20:41:50.937556] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1236 [D 20:41:50.937619] element 0: offset: 0x620d50, size: 24 [D 20:41:50.937634] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 30/70. [D 20:41:50.939801] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.939815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.939824] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.945208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.945222] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.945233] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.945763] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1239 [D 20:41:50.945776] element 0: offset: 0x6347e0, size: 24 [D 20:41:50.945787] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 31/70. [D 20:41:50.945897] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1239 [D 20:41:50.945940] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 32/70. [D 20:41:50.964489] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1239 [D 20:41:50.964550] element 0: offset: 0x6347e0, size: 24 [D 20:41:50.964565] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 33/70. [D 20:41:50.966741] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.966755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.966765] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.972467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.972481] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.972491] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.972569] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1242 [D 20:41:50.972582] element 0: offset: 0x62aff0, size: 24 [D 20:41:50.972593] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 34/70. [D 20:41:50.972701] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1242 [D 20:41:50.972742] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 35/70. [D 20:41:50.989651] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1215 [D 20:41:50.989667] element 0: offset: 0x63c930, size: 24 [D 20:41:50.989678] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 36/70. [D 20:41:50.992190] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.992204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.992216] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.992228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1242 [D 20:41:50.992238] element 0: offset: 0x62aff0, size: 24 [D 20:41:50.992250] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 37/70. [D 20:41:50.992293] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.992306] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.992316] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:51.001459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.001477] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.001488] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:51.001513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.001523] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.001531] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:51.001611] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1245 [D 20:41:51.001624] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.001634] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 38/70. [D 20:41:51.001649] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1248 [D 20:41:51.001663] element 0: offset: 0x620d50, size: 24 [D 20:41:51.001672] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 39/70. [D 20:41:51.011631] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1245 [D 20:41:51.011699] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 40/70. [D 20:41:51.011739] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1248 [D 20:41:51.011752] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 41/70. [D 20:41:51.014752] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1217 [D 20:41:51.014769] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.014783] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 42/70. [D 20:41:51.014887] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.014901] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.014917] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:51.037217] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.037233] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.037242] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:51.037381] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1250 [D 20:41:51.037393] element 0: offset: 0x62aff0, size: 24 [D 20:41:51.037402] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 43/70. [D 20:41:51.040663] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1250 [D 20:41:51.040693] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 44/70. [D 20:41:51.314564] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1230 [D 20:41:51.314633] element 0: offset: 0x61fad0, size: 24 [D 20:41:51.314649] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 45/70. [D 20:41:51.316969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.316985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.316996] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:51.531351] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1245 [D 20:41:51.531413] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.531428] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 46/70. [D 20:41:51.533730] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.533744] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.533756] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:51.539636] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.539651] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.539660] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:51.539789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1254 [D 20:41:51.539803] element 0: offset: 0x6347e0, size: 24 [D 20:41:51.539814] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 47/70. [D 20:41:51.542273] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1254 [D 20:41:51.542291] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 48/70. [D 20:41:51.560567] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1254 [D 20:41:51.560628] element 0: offset: 0x6347e0, size: 24 [D 20:41:51.560643] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 49/70. [D 20:41:51.561281] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.561296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.561306] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:51.570087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.570101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.570113] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:51.570195] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1257 [D 20:41:51.570221] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.570240] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 50/70. [D 20:41:51.570308] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1257 [D 20:41:51.570339] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 51/70. [D 20:41:51.586327] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1257 [D 20:41:51.586342] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.586353] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 52/70. [D 20:41:51.588666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.588679] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.588689] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:51.596453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.596467] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.596478] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:51.596565] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1260 [D 20:41:51.596581] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.596590] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 53/70. [D 20:41:51.596641] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1260 [D 20:41:51.596680] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 54/70. [D 20:41:51.613391] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1260 [D 20:41:51.613452] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.613467] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 55/70. [D 20:41:51.615641] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.615656] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.615665] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:51.714320] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1248 [D 20:41:51.714387] element 0: offset: 0x620d50, size: 24 [D 20:41:51.714401] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 56/70. [D 20:41:51.716696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.716712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.716722] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:51.723453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.723468] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.723477] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:51.723552] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1263 [D 20:41:51.723564] element 0: offset: 0x5b0030, size: 24 [D 20:41:51.723573] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 57/70. [D 20:41:51.723643] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1263 [D 20:41:51.723677] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 58/70. [D 20:41:51.728969] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1250 [D 20:41:51.728983] element 0: offset: 0x62aff0, size: 24 [D 20:41:51.728993] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 59/70. [D 20:41:51.731378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.731392] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.731402] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:51.738272] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.738286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.738294] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:51.738391] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1265 [D 20:41:51.738402] element 0: offset: 0x66e860, size: 24 [D 20:41:51.738411] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 60/70. [D 20:41:51.738505] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1265 [D 20:41:51.738563] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 0/70. [D 20:41:51.739829] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1263 [D 20:41:51.739842] element 0: offset: 0x5b0030, size: 24 [D 20:41:51.739854] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 1/70. [D 20:41:51.739935] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.739948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.739958] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:51.756219] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.756280] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.756290] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:51.757538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1265 [D 20:41:51.757554] element 0: offset: 0x66e860, size: 24 [D 20:41:51.757570] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 2/70. [D 20:41:51.757591] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1269 [D 20:41:51.757607] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.757618] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 3/70. [D 20:41:51.757669] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.757682] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.757692] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:51.759907] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1269 [D 20:41:51.759926] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 4/70. [D 20:41:51.775026] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.775041] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.775052] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:51.775107] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1271 [D 20:41:51.775118] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.775127] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 5/70. [D 20:41:51.780266] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1269 [D 20:41:51.780318] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.780331] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 6/70. [D 20:41:51.780379] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1271 [D 20:41:51.780396] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 7/70. [D 20:41:51.781320] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.781336] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.781346] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:51.796131] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1271 [D 20:41:51.796148] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.796158] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 8/70. [D 20:41:51.798308] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.798321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.798332] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:51.804969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.804983] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.804994] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:51.805108] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1274 [D 20:41:51.805126] element 0: offset: 0x5b0030, size: 24 [D 20:41:51.805136] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 9/70. [D 20:41:51.805188] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1274 [D 20:41:51.805244] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 10/70. [D 20:41:51.820693] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1274 [D 20:41:51.820708] element 0: offset: 0x5b0030, size: 24 [D 20:41:51.820718] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 11/70. [D 20:41:51.821286] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.821300] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.821308] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:51.833741] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.833754] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.833765] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:51.833851] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1277 [D 20:41:51.833869] element 0: offset: 0x657310, size: 24 [D 20:41:51.833878] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 12/70. [D 20:41:51.836254] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1277 [D 20:41:51.836269] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 13/70. [D 20:41:51.853586] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1277 [D 20:41:51.853645] element 0: offset: 0x657310, size: 24 [D 20:41:51.853660] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 14/70. [D 20:41:51.855784] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.855799] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.855808] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:51.861294] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.861308] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.861319] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:51.861782] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1280 [D 20:41:51.861796] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.861807] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 15/70. [D 20:41:51.861930] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1280 [D 20:41:51.861976] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 16/70. [D 20:41:51.880283] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1280 [D 20:41:51.880344] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.880358] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 17/70. [D 20:41:51.882637] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.882651] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.882662] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:51.888462] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.888476] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.888487] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:51.888581] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1283 [D 20:41:51.888609] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.888621] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 18/70. [D 20:41:51.891085] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1283 [D 20:41:51.891103] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 19/70. [D 20:41:51.906357] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1283 [D 20:41:51.906372] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.906383] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 20/70. [D 20:41:51.908673] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.908687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.908697] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.023077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.023109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.023120] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.023224] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1287 [D 20:41:52.023236] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.023247] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 21/70. [D 20:41:52.025663] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1287 [D 20:41:52.025680] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 22/70. [D 20:41:52.040789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1287 [D 20:41:52.040805] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.040815] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 23/70. [D 20:41:52.043117] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.043130] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.043140] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.050636] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.050650] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.050661] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.050751] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1290 [D 20:41:52.050767] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.050776] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 24/70. [D 20:41:52.050871] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1290 [D 20:41:52.050943] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 25/70. [D 20:41:52.103371] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1290 [D 20:41:52.103486] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.103502] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 26/70. [D 20:41:52.106006] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.106021] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.106032] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.111761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.111776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.111787] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.111870] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1293 [D 20:41:52.111883] element 0: offset: 0x691fe0, size: 24 [D 20:41:52.111894] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 27/70. [D 20:41:52.112010] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1293 [D 20:41:52.112066] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 28/70. [D 20:41:52.130477] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1293 [D 20:41:52.130539] element 0: offset: 0x691fe0, size: 24 [D 20:41:52.130553] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 29/70. [D 20:41:52.132680] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.132695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.132705] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.138611] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.138626] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.138637] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.138717] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1296 [D 20:41:52.138730] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.138741] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 30/70. [D 20:41:52.141102] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1296 [D 20:41:52.141120] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 31/70. [D 20:41:52.155819] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1296 [D 20:41:52.155834] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.155844] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 32/70. [D 20:41:52.158003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.158017] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.158028] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.164086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.164099] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.164109] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.164194] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1299 [D 20:41:52.164211] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.164220] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 33/70. [D 20:41:52.164276] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1299 [D 20:41:52.164334] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 34/70. [D 20:41:52.373986] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.374001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.374011] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:52.374156] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1302 [D 20:41:52.374167] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.374182] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 35/70. [D 20:41:52.376703] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1302 [D 20:41:52.376719] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 36/70. [D 20:41:52.393525] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1302 [D 20:41:52.393590] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.393617] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 37/70. [D 20:41:52.395837] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.395850] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.395859] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:52.399162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1299 [D 20:41:52.399175] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.399193] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 38/70. [D 20:41:52.401350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.401364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.401376] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.401395] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.401407] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.401423] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.402504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1305 [D 20:41:52.402518] element 0: offset: 0x620d50, size: 24 [D 20:41:52.402529] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 39/70. [D 20:41:52.402595] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1305 [D 20:41:52.402734] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 40/70. [D 20:41:52.418783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.418798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.418809] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:52.421804] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1308 [D 20:41:52.421858] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.421874] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 41/70. [D 20:41:52.421897] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1305 [D 20:41:52.421914] element 0: offset: 0x620d50, size: 24 [D 20:41:52.421926] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 42/70. [D 20:41:52.424264] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1308 [D 20:41:52.424282] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 43/70. [D 20:41:52.424311] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.424335] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.424344] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:52.439507] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.439522] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.439532] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:52.440526] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1311 [D 20:41:52.440538] element 0: offset: 0x691fe0, size: 24 [D 20:41:52.440550] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 44/70. [D 20:41:52.440568] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1308 [D 20:41:52.440582] element 0: offset: 0x2aaaab2033d0, size: 24 [D 20:41:52.440603] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 45/70. [D 20:41:52.441388] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1311 [D 20:41:52.441440] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 46/70. [D 20:41:52.441476] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.441486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.441495] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:52.453708] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.453722] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.453731] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:52.453794] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1314 [D 20:41:52.453805] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.453818] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 47/70. [D 20:41:52.453920] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1314 [D 20:41:52.453974] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 48/70. [D 20:41:52.535684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.535700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.535709] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:52.535759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1317 [D 20:41:52.535770] element 0: offset: 0x620d50, size: 24 [D 20:41:52.535780] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 49/70. [D 20:41:52.535838] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1317 [D 20:41:52.535879] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 50/70. [D 20:41:52.808832] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.808871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.808881] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:52.808976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1319 [D 20:41:52.808988] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.809000] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 51/70. [D 20:41:52.809062] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1319 [D 20:41:52.809113] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 52/70. [D 20:41:52.825804] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1319 [D 20:41:52.825853] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.825867] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 53/70. [D 20:41:52.826015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.826029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.826037] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:52.832806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.832821] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.832830] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:52.832928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1322 [D 20:41:52.832939] element 0: offset: 0x61f310, size: 24 [D 20:41:52.832949] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 54/70. [D 20:41:52.833013] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1322 [D 20:41:52.833056] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 55/70. [D 20:41:52.851024] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1322 [D 20:41:52.851071] element 0: offset: 0x61f310, size: 24 [D 20:41:52.851084] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 56/70. [D 20:41:52.851148] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.851159] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.851168] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:52.857569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.857583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.857592] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:52.857685] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1325 [D 20:41:52.857696] element 0: offset: 0x657310, size: 24 [D 20:41:52.857706] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 57/70. [D 20:41:52.857769] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1325 [D 20:41:52.857811] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 58/70. [D 20:41:53.003462] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1314 [D 20:41:53.003512] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.003526] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 59/70. [D 20:41:53.005744] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.005803] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.005814] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:53.011573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.011587] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.011599] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:53.011732] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1329 [D 20:41:53.011748] element 0: offset: 0x61f800, size: 24 [D 20:41:53.011762] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 60/70. [D 20:41:53.014217] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1329 [D 20:41:53.014235] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 0/70. [D 20:41:53.030288] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1329 [D 20:41:53.030303] element 0: offset: 0x61f800, size: 24 [D 20:41:53.030314] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 1/70. [D 20:41:53.032633] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.032647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.032657] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:53.190375] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1317 [D 20:41:53.190440] element 0: offset: 0x620d50, size: 24 [D 20:41:53.190455] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 2/70. [D 20:41:53.192729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.192744] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.192754] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.197414] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.197430] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.197441] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.199745] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1332 [D 20:41:53.199759] element 0: offset: 0x66e670, size: 24 [D 20:41:53.199770] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 3/70. [D 20:41:53.199837] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1332 [D 20:41:53.199905] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 4/70. [D 20:41:53.207486] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1325 [D 20:41:53.207501] element 0: offset: 0x657310, size: 24 [D 20:41:53.207512] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 5/70. [D 20:41:53.209908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.209922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.209933] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.215418] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.215432] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.215440] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.215569] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1334 [D 20:41:53.215581] element 0: offset: 0x61f800, size: 24 [D 20:41:53.215592] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 6/70. [D 20:41:53.215609] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1332 [D 20:41:53.215624] element 0: offset: 0x66e670, size: 24 [D 20:41:53.215647] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 7/70. [D 20:41:53.217418] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1334 [D 20:41:53.218050] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 8/70. [D 20:41:53.218070] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.218083] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.218092] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.232621] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.232637] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.232649] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.233497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1338 [D 20:41:53.233521] element 0: offset: 0x634810, size: 24 [D 20:41:53.233533] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 9/70. [D 20:41:53.236066] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1338 [D 20:41:53.236083] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 10/70. [D 20:41:53.240798] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1334 [D 20:41:53.240850] element 0: offset: 0x61f800, size: 24 [D 20:41:53.240865] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 11/70. [D 20:41:53.240969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.240980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.240989] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.245154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1311 [D 20:41:53.245167] element 0: offset: 0x691fe0, size: 24 [D 20:41:53.245181] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 12/70. [D 20:41:53.247696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.247710] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.247722] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:53.253422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.253437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.253446] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:53.253480] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.253490] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.253498] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.254500] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1341 [D 20:41:53.254511] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.254520] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 13/70. [D 20:41:53.254533] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1344 [D 20:41:53.254543] element 0: offset: 0x66e670, size: 24 [D 20:41:53.254556] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 14/70. [D 20:41:53.257187] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1341 [D 20:41:53.257206] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 15/70. [D 20:41:53.257235] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1344 [D 20:41:53.257248] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 16/70. [D 20:41:53.257262] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1338 [D 20:41:53.257328] element 0: offset: 0x634810, size: 24 [D 20:41:53.257342] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 17/70. [D 20:41:53.257421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.257434] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.257452] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.286423] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.286438] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.286446] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.286563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1347 [D 20:41:53.286575] element 0: offset: 0x657310, size: 24 [D 20:41:53.286585] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 18/70. [D 20:41:53.289014] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1347 [D 20:41:53.289028] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 19/70. [D 20:41:53.669854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1341 [D 20:41:53.669917] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.669932] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 20/70. [D 20:41:53.672537] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.672552] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.672563] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.677905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.677921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.677929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.678045] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1349 [D 20:41:53.678056] element 0: offset: 0x646960, size: 24 [D 20:41:53.678065] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 21/70. [D 20:41:53.678134] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1349 [D 20:41:53.678265] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 22/70. [D 20:41:53.694106] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1349 [D 20:41:53.694125] element 0: offset: 0x646960, size: 24 [D 20:41:53.694136] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 23/70. [D 20:41:53.696432] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.696446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.696455] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.706111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.706125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.706136] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.706240] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1352 [D 20:41:53.706252] element 0: offset: 0x5b0030, size: 24 [D 20:41:53.706261] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 24/70. [D 20:41:53.706315] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1352 [D 20:41:53.706370] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 25/70. [D 20:41:53.722736] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1352 [D 20:41:53.722753] element 0: offset: 0x5b0030, size: 24 [D 20:41:53.722763] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 26/70. [D 20:41:53.725099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.725113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.725123] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.731760] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.731786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.731797] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.733529] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1355 [D 20:41:53.733586] element 0: offset: 0x691fe0, size: 24 [D 20:41:53.733602] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 27/70. [D 20:41:53.736117] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1355 [D 20:41:53.736135] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 28/70. [D 20:41:53.739811] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1344 [D 20:41:53.739850] element 0: offset: 0x66e670, size: 24 [D 20:41:53.739865] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 29/70. [D 20:41:53.739965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.740001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.740019] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.749469] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.749485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.749495] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.751603] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1359 [D 20:41:53.751615] element 0: offset: 0x61ee50, size: 24 [D 20:41:53.751624] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 30/70. [D 20:41:53.751691] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1359 [D 20:41:53.751718] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 31/70. [D 20:41:53.758465] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1347 [D 20:41:53.758482] element 0: offset: 0x657310, size: 24 [D 20:41:53.758493] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 32/70. [D 20:41:53.761096] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.761110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.761122] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.761154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1355 [D 20:41:53.761164] element 0: offset: 0x691fe0, size: 24 [D 20:41:53.761174] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 33/70. [D 20:41:53.763742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.763756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.763767] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:53.772141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.772155] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.772164] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:53.772264] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1362 [D 20:41:53.772275] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.772284] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 34/70. [D 20:41:53.772338] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1362 [D 20:41:53.772390] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 35/70. [D 20:41:53.772679] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1359 [D 20:41:53.772693] element 0: offset: 0x61ee50, size: 24 [D 20:41:53.772704] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 36/70. [D 20:41:53.772778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.772791] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.772800] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:53.788120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.788135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.788146] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:53.788214] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1365 [D 20:41:53.788227] element 0: offset: 0x620d50, size: 24 [D 20:41:53.788238] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 37/70. [D 20:41:53.793194] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1362 [D 20:41:53.793248] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.793262] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 38/70. [D 20:41:53.793317] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1365 [D 20:41:53.793335] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 39/70. [D 20:41:53.795516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.795530] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.795540] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:53.808118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.808134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.808142] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:53.808175] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.808185] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.808193] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.808269] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1368 [D 20:41:53.808280] element 0: offset: 0x61f800, size: 24 [D 20:41:53.808289] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 40/70. [D 20:41:53.808302] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1371 [D 20:41:53.808311] element 0: offset: 0x66e670, size: 24 [D 20:41:53.808321] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 41/70. [D 20:41:53.810766] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1368 [D 20:41:53.810781] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 42/70. [D 20:41:53.810806] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1371 [D 20:41:53.810818] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 43/70. [D 20:41:53.810831] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1365 [D 20:41:53.810857] element 0: offset: 0x620d50, size: 24 [D 20:41:53.810869] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 44/70. [D 20:41:53.810941] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.810954] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.810964] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.838597] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.838612] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.838621] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.838730] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1374 [D 20:41:53.838742] element 0: offset: 0x657310, size: 24 [D 20:41:53.838751] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 45/70. [D 20:41:53.838805] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1374 [D 20:41:53.838861] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 46/70. [D 20:41:53.847073] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1368 [D 20:41:53.847091] element 0: offset: 0x61f800, size: 24 [D 20:41:53.847102] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 47/70. [D 20:41:53.849494] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.849507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.849518] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.853481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.853495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.853503] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.853612] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1377 [D 20:41:53.853655] element 0: offset: 0x61ee50, size: 24 [D 20:41:53.853669] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 48/70. [D 20:41:53.853776] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1377 [D 20:41:53.853835] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 49/70. [D 20:41:53.922251] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1371 [D 20:41:53.922298] element 0: offset: 0x66e670, size: 24 [D 20:41:53.922312] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 50/70. [D 20:41:53.922467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.922480] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.922489] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.928157] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.928171] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.928179] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.928274] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1380 [D 20:41:53.928285] element 0: offset: 0x691fe0, size: 24 [D 20:41:53.928295] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 51/70. [D 20:41:53.928359] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1380 [D 20:41:53.928481] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 52/70. [D 20:41:53.942165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1380 [D 20:41:53.942212] element 0: offset: 0x691fe0, size: 24 [D 20:41:53.942226] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 53/70. [D 20:41:53.942369] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.942382] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.942391] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.955828] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.955842] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.955850] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.955945] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1383 [D 20:41:53.955956] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.955966] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 54/70. [D 20:41:53.956031] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1383 [D 20:41:53.956061] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 55/70. [D 20:41:54.401941] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1374 [D 20:41:54.401990] element 0: offset: 0x657310, size: 24 [D 20:41:54.402004] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 56/70. [D 20:41:54.402182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.402196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.402205] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.408215] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.408229] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.408238] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.408338] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1386 [D 20:41:54.408349] element 0: offset: 0x6151c0, size: 24 [D 20:41:54.408359] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 57/70. [D 20:41:54.408422] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1386 [D 20:41:54.408474] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 58/70. [D 20:41:54.413800] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1377 [D 20:41:54.413841] element 0: offset: 0x61ee50, size: 24 [D 20:41:54.413854] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 59/70. [D 20:41:54.416118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.416137] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.416147] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.423240] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.423255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.423266] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.423402] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1389 [D 20:41:54.423418] element 0: offset: 0x66e670, size: 24 [D 20:41:54.423431] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 60/70. [D 20:41:54.425882] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1389 [D 20:41:54.425900] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 0/70. [D 20:41:54.430972] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1386 [D 20:41:54.431018] element 0: offset: 0x6151c0, size: 24 [D 20:41:54.431033] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 1/70. [D 20:41:54.431145] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.431175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.431185] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.441481] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1389 [D 20:41:54.441495] element 0: offset: 0x66e670, size: 24 [D 20:41:54.441506] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 2/70. [D 20:41:54.443827] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.443840] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.443850] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:54.453528] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.453543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.453554] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:54.455004] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1392 [D 20:41:54.455017] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.455027] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 3/70. [D 20:41:54.455136] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1392 [D 20:41:54.455182] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 4/70. [D 20:41:54.473448] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1392 [D 20:41:54.473523] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.473538] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 5/70. [D 20:41:54.475778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.475793] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.475802] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:54.481880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.481894] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.481906] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:54.481987] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1395 [D 20:41:54.482000] element 0: offset: 0x620d50, size: 24 [D 20:41:54.482011] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 6/70. [D 20:41:54.482119] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1395 [D 20:41:54.482179] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 7/70. [D 20:41:54.497737] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.497752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.497760] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.497867] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1397 [D 20:41:54.497879] element 0: offset: 0x6151c0, size: 24 [D 20:41:54.497888] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 8/70. [D 20:41:54.497942] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1397 [D 20:41:54.498001] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 9/70. [D 20:41:54.499479] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1395 [D 20:41:54.499492] element 0: offset: 0x620d50, size: 24 [D 20:41:54.499506] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 10/70. [D 20:41:54.499583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.499596] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.499607] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.511212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.511226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.511238] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.511315] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1401 [D 20:41:54.511328] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.511341] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 11/70. [D 20:41:54.513734] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1401 [D 20:41:54.513750] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 12/70. [D 20:41:54.516605] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1397 [D 20:41:54.516659] element 0: offset: 0x6151c0, size: 24 [D 20:41:54.516674] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 13/70. [D 20:41:54.518885] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.518899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.518910] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.529541] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.529556] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.529565] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.529603] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1401 [D 20:41:54.529613] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.529623] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 14/70. [D 20:41:54.531825] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.531840] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.531849] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.531864] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1403 [D 20:41:54.531874] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.531884] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 15/70. [D 20:41:54.531998] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1403 [D 20:41:54.532023] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 16/70. [D 20:41:54.545796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.545814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.545822] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.545975] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1407 [D 20:41:54.545987] element 0: offset: 0x61ee50, size: 24 [D 20:41:54.545997] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 17/70. [D 20:41:54.546114] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1407 [D 20:41:54.546138] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 18/70. [D 20:41:54.560219] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1407 [D 20:41:54.560237] element 0: offset: 0x61ee50, size: 24 [D 20:41:54.560248] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 19/70. [D 20:41:54.561534] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.561549] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.561560] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.578446] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.578460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.578472] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.578563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1410 [D 20:41:54.578579] element 0: offset: 0x691fe0, size: 24 [D 20:41:54.578588] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 20/70. [D 20:41:54.581071] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1410 [D 20:41:54.581087] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 21/70. [D 20:41:54.596019] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1410 [D 20:41:54.596035] element 0: offset: 0x691fe0, size: 24 [D 20:41:54.596045] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 22/70. [D 20:41:54.598256] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.598270] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.598281] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.791563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1383 [D 20:41:54.791626] element 0: offset: 0x61fad0, size: 24 [D 20:41:54.791643] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 23/70. [D 20:41:54.793559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.793575] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.793586] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:54.994855] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1403 [D 20:41:54.994898] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.994914] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 24/70. [D 20:41:54.995019] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.995032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.995041] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:55.002002] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.002017] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.002026] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:55.002121] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1412 [D 20:41:55.002132] element 0: offset: 0x61f800, size: 24 [D 20:41:55.002143] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 25/70. [D 20:41:55.002208] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1412 [D 20:41:55.002265] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 26/70. [D 20:41:55.018928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1412 [D 20:41:55.018975] element 0: offset: 0x61f800, size: 24 [D 20:41:55.018989] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 27/70. [D 20:41:55.019138] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.019152] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.019160] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:55.026584] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.026598] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.026607] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:55.026702] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1415 [D 20:41:55.026713] element 0: offset: 0x66e670, size: 24 [D 20:41:55.026724] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 28/70. [D 20:41:55.026788] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1415 [D 20:41:55.026836] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 29/70. [D 20:41:55.044599] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1415 [D 20:41:55.044646] element 0: offset: 0x66e670, size: 24 [D 20:41:55.044660] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 30/70. [D 20:41:55.044722] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.044733] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.044742] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:55.052605] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.052620] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.052628] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:55.052722] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1418 [D 20:41:55.052734] element 0: offset: 0x61ee50, size: 24 [D 20:41:55.052744] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 31/70. [D 20:41:55.052808] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1418 [D 20:41:55.052856] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 32/70. [D 20:41:55.071584] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1418 [D 20:41:55.071599] element 0: offset: 0x61ee50, size: 24 [D 20:41:55.071610] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 33/70. [D 20:41:55.071688] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.071700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.071709] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:55.077966] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.077980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.077988] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:55.078037] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1421 [D 20:41:55.078048] element 0: offset: 0x61fad0, size: 24 [D 20:41:55.078058] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 34/70. [D 20:41:55.078110] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1421 [D 20:41:55.078175] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 35/70. [D 20:41:55.093825] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.093842] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.093850] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:55.097580] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1425 [D 20:41:55.097623] element 0: offset: 0x691fe0, size: 24 [D 20:41:55.097637] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 36/70. [D 20:41:55.097657] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1421 [D 20:41:55.097667] element 0: offset: 0x61fad0, size: 24 [D 20:41:55.097677] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 37/70. [D 20:41:55.097719] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1425 [D 20:41:55.097752] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 38/70. [D 20:41:55.097755] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.097785] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.097794] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:55.108461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.108476] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.108485] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:55.112228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1427 [D 20:41:55.112272] element 0: offset: 0x61f800, size: 24 [D 20:41:55.112285] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 39/70. [D 20:41:55.112306] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1425 [D 20:41:55.112316] element 0: offset: 0x691fe0, size: 24 [D 20:41:55.112325] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 40/70. [D 20:41:55.114673] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1427 [D 20:41:55.114696] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 41/70. [D 20:41:55.114732] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.114743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.114753] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:55.128673] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.128688] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.128699] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:55.134403] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1431 [D 20:41:55.134470] element 0: offset: 0x66e670, size: 24 [D 20:41:55.134485] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 42/70. [D 20:41:55.136730] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1431 [D 20:41:55.136749] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 43/70. [D 20:41:55.207979] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.208029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.208039] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.210005] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1434 [D 20:41:55.210025] element 0: offset: 0x635870, size: 24 [D 20:41:55.210039] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 44/70. [D 20:41:55.212508] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1434 [D 20:41:55.212526] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 45/70. [D 20:41:55.230322] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1434 [D 20:41:55.230338] element 0: offset: 0x635870, size: 24 [D 20:41:55.230349] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 46/70. [D 20:41:55.232648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.232662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.232675] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.239982] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.239996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.240007] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.240097] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1437 [D 20:41:55.240113] element 0: offset: 0x657310, size: 24 [D 20:41:55.240122] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 47/70. [D 20:41:55.240175] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1437 [D 20:41:55.240234] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 48/70. [D 20:41:55.257426] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1437 [D 20:41:55.257440] element 0: offset: 0x657310, size: 24 [D 20:41:55.257450] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 49/70. [D 20:41:55.259743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.259757] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.259766] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.268703] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.268718] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.268729] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.268815] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1440 [D 20:41:55.268832] element 0: offset: 0x61fad0, size: 24 [D 20:41:55.268842] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 50/70. [D 20:41:55.271207] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1440 [D 20:41:55.271223] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 51/70. [D 20:41:55.286347] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1440 [D 20:41:55.286362] element 0: offset: 0x61fad0, size: 24 [D 20:41:55.286373] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 52/70. [D 20:41:55.288684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.288698] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.288708] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.293581] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.293594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.293603] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.293726] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1443 [D 20:41:55.293765] element 0: offset: 0x655e70, size: 24 [D 20:41:55.293779] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 53/70. [D 20:41:55.293904] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1443 [D 20:41:55.293932] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 54/70. [D 20:41:55.310966] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1443 [D 20:41:55.311011] element 0: offset: 0x655e70, size: 24 [D 20:41:55.311025] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 55/70. [D 20:41:55.311086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.311098] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.311107] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.316885] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.316899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.316908] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.317006] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1446 [D 20:41:55.317017] element 0: offset: 0x6151c0, size: 24 [D 20:41:55.317027] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 56/70. [D 20:41:55.317091] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1446 [D 20:41:55.317129] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 57/70. [D 20:41:55.416974] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1427 [D 20:41:55.417015] element 0: offset: 0x61f800, size: 24 [D 20:41:55.417028] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 58/70. [D 20:41:55.417125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.417137] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.417146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.423009] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.423024] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.423032] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.423124] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1448 [D 20:41:55.423135] element 0: offset: 0x61ee50, size: 24 [D 20:41:55.423145] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 59/70. [D 20:41:55.423204] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1448 [D 20:41:55.423313] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 60/70. [D 20:41:55.433728] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1431 [D 20:41:55.433773] element 0: offset: 0x66e670, size: 24 [D 20:41:55.433787] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 0/70. [D 20:41:55.433969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.433984] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.433993] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.439234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.439248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.439257] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.441356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1452 [D 20:41:55.441370] element 0: offset: 0x620d50, size: 24 [D 20:41:55.441381] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 1/70. [D 20:41:55.441633] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1452 [D 20:41:55.441652] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 2/70. [D 20:41:55.446361] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1448 [D 20:41:55.446376] element 0: offset: 0x61ee50, size: 24 [D 20:41:55.446386] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 3/70. [D 20:41:55.446491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.446504] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.446513] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.453896] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.453910] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.453918] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.456202] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1455 [D 20:41:55.456244] element 0: offset: 0x61fad0, size: 24 [D 20:41:55.456257] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 4/70. [D 20:41:55.457196] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1455 [D 20:41:55.457216] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 5/70. [D 20:41:55.457424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1452 [D 20:41:55.457438] element 0: offset: 0x620d50, size: 24 [D 20:41:55.457449] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 6/70. [D 20:41:55.457534] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.457548] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.457557] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.480963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.480977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.480986] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.483136] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1458 [D 20:41:55.483150] element 0: offset: 0x691fe0, size: 24 [D 20:41:55.483160] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 7/70. [D 20:41:55.483270] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1458 [D 20:41:55.483332] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 8/70. [D 20:41:55.857052] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1446 [D 20:41:55.857103] element 0: offset: 0x6151c0, size: 24 [D 20:41:55.857117] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 9/70. [D 20:41:55.857273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.857286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.857294] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.862855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.862868] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.862877] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.865081] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1461 [D 20:41:55.865096] element 0: offset: 0x66e670, size: 24 [D 20:41:55.865106] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 10/70. [D 20:41:55.865190] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1461 [D 20:41:55.865226] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 11/70. [D 20:41:55.880208] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1461 [D 20:41:55.880255] element 0: offset: 0x66e670, size: 24 [D 20:41:55.880269] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 12/70. [D 20:41:55.880416] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.880429] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.880438] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.890580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.890594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.890603] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.892804] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1464 [D 20:41:55.892818] element 0: offset: 0x655e70, size: 24 [D 20:41:55.892829] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 13/70. [D 20:41:55.892912] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1464 [D 20:41:55.892943] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 14/70. [D 20:41:56.105914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.105957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.105966] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.108079] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1466 [D 20:41:56.108094] element 0: offset: 0x62b130, size: 24 [D 20:41:56.108106] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 15/70. [D 20:41:56.108224] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1466 [D 20:41:56.108269] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 16/70. [D 20:41:56.124091] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1466 [D 20:41:56.124138] element 0: offset: 0x62b130, size: 24 [D 20:41:56.124152] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 17/70. [D 20:41:56.124299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.124312] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.124321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.129559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.129573] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.129582] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.131662] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1469 [D 20:41:56.131677] element 0: offset: 0x6151c0, size: 24 [D 20:41:56.131687] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 18/70. [D 20:41:56.131794] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1469 [D 20:41:56.131830] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 19/70. [D 20:41:56.148657] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1469 [D 20:41:56.148704] element 0: offset: 0x6151c0, size: 24 [D 20:41:56.148718] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 20/70. [D 20:41:56.148866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.148878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.148887] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.153794] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.153807] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.153816] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.156016] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1472 [D 20:41:56.156030] element 0: offset: 0x657310, size: 24 [D 20:41:56.156040] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 21/70. [D 20:41:56.156148] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1472 [D 20:41:56.156191] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 22/70. [D 20:41:56.172807] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1472 [D 20:41:56.172853] element 0: offset: 0x657310, size: 24 [D 20:41:56.172867] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 23/70. [D 20:41:56.173014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.173027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.173035] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.177873] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.177887] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.177896] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.180100] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1475 [D 20:41:56.180115] element 0: offset: 0x620d50, size: 24 [D 20:41:56.180125] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 24/70. [D 20:41:56.180234] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1475 [D 20:41:56.180276] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 25/70. [D 20:41:56.196101] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1475 [D 20:41:56.196148] element 0: offset: 0x620d50, size: 24 [D 20:41:56.196161] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 26/70. [D 20:41:56.196308] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.196320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.196329] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.200880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.200893] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.200902] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.203111] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1478 [D 20:41:56.203126] element 0: offset: 0x66e670, size: 24 [D 20:41:56.203136] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 27/70. [D 20:41:56.203253] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1478 [D 20:41:56.203281] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 28/70. [D 20:41:56.460673] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1455 [D 20:41:56.460708] element 0: offset: 0x61fad0, size: 24 [D 20:41:56.460721] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 29/70. [D 20:41:56.460884] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.460897] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.460906] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.467111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.467125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.467133] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.469501] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1482 [D 20:41:56.469515] element 0: offset: 0x5b0030, size: 24 [D 20:41:56.469525] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 30/70. [D 20:41:56.469639] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1482 [D 20:41:56.469693] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 31/70. [D 20:41:56.477101] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1458 [D 20:41:56.477153] element 0: offset: 0x691fe0, size: 24 [D 20:41:56.477168] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 32/70. [D 20:41:56.477320] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.477333] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.477341] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.483751] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.483765] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.483774] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.485688] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1485 [D 20:41:56.485702] element 0: offset: 0x620d50, size: 24 [D 20:41:56.485713] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 33/70. [D 20:41:56.488505] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1482 [D 20:41:56.488519] element 0: offset: 0x5b0030, size: 24 [D 20:41:56.488529] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 34/70. [D 20:41:56.488566] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1485 [D 20:41:56.488583] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 35/70. [D 20:41:56.488610] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.488619] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.488627] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.500879] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.500895] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.500904] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.500955] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1488 [D 20:41:56.500966] element 0: offset: 0x61fad0, size: 24 [D 20:41:56.500976] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 36/70. [D 20:41:56.501041] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1488 [D 20:41:56.501088] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 37/70. [D 20:41:56.504901] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1485 [D 20:41:56.504940] element 0: offset: 0x620d50, size: 24 [D 20:41:56.504953] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 38/70. [D 20:41:56.505067] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.505081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.505090] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.514087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.514101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.514110] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.516359] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1491 [D 20:41:56.516374] element 0: offset: 0x61ee50, size: 24 [D 20:41:56.516385] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 39/70. [D 20:41:56.516489] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1491 [D 20:41:56.516531] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 40/70. [D 20:41:56.666590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1464 [D 20:41:56.666641] element 0: offset: 0x655e70, size: 24 [D 20:41:56.666656] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 41/70. [D 20:41:56.666815] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.666828] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.666837] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.672427] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.672441] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.672450] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.674674] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1494 [D 20:41:56.674688] element 0: offset: 0x691fe0, size: 24 [D 20:41:56.674699] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 42/70. [D 20:41:56.674819] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1494 [D 20:41:56.674859] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 43/70. [D 20:41:56.691226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1494 [D 20:41:56.691272] element 0: offset: 0x691fe0, size: 24 [D 20:41:56.691286] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 44/70. [D 20:41:56.691433] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.691446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.691454] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:57.061041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1478 [D 20:41:57.061093] element 0: offset: 0x66e670, size: 24 [D 20:41:57.061109] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 45/70. [D 20:41:57.061277] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.061291] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.061300] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:57.067648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.067663] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.067671] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:57.069737] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1496 [D 20:41:57.069752] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.069762] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 46/70. [D 20:41:57.069875] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1496 [D 20:41:57.069923] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 47/70. [D 20:41:57.087083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1496 [D 20:41:57.087129] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.087143] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 48/70. [D 20:41:57.087288] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.087301] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.087309] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:57.092648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.092661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.092670] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:57.094771] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1499 [D 20:41:57.094786] element 0: offset: 0x646f40, size: 24 [D 20:41:57.094796] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 49/70. [D 20:41:57.094906] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1499 [D 20:41:57.094957] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 50/70. [D 20:41:57.111547] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1499 [D 20:41:57.111594] element 0: offset: 0x646f40, size: 24 [D 20:41:57.111608] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 51/70. [D 20:41:57.111754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.111767] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.111776] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:57.116855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.116869] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.116877] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:57.117741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1502 [D 20:41:57.117755] element 0: offset: 0x66e670, size: 24 [D 20:41:57.117766] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 52/70. [D 20:41:57.117862] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1502 [D 20:41:57.117914] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 53/70. [D 20:41:57.135577] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1502 [D 20:41:57.135622] element 0: offset: 0x66e670, size: 24 [D 20:41:57.135635] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 54/70. [D 20:41:57.135781] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.135794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.135803] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:57.142567] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1488 [D 20:41:57.142582] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.142592] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 55/70. [D 20:41:57.142665] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.142679] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.142687] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.149287] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.149300] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.149308] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.151609] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1506 [D 20:41:57.151623] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.151633] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 56/70. [D 20:41:57.151744] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1506 [D 20:41:57.151807] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 57/70. [D 20:41:57.161089] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1491 [D 20:41:57.161140] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.161155] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 58/70. [D 20:41:57.161309] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.161323] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.161331] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.167549] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.167564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.167573] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.169673] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1509 [D 20:41:57.169728] element 0: offset: 0x6358f0, size: 24 [D 20:41:57.169741] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 59/70. [D 20:41:57.172104] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1509 [D 20:41:57.172130] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 60/70. [D 20:41:57.172153] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1506 [D 20:41:57.174361] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.174374] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 0/70. [D 20:41:57.174472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.174487] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.174501] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.187299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.187314] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.187322] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.188366] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1512 [D 20:41:57.188377] element 0: offset: 0x655e70, size: 24 [D 20:41:57.188387] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 1/70. [D 20:41:57.188419] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1509 [D 20:41:57.188429] element 0: offset: 0x6358f0, size: 24 [D 20:41:57.188439] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 2/70. [D 20:41:57.190752] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1512 [D 20:41:57.190768] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 3/70. [D 20:41:57.190785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.190798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.190810] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.204808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.204823] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.204834] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.204900] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1515 [D 20:41:57.204914] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.204924] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 4/70. [D 20:41:57.207884] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1515 [D 20:41:57.207909] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 5/70. [D 20:41:57.212296] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1512 [D 20:41:57.212348] element 0: offset: 0x655e70, size: 24 [D 20:41:57.212362] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 6/70. [D 20:41:57.212466] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.212508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.212519] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.223682] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.223697] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.223707] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.223744] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1515 [D 20:41:57.223753] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.223763] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 7/70. [D 20:41:57.223813] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.223823] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.223832] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.223877] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1518 [D 20:41:57.223896] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.223906] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 8/70. [D 20:41:57.226217] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1518 [D 20:41:57.226236] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 9/70. [D 20:41:57.240710] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.240724] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.240736] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.240789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1521 [D 20:41:57.240802] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.240811] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 10/70. [D 20:41:57.240919] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1521 [D 20:41:57.240980] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 11/70. [D 20:41:57.301810] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.301826] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.301836] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:57.302497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1524 [D 20:41:57.302511] element 0: offset: 0x655e70, size: 24 [D 20:41:57.302523] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 12/70. [D 20:41:57.302617] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1524 [D 20:41:57.302681] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 13/70. [D 20:41:57.619655] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1518 [D 20:41:57.619699] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.619713] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 14/70. [D 20:41:57.622297] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.622313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.622324] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:57.772750] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1521 [D 20:41:57.772811] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.772828] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 15/70. [D 20:41:57.775174] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.775189] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.775200] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.782027] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.782042] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.782053] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.782185] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1527 [D 20:41:57.782199] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.782210] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 16/70. [D 20:41:57.784908] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1527 [D 20:41:57.784974] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 17/70. [D 20:41:57.792218] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1524 [D 20:41:57.792278] element 0: offset: 0x655e70, size: 24 [D 20:41:57.792293] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 18/70. [D 20:41:57.792450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.792466] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.792475] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.800761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.800775] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.800784] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.800821] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1527 [D 20:41:57.800831] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.800840] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 19/70. [D 20:41:57.800886] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.800896] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.800904] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.800948] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1530 [D 20:41:57.800967] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.803085] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 20/70. [D 20:41:57.803157] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1530 [D 20:41:57.806562] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 21/70. [D 20:41:57.822441] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1530 [D 20:41:57.822456] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.822467] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 22/70. [D 20:41:57.824749] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.824762] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.824771] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:57.833780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.833794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.833805] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:57.833890] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1533 [D 20:41:57.833908] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.833918] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 23/70. [D 20:41:57.836259] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1533 [D 20:41:57.836275] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 24/70. [D 20:41:57.850547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.850562] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.850570] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.850672] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1535 [D 20:41:57.850683] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.850692] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 25/70. [D 20:41:57.850746] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1535 [D 20:41:57.850801] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 26/70. [D 20:41:57.851786] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1533 [D 20:41:57.851801] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.851811] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 27/70. [D 20:41:57.851892] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.851905] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.851929] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.867829] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.867845] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.867856] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.867924] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1539 [D 20:41:57.867936] element 0: offset: 0x655e70, size: 24 [D 20:41:57.867945] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 28/70. [D 20:41:57.873368] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1535 [D 20:41:57.873421] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.873435] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 29/70. [D 20:41:57.873485] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1539 [D 20:41:57.873501] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 30/70. [D 20:41:57.873758] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.873772] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.873783] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.892579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.892601] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.892610] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.893998] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1539 [D 20:41:57.894011] element 0: offset: 0x655e70, size: 24 [D 20:41:57.894021] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 31/70. [D 20:41:57.894084] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1541 [D 20:41:57.894101] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.894161] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 32/70. [D 20:41:57.896726] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.896741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.896750] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.896778] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1541 [D 20:41:57.896790] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 33/70. [D 20:41:57.909118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.909133] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.909145] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.909236] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1545 [D 20:41:57.909247] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.909256] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 34/70. [D 20:41:57.911630] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1545 [D 20:41:57.911646] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 35/70. [D 20:41:57.911679] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1541 [D 20:41:57.911690] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.911699] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 36/70. [D 20:41:57.911781] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.911806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.911816] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.925316] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.925331] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.925339] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.925433] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1547 [D 20:41:57.925444] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.925453] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 37/70. [D 20:41:57.925547] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1547 [D 20:41:57.925608] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 38/70. [D 20:41:57.927929] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1545 [D 20:41:57.927942] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.927953] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 39/70. [D 20:41:57.928035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.928063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.928072] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.940591] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.940606] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.940617] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.940701] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1551 [D 20:41:57.940715] element 0: offset: 0x691fe0, size: 24 [D 20:41:57.940725] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 40/70. [D 20:41:57.947116] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1551 [D 20:41:57.947170] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 41/70. [D 20:41:58.088935] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1547 [D 20:41:58.089001] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.089016] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 42/70. [D 20:41:58.091462] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.091478] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.091487] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:58.097537] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.097553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.097564] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:58.097746] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1553 [D 20:41:58.097760] element 0: offset: 0x620d50, size: 24 [D 20:41:58.097772] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 43/70. [D 20:41:58.100276] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1553 [D 20:41:58.100294] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 44/70. [D 20:41:58.116982] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1553 [D 20:41:58.116997] element 0: offset: 0x620d50, size: 24 [D 20:41:58.117007] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 45/70. [D 20:41:58.119187] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.119200] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.119211] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:58.124627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.124641] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.124652] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:58.124733] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1556 [D 20:41:58.124748] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.124758] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 46/70. [D 20:41:58.124811] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1556 [D 20:41:58.124867] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 47/70. [D 20:41:58.140847] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1556 [D 20:41:58.140862] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.140873] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 48/70. [D 20:41:58.143047] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.143060] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.143071] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:58.153148] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.153161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.153172] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:58.153257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1559 [D 20:41:58.153272] element 0: offset: 0x5b0030, size: 24 [D 20:41:58.153282] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 49/70. [D 20:41:58.155640] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1559 [D 20:41:58.155655] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 50/70. [D 20:41:58.172335] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1559 [D 20:41:58.172395] element 0: offset: 0x5b0030, size: 24 [D 20:41:58.172410] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 51/70. [D 20:41:58.173773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.173788] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.173799] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:58.179752] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.179766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.179777] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:58.179854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1562 [D 20:41:58.179868] element 0: offset: 0x6358f0, size: 24 [D 20:41:58.179878] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 52/70. [D 20:41:58.182219] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1562 [D 20:41:58.182237] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 53/70. [D 20:41:58.197267] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1562 [D 20:41:58.197282] element 0: offset: 0x6358f0, size: 24 [D 20:41:58.197292] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 54/70. [D 20:41:58.197777] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.197790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.197800] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:58.204610] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.204623] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.204634] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:58.204717] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1565 [D 20:41:58.204741] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.204752] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 55/70. [D 20:41:58.207218] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1565 [D 20:41:58.207234] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 56/70. [D 20:41:58.404937] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.404971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.404981] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:58.405155] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1569 [D 20:41:58.405166] element 0: offset: 0x5b0030, size: 24 [D 20:41:58.405177] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 57/70. [D 20:41:58.407541] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1569 [D 20:41:58.407558] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 58/70. [D 20:41:58.661791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.661830] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.661840] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.662205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1572 [D 20:41:58.662220] element 0: offset: 0x61f310, size: 24 [D 20:41:58.662232] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 59/70. [D 20:41:58.662361] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1572 [D 20:41:58.662396] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 60/70. [D 20:41:58.678428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1572 [D 20:41:58.678443] element 0: offset: 0x61f310, size: 24 [D 20:41:58.678453] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 0/70. [D 20:41:58.680794] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.680808] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.680817] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.686503] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.686516] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.686527] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.686612] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1575 [D 20:41:58.686636] element 0: offset: 0x61ee50, size: 24 [D 20:41:58.686648] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 1/70. [D 20:41:58.686699] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1575 [D 20:41:58.686754] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 2/70. [D 20:41:58.703723] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1575 [D 20:41:58.703739] element 0: offset: 0x61ee50, size: 24 [D 20:41:58.703749] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 3/70. [D 20:41:58.706141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.706156] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.706166] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.712184] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.712200] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.712208] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.714248] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1578 [D 20:41:58.714261] element 0: offset: 0x66e730, size: 24 [D 20:41:58.714271] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 4/70. [D 20:41:58.714367] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1578 [D 20:41:58.714420] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 5/70. [D 20:41:58.731994] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1578 [D 20:41:58.732054] element 0: offset: 0x66e730, size: 24 [D 20:41:58.732069] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 6/70. [D 20:41:58.734393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.734408] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.734419] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.739866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.739879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.739890] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.740004] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1581 [D 20:41:58.740022] element 0: offset: 0x620d50, size: 24 [D 20:41:58.740033] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 7/70. [D 20:41:58.742540] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1581 [D 20:41:58.742558] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 8/70. [D 20:41:58.757531] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1581 [D 20:41:58.757546] element 0: offset: 0x620d50, size: 24 [D 20:41:58.757556] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 9/70. [D 20:41:58.757787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.757801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.757821] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.765259] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.765272] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.765282] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.765370] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1584 [D 20:41:58.765396] element 0: offset: 0x61f800, size: 24 [D 20:41:58.765408] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 10/70. [D 20:41:58.767865] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1584 [D 20:41:58.767880] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 11/70. [D 20:41:58.782620] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1584 [D 20:41:58.782635] element 0: offset: 0x61f800, size: 24 [D 20:41:58.782646] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 12/70. [D 20:41:58.784966] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.784980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.784989] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.790304] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.790318] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.790329] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.790413] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1587 [D 20:41:58.790428] element 0: offset: 0x655e70, size: 24 [D 20:41:58.790437] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 13/70. [D 20:41:58.790532] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1587 [D 20:41:58.790595] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 14/70. [D 20:41:58.806581] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1587 [D 20:41:58.806595] element 0: offset: 0x655e70, size: 24 [D 20:41:58.806606] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 15/70. [D 20:41:58.808930] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.808944] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.808953] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.813788] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.813802] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.813811] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.814235] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1590 [D 20:41:58.814248] element 0: offset: 0x61ee50, size: 24 [D 20:41:58.814259] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 16/70. [D 20:41:58.814354] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1590 [D 20:41:58.814418] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 17/70. [D 20:41:58.892736] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1565 [D 20:41:58.892769] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.892781] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 18/70. [D 20:41:58.895159] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.895174] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.895184] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.901917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1551 [D 20:41:58.901935] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.901947] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 19/70. [D 20:41:58.904126] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.904139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.904149] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:58.910614] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.910628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.910639] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:58.910761] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1593 [D 20:41:58.910779] element 0: offset: 0x655e70, size: 24 [D 20:41:58.910789] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 20/70. [D 20:41:58.913306] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1593 [D 20:41:58.913326] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 21/70. [D 20:41:58.930209] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1593 [D 20:41:58.930269] element 0: offset: 0x655e70, size: 24 [D 20:41:58.930284] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 22/70. [D 20:41:58.932579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.932594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.932604] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:58.938718] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.938731] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.938742] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:58.938822] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1596 [D 20:41:58.938834] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.938845] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 23/70. [D 20:41:58.938952] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1596 [D 20:41:58.939004] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 24/70. [D 20:41:58.954211] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1596 [D 20:41:58.954226] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.954236] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 25/70. [D 20:41:58.956585] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.956599] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.956608] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:59.214109] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1569 [D 20:41:59.214177] element 0: offset: 0x5b0030, size: 24 [D 20:41:59.214262] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 26/70. [D 20:41:59.216646] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.216661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.216671] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.223095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.223110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.223119] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.223287] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1599 [D 20:41:59.223299] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.223309] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 27/70. [D 20:41:59.225916] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1599 [D 20:41:59.225951] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 28/70. [D 20:41:59.317642] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1590 [D 20:41:59.317672] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.317686] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 29/70. [D 20:41:59.320296] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.320311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.320379] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.326558] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.326644] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.326655] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.326797] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1602 [D 20:41:59.326812] element 0: offset: 0x61fad0, size: 24 [D 20:41:59.326823] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 30/70. [D 20:41:59.329554] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1602 [D 20:41:59.329572] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 31/70. [D 20:41:59.344467] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1602 [D 20:41:59.344528] element 0: offset: 0x61fad0, size: 24 [D 20:41:59.344543] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 32/70. [D 20:41:59.347014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.347029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.347040] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.445393] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1599 [D 20:41:59.445463] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.445480] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 33/70. [D 20:41:59.445843] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.445859] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.445869] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.454486] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.454501] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.454512] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.454629] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1605 [D 20:41:59.454648] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.454659] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 34/70. [D 20:41:59.457044] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1605 [D 20:41:59.457062] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 35/70. [D 20:41:59.473589] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1605 [D 20:41:59.473648] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.473663] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 36/70. [D 20:41:59.475850] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.475865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.475875] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.481831] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.481845] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.481856] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.482487] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1608 [D 20:41:59.482501] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.482512] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 37/70. [D 20:41:59.482618] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1608 [D 20:41:59.482675] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 38/70. [D 20:41:59.499376] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1608 [D 20:41:59.499391] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.499401] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 39/70. [D 20:41:59.501575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.501588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.501598] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.508022] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.508036] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.508047] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.508129] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1611 [D 20:41:59.508144] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.508153] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 40/70. [D 20:41:59.510528] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1611 [D 20:41:59.510544] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 41/70. [D 20:41:59.526117] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1611 [D 20:41:59.526133] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.526143] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 42/70. [D 20:41:59.528487] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.528501] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.528511] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.534801] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.534815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.534826] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.534909] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1614 [D 20:41:59.534924] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.534934] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 43/70. [D 20:41:59.535031] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1614 [D 20:41:59.535089] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 44/70. [D 20:41:59.622323] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1614 [D 20:41:59.622391] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.622456] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 45/70. [D 20:41:59.624756] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.624771] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.624781] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.631582] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.631599] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.631610] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.631693] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1617 [D 20:41:59.631706] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.631717] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 46/70. [D 20:41:59.631825] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1617 [D 20:41:59.631875] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 47/70. [D 20:41:59.647436] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.647452] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.647463] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.649896] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1619 [D 20:41:59.649956] element 0: offset: 0x61fad0, size: 24 [D 20:41:59.649973] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 48/70. [D 20:41:59.652367] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1619 [D 20:41:59.652434] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 49/70. [D 20:41:59.653841] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1617 [D 20:41:59.653860] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.655466] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 50/70. [D 20:41:59.655564] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.655578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.655600] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.667514] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.667531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.667541] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.668319] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1623 [D 20:41:59.668330] element 0: offset: 0x66e730, size: 24 [D 20:41:59.668341] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 51/70. [D 20:41:59.668360] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1619 [D 20:41:59.668370] element 0: offset: 0x2aaaab203f80, size: 24 [D 20:41:59.668392] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 52/70. [D 20:41:59.670953] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1623 [D 20:41:59.670971] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 53/70. [D 20:41:59.670989] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.670999] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.671056] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.685310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.685326] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.685334] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.685355] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.685364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.685373] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:59.686425] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1623 [D 20:41:59.686437] element 0: offset: 0x2aaaab2009f0, size: 24 [D 20:41:59.686447] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 54/70. [D 20:41:59.686479] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1626 [D 20:41:59.686489] element 0: offset: 0x2aaaab200ac0, size: 24 [D 20:41:59.686499] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 55/70. [D 20:41:59.686512] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1628 [D 20:41:59.686525] element 0: offset: 0x2aaaab207c30, size: 24 [D 20:41:59.686550] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 56/70. [D 20:41:59.689187] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.689201] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.689210] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:59.689231] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1626 [D 20:41:59.689243] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 57/70. [D 20:41:59.689266] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1628 [D 20:41:59.689278] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 58/70. [D 20:41:59.719256] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1626 [D 20:41:59.719319] element 0: offset: 0x2aaaab2069c0, size: 24 [D 20:41:59.719335] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 59/70. [D 20:41:59.721638] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.721653] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.721664] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.721698] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1628 [D 20:41:59.721709] element 0: offset: 0x2aaaab207c30, size: 24 [D 20:41:59.721721] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 60/70. [D 20:41:59.721781] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.721806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.721816] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.727690] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.727704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.727715] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.727831] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1632 [D 20:41:59.727849] element 0: offset: 0x2aaaab207c70, size: 24 [D 20:41:59.727860] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 0/70. [D 20:41:59.727924] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1632 [D 20:41:59.727974] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 1/70. [D 20:41:59.741780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.741794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.741803] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.743242] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1632 [D 20:41:59.743254] element 0: offset: 0x2aaaab207c70, size: 24 [D 20:41:59.743263] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 2/70. [D 20:41:59.743302] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1634 [D 20:41:59.743313] element 0: offset: 0x2aaaab209460, size: 24 [D 20:41:59.743323] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 3/70. [D 20:41:59.745786] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.745799] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.745809] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.745832] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1634 [D 20:41:59.745844] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 4/70. [D 20:41:59.760661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.760675] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.760686] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.760738] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1638 [D 20:41:59.760750] element 0: offset: 0x2aaaab202ed0, size: 24 [D 20:41:59.760759] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 5/70. [D 20:41:59.765718] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1634 [D 20:41:59.765772] element 0: offset: 0x2aaaab209460, size: 24 [D 20:41:59.765787] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 6/70. [D 20:41:59.765843] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1638 [D 20:41:59.765866] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 7/70. [D 20:41:59.768092] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.768106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.768116] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.781066] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.781081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.781092] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.781183] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1640 [D 20:41:59.781210] element 0: offset: 0x2aaaab2092d0, size: 24 [D 20:41:59.781221] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 8/70. [D 20:41:59.781844] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1640 [D 20:41:59.783593] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 9/70. [D 20:42:00.060854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.060914] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.060924] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:00.061083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1644 [D 20:42:00.061096] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.061108] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 10/70. [D 20:42:00.064329] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1644 [D 20:42:00.064350] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 11/70. [D 20:42:00.082337] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1644 [D 20:42:00.082403] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.082417] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 12/70. [D 20:42:00.084601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.084616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.084626] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:00.086782] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1638 [D 20:42:00.086836] element 0: offset: 0x2aaaab202ed0, size: 24 [D 20:42:00.086853] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 13/70. [D 20:42:00.089023] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.089038] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.089048] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:00.093855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.093869] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.093881] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:00.096177] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.096191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.096200] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:00.096222] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1648 [D 20:42:00.096232] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.096243] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 14/70. [D 20:42:00.096261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1650 [D 20:42:00.096273] element 0: offset: 0x2aaaab206930, size: 24 [D 20:42:00.096283] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 15/70. [D 20:42:00.098840] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1648 [D 20:42:00.098859] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 16/70. [D 20:42:00.098886] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1650 [D 20:42:00.098898] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 17/70. [D 20:42:00.285083] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.285148] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.285158] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.285243] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1653 [D 20:42:00.285257] element 0: offset: 0x2aaaab203200, size: 24 [D 20:42:00.285271] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 18/70. [D 20:42:00.287791] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1653 [D 20:42:00.287810] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 19/70. [D 20:42:00.303488] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1653 [D 20:42:00.303506] element 0: offset: 0x2aaaab203200, size: 24 [D 20:42:00.303517] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 20/70. [D 20:42:00.305686] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.305700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.305710] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.311780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.311795] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.311807] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.311894] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1656 [D 20:42:00.311912] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.311922] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 21/70. [D 20:42:00.314403] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1656 [D 20:42:00.314418] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 22/70. [D 20:42:00.329261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1656 [D 20:42:00.329277] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.329287] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 23/70. [D 20:42:00.329857] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.329871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.329881] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.337014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.337027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.337038] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.337125] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1659 [D 20:42:00.337140] element 0: offset: 0x2aaaab203200, size: 24 [D 20:42:00.337151] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 24/70. [D 20:42:00.339499] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1659 [D 20:42:00.339515] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 25/70. [D 20:42:00.355147] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1659 [D 20:42:00.355162] element 0: offset: 0x2aaaab203200, size: 24 [D 20:42:00.355173] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 26/70. [D 20:42:00.357457] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.357470] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.357480] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.362975] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.362989] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.363000] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.363083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1662 [D 20:42:00.363100] element 0: offset: 0x2aaaab207c10, size: 24 [D 20:42:00.363110] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 27/70. [D 20:42:00.363205] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1662 [D 20:42:00.363262] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 28/70. [D 20:42:00.378911] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1662 [D 20:42:00.378926] element 0: offset: 0x2aaaab207c10, size: 24 [D 20:42:00.378937] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 29/70. [D 20:42:00.381231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.381244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.381253] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.386562] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.386575] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.386587] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.386671] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1665 [D 20:42:00.386689] element 0: offset: 0x2aaaab20beb0, size: 24 [D 20:42:00.386699] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 30/70. [D 20:42:00.386794] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1665 [D 20:42:00.386847] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 31/70. [D 20:42:00.570037] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1648 [D 20:42:00.570157] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.570172] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 32/70. [D 20:42:00.572325] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.572340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.572351] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.577868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.577882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.577894] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.578273] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1668 [D 20:42:00.578286] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.578297] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 33/70. [D 20:42:00.578410] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1668 [D 20:42:00.578450] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 34/70. [D 20:42:00.596535] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1668 [D 20:42:00.596598] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.596614] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 35/70. [D 20:42:00.598799] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.598814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.598825] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.604472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.604486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.604496] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.604575] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1671 [D 20:42:00.604588] element 0: offset: 0x2aaaab206770, size: 24 [D 20:42:00.604598] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 36/70. [D 20:42:00.604709] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1671 [D 20:42:00.604745] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 37/70. [D 20:42:00.621956] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1671 [D 20:42:00.622017] element 0: offset: 0x2aaaab206770, size: 24 [D 20:42:00.622031] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 38/70. [D 20:42:00.624198] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.624212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.624222] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.629842] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.629860] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.629871] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.629949] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1674 [D 20:42:00.629962] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.629973] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 39/70. [D 20:42:00.630084] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1674 [D 20:42:00.630130] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 40/70. [D 20:42:00.647292] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1674 [D 20:42:00.647357] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.647373] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 41/70. [D 20:42:00.649608] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.649628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.649638] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.653868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.653883] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.653893] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.655205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1677 [D 20:42:00.655218] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.655229] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 42/70. [D 20:42:00.655336] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1677 [D 20:42:00.655456] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 43/70. [D 20:42:00.673036] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1677 [D 20:42:00.673100] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.673116] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 44/70. [D 20:42:00.675523] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.675539] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.675549] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.680895] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.680954] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.680964] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.686518] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1680 [D 20:42:00.686585] element 0: offset: 0x2aaaab207c10, size: 24 [D 20:42:00.686601] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 45/70. [D 20:42:00.686625] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1665 [D 20:42:00.686635] element 0: offset: 0x2aaaab20beb0, size: 24 [D 20:42:00.686646] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 46/70. [D 20:42:00.686659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1650 [D 20:42:00.686669] element 0: offset: 0x2aaaab206930, size: 24 [D 20:42:00.686687] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 47/70. [D 20:42:00.686754] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1640 [D 20:42:00.686779] element 0: offset: 0x2aaaab2092d0, size: 24 [D 20:42:00.686791] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 48/70. [D 20:42:00.688973] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1680 [D 20:42:00.688991] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 49/70. [D 20:42:00.689023] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.689034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.689043] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.689060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.689069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.689081] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:00.689095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.689120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.689129] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:00.701868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.701882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.701893] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:00.701924] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.701934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.701943] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:00.701960] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.701970] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.701979] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.702002] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1682 [D 20:42:00.702013] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.702038] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 50/70. [D 20:42:00.702052] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1686 [D 20:42:00.702061] element 0: offset: 0x2aaaab20beb0, size: 24 [D 20:42:00.702092] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 51/70. [D 20:42:00.702168] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1689 [D 20:42:00.702181] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.702195] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 52/70. [D 20:42:00.702237] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1682 [D 20:42:00.702256] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 53/70. [D 20:42:00.702312] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1686 [D 20:42:00.702328] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 54/70. [D 20:42:00.702367] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1689 [D 20:42:00.702383] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 55/70. [D 20:42:00.707660] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1680 [D 20:42:00.707677] element 0: offset: 0x63a130, size: 24 [D 20:42:00.707690] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 56/70. [D 20:42:00.707812] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.707828] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.707839] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.743871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.743887] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.743898] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.743961] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1692 [D 20:42:00.743974] element 0: offset: 0x61fad0, size: 24 [D 20:42:00.743986] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 57/70. [D 20:42:00.744084] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1692 [D 20:42:00.744153] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 58/70. [D 20:42:01.140638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1682 [D 20:42:01.140694] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.140711] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 59/70. [D 20:42:01.140896] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.140912] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.140923] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:01.146804] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.146821] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.146831] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:01.146931] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1694 [D 20:42:01.146944] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.146957] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 60/70. [D 20:42:01.147029] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1694 [D 20:42:01.147083] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 0/70. [D 20:42:01.164801] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1694 [D 20:42:01.164819] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.164832] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 1/70. [D 20:42:01.164877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.164890] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.164900] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:01.173125] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1689 [D 20:42:01.173141] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.173154] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 2/70. [D 20:42:01.173233] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.173248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.173259] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:01.175626] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.175643] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.175653] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:01.175705] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1697 [D 20:42:01.175718] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.175730] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 3/70. [D 20:42:01.175789] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1697 [D 20:42:01.175849] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 4/70. [D 20:42:01.188830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.188880] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.188892] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:01.189005] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1701 [D 20:42:01.189019] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.189034] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 5/70. [D 20:42:01.189143] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1701 [D 20:42:01.189194] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 6/70. [D 20:42:01.189414] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1686 [D 20:42:01.189432] element 0: offset: 0x61f310, size: 24 [D 20:42:01.189444] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 7/70. [D 20:42:01.189547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.189563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.189573] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:01.193569] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1697 [D 20:42:01.193619] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.193634] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 8/70. [D 20:42:01.193798] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.193814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.193824] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:01.201128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.201144] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.201155] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:01.201258] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1704 [D 20:42:01.201270] element 0: offset: 0x61f0e0, size: 24 [D 20:42:01.201282] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 9/70. [D 20:42:01.201382] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1704 [D 20:42:01.201436] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 10/70. [D 20:42:01.207781] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1701 [D 20:42:01.207830] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.207846] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 11/70. [D 20:42:01.207979] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.207992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.208004] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:01.210421] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1692 [D 20:42:01.210457] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.210474] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 12/70. [D 20:42:01.210618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.210680] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.210691] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:01.213893] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.213908] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.213917] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:01.215759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1706 [D 20:42:01.215771] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.215784] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 13/70. [D 20:42:01.215856] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1706 [D 20:42:01.215884] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 14/70. [D 20:42:01.217237] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1704 [D 20:42:01.217252] element 0: offset: 0x61f0e0, size: 24 [D 20:42:01.218225] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 15/70. [D 20:42:01.218323] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.218335] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.218349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:01.232201] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.232217] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.232225] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:01.232332] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1710 [D 20:42:01.232343] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.232352] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 16/70. [D 20:42:01.232445] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1710 [D 20:42:01.232502] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 17/70. [D 20:42:01.233225] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1706 [D 20:42:01.233240] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.234926] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 18/70. [D 20:42:01.235021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.235034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.235043] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:01.249684] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1710 [D 20:42:01.249756] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.249772] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 19/70. [D 20:42:01.252104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.252118] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.252128] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:01.257587] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.257601] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.257610] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:01.257697] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1713 [D 20:42:01.257728] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.257740] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 20/70. [D 20:42:01.260192] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1713 [D 20:42:01.260210] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 21/70. [D 20:42:01.278525] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.278540] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.278548] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:01.278649] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1716 [D 20:42:01.278659] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.278668] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 22/70. [D 20:42:01.281025] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1716 [D 20:42:01.281041] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 23/70. [D 20:42:01.281056] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1713 [D 20:42:01.281065] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.281083] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 24/70. [D 20:42:01.281156] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.281168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.281178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:01.293812] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1716 [D 20:42:01.293826] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.293837] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 25/70. [D 20:42:01.296093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.296107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.296116] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:01.835778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.835815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.835825] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:01.835977] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1719 [D 20:42:01.835989] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.836001] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 26/70. [D 20:42:01.838483] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1719 [D 20:42:01.838501] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 27/70. [D 20:42:01.854650] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1719 [D 20:42:01.854665] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.854675] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 28/70. [D 20:42:01.856967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.856980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.856990] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:01.865924] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.865938] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.865950] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:01.867807] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1722 [D 20:42:01.867821] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.867832] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 29/70. [D 20:42:01.867930] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1722 [D 20:42:01.867991] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 30/70. [D 20:42:01.886353] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1722 [D 20:42:01.886418] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.886432] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 31/70. [D 20:42:01.888671] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.888686] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.888696] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:01.895668] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.895686] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.895698] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:01.895803] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1725 [D 20:42:01.895817] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.895828] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 32/70. [D 20:42:01.895939] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1725 [D 20:42:01.895997] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 33/70. [D 20:42:01.912710] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1725 [D 20:42:01.912725] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.912736] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 34/70. [D 20:42:01.913922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.913936] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.913946] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:01.921465] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.921480] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.921490] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:01.921573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1728 [D 20:42:01.921592] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.921601] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 35/70. [D 20:42:01.921697] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1728 [D 20:42:01.921759] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 36/70. [D 20:42:01.939016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.939032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.939041] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:01.939067] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1728 [D 20:42:01.939079] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.939089] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 37/70. [D 20:42:01.939207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1731 [D 20:42:01.939220] element 0: offset: 0x636d10, size: 24 [D 20:42:01.939238] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 38/70. [D 20:42:01.939273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.939284] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.939293] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:01.941631] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1731 [D 20:42:01.944728] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 39/70. [D 20:42:01.957689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.957704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.957713] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:01.957736] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.957746] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.957754] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:01.959169] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1731 [D 20:42:01.959181] element 0: offset: 0x636d10, size: 24 [D 20:42:01.959192] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 40/70. [D 20:42:01.959225] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1734 [D 20:42:01.959234] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.959244] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 41/70. [D 20:42:01.959257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1736 [D 20:42:01.959270] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.959299] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 42/70. [D 20:42:01.961648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.961661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.961672] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:01.961696] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1734 [D 20:42:01.961722] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1736 [D 20:42:01.962616] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 43/70. [D 20:42:01.962697] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 44/70. [D 20:42:01.993381] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.993445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.993456] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:01.993506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.993516] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.993525] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:01.993555] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1734 [D 20:42:01.993566] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.993579] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 45/70. [D 20:42:01.993599] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1736 [D 20:42:01.993609] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.993666] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 46/70. [D 20:42:01.993687] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1740 [D 20:42:01.993697] element 0: offset: 0x63dc60, size: 24 [D 20:42:01.993706] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 47/70. [D 20:42:01.993721] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1743 [D 20:42:01.993730] element 0: offset: 0x61f310, size: 24 [D 20:42:01.993740] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 48/70. [D 20:42:01.996084] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.996098] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.996108] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:01.996125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.996137] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.996146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:01.996183] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1740 [D 20:42:01.996212] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1743 [D 20:42:01.996605] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 49/70. [D 20:42:01.996678] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 50/70. [D 20:42:02.023879] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.023911] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.023920] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.023946] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.023955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.023964] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.028226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1746 [D 20:42:02.028239] element 0: offset: 0x5b0030, size: 24 [D 20:42:02.028250] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 51/70. [D 20:42:02.028266] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1748 [D 20:42:02.028276] element 0: offset: 0x61f800, size: 24 [D 20:42:02.028286] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 52/70. [D 20:42:02.028301] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1743 [D 20:42:02.028330] element 0: offset: 0x61f310, size: 24 [D 20:42:02.028340] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 53/70. [D 20:42:02.028359] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1740 [D 20:42:02.028368] element 0: offset: 0x63dc60, size: 24 [D 20:42:02.028377] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 54/70. [D 20:42:02.030993] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1746 [D 20:42:02.031009] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 55/70. [D 20:42:02.031033] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1748 [D 20:42:02.031045] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 56/70. [D 20:42:02.031066] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.031076] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.031088] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.031104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.031113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.031121] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.058982] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.058996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.059005] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.059025] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.059034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.059043] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.061981] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1752 [D 20:42:02.062042] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.062057] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 57/70. [D 20:42:02.062081] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1755 [D 20:42:02.062091] element 0: offset: 0x657310, size: 24 [D 20:42:02.062100] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 58/70. [D 20:42:02.062118] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1746 [D 20:42:02.062135] element 0: offset: 0x5b0030, size: 24 [D 20:42:02.062145] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 59/70. [D 20:42:02.064665] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1748 [D 20:42:02.064680] element 0: offset: 0x61f800, size: 24 [D 20:42:02.064690] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 60/70. [D 20:42:02.064731] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1752 [D 20:42:02.064745] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 0/70. [D 20:42:02.064773] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1755 [D 20:42:02.064785] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 1/70. [D 20:42:02.064844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.064889] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.064901] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.064926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.064937] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.064947] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.091536] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.091553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.091567] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.091599] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.091611] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.091622] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.091703] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1758 [D 20:42:02.091719] element 0: offset: 0x63df90, size: 24 [D 20:42:02.091733] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 2/70. [D 20:42:02.091755] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1760 [D 20:42:02.091766] element 0: offset: 0x61ee50, size: 24 [D 20:42:02.091777] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 3/70. [D 20:42:02.091852] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1758 [D 20:42:02.091885] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 4/70. [D 20:42:02.091893] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1760 [D 20:42:02.091961] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 5/70. [D 20:42:02.095433] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1755 [D 20:42:02.095475] element 0: offset: 0x657310, size: 24 [D 20:42:02.095490] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 6/70. [D 20:42:02.095617] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.095634] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.095682] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.100220] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1752 [D 20:42:02.100235] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.100247] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 7/70. [D 20:42:02.100361] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.100377] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.100386] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.117793] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.117812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.117821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.117852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.117863] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.117875] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.117986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1764 [D 20:42:02.117999] element 0: offset: 0x61f310, size: 24 [D 20:42:02.118011] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 8/70. [D 20:42:02.118031] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1767 [D 20:42:02.118042] element 0: offset: 0x620d50, size: 24 [D 20:42:02.118053] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 9/70. [D 20:42:02.118130] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1764 [D 20:42:02.118171] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1767 [D 20:42:02.118173] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 10/70. [D 20:42:02.118258] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 11/70. [D 20:42:02.123717] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1760 [D 20:42:02.123754] element 0: offset: 0x61ee50, size: 24 [D 20:42:02.123771] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 12/70. [D 20:42:02.123812] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1758 [D 20:42:02.123823] element 0: offset: 0x63df90, size: 24 [D 20:42:02.123834] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 13/70. [D 20:42:02.126243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.126295] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.126305] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.126324] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.126334] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.126342] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.148846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.148861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.148870] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.148901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.148910] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.148919] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.149013] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1769 [D 20:42:02.149025] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.149037] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 14/70. [D 20:42:02.149056] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1773 [D 20:42:02.149069] element 0: offset: 0x63dc60, size: 24 [D 20:42:02.149079] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 15/70. [D 20:42:02.154545] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1769 [D 20:42:02.154606] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 16/70. [D 20:42:02.154638] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1773 [D 20:42:02.154650] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 17/70. [D 20:42:02.154668] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1764 [D 20:42:02.156916] element 0: offset: 0x61f310, size: 24 [D 20:42:02.156929] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 18/70. [D 20:42:02.156944] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1767 [D 20:42:02.156954] element 0: offset: 0x620d50, size: 24 [D 20:42:02.156964] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 19/70. [D 20:42:02.159232] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.159246] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.159257] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.159273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.159286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.159295] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.184926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.184941] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.184949] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.184981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.184991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.185000] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.185083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1776 [D 20:42:02.185103] element 0: offset: 0x641100, size: 24 [D 20:42:02.185113] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 20/70. [D 20:42:02.185125] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1779 [D 20:42:02.185135] element 0: offset: 0x657310, size: 24 [D 20:42:02.185149] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 21/70. [D 20:42:02.185990] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1769 [D 20:42:02.186017] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.186030] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 22/70. [D 20:42:02.190452] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1773 [D 20:42:02.190511] element 0: offset: 0x63dc60, size: 24 [D 20:42:02.190525] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 23/70. [D 20:42:02.190575] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1776 [D 20:42:02.190591] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 24/70. [D 20:42:02.190623] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1779 [D 20:42:02.190636] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 25/70. [D 20:42:02.190665] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.190675] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.190684] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.192970] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.192985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.192994] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.219548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.219565] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.219574] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.219708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1781 [D 20:42:02.219720] element 0: offset: 0x61ee50, size: 24 [D 20:42:02.219731] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 26/70. [D 20:42:02.221242] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1776 [D 20:42:02.221296] element 0: offset: 0x641100, size: 24 [D 20:42:02.221311] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 27/70. [D 20:42:02.225033] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1779 [D 20:42:02.225081] element 0: offset: 0x657310, size: 24 [D 20:42:02.225095] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 28/70. [D 20:42:02.225142] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1781 [D 20:42:02.225158] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 29/70. [D 20:42:02.225195] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.225206] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.225249] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.227541] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.227555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.227565] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:02.242590] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.242605] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.242613] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:02.242645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.242655] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.242663] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.242753] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1785 [D 20:42:02.242764] element 0: offset: 0x61f310, size: 24 [D 20:42:02.242773] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 30/70. [D 20:42:02.242786] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1788 [D 20:42:02.242795] element 0: offset: 0x691fe0, size: 24 [D 20:42:02.242805] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 31/70. [D 20:42:02.245449] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1785 [D 20:42:02.245462] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 32/70. [D 20:42:02.245485] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1788 [D 20:42:02.245496] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 33/70. [D 20:42:02.276144] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1785 [D 20:42:02.276207] element 0: offset: 0x61f310, size: 24 [D 20:42:02.276222] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 34/70. [D 20:42:02.278422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.278437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.278448] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.281356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1788 [D 20:42:02.281409] element 0: offset: 0x691fe0, size: 24 [D 20:42:02.281424] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 35/70. [D 20:42:02.284584] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.284599] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.284609] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:02.284630] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.284640] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.284649] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:02.284758] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1791 [D 20:42:02.284775] element 0: offset: 0x62b0a0, size: 24 [D 20:42:02.284785] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 36/70. [D 20:42:02.284852] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1791 [D 20:42:02.284905] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 37/70. [D 20:42:02.300859] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.300873] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.300884] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.300946] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1794 [D 20:42:02.300958] element 0: offset: 0x657310, size: 24 [D 20:42:02.300967] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 38/70. [D 20:42:02.301027] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1794 [D 20:42:02.301079] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 39/70. [D 20:42:02.306205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1791 [D 20:42:02.306260] element 0: offset: 0x62b0a0, size: 24 [D 20:42:02.306275] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 40/70. [D 20:42:02.308580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.308594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.308604] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.316299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.316314] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.316324] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.316412] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1797 [D 20:42:02.316426] element 0: offset: 0x6151c0, size: 24 [D 20:42:02.316437] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 41/70. [D 20:42:02.316555] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1797 [D 20:42:02.316599] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 42/70. [D 20:42:02.321453] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1794 [D 20:42:02.321508] element 0: offset: 0x657310, size: 24 [D 20:42:02.321523] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 43/70. [D 20:42:02.321976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.321991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.322001] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.334203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.334218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.334229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.334310] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1800 [D 20:42:02.334323] element 0: offset: 0x691fe0, size: 24 [D 20:42:02.334333] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 44/70. [D 20:42:02.336772] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1800 [D 20:42:02.336789] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 45/70. [D 20:42:02.742857] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1781 [D 20:42:02.742924] element 0: offset: 0x61ee50, size: 24 [D 20:42:02.742939] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 46/70. [D 20:42:02.745211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.745225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.745235] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.751097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.751111] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.751122] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.751203] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1802 [D 20:42:02.751216] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.751226] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 47/70. [D 20:42:02.751296] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1802 [D 20:42:02.751335] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 48/70. [D 20:42:02.768154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1802 [D 20:42:02.768215] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.768230] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 49/70. [D 20:42:02.770021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.770035] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.770045] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.780333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.780348] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.780359] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.780438] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1805 [D 20:42:02.780451] element 0: offset: 0x61f800, size: 24 [D 20:42:02.780461] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 50/70. [D 20:42:02.780540] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1805 [D 20:42:02.780574] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 51/70. [D 20:42:02.799362] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1805 [D 20:42:02.799421] element 0: offset: 0x61f800, size: 24 [D 20:42:02.799435] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 52/70. [D 20:42:02.801555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.801569] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.801578] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.808161] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.808175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.808186] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.808267] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1808 [D 20:42:02.808280] element 0: offset: 0x641100, size: 24 [D 20:42:02.808291] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 53/70. [D 20:42:02.808365] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1808 [D 20:42:02.808403] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 54/70. [D 20:42:02.826049] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1808 [D 20:42:02.826109] element 0: offset: 0x641100, size: 24 [D 20:42:02.826123] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 55/70. [D 20:42:02.828390] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.828404] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.828414] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.864527] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1797 [D 20:42:02.864592] element 0: offset: 0x6151c0, size: 24 [D 20:42:02.864607] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 56/70. [D 20:42:02.866999] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.867014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.867025] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:02.880653] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.880668] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.880679] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:02.880759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1812 [D 20:42:02.880772] element 0: offset: 0x63df90, size: 24 [D 20:42:02.880783] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 57/70. [D 20:42:02.880849] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1812 [D 20:42:02.880902] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 58/70. [D 20:42:02.897508] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1812 [D 20:42:02.897568] element 0: offset: 0x63df90, size: 24 [D 20:42:02.897582] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 59/70. [D 20:42:02.898038] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.898053] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.898062] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:02.909773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.909787] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.909798] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:02.909880] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1815 [D 20:42:02.909893] element 0: offset: 0x61f310, size: 24 [D 20:42:02.909904] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 60/70. [D 20:42:02.909970] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1815 [D 20:42:02.910025] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 0/70. [D 20:42:02.927651] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1815 [D 20:42:02.927709] element 0: offset: 0x61f310, size: 24 [D 20:42:02.927724] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 1/70. [D 20:42:02.929990] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.930004] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.930019] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:02.937855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.937869] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.937880] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:02.937960] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1818 [D 20:42:02.937974] element 0: offset: 0x620d50, size: 24 [D 20:42:02.937984] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 2/70. [D 20:42:02.938052] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1818 [D 20:42:02.938121] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 3/70. [D 20:42:03.122152] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1818 [D 20:42:03.122222] element 0: offset: 0x620d50, size: 24 [D 20:42:03.122238] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 4/70. [D 20:42:03.122262] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1800 [D 20:42:03.122278] element 0: offset: 0x691fe0, size: 24 [D 20:42:03.122288] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 5/70. [D 20:42:03.124616] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.124629] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.124638] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:03.124654] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.124663] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.124671] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.133318] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.133337] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.133346] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.133381] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.133391] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.133399] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:03.133490] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1822 [D 20:42:03.133501] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.133512] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 6/70. [D 20:42:03.133526] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1824 [D 20:42:03.133535] element 0: offset: 0x6151c0, size: 24 [D 20:42:03.133544] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 7/70. [D 20:42:03.136112] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1822 [D 20:42:03.136130] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 8/70. [D 20:42:03.136155] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1824 [D 20:42:03.136166] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 9/70. [D 20:42:03.167382] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1822 [D 20:42:03.167446] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.167460] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 10/70. [D 20:42:03.167648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.167662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.167671] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:03.172640] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1824 [D 20:42:03.172654] element 0: offset: 0x6151c0, size: 24 [D 20:42:03.172665] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 11/70. [D 20:42:03.172740] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.172753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.172761] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.179625] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.179639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.179647] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.181944] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1827 [D 20:42:03.181958] element 0: offset: 0x66e860, size: 24 [D 20:42:03.181967] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 12/70. [D 20:42:03.182052] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1827 [D 20:42:03.182093] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 13/70. [D 20:42:03.201128] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1827 [D 20:42:03.201143] element 0: offset: 0x66e860, size: 24 [D 20:42:03.201153] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 14/70. [D 20:42:03.201231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.201244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.201252] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.207752] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.207766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.207774] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.210021] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1830 [D 20:42:03.210037] element 0: offset: 0x61f310, size: 24 [D 20:42:03.210047] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 15/70. [D 20:42:03.210120] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1830 [D 20:42:03.210166] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 16/70. [D 20:42:03.228152] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1830 [D 20:42:03.228167] element 0: offset: 0x61f310, size: 24 [D 20:42:03.228177] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 17/70. [D 20:42:03.228247] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.228260] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.228268] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.235039] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.235052] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.235060] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.237307] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1833 [D 20:42:03.237321] element 0: offset: 0x625600, size: 24 [D 20:42:03.237331] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 18/70. [D 20:42:03.237404] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1833 [D 20:42:03.237458] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 19/70. [D 20:42:03.257590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1833 [D 20:42:03.257605] element 0: offset: 0x625600, size: 24 [D 20:42:03.257615] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 20/70. [D 20:42:03.257693] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.257706] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.257714] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.264088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.264102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.264110] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.267128] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1836 [D 20:42:03.267141] element 0: offset: 0x620d50, size: 24 [D 20:42:03.267152] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 21/70. [D 20:42:03.267223] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1836 [D 20:42:03.267274] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 22/70. [D 20:42:03.285675] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1836 [D 20:42:03.285690] element 0: offset: 0x620d50, size: 24 [D 20:42:03.285700] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 23/70. [D 20:42:03.285776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.285790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.285798] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.521742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.521756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.521764] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.524011] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1838 [D 20:42:03.524025] element 0: offset: 0x624450, size: 24 [D 20:42:03.524034] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 24/70. [D 20:42:03.524104] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1838 [D 20:42:03.524149] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 25/70. [D 20:42:03.540151] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1838 [D 20:42:03.540166] element 0: offset: 0x624450, size: 24 [D 20:42:03.540176] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 26/70. [D 20:42:03.542452] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.542464] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.542472] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.550583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.550597] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.550605] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.552654] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1841 [D 20:42:03.552668] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.552677] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 27/70. [D 20:42:03.552749] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1841 [D 20:42:03.552796] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 28/70. [D 20:42:03.572561] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1841 [D 20:42:03.572576] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.572586] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 29/70. [D 20:42:03.572658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.572670] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.572678] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.579033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.579046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.579055] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.581294] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1844 [D 20:42:03.581307] element 0: offset: 0x655ed0, size: 24 [D 20:42:03.581317] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 30/70. [D 20:42:03.581415] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1844 [D 20:42:03.581481] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 31/70. [D 20:42:03.600705] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1844 [D 20:42:03.600720] element 0: offset: 0x655ed0, size: 24 [D 20:42:03.600730] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 32/70. [D 20:42:03.600806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.600820] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.600828] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.607148] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.607161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.607170] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.609384] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1847 [D 20:42:03.609397] element 0: offset: 0x61fad0, size: 24 [D 20:42:03.609407] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 33/70. [D 20:42:03.609506] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1847 [D 20:42:03.609574] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 34/70. [D 20:42:03.627647] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1847 [D 20:42:03.627662] element 0: offset: 0x61fad0, size: 24 [D 20:42:03.627671] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 35/70. [D 20:42:03.627743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.627755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.627764] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.633952] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.633966] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.633974] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.634126] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1850 [D 20:42:03.634140] element 0: offset: 0x62b0a0, size: 24 [D 20:42:03.634150] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 36/70. [D 20:42:03.634227] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1850 [D 20:42:03.634264] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 37/70. [D 20:42:03.650952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1850 [D 20:42:03.650967] element 0: offset: 0x62b0a0, size: 24 [D 20:42:03.650977] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 38/70. [D 20:42:03.651097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.651111] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.651119] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.661963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.661976] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.661984] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.664256] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1853 [D 20:42:03.664269] element 0: offset: 0x61ee50, size: 24 [D 20:42:03.664279] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 39/70. [D 20:42:03.664349] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1853 [D 20:42:03.664396] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 40/70. [D 20:42:03.684422] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1853 [D 20:42:03.684437] element 0: offset: 0x61ee50, size: 24 [D 20:42:03.684447] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 41/70. [D 20:42:03.684519] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.684531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.684539] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.690506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.690520] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.690528] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.692768] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1856 [D 20:42:03.692782] element 0: offset: 0x691fe0, size: 24 [D 20:42:03.692791] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 42/70. [D 20:42:03.692890] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1856 [D 20:42:03.692959] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 43/70. [D 20:42:03.712205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1856 [D 20:42:03.712220] element 0: offset: 0x691fe0, size: 24 [D 20:42:03.712230] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 44/70. [D 20:42:03.712302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.712314] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.712322] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.719001] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.719014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.719023] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.719058] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.719069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.719077] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:03.721343] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1861 [D 20:42:03.721357] element 0: offset: 0x61f800, size: 24 [D 20:42:03.721366] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 45/70. [D 20:42:03.721380] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1862 [D 20:42:03.721389] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.721398] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 46/70. [D 20:42:03.721474] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1861 [D 20:42:03.721511] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1862 [D 20:42:03.721544] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 47/70. [D 20:42:03.721606] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 48/70. [D 20:42:03.754927] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1862 [D 20:42:03.754979] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.754993] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 49/70. [D 20:42:03.755142] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.755155] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.755163] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:03.757629] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1861 [D 20:42:03.757643] element 0: offset: 0x61f800, size: 24 [D 20:42:03.757654] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 50/70. [D 20:42:03.757720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.757732] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.757740] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.772764] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.772778] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.772786] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.775062] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1866 [D 20:42:03.775075] element 0: offset: 0x655ed0, size: 24 [D 20:42:03.775085] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 51/70. [D 20:42:03.775201] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1866 [D 20:42:03.775259] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 52/70. [D 20:42:03.791449] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1866 [D 20:42:03.791496] element 0: offset: 0x655ed0, size: 24 [D 20:42:03.791510] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 53/70. [D 20:42:03.791657] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.791669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.791677] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.799249] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.799263] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.799272] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.801501] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1869 [D 20:42:03.801514] element 0: offset: 0x61fad0, size: 24 [D 20:42:03.801524] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 54/70. [D 20:42:03.801640] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1869 [D 20:42:03.801682] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 55/70. [D 20:42:03.822930] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1869 [D 20:42:03.822945] element 0: offset: 0x61fad0, size: 24 [D 20:42:03.822955] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 56/70. [D 20:42:03.823033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.823047] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.823055] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.829196] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.829209] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.829218] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.830137] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1872 [D 20:42:03.830150] element 0: offset: 0x62b0a0, size: 24 [D 20:42:03.830160] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 57/70. [D 20:42:03.830208] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1872 [D 20:42:03.830276] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 58/70. [D 20:42:03.844184] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1872 [D 20:42:03.844230] element 0: offset: 0x62b0a0, size: 24 [D 20:42:03.844244] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 59/70. [D 20:42:03.844388] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.844400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.844408] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.857214] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.857227] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.857236] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.859347] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1875 [D 20:42:03.859360] element 0: offset: 0x61ee50, size: 24 [D 20:42:03.859370] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 60/70. [D 20:42:03.859480] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1875 [D 20:42:03.859528] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 0/70. [D 20:42:03.879461] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1875 [D 20:42:03.879476] element 0: offset: 0x61ee50, size: 24 [D 20:42:03.879486] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 1/70. [D 20:42:03.879557] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.879570] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.879579] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.885315] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.885329] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.885337] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.886142] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1878 [D 20:42:03.886155] element 0: offset: 0x691fe0, size: 24 [D 20:42:03.886166] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 2/70. [D 20:42:03.886250] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1878 [D 20:42:03.886332] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 3/70. [D 20:42:03.903237] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1878 [D 20:42:03.903282] element 0: offset: 0x691fe0, size: 24 [D 20:42:03.903296] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 4/70. [D 20:42:03.903441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.903454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.903462] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.910461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.910475] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.910483] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.912573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1881 [D 20:42:03.912586] element 0: offset: 0x61f800, size: 24 [D 20:42:03.912596] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 5/70. [D 20:42:03.912677] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1881 [D 20:42:03.912704] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 6/70. [D 20:42:03.932265] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1881 [D 20:42:03.932279] element 0: offset: 0x61f800, size: 24 [D 20:42:03.932289] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 7/70. [D 20:42:03.932367] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.932380] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.932388] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.938597] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.938611] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.938619] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.940740] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1884 [D 20:42:03.940753] element 0: offset: 0x6151c0, size: 24 [D 20:42:03.940763] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 8/70. [D 20:42:03.940831] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1884 [D 20:42:03.940881] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 9/70. [D 20:42:03.956460] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1884 [D 20:42:03.956505] element 0: offset: 0x6151c0, size: 24 [D 20:42:03.956519] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 10/70. [D 20:42:03.956661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.956674] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.956682] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.187065] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.187079] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.187087] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.189256] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1887 [D 20:42:04.189269] element 0: offset: 0x655ed0, size: 24 [D 20:42:04.189279] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 11/70. [D 20:42:04.189390] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1887 [D 20:42:04.189446] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 12/70. [D 20:42:04.205563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1887 [D 20:42:04.205578] element 0: offset: 0x655ed0, size: 24 [D 20:42:04.205588] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 13/70. [D 20:42:04.205630] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.205640] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.205649] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.217260] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.217273] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.217281] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.219392] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1890 [D 20:42:04.219405] element 0: offset: 0x61fad0, size: 24 [D 20:42:04.219415] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 14/70. [D 20:42:04.219514] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1890 [D 20:42:04.219584] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 15/70. [D 20:42:04.235503] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1890 [D 20:42:04.235549] element 0: offset: 0x61fad0, size: 24 [D 20:42:04.235563] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 16/70. [D 20:42:04.235627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.235638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.235646] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.241689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.241703] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.241711] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.242140] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1893 [D 20:42:04.242153] element 0: offset: 0x62b0a0, size: 24 [D 20:42:04.242163] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 17/70. [D 20:42:04.242262] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1893 [D 20:42:04.242319] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 18/70. [D 20:42:04.260685] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1893 [D 20:42:04.260700] element 0: offset: 0x62b0a0, size: 24 [D 20:42:04.260710] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 19/70. [D 20:42:04.260782] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.260794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.260802] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.266842] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.266855] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.266864] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.269110] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1896 [D 20:42:04.269124] element 0: offset: 0x625600, size: 24 [D 20:42:04.269133] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 20/70. [D 20:42:04.269230] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1896 [D 20:42:04.269298] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 21/70. [D 20:42:04.285954] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1896 [D 20:42:04.286000] element 0: offset: 0x625600, size: 24 [D 20:42:04.286013] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 22/70. [D 20:42:04.286165] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.286178] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.286186] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.291019] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.291032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.291040] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.291871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.291884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.291892] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.294118] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1899 [D 20:42:04.294131] element 0: offset: 0x6151c0, size: 24 [D 20:42:04.294141] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 23/70. [D 20:42:04.294155] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1902 [D 20:42:04.294164] element 0: offset: 0x655ed0, size: 24 [D 20:42:04.294173] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 24/70. [D 20:42:04.294260] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1899 [D 20:42:04.294301] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1902 [D 20:42:04.294314] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 25/70. [D 20:42:04.294398] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 26/70. [D 20:42:04.322789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1899 [D 20:42:04.322841] element 0: offset: 0x6151c0, size: 24 [D 20:42:04.322855] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 27/70. [D 20:42:04.322921] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.322931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.322940] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.327523] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1902 [D 20:42:04.327537] element 0: offset: 0x655ed0, size: 24 [D 20:42:04.327546] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 28/70. [D 20:42:04.327620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.327632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.327640] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.329606] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.329620] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.329628] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.330169] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1905 [D 20:42:04.330183] element 0: offset: 0x61fad0, size: 24 [D 20:42:04.330193] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 29/70. [D 20:42:04.330292] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1905 [D 20:42:04.330367] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 30/70. [D 20:42:04.344492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.344508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.344517] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.346826] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1908 [D 20:42:04.346865] element 0: offset: 0x2aaaab203c10, size: 24 [D 20:42:04.346878] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 31/70. [D 20:42:04.347607] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1908 [D 20:42:04.347625] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 32/70. [D 20:42:04.347823] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1905 [D 20:42:04.347838] element 0: offset: 0x2aaaab203ad0, size: 24 [D 20:42:04.347848] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 33/70. [D 20:42:04.347944] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.347957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.347965] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.357838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.357852] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.357860] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.360154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1911 [D 20:42:04.360168] element 0: offset: 0x61fad0, size: 24 [D 20:42:04.360178] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 34/70. [D 20:42:04.363790] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1908 [D 20:42:04.363804] element 0: offset: 0x620d50, size: 24 [D 20:42:04.363816] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 35/70. [D 20:42:04.363847] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1911 [D 20:42:04.363859] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 36/70. [D 20:42:04.363903] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.363914] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.363922] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.376288] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.376319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.376328] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.378709] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1911 [D 20:42:04.378750] element 0: offset: 0x2aaaab203c30, size: 24 [D 20:42:04.378763] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 37/70. [D 20:42:04.378831] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1914 [D 20:42:04.378841] element 0: offset: 0x2aaaab209410, size: 24 [D 20:42:04.378851] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 38/70. [D 20:42:04.378936] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.378948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.378956] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.378990] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1914 [D 20:42:04.379012] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 39/70. [D 20:42:04.393787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.393801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.393810] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.396030] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1917 [D 20:42:04.396043] element 0: offset: 0x2aaaab203d50, size: 24 [D 20:42:04.396053] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 40/70. [D 20:42:04.399471] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1917 [D 20:42:04.399489] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 41/70. [D 20:42:04.399526] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1914 [D 20:42:04.399536] element 0: offset: 0x2aaaab209410, size: 24 [D 20:42:04.399545] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 42/70. [D 20:42:04.399620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.399632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.399640] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.415119] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1917 [D 20:42:04.415163] element 0: offset: 0x2aaaab203d50, size: 24 [D 20:42:04.415177] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 43/70. [D 20:42:04.415341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.415354] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.415363] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.417399] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.417412] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.417421] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.418162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1920 [D 20:42:04.418176] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.418186] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 44/70. [D 20:42:04.418273] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1920 [D 20:42:04.418307] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 45/70. [D 20:42:04.432367] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.432382] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.432390] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.434606] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1923 [D 20:42:04.434619] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.434630] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 46/70. [D 20:42:04.437648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1920 [D 20:42:04.437663] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.437674] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 47/70. [D 20:42:04.437703] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1923 [D 20:42:04.437718] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 48/70. [D 20:42:04.437741] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.437750] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.437758] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.453210] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1923 [D 20:42:04.453256] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.453270] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 49/70. [D 20:42:04.453329] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.453340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.453349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.463248] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.463262] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.463271] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.465560] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1926 [D 20:42:04.465573] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.465584] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 50/70. [D 20:42:04.465664] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1926 [D 20:42:04.465701] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 51/70. [D 20:42:04.483257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1926 [D 20:42:04.483273] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.483282] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 52/70. [D 20:42:04.483352] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.483365] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.483373] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.491593] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.491607] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.491615] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.493849] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1929 [D 20:42:04.493863] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.493873] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 53/70. [D 20:42:04.493967] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1929 [D 20:42:04.494031] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 54/70. [D 20:42:04.510461] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1929 [D 20:42:04.510505] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.510519] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 55/70. [D 20:42:04.510663] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.510675] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.510684] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.516453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.516466] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.516474] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.518144] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1932 [D 20:42:04.518157] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.518167] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 56/70. [D 20:42:04.518265] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1932 [D 20:42:04.518327] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 57/70. [D 20:42:04.536042] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1932 [D 20:42:04.536057] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.536067] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 58/70. [D 20:42:04.536155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.536167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.536175] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.747842] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.747856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.747864] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.750218] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1934 [D 20:42:04.750232] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.750241] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 59/70. [D 20:42:04.750343] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1934 [D 20:42:04.750422] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 60/70. [D 20:42:04.766276] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1934 [D 20:42:04.766322] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.766336] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 0/70. [D 20:42:04.768631] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.768654] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.768664] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.776173] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.776188] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.776198] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.776277] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1937 [D 20:42:04.776292] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.776323] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 1/70. [D 20:42:04.778154] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1937 [D 20:42:04.778771] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 2/70. [D 20:42:04.796082] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1937 [D 20:42:04.796144] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.796159] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 3/70. [D 20:42:04.798343] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.798358] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.798369] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.810341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.810356] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.810366] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.810506] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1940 [D 20:42:04.810520] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.810532] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 4/70. [D 20:42:04.812873] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1940 [D 20:42:04.812891] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 5/70. [D 20:42:04.827958] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1940 [D 20:42:04.827973] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.827984] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 6/70. [D 20:42:04.830117] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.830134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.830144] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.834134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.834149] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.834158] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.836269] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1943 [D 20:42:04.836283] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.836295] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 7/70. [D 20:42:04.836392] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1943 [D 20:42:04.836452] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 8/70. [D 20:42:04.855497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1943 [D 20:42:04.855564] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.855579] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 9/70. [D 20:42:04.857722] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.857736] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.857747] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.863831] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.863846] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.863856] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.864012] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1946 [D 20:42:04.864027] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:04.864039] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 10/70. [D 20:42:04.864178] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1946 [D 20:42:04.864204] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 11/70. [D 20:42:04.880972] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1946 [D 20:42:04.881003] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:04.881015] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 12/70. [D 20:42:04.883154] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.883168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.883178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.888987] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.889001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.889012] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.889087] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1949 [D 20:42:04.889101] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.889112] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 13/70. [D 20:42:04.891583] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1949 [D 20:42:04.891600] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 14/70. [D 20:42:04.908985] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1949 [D 20:42:04.909049] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.909064] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 15/70. [D 20:42:04.911253] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.911268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.911278] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.917086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.917101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.917111] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.917207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1952 [D 20:42:04.917220] element 0: offset: 0x2aaaab208c20, size: 24 [D 20:42:04.917236] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 16/70. [D 20:42:04.918161] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1952 [D 20:42:04.918179] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 17/70. [D 20:42:04.933691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.933712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.933721] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.933793] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1956 [D 20:42:04.933805] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.933816] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 18/70. [D 20:42:04.933917] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1956 [D 20:42:04.933966] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 19/70. [D 20:42:04.934190] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1952 [D 20:42:04.934205] element 0: offset: 0x2aaaab208c20, size: 24 [D 20:42:04.934217] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 20/70. [D 20:42:04.934306] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.934319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.934328] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.949880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.949906] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.949916] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.949990] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1958 [D 20:42:04.950004] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.950016] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 21/70. [D 20:42:04.952441] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1958 [D 20:42:04.952460] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 22/70. [D 20:42:04.957850] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1956 [D 20:42:04.957906] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.957921] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 23/70. [D 20:42:04.958018] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.958032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.958052] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.969617] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.969632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.969641] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.969747] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1962 [D 20:42:04.969759] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.969768] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 24/70. [D 20:42:04.969835] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1962 [D 20:42:04.969880] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 25/70. [D 20:42:04.972114] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1958 [D 20:42:04.972128] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.972140] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 26/70. [D 20:42:04.972234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.972247] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.972256] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.985546] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1962 [D 20:42:04.985608] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.985624] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 27/70. [D 20:42:04.987811] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.987825] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.987836] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.002662] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.002678] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.002689] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.002785] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1965 [D 20:42:05.002799] element 0: offset: 0x2aaaab208c20, size: 24 [D 20:42:05.002814] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 28/70. [D 20:42:05.005156] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1965 [D 20:42:05.005173] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 29/70. [D 20:42:05.019912] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1965 [D 20:42:05.019931] element 0: offset: 0x2aaaab208c20, size: 24 [D 20:42:05.019942] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 30/70. [D 20:42:05.022172] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.022186] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.022196] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.029636] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.029657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.029667] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.029749] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1968 [D 20:42:05.029763] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:05.029775] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 31/70. [D 20:42:05.032215] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1968 [D 20:42:05.032233] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 32/70. [D 20:42:05.051461] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1968 [D 20:42:05.051526] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:05.051541] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 33/70. [D 20:42:05.053679] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.053694] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.053704] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.257393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.257456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.257466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.257572] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1971 [D 20:42:05.257596] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:05.257611] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 34/70. [D 20:42:05.260098] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1971 [D 20:42:05.260117] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 35/70. [D 20:42:05.277262] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1971 [D 20:42:05.277280] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:05.277291] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 36/70. [D 20:42:05.278158] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.278172] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.278181] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.287581] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.287596] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.287606] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.287667] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1974 [D 20:42:05.287681] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:05.287691] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 37/70. [D 20:42:05.287745] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1974 [D 20:42:05.287796] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 38/70. [D 20:42:05.305996] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1974 [D 20:42:05.306062] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:05.306077] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 39/70. [D 20:42:05.308450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.308465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.308475] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.320295] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.320310] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.320320] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.320418] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1977 [D 20:42:05.320432] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:05.320448] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 40/70. [D 20:42:05.320516] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1977 [D 20:42:05.320558] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 41/70. [D 20:42:05.335424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1977 [D 20:42:05.335460] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:05.335473] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 42/70. [D 20:42:05.337727] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.337741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.337751] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.353205] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.353220] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.353231] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.353314] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1980 [D 20:42:05.353327] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:05.353338] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 43/70. [D 20:42:05.353398] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1980 [D 20:42:05.353443] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 44/70. [D 20:42:05.372078] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1980 [D 20:42:05.372143] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:05.372158] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 45/70. [D 20:42:05.374448] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.374462] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.374473] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.534004] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.534043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.534053] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.534156] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1983 [D 20:42:05.534171] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:05.534192] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 46/70. [D 20:42:05.536634] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1983 [D 20:42:05.536652] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 47/70. [D 20:42:05.552847] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1983 [D 20:42:05.552863] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:05.552873] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 48/70. [D 20:42:05.555055] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.555069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.555080] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.567725] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.567739] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.567750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.567813] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1986 [D 20:42:05.567827] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.567837] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 49/70. [D 20:42:05.567906] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1986 [D 20:42:05.567954] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 50/70. [D 20:42:05.582155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.582170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.582181] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:05.585286] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1986 [D 20:42:05.585330] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.585343] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 51/70. [D 20:42:05.585449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.585462] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.585471] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:05.585487] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1989 [D 20:42:05.585496] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.585506] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 52/70. [D 20:42:05.585562] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1989 [D 20:42:05.585622] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 53/70. [D 20:42:05.595686] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.595701] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.595713] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:05.598194] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1992 [D 20:42:05.598236] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:05.598249] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 54/70. [D 20:42:05.598379] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1992 [D 20:42:05.598419] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 55/70. [D 20:42:05.600697] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1989 [D 20:42:05.600712] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.600725] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 56/70. [D 20:42:05.600819] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.600847] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.600856] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:05.615153] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1992 [D 20:42:05.615215] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:05.615230] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 57/70. [D 20:42:05.617551] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.617565] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.617575] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.622168] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.622181] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.622192] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.623009] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1995 [D 20:42:05.623024] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:05.623036] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 58/70. [D 20:42:05.623146] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1995 [D 20:42:05.623193] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 59/70. [D 20:42:05.638051] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.638066] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.638074] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:05.638137] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1998 [D 20:42:05.638154] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:05.638163] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 60/70. [D 20:42:05.638265] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1998 [D 20:42:05.638325] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 0/70. [D 20:42:05.640602] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1995 [D 20:42:05.640616] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:05.640628] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 1/70. [D 20:42:05.640711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.640724] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.640748] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:05.656128] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1998 [D 20:42:05.656193] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:05.656208] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 2/70. [D 20:42:05.658555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.658570] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.658581] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.880527] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.880592] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.880602] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.880707] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2001 [D 20:42:05.880722] element 0: offset: 0x2aaaab211170, size: 24 [D 20:42:05.880742] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 3/70. [D 20:42:05.883199] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2001 [D 20:42:05.883217] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 4/70. [D 20:42:05.899095] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2001 [D 20:42:05.899113] element 0: offset: 0x2aaaab211170, size: 24 [D 20:42:05.899123] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 5/70. [D 20:42:05.901266] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.901280] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.901290] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.912386] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.912400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.912411] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.912472] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2004 [D 20:42:05.912485] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:05.912495] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 6/70. [D 20:42:05.912548] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2004 [D 20:42:05.912604] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 7/70. [D 20:42:05.930784] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2004 [D 20:42:05.930845] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:05.930860] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 8/70. [D 20:42:05.933139] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.933153] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.933163] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.941993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.942007] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.942018] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.942113] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2007 [D 20:42:05.942126] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.942137] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 9/70. [D 20:42:05.944469] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2007 [D 20:42:05.944486] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 10/70. [D 20:42:05.959787] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2007 [D 20:42:05.959803] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.959814] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 11/70. [D 20:42:05.961995] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.962008] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.962018] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.015095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.015123] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.015134] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.015207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2009 [D 20:42:06.015221] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.015233] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 12/70. [D 20:42:06.015333] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2009 [D 20:42:06.015388] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 13/70. [D 20:42:06.033854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2009 [D 20:42:06.033918] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.033933] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 14/70. [D 20:42:06.036033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.036048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.036058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.041990] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.042004] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.042014] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.042109] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2012 [D 20:42:06.042123] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:06.042139] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 15/70. [D 20:42:06.044577] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2012 [D 20:42:06.044596] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 16/70. [D 20:42:06.059750] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2012 [D 20:42:06.059767] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:06.059778] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 17/70. [D 20:42:06.061926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.061939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.061948] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.067700] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.067714] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.067725] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.067788] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2015 [D 20:42:06.067801] element 0: offset: 0x2aaaab2168e0, size: 24 [D 20:42:06.067812] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 18/70. [D 20:42:06.067906] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2015 [D 20:42:06.067963] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 19/70. [D 20:42:06.086464] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2015 [D 20:42:06.086527] element 0: offset: 0x2aaaab2168e0, size: 24 [D 20:42:06.086542] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 20/70. [D 20:42:06.088720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.088734] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.088745] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.425768] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.425830] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.425840] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.425945] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2019 [D 20:42:06.425970] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:06.425984] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 21/70. [D 20:42:06.426202] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2019 [D 20:42:06.428404] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 22/70. [D 20:42:06.443604] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2019 [D 20:42:06.443620] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:06.443630] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 23/70. [D 20:42:06.445794] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.445808] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.445818] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.452503] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.452517] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.452528] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.452590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2022 [D 20:42:06.452604] element 0: offset: 0x2aaaab210af0, size: 24 [D 20:42:06.452615] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 24/70. [D 20:42:06.452710] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2022 [D 20:42:06.452762] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 25/70. [D 20:42:06.470438] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2022 [D 20:42:06.470501] element 0: offset: 0x2aaaab210af0, size: 24 [D 20:42:06.470516] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 26/70. [D 20:42:06.470596] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.470610] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.470620] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.478542] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.478556] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.478567] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.478714] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2025 [D 20:42:06.478729] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:06.478741] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 27/70. [D 20:42:06.481066] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2025 [D 20:42:06.481083] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 28/70. [D 20:42:06.495806] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2025 [D 20:42:06.495822] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:06.495833] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 29/70. [D 20:42:06.497993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.498006] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.498016] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.503901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.503915] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.503925] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.503986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2028 [D 20:42:06.504000] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:06.504010] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 30/70. [D 20:42:06.504106] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2028 [D 20:42:06.504155] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 31/70. [D 20:42:06.521759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2028 [D 20:42:06.521821] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:06.521836] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 32/70. [D 20:42:06.522204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.522218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.522228] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.529746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.529760] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.529771] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.529866] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2031 [D 20:42:06.529880] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.529892] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 33/70. [D 20:42:06.532366] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2031 [D 20:42:06.532384] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 34/70. [D 20:42:06.546991] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2031 [D 20:42:06.547007] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.547018] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 35/70. [D 20:42:06.549374] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.549388] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.549397] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.554705] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.554719] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.554730] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.554792] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2034 [D 20:42:06.554805] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:06.554816] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 36/70. [D 20:42:06.554912] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2034 [D 20:42:06.554961] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 37/70. [D 20:42:06.572535] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2034 [D 20:42:06.572602] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:06.572617] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 38/70. [D 20:42:06.574813] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.574828] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.574839] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.578183] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.578197] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.578207] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.580096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2037 [D 20:42:06.580110] element 0: offset: 0x2aaaab2168e0, size: 24 [D 20:42:06.580122] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 39/70. [D 20:42:06.580237] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2037 [D 20:42:06.580271] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 40/70. [D 20:42:06.596907] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2037 [D 20:42:06.596923] element 0: offset: 0x2aaaab2168e0, size: 24 [D 20:42:06.596934] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 41/70. [D 20:42:06.599106] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.599120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.599131] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.605905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.605918] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.605929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.605946] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.605958] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.605967] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:06.606022] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2040 [D 20:42:06.606035] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:06.606046] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 42/70. [D 20:42:06.606059] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2043 [D 20:42:06.606069] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:06.606079] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 43/70. [D 20:42:06.606155] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2040 [D 20:42:06.606225] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 44/70. [D 20:42:06.606278] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2043 [D 20:42:06.606295] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 45/70. [D 20:42:06.634379] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2040 [D 20:42:06.634420] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:06.634433] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 46/70. [D 20:42:06.636643] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.636657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.636666] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:06.639070] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2043 [D 20:42:06.639122] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:06.639137] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 47/70. [D 20:42:06.641297] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.641311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.641321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.872991] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.873048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.873058] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.873162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2045 [D 20:42:06.873177] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:06.873200] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 48/70. [D 20:42:06.874207] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2045 [D 20:42:06.874225] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 49/70. [D 20:42:06.890437] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2045 [D 20:42:06.890453] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:06.890464] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 50/70. [D 20:42:06.892740] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.892753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.892764] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.899519] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.899533] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.899544] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.899606] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2048 [D 20:42:06.899620] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:06.899631] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 51/70. [D 20:42:06.899725] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2048 [D 20:42:06.899776] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 52/70. [D 20:42:06.917954] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2048 [D 20:42:06.918019] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:06.918035] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 53/70. [D 20:42:06.920289] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.920305] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.920316] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.925472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.925486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.925496] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.926285] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2051 [D 20:42:06.926329] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.926343] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 54/70. [D 20:42:06.926920] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2051 [D 20:42:06.926941] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 55/70. [D 20:42:06.942112] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2051 [D 20:42:06.942157] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.942171] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 56/70. [D 20:42:06.944481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.944527] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.944537] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.949602] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.949616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.949626] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.949708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2054 [D 20:42:06.949723] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:06.949736] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 57/70. [D 20:42:06.950206] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2054 [D 20:42:06.950224] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 58/70. [D 20:42:06.967725] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2054 [D 20:42:06.967789] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:06.967804] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 59/70. [D 20:42:06.969934] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.969948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.969958] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.975108] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.975122] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.975132] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.975261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2057 [D 20:42:06.975276] element 0: offset: 0x2aaaab211170, size: 24 [D 20:42:06.975288] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 60/70. [D 20:42:06.977738] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2057 [D 20:42:06.977756] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 0/70. [D 20:42:06.993065] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2057 [D 20:42:06.993081] element 0: offset: 0x2aaaab211170, size: 24 [D 20:42:06.993091] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 1/70. [D 20:42:06.994185] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.994199] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.994209] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.103085] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.103100] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.103111] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.103173] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2061 [D 20:42:07.103187] element 0: offset: 0x2aaaab210af0, size: 24 [D 20:42:07.103198] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 2/70. [D 20:42:07.103295] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2061 [D 20:42:07.103350] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 3/70. [D 20:42:07.121656] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2061 [D 20:42:07.121718] element 0: offset: 0x2aaaab210af0, size: 24 [D 20:42:07.121732] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 4/70. [D 20:42:07.123873] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.123887] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.123898] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.129939] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.129953] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.129964] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.130059] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2064 [D 20:42:07.130073] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:07.130099] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 5/70. [D 20:42:07.130213] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2064 [D 20:42:07.130258] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 6/70. [D 20:42:07.146429] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2064 [D 20:42:07.146444] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:07.146455] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 7/70. [D 20:42:07.148721] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.148734] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.148744] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.154569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.154582] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.154593] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.154655] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2067 [D 20:42:07.154669] element 0: offset: 0x2aaaab229f10, size: 24 [D 20:42:07.154679] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 8/70. [D 20:42:07.154775] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2067 [D 20:42:07.154826] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 9/70. [D 20:42:07.172804] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2067 [D 20:42:07.172866] element 0: offset: 0x2aaaab229f10, size: 24 [D 20:42:07.172881] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 10/70. [D 20:42:07.175021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.175035] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.175046] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.360423] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.360474] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.360484] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.360587] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2070 [D 20:42:07.360602] element 0: offset: 0x2aaaab202b10, size: 24 [D 20:42:07.360624] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 11/70. [D 20:42:07.362220] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2070 [D 20:42:07.363082] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 12/70. [D 20:42:07.377583] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2070 [D 20:42:07.377598] element 0: offset: 0x2aaaab202b10, size: 24 [D 20:42:07.377609] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 13/70. [D 20:42:07.379886] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.379900] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.379910] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.385326] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.385340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.385350] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.385411] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2073 [D 20:42:07.385425] element 0: offset: 0x2aaaab208d20, size: 24 [D 20:42:07.385435] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 14/70. [D 20:42:07.385534] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2073 [D 20:42:07.385593] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 15/70. [D 20:42:07.402950] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2073 [D 20:42:07.402994] element 0: offset: 0x2aaaab208d20, size: 24 [D 20:42:07.403007] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 16/70. [D 20:42:07.403111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.403123] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.403132] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.914674] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.914688] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.914696] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.916961] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2076 [D 20:42:07.916975] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:07.916985] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 17/70. [D 20:42:07.917096] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2076 [D 20:42:07.917147] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 18/70. [D 20:42:07.945630] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2076 [D 20:42:07.945677] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:07.945691] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 19/70. [D 20:42:07.945841] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.945854] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.945862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.039305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.039319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.039327] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.041580] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2078 [D 20:42:08.041594] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:08.041603] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 20/70. [D 20:42:08.041712] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2078 [D 20:42:08.041755] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 21/70. [D 20:42:08.061379] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2078 [D 20:42:08.061395] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:08.061405] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 22/70. [D 20:42:08.061495] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.061507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.061515] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.067311] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.067325] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.067333] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.069758] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2081 [D 20:42:08.069771] element 0: offset: 0x2aaaab226270, size: 24 [D 20:42:08.069781] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 23/70. [D 20:42:08.069882] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2081 [D 20:42:08.069939] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 24/70. [D 20:42:08.086103] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2081 [D 20:42:08.086150] element 0: offset: 0x2aaaab226270, size: 24 [D 20:42:08.086164] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 25/70. [D 20:42:08.086334] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.086347] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.086355] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.093030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.093044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.093052] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.095264] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2084 [D 20:42:08.095277] element 0: offset: 0x2aaaab21ab70, size: 24 [D 20:42:08.095287] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 26/70. [D 20:42:08.095370] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2084 [D 20:42:08.095394] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 27/70. [D 20:42:08.112504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2084 [D 20:42:08.112519] element 0: offset: 0x2aaaab21ab70, size: 24 [D 20:42:08.112529] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 28/70. [D 20:42:08.112616] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.112628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.112636] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.121753] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.121766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.121775] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.122286] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2087 [D 20:42:08.122299] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:08.122309] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 29/70. [D 20:42:08.122357] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2087 [D 20:42:08.122421] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 30/70. [D 20:42:08.138793] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2087 [D 20:42:08.138839] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:08.138852] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 31/70. [D 20:42:08.139000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.139013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.139022] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.148599] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.148612] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.148621] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.150813] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2090 [D 20:42:08.150826] element 0: offset: 0x2aaaab208d20, size: 24 [D 20:42:08.150836] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 32/70. [D 20:42:08.150917] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2090 [D 20:42:08.150944] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 33/70. [D 20:42:08.168890] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2090 [D 20:42:08.168905] element 0: offset: 0x2aaaab208d20, size: 24 [D 20:42:08.168915] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 34/70. [D 20:42:08.169002] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.169014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.169022] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.174799] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.174812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.174820] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.177035] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2093 [D 20:42:08.177049] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:08.177059] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 35/70. [D 20:42:08.177128] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2093 [D 20:42:08.177170] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 36/70. [D 20:42:08.193326] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2093 [D 20:42:08.193373] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:08.193386] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 37/70. [D 20:42:08.193449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.193460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.193469] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.201153] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.201166] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.201175] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.203375] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2096 [D 20:42:08.203388] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:08.203398] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 38/70. [D 20:42:08.203511] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2096 [D 20:42:08.203565] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 39/70. [D 20:42:08.222081] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2096 [D 20:42:08.222095] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:08.222105] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 40/70. [D 20:42:08.222178] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.222190] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.222199] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.227346] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.227360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.227369] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.229589] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2099 [D 20:42:08.229602] element 0: offset: 0x2aaaab226270, size: 24 [D 20:42:08.229612] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 41/70. [D 20:42:08.229710] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2099 [D 20:42:08.229785] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 42/70. [D 20:42:08.245431] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2099 [D 20:42:08.245478] element 0: offset: 0x2aaaab226270, size: 24 [D 20:42:08.245491] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 43/70. [D 20:42:08.245554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.245565] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.245574] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.919994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.920008] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.920017] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.922301] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2103 [D 20:42:08.922314] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:08.922324] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 44/70. [D 20:42:08.922405] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2103 [D 20:42:08.922441] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 45/70. [D 20:42:08.940624] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2103 [D 20:42:08.940639] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:08.940649] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 46/70. [D 20:42:08.940723] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.940735] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.940743] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.953360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.953374] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.953382] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.955608] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2106 [D 20:42:08.955621] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:42:08.955631] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 47/70. [D 20:42:08.955701] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2106 [D 20:42:08.955754] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 48/70. [D 20:42:08.971364] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2106 [D 20:42:08.971410] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:42:08.971423] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 49/70. [D 20:42:08.971590] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.971604] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.971612] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.983580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.983593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.983602] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.985796] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2109 [D 20:42:08.985810] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:08.985820] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 50/70. [D 20:42:08.985901] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2109 [D 20:42:08.985928] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 51/70. [D 20:42:09.005191] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2109 [D 20:42:09.005206] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:09.005216] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 52/70. [D 20:42:09.005290] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.005303] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.005311] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.012304] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.012317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.012326] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.014567] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2112 [D 20:42:09.014580] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:09.014590] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 53/70. [D 20:42:09.014659] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2112 [D 20:42:09.014709] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 54/70. [D 20:42:09.032281] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2112 [D 20:42:09.032330] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:09.032344] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 55/70. [D 20:42:09.032411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.032422] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.032431] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.042413] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.042427] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.042435] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.044705] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2115 [D 20:42:09.044719] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:09.044729] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 56/70. [D 20:42:09.044844] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2115 [D 20:42:09.044904] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 57/70. [D 20:42:09.057287] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.057303] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.057312] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.059529] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2118 [D 20:42:09.059543] element 0: offset: 0x61fad0, size: 24 [D 20:42:09.059554] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 58/70. [D 20:42:09.062371] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2118 [D 20:42:09.062388] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 59/70. [D 20:42:09.065116] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2115 [D 20:42:09.065130] element 0: offset: 0x61f0a0, size: 24 [D 20:42:09.065139] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 60/70. [D 20:42:09.065242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.065255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.065263] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.076716] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.076729] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.076737] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.079428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2121 [D 20:42:09.079472] element 0: offset: 0x615190, size: 24 [D 20:42:09.079486] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 0/70. [D 20:42:09.080090] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2121 [D 20:42:09.080108] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 1/70. [D 20:42:09.080280] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2118 [D 20:42:09.080295] element 0: offset: 0x61fad0, size: 24 [D 20:42:09.080305] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 2/70. [D 20:42:09.080401] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.080413] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.080422] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.092162] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.092175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.092184] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.094377] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2124 [D 20:42:09.094390] element 0: offset: 0x61f310, size: 24 [D 20:42:09.094400] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 3/70. [D 20:42:09.097402] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2121 [D 20:42:09.097416] element 0: offset: 0x615190, size: 24 [D 20:42:09.097427] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 4/70. [D 20:42:09.097461] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2124 [D 20:42:09.097474] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 5/70. [D 20:42:09.097496] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.097505] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.097513] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.110473] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.110486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.110495] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.113083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2127 [D 20:42:09.113121] element 0: offset: 0x63df90, size: 24 [D 20:42:09.113134] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 6/70. [D 20:42:09.113854] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2127 [D 20:42:09.113873] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 7/70. [D 20:42:09.114075] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2124 [D 20:42:09.114089] element 0: offset: 0x61f310, size: 24 [D 20:42:09.114100] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 8/70. [D 20:42:09.114195] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.114207] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.114216] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.128072] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.128086] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.128094] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.128265] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.128279] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.128287] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:09.130495] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2131 [D 20:42:09.130508] element 0: offset: 0x615190, size: 24 [D 20:42:09.130518] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 9/70. [D 20:42:09.130532] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2133 [D 20:42:09.130540] element 0: offset: 0x61f0e0, size: 24 [D 20:42:09.130549] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 10/70. [D 20:42:09.133669] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2127 [D 20:42:09.133684] element 0: offset: 0x63df90, size: 24 [D 20:42:09.133697] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 11/70. [D 20:42:09.133732] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2131 [D 20:42:09.133747] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 12/70. [D 20:42:09.133773] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2133 [D 20:42:09.133785] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 13/70. [D 20:42:09.133807] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.133816] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.133824] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:09.156775] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.156789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.156797] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:09.159370] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2136 [D 20:42:09.159411] element 0: offset: 0x61fa80, size: 24 [D 20:42:09.159425] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 14/70. [D 20:42:09.160147] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2131 [D 20:42:09.160162] element 0: offset: 0x615190, size: 24 [D 20:42:09.160171] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 15/70. [D 20:42:09.162407] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2133 [D 20:42:09.162422] element 0: offset: 0x61f0e0, size: 24 [D 20:42:09.162433] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 16/70. [D 20:42:09.162475] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2136 [D 20:42:09.162490] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 17/70. [D 20:42:09.162518] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.162528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.162536] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:09.162554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.162563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.162571] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.176374] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2136 [D 20:42:09.176420] element 0: offset: 0x61fa80, size: 24 [D 20:42:09.176435] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 18/70. [D 20:42:09.176602] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.176615] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.176624] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.182614] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.182627] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.182636] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.184861] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2139 [D 20:42:09.184874] element 0: offset: 0x61ee50, size: 24 [D 20:42:09.184884] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 19/70. [D 20:42:09.184965] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2139 [D 20:42:09.185040] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.185052] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.185060] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.185074] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 20/70. [D 20:42:09.185140] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2142 [D 20:42:09.185160] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.185171] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 21/70. [D 20:42:09.185218] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2142 [D 20:42:09.194442] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 22/70. [D 20:42:09.201597] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2139 [D 20:42:09.201612] element 0: offset: 0x61ee50, size: 24 [D 20:42:09.201622] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 23/70. [D 20:42:09.201737] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.201750] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.201758] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.213795] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2142 [D 20:42:09.213841] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.213856] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 24/70. [D 20:42:09.214003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.214016] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.214024] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.231254] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.231268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.231276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.233484] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2145 [D 20:42:09.233497] element 0: offset: 0x615190, size: 24 [D 20:42:09.233507] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 25/70. [D 20:42:09.233589] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2145 [D 20:42:09.233631] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 26/70. [D 20:42:09.246366] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.246382] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.246390] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.248637] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2148 [D 20:42:09.248651] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.248661] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 27/70. [D 20:42:09.251841] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2145 [D 20:42:09.251856] element 0: offset: 0x615190, size: 24 [D 20:42:09.251866] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 28/70. [D 20:42:09.251897] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2148 [D 20:42:09.251909] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 29/70. [D 20:42:09.251958] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.251968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.251976] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.265469] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.265483] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.265492] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.268098] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2151 [D 20:42:09.268139] element 0: offset: 0x63df90, size: 24 [D 20:42:09.268153] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 30/70. [D 20:42:09.268685] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2151 [D 20:42:09.268701] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 31/70. [D 20:42:09.268893] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2148 [D 20:42:09.268908] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.268918] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 32/70. [D 20:42:09.269014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.269026] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.269035] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.282089] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.282102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.282111] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.284368] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2154 [D 20:42:09.284382] element 0: offset: 0x61ee50, size: 24 [D 20:42:09.284392] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 33/70. [D 20:42:09.286427] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2154 [D 20:42:09.286444] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 34/70. [D 20:42:09.289785] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2151 [D 20:42:09.289798] element 0: offset: 0x63df90, size: 24 [D 20:42:09.289808] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 35/70. [D 20:42:09.289915] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.289928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.289936] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.298972] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.298985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.298994] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.301648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2157 [D 20:42:09.301689] element 0: offset: 0x61fad0, size: 24 [D 20:42:09.301702] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 36/70. [D 20:42:09.302174] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2157 [D 20:42:09.302191] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 37/70. [D 20:42:09.302408] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2154 [D 20:42:09.302422] element 0: offset: 0x61ee50, size: 24 [D 20:42:09.302433] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 38/70. [D 20:42:09.304806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.304867] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.304877] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.317369] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2157 [D 20:42:09.317430] element 0: offset: 0x61fad0, size: 24 [D 20:42:09.317445] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 39/70. [D 20:42:09.318335] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.318350] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.318361] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.318383] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.318396] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.318404] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.320014] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2160 [D 20:42:09.320031] element 0: offset: 0x61f800, size: 24 [D 20:42:09.320042] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 40/70. [D 20:42:09.320148] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2160 [D 20:42:09.320204] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 41/70. [D 20:42:09.335741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2160 [D 20:42:09.335789] element 0: offset: 0x61f800, size: 24 [D 20:42:09.335802] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 42/70. [D 20:42:09.335970] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.335983] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.335992] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.370612] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.370626] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.370634] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.372728] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2162 [D 20:42:09.372741] element 0: offset: 0x615190, size: 24 [D 20:42:09.372751] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 43/70. [D 20:42:09.372832] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2162 [D 20:42:09.372857] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 44/70. [D 20:42:09.390166] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2162 [D 20:42:09.390181] element 0: offset: 0x615190, size: 24 [D 20:42:09.390191] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 45/70. [D 20:42:09.390269] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.390282] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.390290] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.009282] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.009296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.009304] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.011588] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2166 [D 20:42:10.011601] element 0: offset: 0x620d50, size: 24 [D 20:42:10.011611] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 46/70. [D 20:42:10.011717] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2166 [D 20:42:10.011780] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 47/70. [D 20:42:10.032459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.032508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.032518] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:10.032553] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.032563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.032571] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:10.032665] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2169 [D 20:42:10.032677] element 0: offset: 0x61f800, size: 24 [D 20:42:10.032689] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 48/70. [D 20:42:10.032709] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2172 [D 20:42:10.032719] element 0: offset: 0x61f0e0, size: 24 [D 20:42:10.032729] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 49/70. [D 20:42:10.032774] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2169 [D 20:42:10.032796] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 50/70. [D 20:42:10.032812] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2172 [D 20:42:10.032870] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2166 [D 20:42:10.032876] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 51/70. [D 20:42:10.032880] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:10.032918] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 52/70. [D 20:42:10.033111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.033123] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.033132] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:10.060522] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.060536] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.060547] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:10.064239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2169 [D 20:42:10.064288] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.064301] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 53/70. [D 20:42:10.066688] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2172 [D 20:42:10.066702] element 0: offset: 0x2aaaab203c10, size: 24 [D 20:42:10.066713] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 54/70. [D 20:42:10.066750] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2175 [D 20:42:10.066760] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.066770] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 55/70. [D 20:42:10.066808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.066818] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.066826] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:10.066846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.066854] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.066863] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:10.066896] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2175 [D 20:42:10.066930] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 56/70. [D 20:42:10.079235] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.079266] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.079276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:10.081841] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2177 [D 20:42:10.081884] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:42:10.081898] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 57/70. [D 20:42:10.082221] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2177 [D 20:42:10.082238] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 58/70. [D 20:42:10.082497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2175 [D 20:42:10.082512] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.082522] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 59/70. [D 20:42:10.082629] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.082649] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.082659] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:10.098993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.099009] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.099020] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:10.099102] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2181 [D 20:42:10.099117] element 0: offset: 0x2aaaab203c10, size: 24 [D 20:42:10.099144] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 60/70. [D 20:42:10.101590] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2181 [D 20:42:10.101608] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 0/70. [D 20:42:10.107034] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2177 [D 20:42:10.107094] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:42:10.107111] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 1/70. [D 20:42:10.109331] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.109345] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.109371] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:10.115645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.115660] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.115668] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:10.115779] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2183 [D 20:42:10.115790] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:10.115800] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 2/70. [D 20:42:10.115911] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2183 [D 20:42:10.115961] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 3/70. [D 20:42:10.116082] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2181 [D 20:42:10.116094] element 0: offset: 0x2aaaab203c10, size: 24 [D 20:42:10.116118] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 4/70. [D 20:42:10.116187] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.116213] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.116224] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:10.133426] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2183 [D 20:42:10.133487] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:10.133502] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 5/70. [D 20:42:10.135782] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.135796] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.135806] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.142481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.142496] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.142507] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.142603] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2186 [D 20:42:10.142617] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.142632] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 6/70. [D 20:42:10.142699] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2186 [D 20:42:10.142738] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 7/70. [D 20:42:10.158406] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2186 [D 20:42:10.158421] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.158432] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 8/70. [D 20:42:10.160821] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.160834] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.160844] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.348019] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.348818] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.348829] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.348912] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2189 [D 20:42:10.348926] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.348938] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 9/70. [D 20:42:10.350403] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2189 [D 20:42:10.351317] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 10/70. [D 20:42:10.369815] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2189 [D 20:42:10.370598] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.370615] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 11/70. [D 20:42:10.372781] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.372796] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.372807] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.381993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.382023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.382033] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.382138] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2192 [D 20:42:10.382152] element 0: offset: 0x2aaaab23b2f0, size: 24 [D 20:42:10.382171] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 12/70. [D 20:42:10.384640] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2192 [D 20:42:10.384658] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 13/70. [D 20:42:10.399355] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2192 [D 20:42:10.399372] element 0: offset: 0x2aaaab23b2f0, size: 24 [D 20:42:10.399383] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 14/70. [D 20:42:10.401529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.401543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.401551] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.410282] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.410296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.410307] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.410370] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2195 [D 20:42:10.410384] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:10.410397] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 15/70. [D 20:42:10.410505] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2195 [D 20:42:10.410583] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 16/70. [D 20:42:10.425805] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.425819] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.425830] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:10.425910] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2199 [D 20:42:10.425924] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.425935] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 17/70. [D 20:42:10.430425] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2195 [D 20:42:10.430479] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:10.430493] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 18/70. [D 20:42:10.430543] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2199 [D 20:42:10.430559] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 19/70. [D 20:42:10.432770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.432784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.432793] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:10.447109] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2199 [D 20:42:10.447125] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.447135] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 20/70. [D 20:42:10.449259] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.449272] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.449283] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.456292] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.456306] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.456318] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.456411] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2202 [D 20:42:10.456424] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.456435] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 21/70. [D 20:42:10.458767] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2202 [D 20:42:10.458782] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 22/70. [D 20:42:10.476226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2202 [D 20:42:10.476291] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.476306] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 23/70. [D 20:42:10.478434] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.478448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.478458] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.484823] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.484838] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.484849] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.484946] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2205 [D 20:42:10.484960] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:10.484986] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 24/70. [D 20:42:10.486422] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2205 [D 20:42:10.487419] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 25/70. [D 20:42:10.502457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2205 [D 20:42:10.502472] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:10.502483] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 26/70. [D 20:42:10.504748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.504761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.504771] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.568864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.568879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.568890] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.568953] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2208 [D 20:42:10.568966] element 0: offset: 0x2aaaab203850, size: 24 [D 20:42:10.568976] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 27/70. [D 20:42:10.569078] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2208 [D 20:42:10.569144] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 28/70. [D 20:42:10.586878] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2208 [D 20:42:10.586923] element 0: offset: 0x2aaaab203850, size: 24 [D 20:42:10.586936] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 29/70. [D 20:42:10.587041] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.587054] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.587063] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.593217] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.593230] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.593239] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.595474] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2211 [D 20:42:10.595488] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:10.595498] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 30/70. [D 20:42:10.595610] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2211 [D 20:42:10.595666] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 31/70. [D 20:42:10.611858] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2211 [D 20:42:10.611903] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:10.611917] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 32/70. [D 20:42:10.611980] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.611991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.611999] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.620481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.620495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.620504] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.622708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2214 [D 20:42:10.622722] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.622732] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 33/70. [D 20:42:10.622837] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2214 [D 20:42:10.622886] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 34/70. [D 20:42:10.641483] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2214 [D 20:42:10.641498] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.641508] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 35/70. [D 20:42:10.641582] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.641594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.641602] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.816990] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.817003] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.817012] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.819266] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2217 [D 20:42:10.819279] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:10.819290] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 36/70. [D 20:42:10.819387] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2217 [D 20:42:10.819455] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 37/70. [D 20:42:10.834784] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2217 [D 20:42:10.834831] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:10.834844] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 38/70. [D 20:42:10.834997] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.835010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.835019] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.841005] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.841019] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.841027] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.842457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2220 [D 20:42:10.842471] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:10.842481] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 39/70. [D 20:42:10.842578] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2220 [D 20:42:10.842633] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 40/70. [D 20:42:10.861594] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2220 [D 20:42:10.861609] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:10.861620] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 41/70. [D 20:42:10.861706] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.861718] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.861727] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.201887] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.201901] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.201910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.204167] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2223 [D 20:42:11.204180] element 0: offset: 0x2aaaab21ab50, size: 24 [D 20:42:11.204190] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 42/70. [D 20:42:11.204261] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2223 [D 20:42:11.204305] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 43/70. [D 20:42:11.220659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2223 [D 20:42:11.220706] element 0: offset: 0x2aaaab21ab50, size: 24 [D 20:42:11.220720] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 44/70. [D 20:42:11.220784] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.220795] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.220804] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.221055] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.221069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.221078] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.223274] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2226 [D 20:42:11.223287] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.223298] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 45/70. [D 20:42:11.223380] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2226 [D 20:42:11.223406] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 46/70. [D 20:42:11.238740] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.238755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.238764] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.241035] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2229 [D 20:42:11.241049] element 0: offset: 0x2aaaab205200, size: 24 [D 20:42:11.241059] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 47/70. [D 20:42:11.242547] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2226 [D 20:42:11.242561] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.242571] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 48/70. [D 20:42:11.242593] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2229 [D 20:42:11.242606] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 49/70. [D 20:42:11.242649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.242661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.242669] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.255761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.255806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.255816] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.257694] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2229 [D 20:42:11.257732] element 0: offset: 0x2aaaab205200, size: 24 [D 20:42:11.257745] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 50/70. [D 20:42:11.257858] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2232 [D 20:42:11.257871] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.257882] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 51/70. [D 20:42:11.257910] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.257919] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.257928] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.257990] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2232 [D 20:42:11.258040] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 52/70. [D 20:42:11.273963] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2232 [D 20:42:11.273977] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.273988] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 53/70. [D 20:42:11.274104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.274118] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.274127] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.278037] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.278051] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.278059] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.280252] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2235 [D 20:42:11.280265] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:11.280275] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 54/70. [D 20:42:11.280373] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2235 [D 20:42:11.280445] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 55/70. [D 20:42:11.294024] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2235 [D 20:42:11.294072] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:11.294085] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 56/70. [D 20:42:11.294236] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.294248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.294257] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.294743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.294756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.294765] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.297016] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2238 [D 20:42:11.297030] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:11.297040] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 57/70. [D 20:42:11.297149] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2238 [D 20:42:11.297198] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 58/70. [D 20:42:11.309789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.309805] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.309815] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.312136] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2241 [D 20:42:11.312150] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.312160] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 59/70. [D 20:42:11.314557] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2241 [D 20:42:11.314575] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 60/70. [D 20:42:11.319904] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2238 [D 20:42:11.319918] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:11.319927] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 0/70. [D 20:42:11.320055] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.320068] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.320077] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.329012] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2241 [D 20:42:11.329058] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.329073] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 1/70. [D 20:42:11.329242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.329255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.329263] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.331742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.331755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.331764] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.334036] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2244 [D 20:42:11.334050] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.334060] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 2/70. [D 20:42:11.334141] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2244 [D 20:42:11.334176] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 3/70. [D 20:42:11.346988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.347003] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.347012] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.349139] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2247 [D 20:42:11.349152] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:11.349163] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 4/70. [D 20:42:11.352457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2244 [D 20:42:11.352471] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.352484] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 5/70. [D 20:42:11.352514] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2247 [D 20:42:11.352527] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 6/70. [D 20:42:11.352550] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.352559] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.352567] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.366520] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.366533] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.366542] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.368798] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2250 [D 20:42:11.368811] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:11.368821] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 7/70. [D 20:42:11.368928] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2250 [D 20:42:11.368944] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 8/70. [D 20:42:11.385606] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2250 [D 20:42:11.385620] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:11.385630] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 9/70. [D 20:42:11.385748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.385762] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.385770] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.399643] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.399657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.399665] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.401897] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2253 [D 20:42:11.401911] element 0: offset: 0x2aaaab21ab50, size: 24 [D 20:42:11.401921] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 10/70. [D 20:42:11.402019] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2253 [D 20:42:11.402078] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 11/70. [D 20:42:11.421024] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2253 [D 20:42:11.421039] element 0: offset: 0x2aaaab21ab50, size: 24 [D 20:42:11.421049] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 12/70. [D 20:42:11.421122] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.421134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.421143] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.427115] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.427128] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.427137] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.429420] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2256 [D 20:42:11.429433] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.429443] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 13/70. [D 20:42:11.429512] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2256 [D 20:42:11.429554] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 14/70. [D 20:42:11.447772] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2256 [D 20:42:11.447787] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.447798] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 15/70. [D 20:42:11.447866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.447879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.447888] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.456010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.456023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.456032] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.458287] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2259 [D 20:42:11.458301] element 0: offset: 0x2aaaab2359f0, size: 24 [D 20:42:11.458311] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 16/70. [D 20:42:11.458408] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2259 [D 20:42:11.458467] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 17/70. [D 20:42:11.477538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2259 [D 20:42:11.477553] element 0: offset: 0x2aaaab2359f0, size: 24 [D 20:42:11.477563] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 18/70. [D 20:42:11.477637] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.477649] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.477657] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.549209] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2247 [D 20:42:11.549259] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:11.549274] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 19/70. [D 20:42:11.549345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.549356] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.549365] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.560242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.560256] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.560265] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.562407] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2262 [D 20:42:11.562421] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.562431] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 20/70. [D 20:42:11.562516] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2262 [D 20:42:11.562552] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 21/70. [D 20:42:11.581768] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2262 [D 20:42:11.581784] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.581794] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 22/70. [D 20:42:11.581869] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.581881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.581889] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.588386] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.588400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.588408] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.590539] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2265 [D 20:42:11.590552] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:11.590563] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 23/70. [D 20:42:11.590632] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2265 [D 20:42:11.590678] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 24/70. [D 20:42:11.607952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2265 [D 20:42:11.607999] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:11.608014] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 25/70. [D 20:42:11.608078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.608089] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.608098] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.616728] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.616742] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.616750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.618524] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2268 [D 20:42:11.618538] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.618548] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 26/70. [D 20:42:11.618607] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2268 [D 20:42:11.618658] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 27/70. [D 20:42:11.710649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.710664] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.710672] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.712803] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2270 [D 20:42:11.712817] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.712827] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 28/70. [D 20:42:11.712900] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2270 [D 20:42:11.712942] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 29/70. [D 20:42:11.955636] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2268 [D 20:42:11.955653] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.955663] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 30/70. [D 20:42:11.955744] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.955756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.955764] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.090036] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2270 [D 20:42:12.090086] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:12.090100] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 31/70. [D 20:42:12.090264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.090277] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.090285] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:12.097129] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.097143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.097152] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:12.099490] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2273 [D 20:42:12.099504] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:12.099514] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 32/70. [D 20:42:12.099689] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2273 [D 20:42:12.099707] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 33/70. [D 20:42:12.117836] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2273 [D 20:42:12.117850] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:12.117860] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 34/70. [D 20:42:12.117952] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.117964] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.117972] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:12.123952] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.123966] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.123974] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:12.126067] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2276 [D 20:42:12.126080] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:12.126090] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 35/70. [D 20:42:12.126185] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2276 [D 20:42:12.126271] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 36/70. [D 20:42:12.142022] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2276 [D 20:42:12.142068] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:12.142081] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 37/70. [D 20:42:12.142229] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.142242] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.142251] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:12.148298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.148311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.148319] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:12.150538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2279 [D 20:42:12.150552] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:12.150562] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 38/70. [D 20:42:12.150693] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2279 [D 20:42:12.150744] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 39/70. [D 20:42:12.169096] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.169113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.169124] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.169205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2283 [D 20:42:12.169220] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:12.169233] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 40/70. [D 20:42:12.174566] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2279 [D 20:42:12.174617] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:12.174632] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 41/70. [D 20:42:12.174681] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2283 [D 20:42:12.174698] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 42/70. [D 20:42:12.176898] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.176912] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.176922] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.193858] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.193873] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.193882] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.193994] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2285 [D 20:42:12.194006] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:12.194259] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 43/70. [D 20:42:12.196537] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2285 [D 20:42:12.196552] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 44/70. [D 20:42:12.196567] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2283 [D 20:42:12.196577] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:12.196590] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 45/70. [D 20:42:12.196669] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.196682] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.196692] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.208402] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.208416] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.208427] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.208495] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2289 [D 20:42:12.208509] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:12.208520] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 46/70. [D 20:42:12.213953] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2285 [D 20:42:12.214005] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:12.214018] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 47/70. [D 20:42:12.214069] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2289 [D 20:42:12.214085] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 48/70. [D 20:42:12.214559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.214574] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.214585] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.232800] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.232815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.232823] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.233248] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2291 [D 20:42:12.233259] element 0: offset: 0x2aaaab208c00, size: 24 [D 20:42:12.233269] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 49/70. [D 20:42:12.235595] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2291 [D 20:42:12.235610] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 50/70. [D 20:42:12.235625] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2289 [D 20:42:12.235637] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:12.235647] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 51/70. [D 20:42:12.235745] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.235758] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.235768] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.248580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.248594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.248605] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.248671] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2295 [D 20:42:12.248686] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:12.248696] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 52/70. [D 20:42:12.252755] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2295 [D 20:42:12.252812] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 53/70. [D 20:42:12.695746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.695811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.695821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:12.695940] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2298 [D 20:42:12.695955] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:12.695968] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 54/70. [D 20:42:12.698281] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2298 [D 20:42:12.698299] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 55/70. [D 20:42:12.714068] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2298 [D 20:42:12.714084] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:12.714094] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 56/70. [D 20:42:12.716393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.716406] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.716416] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:12.725379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.725392] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.725403] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:12.725465] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2301 [D 20:42:12.725478] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:12.725489] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 57/70. [D 20:42:12.725543] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2301 [D 20:42:12.725580] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 58/70. [D 20:42:12.742991] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2301 [D 20:42:12.743035] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:12.743049] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 59/70. [D 20:42:12.745465] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.745480] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.745491] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:12.748419] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2291 [D 20:42:12.748467] element 0: offset: 0x2aaaab208c00, size: 24 [D 20:42:12.748484] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 60/70. [D 20:42:12.750707] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.750722] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.750733] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.754203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.754220] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.754229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.754337] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2304 [D 20:42:12.754356] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:12.754367] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 0/70. [D 20:42:12.760899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2295 [D 20:42:12.760958] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:12.760972] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 1/70. [D 20:42:12.761023] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2304 [D 20:42:12.761039] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 2/70. [D 20:42:12.761069] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.761080] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.761089] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:12.763341] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2306 [D 20:42:12.763356] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:12.763367] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 3/70. [D 20:42:12.763394] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.763403] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.763412] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:12.763469] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2306 [D 20:42:12.779052] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 4/70. [D 20:42:12.781589] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.781603] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.781611] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:12.781673] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2310 [D 20:42:12.781684] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:12.781693] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 5/70. [D 20:42:12.781786] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2310 [D 20:42:12.782528] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2304 [D 20:42:12.782543] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:12.782553] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 6/70. [D 20:42:12.782631] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.782645] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.782669] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:12.789830] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 7/70. [D 20:42:12.804880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.804932] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.804942] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:12.805042] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2313 [D 20:42:12.805100] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:12.805114] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 8/70. [D 20:42:12.806633] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2313 [D 20:42:12.807563] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 9/70. [D 20:42:13.380982] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2306 [D 20:42:13.381050] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:13.381067] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 10/70. [D 20:42:13.383432] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.383448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.383458] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:13.389012] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.389027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.389037] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:13.389136] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2315 [D 20:42:13.389149] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:13.389161] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 11/70. [D 20:42:13.389229] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2315 [D 20:42:13.389272] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 12/70. [D 20:42:13.396850] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2310 [D 20:42:13.396916] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:13.396932] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 13/70. [D 20:42:13.399184] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.399199] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.399209] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:13.405298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.405313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.405322] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:13.405417] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2319 [D 20:42:13.405430] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:13.405441] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 14/70. [D 20:42:13.410637] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2315 [D 20:42:13.410681] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:13.410695] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 15/70. [D 20:42:13.410743] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2319 [D 20:42:13.410758] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 16/70. [D 20:42:13.410789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.410800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.410808] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:13.427812] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2319 [D 20:42:13.427826] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:13.427836] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 17/70. [D 20:42:13.427910] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.427922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.427930] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:13.438992] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.439006] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.439014] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:13.441240] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2322 [D 20:42:13.441253] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:13.441264] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 18/70. [D 20:42:13.441362] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2322 [D 20:42:13.441414] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 19/70. [D 20:42:13.460281] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2322 [D 20:42:13.460296] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:13.460306] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 20/70. [D 20:42:13.460379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.460391] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.460399] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:13.465529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.465543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.465552] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:13.467778] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2325 [D 20:42:13.467791] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.467801] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 21/70. [D 20:42:13.467917] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2325 [D 20:42:13.467954] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 22/70. [D 20:42:13.486649] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2325 [D 20:42:13.486664] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.486674] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 23/70. [D 20:42:13.488932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.488988] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.488998] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:13.494101] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.494116] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.494125] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:13.494226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2328 [D 20:42:13.494241] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:13.494255] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 24/70. [D 20:42:13.496619] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2328 [D 20:42:13.496637] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 25/70. [D 20:42:13.514307] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2328 [D 20:42:13.514368] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:13.514383] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 26/70. [D 20:42:13.514642] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.514656] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.514666] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:13.546014] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2313 [D 20:42:13.546051] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:13.546066] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 27/70. [D 20:42:13.548562] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.548577] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.548588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.554644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.554659] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.554670] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.554799] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2331 [D 20:42:13.554813] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:13.554825] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 28/70. [D 20:42:13.554896] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2331 [D 20:42:13.554930] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 29/70. [D 20:42:13.573930] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2331 [D 20:42:13.573994] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:13.574009] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 30/70. [D 20:42:13.576204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.576219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.576230] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.582629] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.582642] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.582653] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.583278] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2334 [D 20:42:13.583292] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:13.583303] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 31/70. [D 20:42:13.583416] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2334 [D 20:42:13.583461] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 32/70. [D 20:42:13.602018] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2334 [D 20:42:13.602080] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:13.602095] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 33/70. [D 20:42:13.604328] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.604343] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.604353] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.610012] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.610028] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.610038] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.610132] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2337 [D 20:42:13.610146] element 0: offset: 0x2aaaab217e10, size: 24 [D 20:42:13.610158] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 34/70. [D 20:42:13.612821] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2337 [D 20:42:13.612840] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 35/70. [D 20:42:13.627450] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2337 [D 20:42:13.627497] element 0: offset: 0x2aaaab217e10, size: 24 [D 20:42:13.627510] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 36/70. [D 20:42:13.630054] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.630069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.630080] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.635208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.635222] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.635234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.635326] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2340 [D 20:42:13.635340] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:13.635351] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 37/70. [D 20:42:13.635469] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2340 [D 20:42:13.635508] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 38/70. [D 20:42:13.652929] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2340 [D 20:42:13.652995] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:13.653009] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 39/70. [D 20:42:13.655194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.655208] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.655219] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.682799] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.682813] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.682824] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.682919] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2345 [D 20:42:13.682933] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:13.682944] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 40/70. [D 20:42:13.839177] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 1310720, tag: 2345 [D 20:42:13.839228] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 41/70. [D 20:42:13.839335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fe44b0 rkey 4a40042 nic_wr_credit 145. [D 20:42:13.839407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40044b0 rkey 4a40044 nic_wr_credit 146. [D 20:42:13.839419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40244b0 rkey 4a40044 nic_wr_credit 147. [D 20:42:13.839430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40444b0 rkey 4a40044 nic_wr_credit 148. [D 20:42:13.839444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40644b0 rkey 4a40044 nic_wr_credit 149. [D 20:42:13.839454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40844b0 rkey 4a40044 nic_wr_credit 150. [D 20:42:13.839464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40a44b0 rkey 4a40044 nic_wr_credit 151. [D 20:42:13.839479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40c44b0 rkey 4a40044 nic_wr_credit 152. [D 20:42:13.839489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40e44b0 rkey 4a40044 nic_wr_credit 153. [D 20:42:13.839499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41044b0 rkey 4a40044 nic_wr_credit 154. [D 20:42:13.839515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41244b0 rkey 4a40044 nic_wr_credit 155. [D 20:42:13.839525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41444b0 rkey 4a40044 nic_wr_credit 156. [D 20:42:13.839534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41644b0 rkey 4a40044 nic_wr_credit 157. [D 20:42:13.839544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41844b0 rkey 4a40044 nic_wr_credit 158. [D 20:42:13.839554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41a44b0 rkey 4a40044 nic_wr_credit 159. [D 20:42:13.839565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41c44b0 rkey 4a40044 nic_wr_credit 160. [D 20:42:13.839574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41e44b0 rkey 4a40044 nic_wr_credit 161. [D 20:42:13.839584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42044b0 rkey 4a40044 nic_wr_credit 162. [D 20:42:13.839741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42244b0 rkey 4a40044 nic_wr_credit 163. [D 20:42:13.839753] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f42444b0 rkey 4a40044 nic_wr_credit 164. [D 20:42:13.848369] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 164. [D 20:42:13.848394] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 42/70. [D 20:42:13.850661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.850677] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.850687] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.871629] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.871647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.871658] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.871693] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.871703] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.871714] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:13.871830] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2349 [D 20:42:13.871845] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.871858] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 43/70. [D 20:42:13.871890] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2351 [D 20:42:13.871900] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:13.871911] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 44/70. [D 20:42:13.874622] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2349 [D 20:42:13.874642] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 45/70. [D 20:42:13.874667] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2351 [D 20:42:13.874682] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 46/70. [D 20:42:13.881846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.881874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.881884] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:13.881915] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2349 [D 20:42:13.881925] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.881936] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 47/70. [D 20:42:13.881951] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2351 [D 20:42:13.881960] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:13.881969] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 48/70. [D 20:42:13.882054] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.882067] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.882076] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:13.882131] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2355 [D 20:42:13.882142] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.882152] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 49/70. [D 20:42:13.884546] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.884560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.884571] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:13.884599] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2355 [D 20:42:13.884611] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 50/70. [D 20:42:13.897550] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.897566] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.897577] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:13.897596] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.897609] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.897618] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:13.897705] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2361 [D 20:42:13.897720] element 0: offset: 0x2aaaab208c00, size: 24 [D 20:42:13.897730] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 51/70. [D 20:42:13.897759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2362 [D 20:42:13.897774] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:13.897784] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 52/70. [D 20:42:13.903802] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2355 [D 20:42:13.903865] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.903880] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 53/70. [D 20:42:13.906091] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.906107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.906116] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:13.912926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.912940] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.912950] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:13.912983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.912993] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.913002] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.110105] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2361 [D 20:42:14.110160] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 54/70. [D 20:42:14.110273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 164. [D 20:42:14.110347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 165. [D 20:42:14.110368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 166. [D 20:42:14.110379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 167. [D 20:42:14.110390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 168. [D 20:42:14.110400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 169. [D 20:42:14.110415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 170. [D 20:42:14.110425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 171. [D 20:42:14.110435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 172. [D 20:42:14.110451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 173. [D 20:42:14.110461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 174. [D 20:42:14.110471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 175. [D 20:42:14.110480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 176. [D 20:42:14.110491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 177. [D 20:42:14.110500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 178. [D 20:42:14.110562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 179. [D 20:42:14.110573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 180. [D 20:42:14.110587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 181. [D 20:42:14.110597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 182. [D 20:42:14.110606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 183. [D 20:42:14.110621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 184. [D 20:42:14.110630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 185. [D 20:42:14.110644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 186. [D 20:42:14.110676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 187. [D 20:42:14.110686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 188. [D 20:42:14.110696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 189. [D 20:42:14.110712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 190. [D 20:42:14.110722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 191. [D 20:42:14.110732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 192. [D 20:42:14.110758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 193. [D 20:42:14.110768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 194. [D 20:42:14.110777] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 195. [D 20:42:14.118067] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 195. [D 20:42:14.118083] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 55/70. [D 20:42:14.120354] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.120370] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.120381] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.126170] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.126185] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.126195] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.126229] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2376 [D 20:42:14.126240] element 0: offset: 0x2aaaab202c60, size: 24 [D 20:42:14.126255] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 56/70. [D 20:42:14.148993] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2362 [D 20:42:14.149012] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 57/70. [D 20:42:14.149077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 195. [D 20:42:14.149157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 196. [D 20:42:14.149169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 197. [D 20:42:14.149180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 198. [D 20:42:14.149195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 199. [D 20:42:14.149205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 200. [D 20:42:14.149215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 201. [D 20:42:14.149229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 202. [D 20:42:14.149239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 203. [D 20:42:14.149249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 204. [D 20:42:14.149259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 205. [D 20:42:14.149313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 206. [D 20:42:14.149325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 207. [D 20:42:14.149347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 208. [D 20:42:14.149358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 209. [D 20:42:14.149368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 210. [D 20:42:14.149378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 211. [D 20:42:14.149395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 212. [D 20:42:14.149406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 213. [D 20:42:14.149427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 214. [D 20:42:14.149444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 215. [D 20:42:14.149453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 216. [D 20:42:14.149463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 217. [D 20:42:14.149494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 218. [D 20:42:14.149510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 219. [D 20:42:14.149520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 220. [D 20:42:14.149530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 221. [D 20:42:14.149560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 222. [D 20:42:14.149576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 223. [D 20:42:14.149586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 224. [D 20:42:14.149596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 225. [D 20:42:14.149612] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 226. [D 20:42:14.155194] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 226. [D 20:42:14.155212] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 58/70. [D 20:42:14.157421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.157437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.157447] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.162802] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.162817] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.162828] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.162862] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2378 [D 20:42:14.162873] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:14.162887] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 59/70. [D 20:42:14.191131] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2376 [D 20:42:14.191150] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 60/70. [D 20:42:14.191211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 226. [D 20:42:14.191281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 227. [D 20:42:14.191301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 228. [D 20:42:14.191314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 229. [D 20:42:14.191325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 230. [D 20:42:14.191336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 231. [D 20:42:14.191346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 232. [D 20:42:14.191356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 233. [D 20:42:14.191366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 234. [D 20:42:14.191377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 235. [D 20:42:14.191430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 236. [D 20:42:14.191443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 237. [D 20:42:14.191462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 238. [D 20:42:14.191477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 239. [D 20:42:14.191487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 240. [D 20:42:14.191497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 241. [D 20:42:14.191511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 242. [D 20:42:14.191520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 243. [D 20:42:14.191530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 244. [D 20:42:14.191556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 245. [D 20:42:14.191566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 246. [D 20:42:14.191581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 247. [D 20:42:14.191591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 248. [D 20:42:14.191619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 249. [D 20:42:14.191629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 250. [D 20:42:14.191639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 251. [D 20:42:14.191649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 252. [D 20:42:14.191659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 253. [D 20:42:14.191669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 254. [D 20:42:14.191679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 255. [D 20:42:14.191698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 256. [D 20:42:14.191708] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 257. [D 20:42:14.197136] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 257. [D 20:42:14.197154] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 0/70. [D 20:42:14.199450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.199465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.199476] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.205135] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.205150] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.205160] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.205192] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2382 [D 20:42:14.205203] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:14.205216] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 1/70. [D 20:42:14.284873] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2378 [D 20:42:14.284892] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 2/70. [D 20:42:14.285025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 257. [D 20:42:14.285101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 258. [D 20:42:14.285112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 259. [D 20:42:14.285123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 260. [D 20:42:14.285137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 261. [D 20:42:14.285147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 262. [D 20:42:14.285157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 263. [D 20:42:14.285170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 264. [D 20:42:14.285180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 265. [D 20:42:14.285190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 266. [D 20:42:14.285206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 267. [D 20:42:14.285266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 268. [D 20:42:14.285278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 269. [D 20:42:14.285301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 270. [D 20:42:14.285312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 271. [D 20:42:14.285323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 272. [D 20:42:14.285338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 273. [D 20:42:14.285349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 274. [D 20:42:14.285376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 275. [D 20:42:14.285391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 276. [D 20:42:14.285401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 277. [D 20:42:14.285411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 278. [D 20:42:14.285440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 279. [D 20:42:14.285450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 280. [D 20:42:14.285462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 281. [D 20:42:14.285472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 282. [D 20:42:14.285484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 283. [D 20:42:14.285499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 284. [D 20:42:14.285528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 285. [D 20:42:14.285539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 286. [D 20:42:14.285549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 287. [D 20:42:14.285565] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 288. [D 20:42:14.290955] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 288. [D 20:42:14.290973] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 3/70. [D 20:42:14.293197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.293212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.293222] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.299000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.299015] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.299026] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.299060] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2384 [D 20:42:14.299071] element 0: offset: 0x2aaaab208c00, size: 24 [D 20:42:14.299085] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 4/70. [D 20:42:14.334841] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2384 [D 20:42:14.334861] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 5/70. [D 20:42:14.334925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 288. [D 20:42:14.334994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 289. [D 20:42:14.335014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 290. [D 20:42:14.335025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 291. [D 20:42:14.335035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 292. [D 20:42:14.335045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 293. [D 20:42:14.335060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 294. [D 20:42:14.335070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 295. [D 20:42:14.335079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 296. [D 20:42:14.335089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 297. [D 20:42:14.335106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 298. [D 20:42:14.335117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 299. [D 20:42:14.335126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 300. [D 20:42:14.335136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 301. [D 20:42:14.335146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 302. [D 20:42:14.335164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 303. [D 20:42:14.335216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 304. [D 20:42:14.335226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 305. [D 20:42:14.335236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 306. [D 20:42:14.335246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 307. [D 20:42:14.335261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 308. [D 20:42:14.335271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 309. [D 20:42:14.335281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 310. [D 20:42:14.335305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 311. [D 20:42:14.335315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 312. [D 20:42:14.335325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 313. [D 20:42:14.335340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 314. [D 20:42:14.335350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 315. [D 20:42:14.335376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 316. [D 20:42:14.335386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 317. [D 20:42:14.335396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 318. [D 20:42:14.335424] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 319. [D 20:42:14.340903] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 319. [D 20:42:14.340920] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 6/70. [D 20:42:14.343130] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.343145] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.343156] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.346679] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.346693] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.346703] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.346737] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2387 [D 20:42:14.346749] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:14.349036] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 7/70. [D 20:42:14.429799] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2387 [D 20:42:14.429817] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 8/70. [D 20:42:14.429903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 319. [D 20:42:14.429980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 320. [D 20:42:14.430028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 321. [D 20:42:14.430038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 322. [D 20:42:14.430049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 323. [D 20:42:14.430059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 324. [D 20:42:14.430070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 325. [D 20:42:14.430093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 326. [D 20:42:14.430105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 327. [D 20:42:14.430115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 328. [D 20:42:14.430125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 329. [D 20:42:14.430139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 330. [D 20:42:14.430153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 331. [D 20:42:14.430163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 332. [D 20:42:14.430175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 333. [D 20:42:14.430185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 334. [D 20:42:14.430195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 335. [D 20:42:14.430205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 336. [D 20:42:14.430223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 337. [D 20:42:14.430254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 338. [D 20:42:14.430267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 339. [D 20:42:14.430277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 340. [D 20:42:14.430300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 341. [D 20:42:14.430311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 342. [D 20:42:14.430321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 343. [D 20:42:14.430334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 344. [D 20:42:14.430344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 345. [D 20:42:14.430369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 346. [D 20:42:14.430379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 347. [D 20:42:14.430389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 348. [D 20:42:14.430400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 349. [D 20:42:14.430424] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 350. [D 20:42:14.435885] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 350. [D 20:42:14.435904] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 9/70. [D 20:42:14.438204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.438219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.438229] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.443751] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.443765] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.443776] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.443809] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2390 [D 20:42:14.443821] element 0: offset: 0x2aaaab202c60, size: 24 [D 20:42:14.443835] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 10/70. [D 20:42:14.449159] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2382 [D 20:42:14.449185] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 11/70. [D 20:42:14.449247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 350. [D 20:42:14.449309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 351. [D 20:42:14.449325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 352. [D 20:42:14.449336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 353. [D 20:42:14.449349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 354. [D 20:42:14.449359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 355. [D 20:42:14.449369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 356. [D 20:42:14.449382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 357. [D 20:42:14.449392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 358. [D 20:42:14.449402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 359. [D 20:42:14.449418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 360. [D 20:42:14.449427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 361. [D 20:42:14.449437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 362. [D 20:42:14.449452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 363. [D 20:42:14.449462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 364. [D 20:42:14.449472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 365. [D 20:42:14.449515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 366. [D 20:42:14.449526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 367. [D 20:42:14.449537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 368. [D 20:42:14.449547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 369. [D 20:42:14.449570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 370. [D 20:42:14.449580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 371. [D 20:42:14.449591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 372. [D 20:42:14.449601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 373. [D 20:42:14.449610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 374. [D 20:42:14.449627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 375. [D 20:42:14.449637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 376. [D 20:42:14.449647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 377. [D 20:42:14.449657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 378. [D 20:42:14.449691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 379. [D 20:42:14.449702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 380. [D 20:42:14.449713] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 381. [D 20:42:14.458606] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 381. [D 20:42:14.458681] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 12/70. [D 20:42:14.460863] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.460878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.460889] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.466928] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.466949] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.466960] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.466993] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2394 [D 20:42:14.467004] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:14.467017] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 13/70. [D 20:42:14.477772] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2390 [D 20:42:14.477791] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 14/70. [D 20:42:14.477850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 381. [D 20:42:14.477915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 382. [D 20:42:14.477934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 383. [D 20:42:14.477945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 384. [D 20:42:14.477955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 385. [D 20:42:14.477965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 386. [D 20:42:14.477981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 387. [D 20:42:14.477991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 388. [D 20:42:14.478001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 389. [D 20:42:14.478017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 390. [D 20:42:14.478026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 391. [D 20:42:14.478036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 392. [D 20:42:14.478047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 393. [D 20:42:14.478056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 394. [D 20:42:14.478066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 395. [D 20:42:14.478076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 396. [D 20:42:14.478130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 397. [D 20:42:14.478141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 398. [D 20:42:14.478151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 399. [D 20:42:14.478177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 400. [D 20:42:14.478187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 401. [D 20:42:14.478197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 402. [D 20:42:14.478207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 403. [D 20:42:14.478217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 404. [D 20:42:14.478228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 405. [D 20:42:14.478239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 406. [D 20:42:14.478248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 407. [D 20:42:14.478282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 408. [D 20:42:14.478294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 409. [D 20:42:14.478308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 410. [D 20:42:14.478318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 411. [D 20:42:14.478328] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 412. [D 20:42:14.483774] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 412. [D 20:42:14.483793] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 15/70. [D 20:42:14.485999] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.486013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.486024] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.491748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.491763] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.491773] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.491812] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2396 [D 20:42:14.491823] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:14.491837] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 16/70. [D 20:42:14.553546] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2394 [D 20:42:14.553598] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 17/70. [D 20:42:14.553670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 412. [D 20:42:14.553744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 413. [D 20:42:14.553755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 414. [D 20:42:14.553766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 415. [D 20:42:14.553780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 416. [D 20:42:14.553790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 417. [D 20:42:14.553801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 418. [D 20:42:14.553815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 419. [D 20:42:14.553825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 420. [D 20:42:14.553835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 421. [D 20:42:14.553851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 422. [D 20:42:14.553860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 423. [D 20:42:14.553870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 424. [D 20:42:14.553880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 425. [D 20:42:14.553889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 426. [D 20:42:14.553899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 427. [D 20:42:14.553910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 428. [D 20:42:14.553922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 429. [D 20:42:14.553980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 430. [D 20:42:14.553991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 431. [D 20:42:14.554000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 432. [D 20:42:14.554010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 433. [D 20:42:14.554026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 434. [D 20:42:14.554036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 435. [D 20:42:14.554045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 436. [D 20:42:14.554055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 437. [D 20:42:14.554072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 438. [D 20:42:14.554082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 439. [D 20:42:14.554092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 440. [D 20:42:14.554102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 441. [D 20:42:14.554129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 442. [D 20:42:14.554140] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 443. [D 20:42:14.559599] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 443. [D 20:42:14.559617] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 18/70. [D 20:42:14.561828] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.561844] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.561854] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.567877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.567899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.567910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.567944] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2400 [D 20:42:14.567955] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:14.567968] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 19/70. [D 20:42:14.582793] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2396 [D 20:42:14.582812] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 20/70. [D 20:42:14.582869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 443. [D 20:42:14.582935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 444. [D 20:42:14.582955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 445. [D 20:42:14.582966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 446. [D 20:42:14.582977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 447. [D 20:42:14.582987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 448. [D 20:42:14.583002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 449. [D 20:42:14.583012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 450. [D 20:42:14.583022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 451. [D 20:42:14.583038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 452. [D 20:42:14.583089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 453. [D 20:42:14.583101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 454. [D 20:42:14.583111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 455. [D 20:42:14.583136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 456. [D 20:42:14.583146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 457. [D 20:42:14.583157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 458. [D 20:42:14.583167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 459. [D 20:42:14.583177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 460. [D 20:42:14.583187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 461. [D 20:42:14.583197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 462. [D 20:42:14.583224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 463. [D 20:42:14.583240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 464. [D 20:42:14.583250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 465. [D 20:42:14.583259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 466. [D 20:42:14.583275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 467. [D 20:42:14.583285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 468. [D 20:42:14.583295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 469. [D 20:42:14.583304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 470. [D 20:42:14.583315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 471. [D 20:42:14.583325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 472. [D 20:42:14.583334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 473. [D 20:42:14.583359] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 474. [D 20:42:14.588792] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 474. [D 20:42:14.588810] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 21/70. [D 20:42:14.591125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.591140] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.591151] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.596829] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.596843] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.596853] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.596887] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2402 [D 20:42:14.596898] element 0: offset: 0x2aaaab202c60, size: 24 [D 20:42:14.596912] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 22/70. [D 20:42:14.656173] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2402 [D 20:42:14.656231] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 23/70. [D 20:42:14.656298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 474. [D 20:42:14.656372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 475. [D 20:42:14.656384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 476. [D 20:42:14.656395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 477. [D 20:42:14.656405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 478. [D 20:42:14.656414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 479. [D 20:42:14.656425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 480. [D 20:42:14.656435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 481. [D 20:42:14.656445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 482. [D 20:42:14.656455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 483. [D 20:42:14.656473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 484. [D 20:42:14.656482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 485. [D 20:42:14.656492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 486. [D 20:42:14.656502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 487. [D 20:42:14.656566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 488. [D 20:42:14.656577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 489. [D 20:42:14.656587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 490. [D 20:42:14.656597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 491. [D 20:42:14.656607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 492. [D 20:42:14.656617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 493. [D 20:42:14.656627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 494. [D 20:42:14.656642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 495. [D 20:42:14.656651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 496. [D 20:42:14.656661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 497. [D 20:42:14.656671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 498. [D 20:42:14.656683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 499. [D 20:42:14.656693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 500. [D 20:42:14.656716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 501. [D 20:42:14.656726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 502. [D 20:42:14.656736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 503. [D 20:42:14.656746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 504. [D 20:42:14.656764] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 505. [D 20:42:14.662298] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 505. [D 20:42:14.662315] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 24/70. [D 20:42:14.664503] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.664518] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.664529] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.670048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.670064] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.670074] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.670107] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2405 [D 20:42:14.670119] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:14.670131] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 25/70. [D 20:42:14.722289] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2400 [D 20:42:14.722308] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 26/70. [D 20:42:14.722367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 505. [D 20:42:14.722437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 506. [D 20:42:14.722455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 507. [D 20:42:14.722465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 508. [D 20:42:14.722477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 509. [D 20:42:14.722486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 510. [D 20:42:14.722502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 511. [D 20:42:14.722512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 512. [D 20:42:14.722522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 513. [D 20:42:14.722538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 514. [D 20:42:14.722589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 515. [D 20:42:14.722601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 516. [D 20:42:14.722610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 517. [D 20:42:14.722638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 518. [D 20:42:14.722648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 519. [D 20:42:14.722663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 520. [D 20:42:14.722673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 521. [D 20:42:14.722683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 522. [D 20:42:14.722708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 523. [D 20:42:14.722719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 524. [D 20:42:14.722729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 525. [D 20:42:14.722740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 526. [D 20:42:14.722750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 527. [D 20:42:14.722760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 528. [D 20:42:14.722770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 529. [D 20:42:14.722795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 530. [D 20:42:14.722811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 531. [D 20:42:14.722821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 532. [D 20:42:14.722830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 533. [D 20:42:14.722855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 534. [D 20:42:14.722865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 535. [D 20:42:14.722876] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 536. [D 20:42:14.728291] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 536. [D 20:42:14.728308] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 27/70. [D 20:42:14.730491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.730506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.730515] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.736670] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.736685] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.736697] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.736731] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2409 [D 20:42:14.736742] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:14.736754] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 28/70. [D 20:42:15.055861] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2405 [D 20:42:15.055915] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 29/70. [D 20:42:15.056053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 536. [D 20:42:15.056134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 537. [D 20:42:15.056146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 538. [D 20:42:15.056157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 539. [D 20:42:15.056171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 540. [D 20:42:15.056181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 541. [D 20:42:15.056191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 542. [D 20:42:15.056207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 543. [D 20:42:15.056217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 544. [D 20:42:15.056227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 545. [D 20:42:15.056240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 546. [D 20:42:15.056250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 547. [D 20:42:15.056288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 548. [D 20:42:15.056299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 549. [D 20:42:15.056313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 550. [D 20:42:15.056323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 551. [D 20:42:15.056333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 552. [D 20:42:15.056348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 553. [D 20:42:15.056357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 554. [D 20:42:15.056367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 555. [D 20:42:15.056382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 556. [D 20:42:15.056392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 557. [D 20:42:15.056402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 558. [D 20:42:15.056412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 559. [D 20:42:15.056428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 560. [D 20:42:15.056450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 561. [D 20:42:15.056461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 562. [D 20:42:15.056470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 563. [D 20:42:15.056480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 564. [D 20:42:15.056496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 565. [D 20:42:15.056507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 566. [D 20:42:15.056516] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 567. [D 20:42:15.058774] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.058790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.058801] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 5 [D 20:42:15.058863] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 2412 [D 20:42:15.058877] element 0: offset: 0x2aaaab229a50, size: 104 [D 20:42:15.058890] openib_post_sr: 10.1.4.240:38258 bh 0 len 120 wr 30/70. [D 20:42:15.061994] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 567. [D 20:42:15.062009] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 31/70. [D 20:42:15.062689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.062702] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.062713] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 4 [D 20:42:15.062731] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.062743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.062751] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.168642] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2409 [D 20:42:15.168662] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 32/70. [D 20:42:15.168764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 567. [D 20:42:15.168875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 568. [D 20:42:15.168886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 569. [D 20:42:15.168897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 570. [D 20:42:15.168911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 571. [D 20:42:15.168921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 572. [D 20:42:15.168931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 573. [D 20:42:15.168945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 574. [D 20:42:15.168955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 575. [D 20:42:15.168965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 576. [D 20:42:15.168975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 577. [D 20:42:15.168985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 578. [D 20:42:15.168995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 579. [D 20:42:15.169005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 580. [D 20:42:15.169035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 581. [D 20:42:15.169057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 582. [D 20:42:15.169071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 583. [D 20:42:15.169081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 584. [D 20:42:15.169091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 585. [D 20:42:15.169116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 586. [D 20:42:15.169126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 587. [D 20:42:15.169139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 588. [D 20:42:15.169179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 589. [D 20:42:15.169190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 590. [D 20:42:15.169203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 591. [D 20:42:15.169227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 592. [D 20:42:15.169237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 593. [D 20:42:15.169247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 594. [D 20:42:15.169270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 595. [D 20:42:15.169281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 596. [D 20:42:15.169291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 597. [D 20:42:15.169302] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 598. [D 20:42:15.174735] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 598. [D 20:42:15.174753] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 33/70. [D 20:42:15.177046] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.177061] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.177071] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:15.183755] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.183770] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.183781] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:15.183815] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2415 [D 20:42:15.183826] element 0: offset: 0x2aaaab2030a0, size: 24 [D 20:42:15.183838] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 34/70. [D 20:42:15.198327] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.198364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.198373] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.198402] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2417 [D 20:42:15.198412] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.198424] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 35/70. [D 20:42:15.239047] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2415 [D 20:42:15.239088] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 36/70. [D 20:42:15.239149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 598. [D 20:42:15.239221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 599. [D 20:42:15.239232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 600. [D 20:42:15.239243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 601. [D 20:42:15.239253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 602. [D 20:42:15.239262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 603. [D 20:42:15.239273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 604. [D 20:42:15.239283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 605. [D 20:42:15.239292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 606. [D 20:42:15.239302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 607. [D 20:42:15.239312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 608. [D 20:42:15.239322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 609. [D 20:42:15.239332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 610. [D 20:42:15.239389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 611. [D 20:42:15.239413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 612. [D 20:42:15.239424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 613. [D 20:42:15.239434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 614. [D 20:42:15.239443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 615. [D 20:42:15.239460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 616. [D 20:42:15.239470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 617. [D 20:42:15.239480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 618. [D 20:42:15.239489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 619. [D 20:42:15.239516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 620. [D 20:42:15.239526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 621. [D 20:42:15.239537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 622. [D 20:42:15.239547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 623. [D 20:42:15.239568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 624. [D 20:42:15.239585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 625. [D 20:42:15.239595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 626. [D 20:42:15.239605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 627. [D 20:42:15.239615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 628. [D 20:42:15.239625] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 629. [D 20:42:15.245077] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 629. [D 20:42:15.245096] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 37/70. [D 20:42:15.246715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.246730] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.246742] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.253491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.253505] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.253515] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.253549] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2421 [D 20:42:15.253560] element 0: offset: 0x2aaaab202f80, size: 24 [D 20:42:15.253574] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 38/70. [D 20:42:15.317098] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2417 [D 20:42:15.317153] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 39/70. [D 20:42:15.317219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 629. [D 20:42:15.317291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 630. [D 20:42:15.317302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 631. [D 20:42:15.317314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 632. [D 20:42:15.317324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 633. [D 20:42:15.317335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 634. [D 20:42:15.317346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 635. [D 20:42:15.317355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 636. [D 20:42:15.317365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 637. [D 20:42:15.317383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 638. [D 20:42:15.317392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 639. [D 20:42:15.317402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 640. [D 20:42:15.317458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 641. [D 20:42:15.317470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 642. [D 20:42:15.317482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 643. [D 20:42:15.317492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 644. [D 20:42:15.317502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 645. [D 20:42:15.317512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 646. [D 20:42:15.317536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 647. [D 20:42:15.317547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 648. [D 20:42:15.317569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 649. [D 20:42:15.317580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 650. [D 20:42:15.317590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 651. [D 20:42:15.317600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 652. [D 20:42:15.317610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 653. [D 20:42:15.317620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 654. [D 20:42:15.317644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 655. [D 20:42:15.317654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 656. [D 20:42:15.317664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 657. [D 20:42:15.317678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 658. [D 20:42:15.317687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 659. [D 20:42:15.317697] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 660. [D 20:42:15.323150] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 660. [D 20:42:15.323167] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 40/70. [D 20:42:15.325493] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.325508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.325518] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.330744] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.330758] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.330770] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.330804] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2423 [D 20:42:15.330815] element 0: offset: 0x2aaaab235a20, size: 24 [D 20:42:15.330827] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 41/70. [D 20:42:15.369309] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2421 [D 20:42:15.369327] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 42/70. [D 20:42:15.369392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 660. [D 20:42:15.369504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 661. [D 20:42:15.369518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 662. [D 20:42:15.369529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 663. [D 20:42:15.369540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 664. [D 20:42:15.369551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 665. [D 20:42:15.369561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 666. [D 20:42:15.369584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 667. [D 20:42:15.369594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 668. [D 20:42:15.369604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 669. [D 20:42:15.369614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 670. [D 20:42:15.369624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 671. [D 20:42:15.369648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 672. [D 20:42:15.369658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 673. [D 20:42:15.369679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 674. [D 20:42:15.369689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 675. [D 20:42:15.369699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 676. [D 20:42:15.369713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 677. [D 20:42:15.369736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 678. [D 20:42:15.369748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 679. [D 20:42:15.369758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 680. [D 20:42:15.369780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 681. [D 20:42:15.369790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 682. [D 20:42:15.369800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 683. [D 20:42:15.369821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 684. [D 20:42:15.369831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 685. [D 20:42:15.369841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 686. [D 20:42:15.369851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 687. [D 20:42:15.369862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 688. [D 20:42:15.369872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 689. [D 20:42:15.369882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 690. [D 20:42:15.369895] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 691. [D 20:42:15.375362] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 691. [D 20:42:15.375380] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 43/70. [D 20:42:15.377554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.377569] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.377580] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.471103] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2370 [D 20:42:15.471119] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:15.471137] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 44/70. [D 20:42:15.473264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.473278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.473288] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:15.473352] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2373 [D 20:42:15.473365] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:15.473376] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 45/70. [D 20:42:15.476795] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2373 [D 20:42:15.476814] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 46/70. [D 20:42:15.476834] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.476848] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.476857] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:15.476944] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2429 [D 20:42:15.476963] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:15.476975] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 47/70. [D 20:42:15.477320] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2429 [D 20:42:15.485957] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 48/70. [D 20:42:15.492437] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2373 [D 20:42:15.492457] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:15.492468] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 49/70. [D 20:42:15.493059] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2429 [D 20:42:15.493074] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:15.493084] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 50/70. [D 20:42:15.493157] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.493169] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.493178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:15.493194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.493203] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.493211] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:15.497255] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.497269] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.497278] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:15.498252] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.498266] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.498275] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:15.498768] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2432 [D 20:42:15.498782] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:15.498792] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 51/70. [D 20:42:15.498834] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2435 [D 20:42:15.498844] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.498854] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 52/70. [D 20:42:15.499095] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2435 [D 20:42:15.499113] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 53/70. [D 20:42:15.511371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.511385] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.511394] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.511412] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2438 [D 20:42:15.511422] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:15.511432] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 54/70. [D 20:42:15.517481] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2435 [D 20:42:15.517531] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.517546] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 55/70. [D 20:42:15.517702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.517715] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.517724] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.525967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.525983] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.525992] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.526095] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2441 [D 20:42:15.526106] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:15.526117] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 56/70. [D 20:42:15.526225] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2441 [D 20:42:15.526339] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 57/70. [D 20:42:15.546958] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2441 [D 20:42:15.546973] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:15.546983] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 58/70. [D 20:42:15.547065] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.547079] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.547087] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.554316] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.554329] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.554338] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.554386] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2444 [D 20:42:15.554396] element 0: offset: 0x2aaaab202f80, size: 24 [D 20:42:15.554406] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 59/70. [D 20:42:15.554459] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2444 [D 20:42:15.554510] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 60/70. [D 20:42:15.563983] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2423 [D 20:42:15.564003] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 0/70. [D 20:42:15.567369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 691. [D 20:42:15.567395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 692. [D 20:42:15.567406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 693. [D 20:42:15.567417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 694. [D 20:42:15.567428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 695. [D 20:42:15.567439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 696. [D 20:42:15.567449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 697. [D 20:42:15.567459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 698. [D 20:42:15.567469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 699. [D 20:42:15.567479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 700. [D 20:42:15.567489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 701. [D 20:42:15.567506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 702. [D 20:42:15.567516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 703. [D 20:42:15.567526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 704. [D 20:42:15.567535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 705. [D 20:42:15.567545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 706. [D 20:42:15.567556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 707. [D 20:42:15.567588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 708. [D 20:42:15.567598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 709. [D 20:42:15.567609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 710. [D 20:42:15.567619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 711. [D 20:42:15.567629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 712. [D 20:42:15.567639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 713. [D 20:42:15.567657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 714. [D 20:42:15.567667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 715. [D 20:42:15.567677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 716. [D 20:42:15.567702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 717. [D 20:42:15.567713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 718. [D 20:42:15.567723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 719. [D 20:42:15.567733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 720. [D 20:42:15.567743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 721. [D 20:42:15.567753] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 722. [D 20:42:15.573328] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 722. [D 20:42:15.573394] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 1/70. [D 20:42:15.573458] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.573472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.573480] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.576217] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2444 [D 20:42:15.576230] element 0: offset: 0x2aaaab202f80, size: 24 [D 20:42:15.576241] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 2/70. [D 20:42:15.576305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.576316] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.576325] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:15.579120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.579135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.579144] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:15.579162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2446 [D 20:42:15.579172] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:15.579182] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 3/70. [D 20:42:15.584088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.584103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.584111] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.584171] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2450 [D 20:42:15.584182] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.584192] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 4/70. [D 20:42:15.584289] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2450 [D 20:42:15.584376] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 5/70. [D 20:42:15.605376] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2450 [D 20:42:15.605390] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.605401] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 6/70. [D 20:42:15.605482] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.605496] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.605504] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.612874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.612888] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.612896] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.612945] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2453 [D 20:42:15.612956] element 0: offset: 0x2aaaab235880, size: 24 [D 20:42:15.612966] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 7/70. [D 20:42:15.613020] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2453 [D 20:42:15.613072] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 8/70. [D 20:42:15.631608] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2453 [D 20:42:15.631622] element 0: offset: 0x2aaaab235880, size: 24 [D 20:42:15.631632] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 9/70. [D 20:42:15.631709] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.631723] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.631731] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.635118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.635132] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.635140] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.635188] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2456 [D 20:42:15.635199] element 0: offset: 0x2aaaab208e30, size: 24 [D 20:42:15.635209] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 10/70. [D 20:42:15.635258] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2456 [D 20:42:15.635292] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 11/70. [D 20:42:15.642891] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2456 [D 20:42:15.642907] element 0: offset: 0x2aaaab208e30, size: 24 [D 20:42:15.642917] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 12/70. [D 20:42:15.642981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.642993] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.643001] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.643907] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.643921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.643929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.643976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2459 [D 20:42:15.643987] element 0: offset: 0x2aaaab20e7d0, size: 24 [D 20:42:15.643997] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 13/70. [D 20:42:15.644141] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2446 [D 20:42:15.644158] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 14/70. [D 20:42:15.644209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 722. [D 20:42:15.644269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 723. [D 20:42:15.644281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 724. [D 20:42:15.644291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 725. [D 20:42:15.644302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 726. [D 20:42:15.644312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 727. [D 20:42:15.644321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 728. [D 20:42:15.644331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 729. [D 20:42:15.644347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 730. [D 20:42:15.644356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 731. [D 20:42:15.644387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 732. [D 20:42:15.644402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 733. [D 20:42:15.644411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 734. [D 20:42:15.644422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 735. [D 20:42:15.644437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 736. [D 20:42:15.644447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 737. [D 20:42:15.644473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 738. [D 20:42:15.644483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 739. [D 20:42:15.644493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 740. [D 20:42:15.644506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 741. [D 20:42:15.644516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 742. [D 20:42:15.644526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 743. [D 20:42:15.644555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 744. [D 20:42:15.644566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 745. [D 20:42:15.644577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 746. [D 20:42:15.644586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 747. [D 20:42:15.644597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 748. [D 20:42:15.644621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 749. [D 20:42:15.644632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 750. [D 20:42:15.644643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 751. [D 20:42:15.644653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 752. [D 20:42:15.644663] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 753. [D 20:42:15.653310] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 753. [D 20:42:15.653329] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 15/70. [D 20:42:15.653537] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.653553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.653561] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.659417] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.659430] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.659439] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.659454] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2461 [D 20:42:15.659463] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.659475] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 16/70. [D 20:42:15.738224] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2432 [D 20:42:15.738241] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 17/70. [D 20:42:15.738343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 753. [D 20:42:15.738453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 754. [D 20:42:15.738464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 755. [D 20:42:15.738474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 756. [D 20:42:15.738484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 757. [D 20:42:15.738495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 758. [D 20:42:15.738505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 759. [D 20:42:15.738515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 760. [D 20:42:15.738525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 761. [D 20:42:15.738534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 762. [D 20:42:15.738544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 763. [D 20:42:15.738576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 764. [D 20:42:15.738586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 765. [D 20:42:15.738610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 766. [D 20:42:15.738620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 767. [D 20:42:15.738633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 768. [D 20:42:15.738651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 769. [D 20:42:15.738662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 770. [D 20:42:15.738672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 771. [D 20:42:15.738682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 772. [D 20:42:15.738707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 773. [D 20:42:15.738717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 774. [D 20:42:15.738734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 775. [D 20:42:15.738758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 776. [D 20:42:15.738768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 777. [D 20:42:15.738777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 778. [D 20:42:15.738798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 779. [D 20:42:15.738808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 780. [D 20:42:15.738818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 781. [D 20:42:15.738840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 782. [D 20:42:15.738850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 783. [D 20:42:15.738860] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 784. [D 20:42:15.744653] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 784. [D 20:42:15.744671] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 18/70. [D 20:42:15.744736] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.744751] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.744759] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.751263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.751276] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.751284] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.751300] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2465 [D 20:42:15.751310] element 0: offset: 0x2aaaab235a20, size: 24 [D 20:42:15.751320] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 19/70. [D 20:42:15.806448] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2461 [D 20:42:15.806464] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 20/70. [D 20:42:15.806523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 784. [D 20:42:15.806593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 785. [D 20:42:15.806652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 786. [D 20:42:15.806663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 787. [D 20:42:15.806673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 788. [D 20:42:15.806684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 789. [D 20:42:15.806694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 790. [D 20:42:15.806722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 791. [D 20:42:15.806787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 792. [D 20:42:15.806798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 793. [D 20:42:15.806808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 794. [D 20:42:15.806818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 795. [D 20:42:15.806828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 796. [D 20:42:15.806838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 797. [D 20:42:15.806848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 798. [D 20:42:15.806858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 799. [D 20:42:15.806868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 800. [D 20:42:15.806890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 801. [D 20:42:15.806901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 802. [D 20:42:15.806911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 803. [D 20:42:15.806934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 804. [D 20:42:15.806944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 805. [D 20:42:15.806953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 806. [D 20:42:15.806975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 807. [D 20:42:15.806985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 808. [D 20:42:15.806995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 809. [D 20:42:15.807006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 810. [D 20:42:15.807016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 811. [D 20:42:15.807026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 812. [D 20:42:15.807052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 813. [D 20:42:15.807062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 814. [D 20:42:15.807073] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 815. [D 20:42:15.812478] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 815. [D 20:42:15.812495] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 21/70. [D 20:42:15.812561] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.812576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.812584] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.818049] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.818063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.818071] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.818086] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2467 [D 20:42:15.818096] element 0: offset: 0x2aaaab235880, size: 24 [D 20:42:15.818106] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 22/70. [D 20:42:15.888353] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2467 [D 20:42:15.888369] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 23/70. [D 20:42:15.888471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 815. [D 20:42:15.888548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 816. [D 20:42:15.888559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 817. [D 20:42:15.888569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 818. [D 20:42:15.888583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 819. [D 20:42:15.888593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 820. [D 20:42:15.888602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 821. [D 20:42:15.888612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 822. [D 20:42:15.888622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 823. [D 20:42:15.888632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 824. [D 20:42:15.888641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 825. [D 20:42:15.888659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 826. [D 20:42:15.888669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 827. [D 20:42:15.888678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 828. [D 20:42:15.888688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 829. [D 20:42:15.888700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 830. [D 20:42:15.888709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 831. [D 20:42:15.888719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 832. [D 20:42:15.888777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 833. [D 20:42:15.888788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 834. [D 20:42:15.888807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 835. [D 20:42:15.888817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 836. [D 20:42:15.888827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 837. [D 20:42:15.888837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 838. [D 20:42:15.888847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 839. [D 20:42:15.888857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 840. [D 20:42:15.888866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 841. [D 20:42:15.888876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 842. [D 20:42:15.888901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 843. [D 20:42:15.888911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 844. [D 20:42:15.888921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 845. [D 20:42:15.888932] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 846. [D 20:42:15.894447] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 846. [D 20:42:15.894465] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 24/70. [D 20:42:15.894770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.894785] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.894795] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.902209] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.902223] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.902234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.902268] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2470 [D 20:42:15.902279] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:15.902293] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 25/70. [D 20:42:16.046660] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2470 [D 20:42:16.046696] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 26/70. [D 20:42:16.046829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 846. [D 20:42:16.046942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 847. [D 20:42:16.046954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 848. [D 20:42:16.046965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 849. [D 20:42:16.046979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 850. [D 20:42:16.046989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 851. [D 20:42:16.046999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 852. [D 20:42:16.047014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 853. [D 20:42:16.047023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 854. [D 20:42:16.047033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 855. [D 20:42:16.047063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 856. [D 20:42:16.047100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 857. [D 20:42:16.047123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 858. [D 20:42:16.047153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 859. [D 20:42:16.047163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 860. [D 20:42:16.047172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 861. [D 20:42:16.047182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 862. [D 20:42:16.047199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 863. [D 20:42:16.047224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 864. [D 20:42:16.047237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 865. [D 20:42:16.047247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 866. [D 20:42:16.047256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 867. [D 20:42:16.047270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 868. [D 20:42:16.047280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 869. [D 20:42:16.047290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 870. [D 20:42:16.047305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 871. [D 20:42:16.047315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 872. [D 20:42:16.047325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 873. [D 20:42:16.047335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 874. [D 20:42:16.047344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 875. [D 20:42:16.047363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 876. [D 20:42:16.047388] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 877. [D 20:42:16.052843] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 877. [D 20:42:16.052859] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 27/70. [D 20:42:16.055153] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.055168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.055178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.058761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.058775] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.058785] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.058818] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2473 [D 20:42:16.058829] element 0: offset: 0x2aaaab202f80, size: 24 [D 20:42:16.058841] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 28/70. [D 20:42:16.142568] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2465 [D 20:42:16.142586] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 29/70. [D 20:42:16.142672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 877. [D 20:42:16.142762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 878. [D 20:42:16.142774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 879. [D 20:42:16.142784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 880. [D 20:42:16.142795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 881. [D 20:42:16.142805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 882. [D 20:42:16.142815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 883. [D 20:42:16.142826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 884. [D 20:42:16.142835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 885. [D 20:42:16.142848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 886. [D 20:42:16.142864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 887. [D 20:42:16.142879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 888. [D 20:42:16.142889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 889. [D 20:42:16.142898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 890. [D 20:42:16.142915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 891. [D 20:42:16.142925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 892. [D 20:42:16.142975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 893. [D 20:42:16.142988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 894. [D 20:42:16.142998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 895. [D 20:42:16.143055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 896. [D 20:42:16.143068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 897. [D 20:42:16.143077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 898. [D 20:42:16.143104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 899. [D 20:42:16.143116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 900. [D 20:42:16.143129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 901. [D 20:42:16.143139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 902. [D 20:42:16.143148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 903. [D 20:42:16.143163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 904. [D 20:42:16.143186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 905. [D 20:42:16.143200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 906. [D 20:42:16.143210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 907. [D 20:42:16.143220] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 908. [D 20:42:16.148647] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 908. [D 20:42:16.148664] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 30/70. [D 20:42:16.151015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.151031] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.151041] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.157644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.157658] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.157668] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.157700] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2477 [D 20:42:16.157711] element 0: offset: 0x2aaaab223670, size: 24 [D 20:42:16.157723] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 31/70. [D 20:42:16.170106] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2438 [D 20:42:16.170125] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 32/70. [D 20:42:16.170190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 908. [D 20:42:16.170269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 909. [D 20:42:16.170280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 910. [D 20:42:16.170291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 911. [D 20:42:16.170302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 912. [D 20:42:16.170311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 913. [D 20:42:16.170321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 914. [D 20:42:16.170331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 915. [D 20:42:16.170347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 916. [D 20:42:16.170357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 917. [D 20:42:16.170367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 918. [D 20:42:16.170377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 919. [D 20:42:16.170388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 920. [D 20:42:16.170397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 921. [D 20:42:16.170408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 922. [D 20:42:16.170422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 923. [D 20:42:16.170432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 924. [D 20:42:16.170441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 925. [D 20:42:16.170452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 926. [D 20:42:16.170462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 927. [D 20:42:16.170524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 928. [D 20:42:16.170538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 929. [D 20:42:16.170549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 930. [D 20:42:16.170569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 931. [D 20:42:16.170583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 932. [D 20:42:16.170593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 933. [D 20:42:16.170602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 934. [D 20:42:16.170616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 935. [D 20:42:16.170626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 936. [D 20:42:16.170636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 937. [D 20:42:16.170664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 938. [D 20:42:16.170677] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 939. [D 20:42:16.174948] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2473 [D 20:42:16.174967] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 33/70. [D 20:42:16.176143] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 939. [D 20:42:16.176189] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 34/70. [D 20:42:16.176204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 939. [D 20:42:16.176220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 940. [D 20:42:16.176231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 941. [D 20:42:16.176240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 942. [D 20:42:16.176255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 943. [D 20:42:16.176265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 944. [D 20:42:16.176274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 945. [D 20:42:16.176289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 946. [D 20:42:16.176299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 947. [D 20:42:16.176309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 948. [D 20:42:16.176345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 949. [D 20:42:16.176355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 950. [D 20:42:16.176365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 951. [D 20:42:16.176375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 952. [D 20:42:16.176390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 953. [D 20:42:16.176400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 954. [D 20:42:16.176410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 955. [D 20:42:16.176434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 956. [D 20:42:16.176443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 957. [D 20:42:16.176465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 958. [D 20:42:16.176475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 959. [D 20:42:16.176484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 960. [D 20:42:16.176495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 961. [D 20:42:16.176505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 962. [D 20:42:16.176514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 963. [D 20:42:16.176524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 964. [D 20:42:16.176534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 965. [D 20:42:16.176553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 966. [D 20:42:16.176563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 967. [D 20:42:16.176572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 968. [D 20:42:16.176583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 969. [D 20:42:16.176592] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 970. [D 20:42:16.176667] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.176681] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.176707] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.182124] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 970. [D 20:42:16.182139] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 35/70. [D 20:42:16.184207] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.184220] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.184230] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.184262] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2480 [D 20:42:16.184273] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:16.184284] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 36/70. [D 20:42:16.184305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.184321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.184330] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.190179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.190195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.190205] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.190221] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2482 [D 20:42:16.190232] element 0: offset: 0x2aaaab235880, size: 24 [D 20:42:16.190241] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 37/70. [D 20:42:16.259618] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2477 [D 20:42:16.259637] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 38/70. [D 20:42:16.259697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 970. [D 20:42:16.259776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 971. [D 20:42:16.259788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 972. [D 20:42:16.259798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 973. [D 20:42:16.259809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 974. [D 20:42:16.259818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 975. [D 20:42:16.259834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 976. [D 20:42:16.259844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 977. [D 20:42:16.259854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 978. [D 20:42:16.259869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 979. [D 20:42:16.259879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 980. [D 20:42:16.259888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 981. [D 20:42:16.259898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 982. [D 20:42:16.259908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 983. [D 20:42:16.259918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 984. [D 20:42:16.259927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 985. [D 20:42:16.259937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 986. [D 20:42:16.259990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 987. [D 20:42:16.260002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 988. [D 20:42:16.260012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 989. [D 20:42:16.260021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 990. [D 20:42:16.260046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 991. [D 20:42:16.260055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 992. [D 20:42:16.260065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 993. [D 20:42:16.260076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 994. [D 20:42:16.260085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 995. [D 20:42:16.260095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 996. [D 20:42:16.260105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 997. [D 20:42:16.260121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 998. [D 20:42:16.260130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 999. [D 20:42:16.260140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1000. [D 20:42:16.260166] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1001. [D 20:42:16.265680] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1001. [D 20:42:16.265698] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 39/70. [D 20:42:16.266794] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.266809] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.266820] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.274497] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.274512] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.274522] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.274555] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2486 [D 20:42:16.274566] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:16.274578] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 40/70. [D 20:42:16.333165] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2482 [D 20:42:16.333196] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 41/70. [D 20:42:16.333257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 1001. [D 20:42:16.333328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 1002. [D 20:42:16.333339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 1003. [D 20:42:16.333349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 1004. [D 20:42:16.333369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 1005. [D 20:42:16.333379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 1006. [D 20:42:16.333389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 1007. [D 20:42:16.333400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 1008. [D 20:42:16.333409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 1009. [D 20:42:16.333419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 1010. [D 20:42:16.333429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 1011. [D 20:42:16.333486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 1012. [D 20:42:16.333509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 1013. [D 20:42:16.333523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 1014. [D 20:42:16.333533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 1015. [D 20:42:16.333543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 1016. [D 20:42:16.333557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 1017. [D 20:42:16.333567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 1018. [D 20:42:16.333576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 1019. [D 20:42:16.333602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 1020. [D 20:42:16.333612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 1021. [D 20:42:16.333622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 1022. [D 20:42:16.333633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 1023. [D 20:42:16.333642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 1024. [D 20:42:16.333652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 1025. [D 20:42:16.333677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 1026. [D 20:42:16.333688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 1027. [D 20:42:16.333697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 1028. [D 20:42:16.333707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 1029. [D 20:42:16.333717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 1030. [D 20:42:16.333743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 1031. [D 20:42:16.333753] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 1032. [D 20:42:16.339257] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1032. [D 20:42:16.339276] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 42/70. [D 20:42:16.341539] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.341554] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.341564] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.395327] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2486 [D 20:42:16.395347] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 43/70. [D 20:42:16.395407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1032. [D 20:42:16.395486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1033. [D 20:42:16.395498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1034. [D 20:42:16.395509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1035. [D 20:42:16.395519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1036. [D 20:42:16.395528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1037. [D 20:42:16.395539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1038. [D 20:42:16.395549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1039. [D 20:42:16.395558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1040. [D 20:42:16.395568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1041. [D 20:42:16.395578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1042. [D 20:42:16.395588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1043. [D 20:42:16.395635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1044. [D 20:42:16.395650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1045. [D 20:42:16.395661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1046. [D 20:42:16.395671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1047. [D 20:42:16.395681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1048. [D 20:42:16.395691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1049. [D 20:42:16.395711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1050. [D 20:42:16.395728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1051. [D 20:42:16.395747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1052. [D 20:42:16.395776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1053. [D 20:42:16.395792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1054. [D 20:42:16.395802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1055. [D 20:42:16.395811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1056. [D 20:42:16.395842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1057. [D 20:42:16.395859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1058. [D 20:42:16.395870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1059. [D 20:42:16.395879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1060. [D 20:42:16.395895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1061. [D 20:42:16.395905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1062. [D 20:42:16.395915] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1063. [D 20:42:16.401413] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1063. [D 20:42:16.401431] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 44/70. [D 20:42:16.403678] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.403694] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.403704] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:16.410533] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.410547] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.410556] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:16.410590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2489 [D 20:42:16.410601] element 0: offset: 0x2aaaab235a20, size: 24 [D 20:42:16.410615] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 45/70. [D 20:42:16.437692] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2459 [D 20:42:16.437710] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 46/70. [D 20:42:16.437777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 1063. [D 20:42:16.437856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 1064. [D 20:42:16.437867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 1065. [D 20:42:16.437878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 1066. [D 20:42:16.437888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 1067. [D 20:42:16.437897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 1068. [D 20:42:16.437907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 1069. [D 20:42:16.437918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 1070. [D 20:42:16.437927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 1071. [D 20:42:16.437937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 1072. [D 20:42:16.437946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 1073. [D 20:42:16.438009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 1074. [D 20:42:16.438020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 1075. [D 20:42:16.438041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 1076. [D 20:42:16.438055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 1077. [D 20:42:16.438065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 1078. [D 20:42:16.438075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 1079. [D 20:42:16.438088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 1080. [D 20:42:16.438098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 1081. [D 20:42:16.438122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 1082. [D 20:42:16.438134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 1083. [D 20:42:16.438143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 1084. [D 20:42:16.438154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 1085. [D 20:42:16.438164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 1086. [D 20:42:16.438173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 1087. [D 20:42:16.438183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 1088. [D 20:42:16.438209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 1089. [D 20:42:16.438218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 1090. [D 20:42:16.438228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 1091. [D 20:42:16.438238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 1092. [D 20:42:16.438248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 1093. [D 20:42:16.438268] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 1094. [D 20:42:16.445531] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1094. [D 20:42:16.445556] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 47/70. [D 20:42:16.447724] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.447739] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.447749] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:16.453459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.453477] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.453488] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:16.453523] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2492 [D 20:42:16.453534] element 0: offset: 0x2aaaab218000, size: 24 [D 20:42:16.453548] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 48/70. [D 20:42:16.471060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.471104] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.471114] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.471145] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2494 [D 20:42:16.471156] element 0: offset: 0x2aaaab2030a0, size: 24 [D 20:42:16.471167] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 49/70. [D 20:42:16.474987] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2489 [D 20:42:16.475005] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 50/70. [D 20:42:16.475155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1094. [D 20:42:16.475219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1095. [D 20:42:16.475230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1096. [D 20:42:16.475240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1097. [D 20:42:16.475255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1098. [D 20:42:16.475264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1099. [D 20:42:16.475274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1100. [D 20:42:16.475288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1101. [D 20:42:16.475298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1102. [D 20:42:16.475307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1103. [D 20:42:16.475318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1104. [D 20:42:16.475328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1105. [D 20:42:16.475338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1106. [D 20:42:16.475388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1107. [D 20:42:16.475402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1108. [D 20:42:16.475412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1109. [D 20:42:16.475422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1110. [D 20:42:16.475447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1111. [D 20:42:16.475457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1112. [D 20:42:16.475467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1113. [D 20:42:16.475478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1114. [D 20:42:16.475488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1115. [D 20:42:16.475498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1116. [D 20:42:16.475526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1117. [D 20:42:16.475536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1118. [D 20:42:16.475546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1119. [D 20:42:16.475556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1120. [D 20:42:16.475566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1121. [D 20:42:16.475586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1122. [D 20:42:16.475596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1123. [D 20:42:16.475606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1124. [D 20:42:16.475624] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1125. [D 20:42:16.484773] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1125. [D 20:42:16.484792] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 51/70. [D 20:42:16.487128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.487143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.487153] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.493754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.493804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.493814] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.493851] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2498 [D 20:42:16.493862] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:16.493877] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 52/70. [D 20:42:16.510982] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2480 [D 20:42:16.511001] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 53/70. [D 20:42:16.511061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1125. [D 20:42:16.511163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1126. [D 20:42:16.511177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1127. [D 20:42:16.511188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1128. [D 20:42:16.511199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1129. [D 20:42:16.511209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1130. [D 20:42:16.511219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1131. [D 20:42:16.511229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1132. [D 20:42:16.511240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1133. [D 20:42:16.511250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1134. [D 20:42:16.511260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1135. [D 20:42:16.511270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1136. [D 20:42:16.511287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1137. [D 20:42:16.511297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1138. [D 20:42:16.511338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1139. [D 20:42:16.511349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1140. [D 20:42:16.511373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1141. [D 20:42:16.511387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1142. [D 20:42:16.511397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1143. [D 20:42:16.511407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1144. [D 20:42:16.511435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1145. [D 20:42:16.511446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1146. [D 20:42:16.511457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1147. [D 20:42:16.511466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1148. [D 20:42:16.511477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1149. [D 20:42:16.511487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1150. [D 20:42:16.511497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1151. [D 20:42:16.511513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1152. [D 20:42:16.511523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1153. [D 20:42:16.511533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1154. [D 20:42:16.511566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1155. [D 20:42:16.511576] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1156. [D 20:42:16.517019] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1156. [D 20:42:16.517036] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 54/70. [D 20:42:16.519202] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.519217] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.519227] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.524760] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.524783] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.524793] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.524828] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2501 [D 20:42:16.524839] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:16.524853] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 55/70. [D 20:42:17.171510] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2498 [D 20:42:17.171567] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 56/70. [D 20:42:17.171680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1156. [D 20:42:17.171755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1157. [D 20:42:17.171766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1158. [D 20:42:17.171776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1159. [D 20:42:17.171791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1160. [D 20:42:17.171801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1161. [D 20:42:17.171810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1162. [D 20:42:17.171826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1163. [D 20:42:17.171836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1164. [D 20:42:17.171845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1165. [D 20:42:17.171861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1166. [D 20:42:17.171870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1167. [D 20:42:17.171957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1168. [D 20:42:17.171968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1169. [D 20:42:17.171978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1170. [D 20:42:17.171988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1171. [D 20:42:17.172002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1172. [D 20:42:17.172011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1173. [D 20:42:17.172021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1174. [D 20:42:17.172030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1175. [D 20:42:17.172041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1176. [D 20:42:17.172050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1177. [D 20:42:17.172075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1178. [D 20:42:17.172086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1179. [D 20:42:17.172096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1180. [D 20:42:17.172105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1181. [D 20:42:17.172129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1182. [D 20:42:17.172139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1183. [D 20:42:17.172149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1184. [D 20:42:17.172159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1185. [D 20:42:17.172169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1186. [D 20:42:17.172179] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1187. [D 20:42:17.177650] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1187. [D 20:42:17.177666] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 57/70. [D 20:42:17.178870] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.178885] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.178896] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.186668] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.186684] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.186693] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.186727] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2504 [D 20:42:17.186738] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:17.186752] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 58/70. [D 20:42:17.254571] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2501 [D 20:42:17.254590] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 59/70. [D 20:42:17.254648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1187. [D 20:42:17.254727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1188. [D 20:42:17.254738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1189. [D 20:42:17.254749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1190. [D 20:42:17.254759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1191. [D 20:42:17.254769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1192. [D 20:42:17.254785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1193. [D 20:42:17.254794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1194. [D 20:42:17.254804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1195. [D 20:42:17.254814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1196. [D 20:42:17.254868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1197. [D 20:42:17.254878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1198. [D 20:42:17.254891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1199. [D 20:42:17.254901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1200. [D 20:42:17.254910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1201. [D 20:42:17.254938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1202. [D 20:42:17.254949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1203. [D 20:42:17.254959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1204. [D 20:42:17.254969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1205. [D 20:42:17.254979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1206. [D 20:42:17.254989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1207. [D 20:42:17.254999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1208. [D 20:42:17.255008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1209. [D 20:42:17.255018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1210. [D 20:42:17.255028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1211. [D 20:42:17.255053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1212. [D 20:42:17.255063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1213. [D 20:42:17.255077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1214. [D 20:42:17.255086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1215. [D 20:42:17.255096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1216. [D 20:42:17.255111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1217. [D 20:42:17.255121] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1218. [D 20:42:17.260687] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1218. [D 20:42:17.260704] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 60/70. [D 20:42:17.263001] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.263016] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.263026] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.266892] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.266907] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.266917] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.266950] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2507 [D 20:42:17.266961] element 0: offset: 0x2aaaab217d60, size: 24 [D 20:42:17.266973] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 0/70. [D 20:42:17.576137] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2507 [D 20:42:17.576157] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 1/70. [D 20:42:17.576252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1218. [D 20:42:17.576332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1219. [D 20:42:17.576343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1220. [D 20:42:17.576354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1221. [D 20:42:17.576364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1222. [D 20:42:17.576374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1223. [D 20:42:17.576384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1224. [D 20:42:17.576394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1225. [D 20:42:17.576404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1226. [D 20:42:17.576414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1227. [D 20:42:17.576423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1228. [D 20:42:17.576439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1229. [D 20:42:17.576448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1230. [D 20:42:17.576458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1231. [D 20:42:17.576539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1232. [D 20:42:17.576550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1233. [D 20:42:17.576563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1234. [D 20:42:17.576574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1235. [D 20:42:17.576583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1236. [D 20:42:17.576593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1237. [D 20:42:17.576619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1238. [D 20:42:17.576629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1239. [D 20:42:17.576639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1240. [D 20:42:17.576649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1241. [D 20:42:17.576676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1242. [D 20:42:17.576686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1243. [D 20:42:17.576696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1244. [D 20:42:17.576707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1245. [D 20:42:17.576716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1246. [D 20:42:17.576731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1247. [D 20:42:17.576741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1248. [D 20:42:17.576751] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1249. [D 20:42:17.582271] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1249. [D 20:42:17.582288] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 2/70. [D 20:42:17.584611] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.584626] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.584636] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.590124] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.590139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.590148] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.590182] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2510 [D 20:42:17.590193] element 0: offset: 0x2aaaab235a20, size: 24 [D 20:42:17.590207] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 3/70. [D 20:42:17.666618] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2492 [D 20:42:17.666637] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 4/70. [D 20:42:17.666772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1249. [D 20:42:17.666840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 1250. [D 20:42:17.666861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 1251. [D 20:42:17.666872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 1252. [D 20:42:17.666883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 1253. [D 20:42:17.666892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 1254. [D 20:42:17.666903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1255. [D 20:42:17.666913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1256. [D 20:42:17.666923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1257. [D 20:42:17.667002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 1258. [D 20:42:17.667015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 1259. [D 20:42:17.667025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 1260. [D 20:42:17.667035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 1261. [D 20:42:17.667046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 1262. [D 20:42:17.667073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1263. [D 20:42:17.667083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1264. [D 20:42:17.667093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1265. [D 20:42:17.667108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 1266. [D 20:42:17.667132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 1267. [D 20:42:17.667143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 1268. [D 20:42:17.667153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 1269. [D 20:42:17.667163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 1270. [D 20:42:17.667173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1271. [D 20:42:17.667183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1272. [D 20:42:17.667203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1273. [D 20:42:17.667213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 1274. [D 20:42:17.667223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 1275. [D 20:42:17.667233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 1276. [D 20:42:17.667243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 1277. [D 20:42:17.667260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 1278. [D 20:42:17.667287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1279. [D 20:42:17.667301] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1280. [D 20:42:17.672700] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1280. [D 20:42:17.672716] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 5/70. [D 20:42:17.675077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.675092] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.675104] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.680881] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.680894] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.680904] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.680937] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2513 [D 20:42:17.680947] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:17.680962] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 6/70. [D 20:42:17.704106] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2504 [D 20:42:17.704125] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 7/70. [D 20:42:17.704182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1280. [D 20:42:17.704250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1281. [D 20:42:17.704261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1282. [D 20:42:17.704272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1283. [D 20:42:17.704282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1284. [D 20:42:17.704292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1285. [D 20:42:17.704302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1286. [D 20:42:17.704312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1287. [D 20:42:17.704322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1288. [D 20:42:17.704332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1289. [D 20:42:17.704341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1290. [D 20:42:17.704351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1291. [D 20:42:17.704391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1292. [D 20:42:17.704404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1293. [D 20:42:17.704414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1294. [D 20:42:17.704424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1295. [D 20:42:17.704461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1296. [D 20:42:17.704471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1297. [D 20:42:17.704481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1298. [D 20:42:17.704494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1299. [D 20:42:17.704504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1300. [D 20:42:17.704513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1301. [D 20:42:17.704539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1302. [D 20:42:17.704548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1303. [D 20:42:17.704558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1304. [D 20:42:17.704569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1305. [D 20:42:17.704578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1306. [D 20:42:17.704598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1307. [D 20:42:17.704608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1308. [D 20:42:17.704617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1309. [D 20:42:17.704627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1310. [D 20:42:17.704637] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1311. [D 20:42:17.710107] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1311. [D 20:42:17.710124] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 8/70. [D 20:42:17.710884] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.710899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.710909] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.719010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.719026] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.719036] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.719069] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2516 [D 20:42:17.719080] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:17.719092] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 9/70. [D 20:42:17.763690] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2516 [D 20:42:17.763710] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 10/70. [D 20:42:17.763772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1311. [D 20:42:17.763842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1312. [D 20:42:17.763863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1313. [D 20:42:17.763875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1314. [D 20:42:17.763886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1315. [D 20:42:17.763896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1316. [D 20:42:17.763906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1317. [D 20:42:17.763916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1318. [D 20:42:17.763927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1319. [D 20:42:17.763938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1320. [D 20:42:17.763948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1321. [D 20:42:17.763958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1322. [D 20:42:17.763975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1323. [D 20:42:17.763985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1324. [D 20:42:17.763995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1325. [D 20:42:17.764005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1326. [D 20:42:17.764015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1327. [D 20:42:17.764027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1328. [D 20:42:17.764036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1329. [D 20:42:17.764046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1330. [D 20:42:17.764057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1331. [D 20:42:17.764108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1332. [D 20:42:17.764120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1333. [D 20:42:17.764131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1334. [D 20:42:17.764141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1335. [D 20:42:17.764151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1336. [D 20:42:17.764161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1337. [D 20:42:17.764177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1338. [D 20:42:17.764186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1339. [D 20:42:17.764212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1340. [D 20:42:17.764222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1341. [D 20:42:17.764232] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1342. [D 20:42:17.769777] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1342. [D 20:42:17.769794] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 11/70. [D 20:42:17.772114] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.772129] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.772140] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.839813] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2513 [D 20:42:17.839832] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 12/70. [D 20:42:17.839922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1342. [D 20:42:17.840022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 1343. [D 20:42:17.840033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 1344. [D 20:42:17.840044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 1345. [D 20:42:17.840055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 1346. [D 20:42:17.840065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 1347. [D 20:42:17.840075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1348. [D 20:42:17.840085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1349. [D 20:42:17.840095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1350. [D 20:42:17.840105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 1351. [D 20:42:17.840115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 1352. [D 20:42:17.840148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 1353. [D 20:42:17.840165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 1354. [D 20:42:17.840187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 1355. [D 20:42:17.840202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1356. [D 20:42:17.840223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1357. [D 20:42:17.840236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1358. [D 20:42:17.840246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 1359. [D 20:42:17.840256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 1360. [D 20:42:17.840279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 1361. [D 20:42:17.840289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 1362. [D 20:42:17.840299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 1363. [D 20:42:17.840309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1364. [D 20:42:17.840332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1365. [D 20:42:17.840344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1366. [D 20:42:17.840353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 1367. [D 20:42:17.840374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 1368. [D 20:42:17.840385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 1369. [D 20:42:17.840404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 1370. [D 20:42:17.840420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 1371. [D 20:42:17.840429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1372. [D 20:42:17.840456] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1373. [D 20:42:17.845883] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1373. [D 20:42:17.845900] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 13/70. [D 20:42:17.848191] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.848206] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.848216] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:17.854190] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.854204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.854215] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:17.854248] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2519 [D 20:42:17.854260] element 0: offset: 0x2aaaab203080, size: 24 [D 20:42:17.854274] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 14/70. [D 20:42:17.869320] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2510 [D 20:42:17.869338] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 15/70. [D 20:42:17.869404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1373. [D 20:42:17.869510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1374. [D 20:42:17.869523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1375. [D 20:42:17.869533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1376. [D 20:42:17.869548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1377. [D 20:42:17.869558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1378. [D 20:42:17.869568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1379. [D 20:42:17.869581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1380. [D 20:42:17.869591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1381. [D 20:42:17.869601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1382. [D 20:42:17.869631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1383. [D 20:42:17.869641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1384. [D 20:42:17.869667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1385. [D 20:42:17.869683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1386. [D 20:42:17.869702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1387. [D 20:42:17.869713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1388. [D 20:42:17.869723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1389. [D 20:42:17.869733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1390. [D 20:42:17.869758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1391. [D 20:42:17.869768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1392. [D 20:42:17.869778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1393. [D 20:42:17.869811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1394. [D 20:42:17.869822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1395. [D 20:42:17.869832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1396. [D 20:42:17.869852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1397. [D 20:42:17.869862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1398. [D 20:42:17.869872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1399. [D 20:42:17.869897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1400. [D 20:42:17.869906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1401. [D 20:42:17.869916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1402. [D 20:42:17.869926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1403. [D 20:42:17.869944] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1404. [D 20:42:17.875406] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1404. [D 20:42:17.875424] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 16/70. [D 20:42:17.877573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.877588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.877599] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:17.883783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.883807] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.883818] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:17.883854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2522 [D 20:42:17.883865] element 0: offset: 0x2aaaab217d60, size: 24 [D 20:42:17.883880] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 17/70. [D 20:42:17.894732] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2494 [D 20:42:17.894750] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 18/70. [D 20:42:17.894817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1404. [D 20:42:17.894901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1405. [D 20:42:17.894913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1406. [D 20:42:17.894923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1407. [D 20:42:17.894934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1408. [D 20:42:17.894944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1409. [D 20:42:17.894954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1410. [D 20:42:17.894964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1411. [D 20:42:17.894974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1412. [D 20:42:17.894984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1413. [D 20:42:17.894993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1414. [D 20:42:17.895010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1415. [D 20:42:17.895020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1416. [D 20:42:17.895030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1417. [D 20:42:17.895052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1418. [D 20:42:17.895062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1419. [D 20:42:17.895072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1420. [D 20:42:17.895082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1421. [D 20:42:17.895099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1422. [D 20:42:17.895109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1423. [D 20:42:17.895159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1424. [D 20:42:17.895172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1425. [D 20:42:17.895183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1426. [D 20:42:17.895194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1427. [D 20:42:17.895216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1428. [D 20:42:17.895227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1429. [D 20:42:17.895237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1430. [D 20:42:17.895247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1431. [D 20:42:17.895257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1432. [D 20:42:17.895272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1433. [D 20:42:17.895291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1434. [D 20:42:17.895301] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1435. [D 20:42:17.900761] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1435. [D 20:42:17.900797] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 19/70. [D 20:42:17.902950] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.902966] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.902976] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:17.906894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.906939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.906948] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:17.906986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2526 [D 20:42:17.906999] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:17.909206] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 20/70. [D 20:42:17.909236] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.909250] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.909260] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.909277] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2527 [D 20:42:17.909288] element 0: offset: 0x2aaaab218000, size: 24 [D 20:42:17.909298] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 21/70. [D 20:42:17.913635] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2519 [D 20:42:17.913668] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 22/70. [D 20:42:17.913731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1435. [D 20:42:17.913801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1436. [D 20:42:17.913822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1437. [D 20:42:17.913833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1438. [D 20:42:17.913843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1439. [D 20:42:17.913853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1440. [D 20:42:17.913868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1441. [D 20:42:17.913878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1442. [D 20:42:17.913888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1443. [D 20:42:17.913903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1444. [D 20:42:17.913913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1445. [D 20:42:17.913923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1446. [D 20:42:17.913939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1447. [D 20:42:17.913949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1448. [D 20:42:17.913959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1449. [D 20:42:17.913969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1450. [D 20:42:17.913979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1451. [D 20:42:17.913997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1452. [D 20:42:17.914047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1453. [D 20:42:17.914058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1454. [D 20:42:17.914068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1455. [D 20:42:17.914084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1456. [D 20:42:17.914093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1457. [D 20:42:17.914103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1458. [D 20:42:17.914132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1459. [D 20:42:17.914142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1460. [D 20:42:17.914154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1461. [D 20:42:17.914164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1462. [D 20:42:17.914174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1463. [D 20:42:17.914188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1464. [D 20:42:17.914198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1465. [D 20:42:17.914207] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1466. [D 20:42:17.922376] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1466. [D 20:42:17.922393] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 23/70. [D 20:42:17.924713] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.924729] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.924739] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.928431] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.928446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.928455] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.928489] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2531 [D 20:42:17.928500] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:17.928513] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 24/70. [D 20:42:17.969302] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2531 [D 20:42:17.969320] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 25/70. [D 20:42:17.969390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 1466. [D 20:42:17.969405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1467. [D 20:42:17.969415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1468. [D 20:42:17.969424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1469. [D 20:42:17.969434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1470. [D 20:42:17.969443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1471. [D 20:42:17.969453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1472. [D 20:42:17.969462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1473. [D 20:42:17.969472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1474. [D 20:42:17.969481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1475. [D 20:42:17.969490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1476. [D 20:42:17.969500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1477. [D 20:42:17.969509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1478. [D 20:42:17.969518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1479. [D 20:42:17.969528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1480. [D 20:42:17.969537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1481. [D 20:42:17.969546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1482. [D 20:42:17.969555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1483. [D 20:42:17.969565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1484. [D 20:42:17.969574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1485. [D 20:42:17.969583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1486. [D 20:42:17.969593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1487. [D 20:42:17.969602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1488. [D 20:42:17.969611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1489. [D 20:42:17.969621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1490. [D 20:42:17.969630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1491. [D 20:42:17.969639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1492. [D 20:42:17.969649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1493. [D 20:42:17.969658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1494. [D 20:42:17.969668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1495. [D 20:42:17.969678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1496. [D 20:42:17.969687] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1497. [D 20:42:17.975368] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1497. [D 20:42:17.975438] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 26/70. [D 20:42:17.977526] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.977541] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.977551] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.983505] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.983520] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.983531] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.983564] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2534 [D 20:42:17.983575] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:17.983587] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 27/70. [D 20:42:18.059663] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2527 [D 20:42:18.059682] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 28/70. [D 20:42:18.059820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1497. [D 20:42:18.059891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1498. [D 20:42:18.059903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1499. [D 20:42:18.059913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1500. [D 20:42:18.059924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1501. [D 20:42:18.059933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1502. [D 20:42:18.059943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1503. [D 20:42:18.059954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1504. [D 20:42:18.059964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1505. [D 20:42:18.059974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1506. [D 20:42:18.059984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1507. [D 20:42:18.060000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1508. [D 20:42:18.060010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1509. [D 20:42:18.060020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1510. [D 20:42:18.060030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1511. [D 20:42:18.060040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1512. [D 20:42:18.060051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1513. [D 20:42:18.060061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1514. [D 20:42:18.060071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1515. [D 20:42:18.060081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1516. [D 20:42:18.060091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1517. [D 20:42:18.060101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1518. [D 20:42:18.060111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1519. [D 20:42:18.060121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1520. [D 20:42:18.060131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1521. [D 20:42:18.060144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1522. [D 20:42:18.060154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1523. [D 20:42:18.060211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1524. [D 20:42:18.060221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1525. [D 20:42:18.060231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1526. [D 20:42:18.060242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1527. [D 20:42:18.060264] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1528. [D 20:42:18.065786] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1528. [D 20:42:18.065803] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 29/70. [D 20:42:18.068099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.068114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.068124] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.073538] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.073553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.073564] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.073597] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2536 [D 20:42:18.073608] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:18.073622] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 30/70. [D 20:42:18.119894] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2534 [D 20:42:18.119913] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 31/70. [D 20:42:18.119970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1528. [D 20:42:18.120036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1529. [D 20:42:18.120057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1530. [D 20:42:18.120067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1531. [D 20:42:18.120078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1532. [D 20:42:18.120088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1533. [D 20:42:18.120103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1534. [D 20:42:18.120112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1535. [D 20:42:18.120122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1536. [D 20:42:18.120138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1537. [D 20:42:18.120189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1538. [D 20:42:18.120199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1539. [D 20:42:18.120215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1540. [D 20:42:18.120225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1541. [D 20:42:18.120236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1542. [D 20:42:18.120246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1543. [D 20:42:18.120257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1544. [D 20:42:18.120269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1545. [D 20:42:18.120279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1546. [D 20:42:18.120289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1547. [D 20:42:18.120318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1548. [D 20:42:18.120328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1549. [D 20:42:18.120340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1550. [D 20:42:18.120355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1551. [D 20:42:18.120365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1552. [D 20:42:18.120390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1553. [D 20:42:18.120400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1554. [D 20:42:18.120410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1555. [D 20:42:18.120424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1556. [D 20:42:18.120434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1557. [D 20:42:18.120444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1558. [D 20:42:18.120473] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1559. [D 20:42:18.125944] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1559. [D 20:42:18.125961] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 32/70. [D 20:42:18.126908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.126923] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.126933] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.134284] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.134299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.134310] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.134342] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2540 [D 20:42:18.134353] element 0: offset: 0x2aaaab235940, size: 24 [D 20:42:18.134365] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 33/70. [D 20:42:18.166601] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2522 [D 20:42:18.166620] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 34/70. [D 20:42:18.166678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1559. [D 20:42:18.166758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 1560. [D 20:42:18.166770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 1561. [D 20:42:18.166780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 1562. [D 20:42:18.166791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 1563. [D 20:42:18.166801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 1564. [D 20:42:18.166817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1565. [D 20:42:18.166827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1566. [D 20:42:18.166836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1567. [D 20:42:18.166847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 1568. [D 20:42:18.166909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 1569. [D 20:42:18.166934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 1570. [D 20:42:18.166944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 1571. [D 20:42:18.166959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 1572. [D 20:42:18.166969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1573. [D 20:42:18.166979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1574. [D 20:42:18.167008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1575. [D 20:42:18.167018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 1576. [D 20:42:18.167030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 1577. [D 20:42:18.167040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 1578. [D 20:42:18.167050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 1579. [D 20:42:18.167064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 1580. [D 20:42:18.167083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1581. [D 20:42:18.167094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1582. [D 20:42:18.167105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1583. [D 20:42:18.167115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 1584. [D 20:42:18.167137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 1585. [D 20:42:18.167148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 1586. [D 20:42:18.167158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 1587. [D 20:42:18.167172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 1588. [D 20:42:18.167182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1589. [D 20:42:18.167192] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1590. [D 20:42:18.172615] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1590. [D 20:42:18.172632] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 35/70. [D 20:42:18.174843] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.174858] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.174868] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.180549] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.180564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.180575] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.180608] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2543 [D 20:42:18.180619] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:18.180634] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 36/70. [D 20:42:18.229078] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2540 [D 20:42:18.229097] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 37/70. [D 20:42:18.229161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1590. [D 20:42:18.229230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1591. [D 20:42:18.229250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1592. [D 20:42:18.229261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1593. [D 20:42:18.229272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1594. [D 20:42:18.229282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1595. [D 20:42:18.229296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1596. [D 20:42:18.229306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1597. [D 20:42:18.229316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1598. [D 20:42:18.229331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1599. [D 20:42:18.229383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1600. [D 20:42:18.229407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1601. [D 20:42:18.229419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1602. [D 20:42:18.229429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1603. [D 20:42:18.229440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1604. [D 20:42:18.229450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1605. [D 20:42:18.229460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1606. [D 20:42:18.229471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1607. [D 20:42:18.229497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1608. [D 20:42:18.229507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1609. [D 20:42:18.229517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1610. [D 20:42:18.229527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1611. [D 20:42:18.229543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1612. [D 20:42:18.229554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1613. [D 20:42:18.229564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1614. [D 20:42:18.229574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1615. [D 20:42:18.229583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1616. [D 20:42:18.229603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1617. [D 20:42:18.229627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1618. [D 20:42:18.229638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1619. [D 20:42:18.229649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1620. [D 20:42:18.229659] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1621. [D 20:42:18.235141] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1621. [D 20:42:18.235159] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 38/70. [D 20:42:18.237302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.237317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.237327] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.243516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.243530] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.243541] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.243573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2546 [D 20:42:18.243584] element 0: offset: 0x2aaaab236a80, size: 24 [D 20:42:18.243597] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 39/70. [D 20:42:18.314739] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2536 [D 20:42:18.314757] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 40/70. [D 20:42:18.314880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1621. [D 20:42:18.314967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1622. [D 20:42:18.314979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1623. [D 20:42:18.314989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1624. [D 20:42:18.315000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1625. [D 20:42:18.315010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1626. [D 20:42:18.315020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1627. [D 20:42:18.315030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1628. [D 20:42:18.315040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1629. [D 20:42:18.315050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1630. [D 20:42:18.315060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1631. [D 20:42:18.315105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1632. [D 20:42:18.315117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1633. [D 20:42:18.315127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1634. [D 20:42:18.315138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1635. [D 20:42:18.315175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1636. [D 20:42:18.315185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1637. [D 20:42:18.315195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1638. [D 20:42:18.315224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1639. [D 20:42:18.315235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1640. [D 20:42:18.315249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1641. [D 20:42:18.315259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1642. [D 20:42:18.315269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1643. [D 20:42:18.315297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1644. [D 20:42:18.315310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1645. [D 20:42:18.315322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1646. [D 20:42:18.315333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1647. [D 20:42:18.315343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1648. [D 20:42:18.315353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1649. [D 20:42:18.315366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1650. [D 20:42:18.315376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1651. [D 20:42:18.315386] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1652. [D 20:42:18.320825] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1652. [D 20:42:18.320843] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 41/70. [D 20:42:18.323203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.323219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.323229] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.326907] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.326920] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.326930] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.326962] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2548 [D 20:42:18.326973] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:18.326985] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 42/70. [D 20:42:18.382431] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2546 [D 20:42:18.382450] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 43/70. [D 20:42:18.382510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1652. [D 20:42:18.382577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1653. [D 20:42:18.382598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1654. [D 20:42:18.382612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1655. [D 20:42:18.382622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1656. [D 20:42:18.382633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1657. [D 20:42:18.382643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1658. [D 20:42:18.382653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1659. [D 20:42:18.382663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1660. [D 20:42:18.382678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1661. [D 20:42:18.382726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1662. [D 20:42:18.382741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1663. [D 20:42:18.382765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1664. [D 20:42:18.382780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1665. [D 20:42:18.382790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1666. [D 20:42:18.382800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1667. [D 20:42:18.382825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1668. [D 20:42:18.382835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1669. [D 20:42:18.382845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1670. [D 20:42:18.382861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1671. [D 20:42:18.382871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1672. [D 20:42:18.382881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1673. [D 20:42:18.382897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1674. [D 20:42:18.382938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1675. [D 20:42:18.382948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1676. [D 20:42:18.382958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1677. [D 20:42:18.382985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1678. [D 20:42:18.382995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1679. [D 20:42:18.383007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1680. [D 20:42:18.383017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1681. [D 20:42:18.383032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1682. [D 20:42:18.383043] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1683. [D 20:42:18.388492] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1683. [D 20:42:18.388510] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 44/70. [D 20:42:18.390826] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.390841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.390851] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.472783] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2543 [D 20:42:18.472802] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 45/70. [D 20:42:18.472936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1683. [D 20:42:18.473006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 1684. [D 20:42:18.473017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 1685. [D 20:42:18.473028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 1686. [D 20:42:18.473039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 1687. [D 20:42:18.473049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 1688. [D 20:42:18.473059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1689. [D 20:42:18.473069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1690. [D 20:42:18.473079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1691. [D 20:42:18.473089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 1692. [D 20:42:18.473099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 1693. [D 20:42:18.473142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 1694. [D 20:42:18.473155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 1695. [D 20:42:18.473165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 1696. [D 20:42:18.473175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1697. [D 20:42:18.473210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1698. [D 20:42:18.473223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1699. [D 20:42:18.473233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 1700. [D 20:42:18.473259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 1701. [D 20:42:18.473274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 1702. [D 20:42:18.473284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 1703. [D 20:42:18.473294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 1704. [D 20:42:18.473310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1705. [D 20:42:18.473320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1706. [D 20:42:18.473329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1707. [D 20:42:18.473357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 1708. [D 20:42:18.473367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 1709. [D 20:42:18.473381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 1710. [D 20:42:18.473391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 1711. [D 20:42:18.473401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 1712. [D 20:42:18.473428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1713. [D 20:42:18.473438] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1714. [D 20:42:18.478866] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1714. [D 20:42:18.478883] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 46/70. [D 20:42:18.481192] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.481208] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.481218] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:18.486923] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.486939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.486949] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:18.486983] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2552 [D 20:42:18.486993] element 0: offset: 0x2aaaab218000, size: 24 [D 20:42:18.487006] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 47/70. [D 20:42:18.519040] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2526 [D 20:42:18.519058] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 48/70. [D 20:42:18.519122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1714. [D 20:42:18.519200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1715. [D 20:42:18.519211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1716. [D 20:42:18.519222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1717. [D 20:42:18.519233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1718. [D 20:42:18.519243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1719. [D 20:42:18.519259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1720. [D 20:42:18.519269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1721. [D 20:42:18.519278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1722. [D 20:42:18.519295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1723. [D 20:42:18.519344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1724. [D 20:42:18.519357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1725. [D 20:42:18.519367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1726. [D 20:42:18.519393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1727. [D 20:42:18.519403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1728. [D 20:42:18.519414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1729. [D 20:42:18.519424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1730. [D 20:42:18.519434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1731. [D 20:42:18.519445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1732. [D 20:42:18.519472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1733. [D 20:42:18.519483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1734. [D 20:42:18.519493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1735. [D 20:42:18.519503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1736. [D 20:42:18.519514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1737. [D 20:42:18.519525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1738. [D 20:42:18.519546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1739. [D 20:42:18.519556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1740. [D 20:42:18.519571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1741. [D 20:42:18.519582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1742. [D 20:42:18.519602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1743. [D 20:42:18.519612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1744. [D 20:42:18.519622] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1745. [D 20:42:18.522900] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.522920] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.522929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.522967] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2555 [D 20:42:18.522979] element 0: offset: 0x2aaaab235940, size: 24 [D 20:42:18.522992] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 49/70. [D 20:42:18.525247] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1745. [D 20:42:18.525263] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 50/70. [D 20:42:18.527681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.527696] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.527706] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.533687] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.533711] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.533722] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.533748] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2558 [D 20:42:18.533759] element 0: offset: 0x2aaaab225ec0, size: 24 [D 20:42:18.533770] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 51/70. [D 20:42:18.595985] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2548 [D 20:42:18.596004] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 52/70. [D 20:42:18.596063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1745. [D 20:42:18.596143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1746. [D 20:42:18.596155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1747. [D 20:42:18.596166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1748. [D 20:42:18.596180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1749. [D 20:42:18.596190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1750. [D 20:42:18.596200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1751. [D 20:42:18.596215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1752. [D 20:42:18.596225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1753. [D 20:42:18.596235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1754. [D 20:42:18.596245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1755. [D 20:42:18.596283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1756. [D 20:42:18.596294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1757. [D 20:42:18.596304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1758. [D 20:42:18.596338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1759. [D 20:42:18.596350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1760. [D 20:42:18.596360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1761. [D 20:42:18.596370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1762. [D 20:42:18.596386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1763. [D 20:42:18.596396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1764. [D 20:42:18.596420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1765. [D 20:42:18.596431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1766. [D 20:42:18.596441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1767. [D 20:42:18.596455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1768. [D 20:42:18.596482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1769. [D 20:42:18.596495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1770. [D 20:42:18.596505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1771. [D 20:42:18.596527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1772. [D 20:42:18.596539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1773. [D 20:42:18.596549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1774. [D 20:42:18.596563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1775. [D 20:42:18.596573] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1776. [D 20:42:18.601999] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1776. [D 20:42:18.602016] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 53/70. [D 20:42:18.604333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.604348] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.604359] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.609846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.609861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.609871] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.609904] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2560 [D 20:42:18.609914] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:18.609927] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 54/70. [D 20:42:18.665483] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2558 [D 20:42:18.665501] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 55/70. [D 20:42:18.665562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1776. [D 20:42:18.665639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1777. [D 20:42:18.665650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1778. [D 20:42:18.665661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1779. [D 20:42:18.665672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1780. [D 20:42:18.665682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1781. [D 20:42:18.665699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1782. [D 20:42:18.665708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1783. [D 20:42:18.665718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1784. [D 20:42:18.665734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1785. [D 20:42:18.665782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1786. [D 20:42:18.665795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1787. [D 20:42:18.665805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1788. [D 20:42:18.665832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1789. [D 20:42:18.665842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1790. [D 20:42:18.665857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1791. [D 20:42:18.665866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1792. [D 20:42:18.665876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1793. [D 20:42:18.665905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1794. [D 20:42:18.665921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1795. [D 20:42:18.665932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1796. [D 20:42:18.665942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1797. [D 20:42:18.665958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1798. [D 20:42:18.665978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1799. [D 20:42:18.665989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1800. [D 20:42:18.666000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1801. [D 20:42:18.666010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1802. [D 20:42:18.666024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1803. [D 20:42:18.666035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1804. [D 20:42:18.666055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1805. [D 20:42:18.666066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1806. [D 20:42:18.666076] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1807. [D 20:42:18.671551] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1807. [D 20:42:18.671567] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 56/70. [D 20:42:18.673796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.673812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.673822] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.679664] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.679679] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.679690] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.679722] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2564 [D 20:42:18.679733] element 0: offset: 0x2aaaab2302e0, size: 24 [D 20:42:18.679745] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 57/70. [D 20:42:18.777804] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2560 [D 20:42:18.777823] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 58/70. [D 20:42:18.777922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1807. [D 20:42:18.778003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1808. [D 20:42:18.778015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1809. [D 20:42:18.778026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1810. [D 20:42:18.778040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1811. [D 20:42:18.778050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1812. [D 20:42:18.778060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1813. [D 20:42:18.778074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1814. [D 20:42:18.778084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1815. [D 20:42:18.778094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1816. [D 20:42:18.778157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1817. [D 20:42:18.778168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1818. [D 20:42:18.778187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1819. [D 20:42:18.778198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1820. [D 20:42:18.778208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1821. [D 20:42:18.778217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1822. [D 20:42:18.778228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1823. [D 20:42:18.778239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1824. [D 20:42:18.778249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1825. [D 20:42:18.778259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1826. [D 20:42:18.778286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1827. [D 20:42:18.778296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1828. [D 20:42:18.778307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1829. [D 20:42:18.778318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1830. [D 20:42:18.778327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1831. [D 20:42:18.778338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1832. [D 20:42:18.778357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1833. [D 20:42:18.778367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1834. [D 20:42:18.778377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1835. [D 20:42:18.778387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1836. [D 20:42:18.778397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1837. [D 20:42:18.778407] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1838. [D 20:42:18.783926] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1838. [D 20:42:18.783943] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 59/70. [D 20:42:18.786262] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.786277] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.786287] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.791634] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.791648] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.791659] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.791692] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2566 [D 20:42:18.791703] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:18.791715] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 60/70. [D 20:42:18.814665] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2555 [D 20:42:18.814683] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 0/70. [D 20:42:18.814746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1838. [D 20:42:18.814823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 1839. [D 20:42:18.814835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 1840. [D 20:42:18.814845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 1841. [D 20:42:18.814856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 1842. [D 20:42:18.814866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 1843. [D 20:42:18.814882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1844. [D 20:42:18.814892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1845. [D 20:42:18.814902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1846. [D 20:42:18.814913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 1847. [D 20:42:18.814969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 1848. [D 20:42:18.814980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 1849. [D 20:42:18.814991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 1850. [D 20:42:18.815001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 1851. [D 20:42:18.815011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1852. [D 20:42:18.815021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1853. [D 20:42:18.815031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1854. [D 20:42:18.815041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 1855. [D 20:42:18.815051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 1856. [D 20:42:18.815061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 1857. [D 20:42:18.815088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 1858. [D 20:42:18.815099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 1859. [D 20:42:18.815109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1860. [D 20:42:18.815119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1861. [D 20:42:18.815130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1862. [D 20:42:18.815154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 1863. [D 20:42:18.815163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 1864. [D 20:42:18.815178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 1865. [D 20:42:18.815188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 1866. [D 20:42:18.815198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 1867. [D 20:42:18.815221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1868. [D 20:42:18.815232] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1869. [D 20:42:18.820678] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1869. [D 20:42:18.820696] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 1/70. [D 20:42:18.822838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.822853] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.822863] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.828445] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.828460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.828471] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.828503] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2570 [D 20:42:18.828514] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:18.828527] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 2/70. [D 20:42:18.869872] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2566 [D 20:42:18.869891] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 3/70. [D 20:42:18.869950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1869. [D 20:42:18.870033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1870. [D 20:42:18.870045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1871. [D 20:42:18.870058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1872. [D 20:42:18.870069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1873. [D 20:42:18.870079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1874. [D 20:42:18.870090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1875. [D 20:42:18.870100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1876. [D 20:42:18.870110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1877. [D 20:42:18.870120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1878. [D 20:42:18.870145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1879. [D 20:42:18.870160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1880. [D 20:42:18.870170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1881. [D 20:42:18.870180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1882. [D 20:42:18.870190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1883. [D 20:42:18.870212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1884. [D 20:42:18.870222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1885. [D 20:42:18.870232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1886. [D 20:42:18.870255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1887. [D 20:42:18.870265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1888. [D 20:42:18.870275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1889. [D 20:42:18.870297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1890. [D 20:42:18.870308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1891. [D 20:42:18.870319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1892. [D 20:42:18.870328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1893. [D 20:42:18.870339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1894. [D 20:42:18.870363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1895. [D 20:42:18.870375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1896. [D 20:42:18.870385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1897. [D 20:42:18.870394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1898. [D 20:42:18.870404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1899. [D 20:42:18.870431] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1900. [D 20:42:18.875950] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1900. [D 20:42:18.875966] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 4/70. [D 20:42:18.878304] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.878319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.878329] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.884684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.884698] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.884708] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.884741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2572 [D 20:42:18.884752] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:18.884764] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 5/70. [D 20:42:18.906539] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2564 [D 20:42:18.906557] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 6/70. [D 20:42:18.906619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1900. [D 20:42:18.906723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1901. [D 20:42:18.906737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1902. [D 20:42:18.906749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1903. [D 20:42:18.906760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1904. [D 20:42:18.906770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1905. [D 20:42:18.906781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1906. [D 20:42:18.906806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1907. [D 20:42:18.906816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1908. [D 20:42:18.906826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1909. [D 20:42:18.906837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1910. [D 20:42:18.906859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1911. [D 20:42:18.906870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1912. [D 20:42:18.906883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1913. [D 20:42:18.906893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1914. [D 20:42:18.906903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1915. [D 20:42:18.906913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1916. [D 20:42:18.906953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1917. [D 20:42:18.906973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1918. [D 20:42:18.906984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1919. [D 20:42:18.907000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1920. [D 20:42:18.907021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1921. [D 20:42:18.907032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1922. [D 20:42:18.907042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1923. [D 20:42:18.907051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1924. [D 20:42:18.907062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1925. [D 20:42:18.907073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1926. [D 20:42:18.907083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1927. [D 20:42:18.907099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1928. [D 20:42:18.907124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1929. [D 20:42:18.907135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1930. [D 20:42:18.907146] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1931. [D 20:42:18.912584] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1931. [D 20:42:18.912602] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 7/70. [D 20:42:18.914817] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.914832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.914842] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.920661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.920682] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.920692] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.920725] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2576 [D 20:42:18.920736] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:18.920750] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 8/70. [D 20:42:18.976358] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2552 [D 20:42:18.976376] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 9/70. [D 20:42:18.976436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1931. [D 20:42:18.976507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1932. [D 20:42:18.976563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1933. [D 20:42:18.976575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1934. [D 20:42:18.976586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1935. [D 20:42:18.976596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1936. [D 20:42:18.976606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1937. [D 20:42:18.976628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1938. [D 20:42:18.976643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1939. [D 20:42:18.976653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1940. [D 20:42:18.976663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1941. [D 20:42:18.976673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1942. [D 20:42:18.976700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1943. [D 20:42:18.976711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1944. [D 20:42:18.976733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1945. [D 20:42:18.976743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1946. [D 20:42:18.976753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1947. [D 20:42:18.976773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1948. [D 20:42:18.976787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1949. [D 20:42:18.976809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1950. [D 20:42:18.976825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1951. [D 20:42:18.976835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1952. [D 20:42:18.976859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1953. [D 20:42:18.976869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1954. [D 20:42:18.976891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1955. [D 20:42:18.976901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1956. [D 20:42:18.976921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1957. [D 20:42:18.976932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1958. [D 20:42:18.976942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1959. [D 20:42:18.976965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1960. [D 20:42:18.976976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1961. [D 20:42:18.976987] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1962. [D 20:42:18.982363] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1962. [D 20:42:18.982379] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 10/70. [D 20:42:18.984628] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.984642] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.984652] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.026072] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2572 [D 20:42:19.026090] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 11/70. [D 20:42:19.026152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1962. [D 20:42:19.026263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1963. [D 20:42:19.026277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1964. [D 20:42:19.026288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1965. [D 20:42:19.026299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1966. [D 20:42:19.026310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1967. [D 20:42:19.026321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1968. [D 20:42:19.026349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1969. [D 20:42:19.026360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1970. [D 20:42:19.026370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1971. [D 20:42:19.026380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1972. [D 20:42:19.026390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1973. [D 20:42:19.026400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1974. [D 20:42:19.026410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1975. [D 20:42:19.026420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1976. [D 20:42:19.026444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1977. [D 20:42:19.026454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1978. [D 20:42:19.026476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1979. [D 20:42:19.026486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1980. [D 20:42:19.026496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1981. [D 20:42:19.026524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1982. [D 20:42:19.026535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1983. [D 20:42:19.026549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1984. [D 20:42:19.026559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1985. [D 20:42:19.026569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1986. [D 20:42:19.026592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1987. [D 20:42:19.026602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1988. [D 20:42:19.026612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1989. [D 20:42:19.026622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1990. [D 20:42:19.026632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1991. [D 20:42:19.026642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1992. [D 20:42:19.026666] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1993. [D 20:42:19.032123] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1993. [D 20:42:19.032140] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 12/70. [D 20:42:19.034284] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.034299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.034309] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:19.040284] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.040300] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.040311] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:19.040343] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2578 [D 20:42:19.040354] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:19.040366] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 13/70. [D 20:42:19.095793] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2576 [D 20:42:19.095811] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 14/70. [D 20:42:19.095870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1993. [D 20:42:19.095946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1994. [D 20:42:19.095958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1995. [D 20:42:19.095969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1996. [D 20:42:19.095980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1997. [D 20:42:19.095990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1998. [D 20:42:19.096005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1999. [D 20:42:19.096015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2000. [D 20:42:19.096025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2001. [D 20:42:19.096041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2002. [D 20:42:19.096051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2003. [D 20:42:19.096061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2004. [D 20:42:19.096070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2005. [D 20:42:19.096088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2006. [D 20:42:19.096098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2007. [D 20:42:19.096107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2008. [D 20:42:19.096161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2009. [D 20:42:19.096172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2010. [D 20:42:19.096182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2011. [D 20:42:19.096206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2012. [D 20:42:19.096217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2013. [D 20:42:19.096232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2014. [D 20:42:19.096242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2015. [D 20:42:19.096252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2016. [D 20:42:19.096268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2017. [D 20:42:19.096278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2018. [D 20:42:19.096302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2019. [D 20:42:19.096312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2020. [D 20:42:19.096323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2021. [D 20:42:19.096338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2022. [D 20:42:19.096348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2023. [D 20:42:19.096373] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2024. [D 20:42:19.101858] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2024. [D 20:42:19.101876] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 15/70. [D 20:42:19.102979] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.102994] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.103004] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:19.110298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.110313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.110323] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:19.110356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2582 [D 20:42:19.110367] element 0: offset: 0x2aaaab235940, size: 24 [D 20:42:19.110379] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 16/70. [D 20:42:19.114476] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.114490] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.114500] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.114515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2585 [D 20:42:19.114525] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:19.114535] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 17/70. [D 20:42:19.166874] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2570 [D 20:42:19.166892] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 18/70. [D 20:42:19.166951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2024. [D 20:42:19.167032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2025. [D 20:42:19.167044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2026. [D 20:42:19.167054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2027. [D 20:42:19.167065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2028. [D 20:42:19.167075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2029. [D 20:42:19.167091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2030. [D 20:42:19.167101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2031. [D 20:42:19.167111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2032. [D 20:42:19.167126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2033. [D 20:42:19.167176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2034. [D 20:42:19.167187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2035. [D 20:42:19.167197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2036. [D 20:42:19.167224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2037. [D 20:42:19.167234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2038. [D 20:42:19.167244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2039. [D 20:42:19.167257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2040. [D 20:42:19.167267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2041. [D 20:42:19.167277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2042. [D 20:42:19.167329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2043. [D 20:42:19.167340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2044. [D 20:42:19.167350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2045. [D 20:42:19.167374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2046. [D 20:42:19.167384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2047. [D 20:42:19.167395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2048. [D 20:42:19.167405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2049. [D 20:42:19.167415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2050. [D 20:42:19.167426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2051. [D 20:42:19.167436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2052. [D 20:42:19.167457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2053. [D 20:42:19.167467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2054. [D 20:42:19.167477] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2055. [D 20:42:19.172886] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2055. [D 20:42:19.172902] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 19/70. [D 20:42:19.175015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.175030] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.175040] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.180845] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.180865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.180876] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.180910] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2588 [D 20:42:19.180920] element 0: offset: 0x2aaaab218100, size: 24 [D 20:42:19.180933] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 20/70. [D 20:42:19.246107] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2588 [D 20:42:19.246126] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 21/70. [D 20:42:19.246185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2055. [D 20:42:19.246256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2056. [D 20:42:19.246268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2057. [D 20:42:19.246279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2058. [D 20:42:19.246291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2059. [D 20:42:19.246301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2060. [D 20:42:19.246311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2061. [D 20:42:19.246324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2062. [D 20:42:19.246334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2063. [D 20:42:19.246344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2064. [D 20:42:19.246384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2065. [D 20:42:19.246395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2066. [D 20:42:19.246405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2067. [D 20:42:19.246415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2068. [D 20:42:19.246454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2069. [D 20:42:19.246465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2070. [D 20:42:19.246475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2071. [D 20:42:19.246485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2072. [D 20:42:19.246496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2073. [D 20:42:19.246506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2074. [D 20:42:19.246531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2075. [D 20:42:19.246541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2076. [D 20:42:19.246557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2077. [D 20:42:19.246581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2078. [D 20:42:19.246592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2079. [D 20:42:19.246602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2080. [D 20:42:19.246612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2081. [D 20:42:19.246622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2082. [D 20:42:19.246645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2083. [D 20:42:19.246655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2084. [D 20:42:19.246671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2085. [D 20:42:19.246681] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2086. [D 20:42:19.252164] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2086. [D 20:42:19.252181] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 22/70. [D 20:42:19.254448] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.254463] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.254473] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.260264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.260278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.260289] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.260320] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2591 [D 20:42:19.260331] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:19.260343] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 23/70. [D 20:42:19.311288] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2578 [D 20:42:19.311306] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 24/70. [D 20:42:19.311365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2086. [D 20:42:19.311434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2087. [D 20:42:19.311455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2088. [D 20:42:19.311466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2089. [D 20:42:19.311477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2090. [D 20:42:19.311486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2091. [D 20:42:19.311500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2092. [D 20:42:19.311510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2093. [D 20:42:19.311520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2094. [D 20:42:19.311536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2095. [D 20:42:19.311589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2096. [D 20:42:19.311599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2097. [D 20:42:19.311610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2098. [D 20:42:19.311634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2099. [D 20:42:19.311644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2100. [D 20:42:19.311655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2101. [D 20:42:19.311665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2102. [D 20:42:19.311675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2103. [D 20:42:19.311685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2104. [D 20:42:19.311711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2105. [D 20:42:19.311727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2106. [D 20:42:19.311738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2107. [D 20:42:19.311748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2108. [D 20:42:19.311758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2109. [D 20:42:19.311768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2110. [D 20:42:19.311792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2111. [D 20:42:19.311805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2112. [D 20:42:19.311815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2113. [D 20:42:19.311825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2114. [D 20:42:19.311848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2115. [D 20:42:19.311857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2116. [D 20:42:19.311868] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2117. [D 20:42:19.317287] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2117. [D 20:42:19.317304] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 25/70. [D 20:42:19.318995] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.319011] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.319021] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.460715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.460730] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.460741] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.460773] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2593 [D 20:42:19.460784] element 0: offset: 0x2aaaab2302e0, size: 24 [D 20:42:19.460797] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 26/70. [D 20:42:19.630418] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2593 [D 20:42:19.630436] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 27/70. [D 20:42:19.630534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 2117. [D 20:42:19.630645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 2118. [D 20:42:19.630657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2119. [D 20:42:19.630668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2120. [D 20:42:19.630682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2121. [D 20:42:19.630692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2122. [D 20:42:19.630702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2123. [D 20:42:19.630716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2124. [D 20:42:19.630725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2125. [D 20:42:19.630735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2126. [D 20:42:19.630746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2127. [D 20:42:19.630773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2128. [D 20:42:19.630784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2129. [D 20:42:19.630805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2130. [D 20:42:19.630814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2131. [D 20:42:19.630825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2132. [D 20:42:19.630848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2133. [D 20:42:19.630861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2134. [D 20:42:19.630887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2135. [D 20:42:19.630897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2136. [D 20:42:19.630922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2137. [D 20:42:19.630932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2138. [D 20:42:19.630945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2139. [D 20:42:19.630967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2140. [D 20:42:19.630980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2141. [D 20:42:19.631014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2142. [D 20:42:19.631024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2143. [D 20:42:19.631046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2144. [D 20:42:19.631057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2145. [D 20:42:19.631067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2146. [D 20:42:19.631090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2147. [D 20:42:19.631100] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2148. [D 20:42:19.636504] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2148. [D 20:42:19.636522] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 28/70. [D 20:42:19.638832] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.638847] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.638858] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.643025] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.643039] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.643050] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.643083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2596 [D 20:42:19.643094] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:19.644210] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 29/70. [D 20:42:19.689744] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2585 [D 20:42:19.689762] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 30/70. [D 20:42:19.689823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2148. [D 20:42:19.689917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2149. [D 20:42:19.689930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2150. [D 20:42:19.689942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2151. [D 20:42:19.689953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2152. [D 20:42:19.689963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2153. [D 20:42:19.689974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2154. [D 20:42:19.689984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2155. [D 20:42:19.689995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2156. [D 20:42:19.690035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2157. [D 20:42:19.690057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2158. [D 20:42:19.690071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2159. [D 20:42:19.690090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2160. [D 20:42:19.690105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2161. [D 20:42:19.690115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2162. [D 20:42:19.690138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2163. [D 20:42:19.690148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2164. [D 20:42:19.690168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2165. [D 20:42:19.690180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2166. [D 20:42:19.690190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2167. [D 20:42:19.690215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2168. [D 20:42:19.690225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2169. [D 20:42:19.690252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2170. [D 20:42:19.690262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2171. [D 20:42:19.690283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2172. [D 20:42:19.690294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2173. [D 20:42:19.690317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2174. [D 20:42:19.690328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2175. [D 20:42:19.690338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2176. [D 20:42:19.690348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2177. [D 20:42:19.690359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2178. [D 20:42:19.690369] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2179. [D 20:42:19.695771] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2179. [D 20:42:19.695788] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 31/70. [D 20:42:19.698077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.698092] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.698102] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.703362] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.703382] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.703393] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.703426] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2600 [D 20:42:19.703437] element 0: offset: 0x2aaaab236c70, size: 24 [D 20:42:19.703451] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 32/70. [D 20:42:19.741489] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2591 [D 20:42:19.741509] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 33/70. [D 20:42:19.741572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2179. [D 20:42:19.741648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2180. [D 20:42:19.741660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2181. [D 20:42:19.741671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2182. [D 20:42:19.741682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2183. [D 20:42:19.741692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2184. [D 20:42:19.741708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2185. [D 20:42:19.741718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2186. [D 20:42:19.741728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2187. [D 20:42:19.741743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2188. [D 20:42:19.741753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2189. [D 20:42:19.741803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2190. [D 20:42:19.741818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2191. [D 20:42:19.741839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2192. [D 20:42:19.741854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2193. [D 20:42:19.741864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2194. [D 20:42:19.741874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2195. [D 20:42:19.741888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2196. [D 20:42:19.741898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2197. [D 20:42:19.741908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2198. [D 20:42:19.741918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2199. [D 20:42:19.741943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2200. [D 20:42:19.741954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2201. [D 20:42:19.741964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2202. [D 20:42:19.741973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2203. [D 20:42:19.742004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2204. [D 20:42:19.742015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2205. [D 20:42:19.742025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2206. [D 20:42:19.742035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2207. [D 20:42:19.742045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2208. [D 20:42:19.742067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2209. [D 20:42:19.742077] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2210. [D 20:42:19.747528] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2210. [D 20:42:19.747546] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 34/70. [D 20:42:19.749634] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.749648] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.749659] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.755010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.755024] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.755035] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.755068] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2603 [D 20:42:19.755079] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:19.755744] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 35/70. [D 20:42:19.842014] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2582 [D 20:42:19.842032] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 36/70. [D 20:42:19.842153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 2210. [D 20:42:19.842230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 2211. [D 20:42:19.842241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 2212. [D 20:42:19.842252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 2213. [D 20:42:19.842262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 2214. [D 20:42:19.842272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 2215. [D 20:42:19.842281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2216. [D 20:42:19.842291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2217. [D 20:42:19.842301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2218. [D 20:42:19.842311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 2219. [D 20:42:19.842320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 2220. [D 20:42:19.842330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 2221. [D 20:42:19.842379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 2222. [D 20:42:19.842389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 2223. [D 20:42:19.842410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2224. [D 20:42:19.842421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2225. [D 20:42:19.842431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2226. [D 20:42:19.842441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2227. [D 20:42:19.842454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2228. [D 20:42:19.842464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2229. [D 20:42:19.842473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2230. [D 20:42:19.842489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2231. [D 20:42:19.842499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2232. [D 20:42:19.842509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2233. [D 20:42:19.842541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2234. [D 20:42:19.842550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2235. [D 20:42:19.842560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2236. [D 20:42:19.842575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2237. [D 20:42:19.842585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2238. [D 20:42:19.842611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2239. [D 20:42:19.842621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2240. [D 20:42:19.842631] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2241. [D 20:42:19.848088] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2241. [D 20:42:19.848107] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 37/70. [D 20:42:19.850424] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.850439] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.850450] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.856664] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.856678] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.856689] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.856721] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2606 [D 20:42:19.856732] element 0: offset: 0x2aaaab20f830, size: 24 [D 20:42:19.856744] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 38/70. [D 20:42:19.904147] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2596 [D 20:42:19.904166] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 39/70. [D 20:42:19.904229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 2241. [D 20:42:19.904300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 2242. [D 20:42:19.904318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2243. [D 20:42:19.904329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2244. [D 20:42:19.904361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2245. [D 20:42:19.904373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2246. [D 20:42:19.904383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2247. [D 20:42:19.904392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2248. [D 20:42:19.904406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2249. [D 20:42:19.904416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2250. [D 20:42:19.904426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2251. [D 20:42:19.904456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2252. [D 20:42:19.904473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2253. [D 20:42:19.904495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2254. [D 20:42:19.904506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2255. [D 20:42:19.904516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2256. [D 20:42:19.904526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2257. [D 20:42:19.904536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2258. [D 20:42:19.904546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2259. [D 20:42:19.904569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2260. [D 20:42:19.904579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2261. [D 20:42:19.904599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2262. [D 20:42:19.904609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2263. [D 20:42:19.904619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2264. [D 20:42:19.904635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2265. [D 20:42:19.904644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2266. [D 20:42:19.904668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2267. [D 20:42:19.904678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2268. [D 20:42:19.904689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2269. [D 20:42:19.904716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2270. [D 20:42:19.904727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2271. [D 20:42:19.904740] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2272. [D 20:42:19.910154] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2272. [D 20:42:19.910172] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 40/70. [D 20:42:19.912425] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.912440] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.912450] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.917889] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.917904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.917915] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.917948] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2608 [D 20:42:19.917959] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:19.917972] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 41/70. [D 20:42:19.966565] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2608 [D 20:42:19.966583] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 42/70. [D 20:42:19.966644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 2272. [D 20:42:19.966714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 2273. [D 20:42:19.966774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2274. [D 20:42:19.966785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2275. [D 20:42:19.966796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2276. [D 20:42:19.966807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2277. [D 20:42:19.966817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2278. [D 20:42:19.966840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2279. [D 20:42:19.966850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2280. [D 20:42:19.966860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2281. [D 20:42:19.966876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2282. [D 20:42:19.966901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2283. [D 20:42:19.966912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2284. [D 20:42:19.966934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2285. [D 20:42:19.966944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2286. [D 20:42:19.966955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2287. [D 20:42:19.966976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2288. [D 20:42:19.966990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2289. [D 20:42:19.967012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2290. [D 20:42:19.967028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2291. [D 20:42:19.967038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2292. [D 20:42:19.967060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2293. [D 20:42:19.967072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2294. [D 20:42:19.967095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2295. [D 20:42:19.967110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2296. [D 20:42:19.967131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2297. [D 20:42:19.967145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2298. [D 20:42:19.967167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2299. [D 20:42:19.967180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2300. [D 20:42:19.967201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2301. [D 20:42:19.967214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2302. [D 20:42:19.967224] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2303. [D 20:42:19.972614] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2303. [D 20:42:19.972631] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 43/70. [D 20:42:19.974783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.974798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.974808] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.979029] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.979044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.979054] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.979087] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2611 [D 20:42:19.979098] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:19.979110] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 44/70. [D 20:42:20.025111] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2600 [D 20:42:20.025129] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 45/70. [D 20:42:20.025194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2303. [D 20:42:20.025305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2304. [D 20:42:20.025317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2305. [D 20:42:20.025328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2306. [D 20:42:20.025342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2307. [D 20:42:20.025352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2308. [D 20:42:20.025362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2309. [D 20:42:20.025376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2310. [D 20:42:20.025386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2311. [D 20:42:20.025396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2312. [D 20:42:20.025406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2313. [D 20:42:20.025432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2314. [D 20:42:20.025442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2315. [D 20:42:20.025464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2316. [D 20:42:20.025474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2317. [D 20:42:20.025485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2318. [D 20:42:20.025504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2319. [D 20:42:20.025519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2320. [D 20:42:20.025529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2321. [D 20:42:20.025555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2322. [D 20:42:20.025565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2323. [D 20:42:20.025575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2324. [D 20:42:20.025598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2325. [D 20:42:20.025607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2326. [D 20:42:20.025629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2327. [D 20:42:20.025639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2328. [D 20:42:20.025649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2329. [D 20:42:20.025671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2330. [D 20:42:20.025682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2331. [D 20:42:20.025702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2332. [D 20:42:20.025713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2333. [D 20:42:20.025735] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2334. [D 20:42:20.031158] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2334. [D 20:42:20.031174] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 46/70. [D 20:42:20.033341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.033356] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.033366] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.039096] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.039112] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.039122] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.039156] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2615 [D 20:42:20.039167] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:20.039179] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 47/70. [D 20:42:20.045053] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2603 [D 20:42:20.045071] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 48/70. [D 20:42:20.045237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2334. [D 20:42:20.045304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2335. [D 20:42:20.045316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2336. [D 20:42:20.045327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2337. [D 20:42:20.045338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2338. [D 20:42:20.045347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2339. [D 20:42:20.045357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2340. [D 20:42:20.045368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2341. [D 20:42:20.045377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2342. [D 20:42:20.045387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2343. [D 20:42:20.045397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2344. [D 20:42:20.045431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2345. [D 20:42:20.045442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2346. [D 20:42:20.045464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2347. [D 20:42:20.045479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2348. [D 20:42:20.045489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2349. [D 20:42:20.045511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2350. [D 20:42:20.045521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2351. [D 20:42:20.045531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2352. [D 20:42:20.045558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2353. [D 20:42:20.045568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2354. [D 20:42:20.045580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2355. [D 20:42:20.045590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2356. [D 20:42:20.045600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2357. [D 20:42:20.045626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2358. [D 20:42:20.045636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2359. [D 20:42:20.045649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2360. [D 20:42:20.045659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2361. [D 20:42:20.045680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2362. [D 20:42:20.045691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2363. [D 20:42:20.045700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2364. [D 20:42:20.045724] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2365. [D 20:42:20.052724] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2365. [D 20:42:20.052740] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 49/70. [D 20:42:20.055075] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.055091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.055101] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.060538] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.060553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.060563] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.060596] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2618 [D 20:42:20.060607] element 0: offset: 0x2aaaab218130, size: 24 [D 20:42:20.060620] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 50/70. [D 20:42:20.102034] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2606 [D 20:42:20.102052] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 51/70. [D 20:42:20.102112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 2365. [D 20:42:20.102189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 2366. [D 20:42:20.102200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 2367. [D 20:42:20.102211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 2368. [D 20:42:20.102221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 2369. [D 20:42:20.102231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 2370. [D 20:42:20.102247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2371. [D 20:42:20.102257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2372. [D 20:42:20.102267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2373. [D 20:42:20.102283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 2374. [D 20:42:20.102333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 2375. [D 20:42:20.102345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 2376. [D 20:42:20.102372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 2377. [D 20:42:20.102382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 2378. [D 20:42:20.102392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2379. [D 20:42:20.102421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2380. [D 20:42:20.102431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2381. [D 20:42:20.102445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2382. [D 20:42:20.102455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2383. [D 20:42:20.102465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2384. [D 20:42:20.102481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2385. [D 20:42:20.102504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2386. [D 20:42:20.102517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2387. [D 20:42:20.102526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2388. [D 20:42:20.102537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2389. [D 20:42:20.102559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2390. [D 20:42:20.102569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2391. [D 20:42:20.102580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2392. [D 20:42:20.102589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2393. [D 20:42:20.102599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2394. [D 20:42:20.102623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2395. [D 20:42:20.102633] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2396. [D 20:42:20.108044] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2396. [D 20:42:20.108062] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 52/70. [D 20:42:20.110340] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.110355] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.110365] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.116371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.116385] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.116395] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.116428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2621 [D 20:42:20.116439] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:20.116454] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 53/70. [D 20:42:20.157996] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2621 [D 20:42:20.158015] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 54/70. [D 20:42:20.158071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 2396. [D 20:42:20.158140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 2397. [D 20:42:20.158166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 2398. [D 20:42:20.158178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 2399. [D 20:42:20.158189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 2400. [D 20:42:20.158199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 2401. [D 20:42:20.158210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2402. [D 20:42:20.158220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2403. [D 20:42:20.158230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2404. [D 20:42:20.158240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 2405. [D 20:42:20.158263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 2406. [D 20:42:20.158274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 2407. [D 20:42:20.158298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 2408. [D 20:42:20.158308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 2409. [D 20:42:20.158336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2410. [D 20:42:20.158346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2411. [D 20:42:20.158358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2412. [D 20:42:20.158382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2413. [D 20:42:20.158395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2414. [D 20:42:20.158413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2415. [D 20:42:20.158424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2416. [D 20:42:20.158434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2417. [D 20:42:20.158456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2418. [D 20:42:20.158467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2419. [D 20:42:20.158477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2420. [D 20:42:20.158499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2421. [D 20:42:20.158509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2422. [D 20:42:20.158529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2423. [D 20:42:20.158541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2424. [D 20:42:20.158551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2425. [D 20:42:20.158572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2426. [D 20:42:20.158582] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2427. [D 20:42:20.164080] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2427. [D 20:42:20.164097] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 55/70. [D 20:42:20.166255] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.166270] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.166281] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.171056] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.171071] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.171082] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.171116] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2624 [D 20:42:20.171127] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:20.171139] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 56/70. [D 20:42:20.218617] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2611 [D 20:42:20.218636] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 57/70. [D 20:42:20.218696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2427. [D 20:42:20.218767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2428. [D 20:42:20.218822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2429. [D 20:42:20.218833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2430. [D 20:42:20.218844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2431. [D 20:42:20.218854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2432. [D 20:42:20.218864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2433. [D 20:42:20.218888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2434. [D 20:42:20.218899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2435. [D 20:42:20.218909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2436. [D 20:42:20.218920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2437. [D 20:42:20.218929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2438. [D 20:42:20.218952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2439. [D 20:42:20.218967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2440. [D 20:42:20.218988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2441. [D 20:42:20.219002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2442. [D 20:42:20.219023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2443. [D 20:42:20.219038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2444. [D 20:42:20.219064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2445. [D 20:42:20.219074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2446. [D 20:42:20.219095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2447. [D 20:42:20.219107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2448. [D 20:42:20.219116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2449. [D 20:42:20.219135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2450. [D 20:42:20.219146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2451. [D 20:42:20.219156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2452. [D 20:42:20.219166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2453. [D 20:42:20.219176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2454. [D 20:42:20.219194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2455. [D 20:42:20.219203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2456. [D 20:42:20.219213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2457. [D 20:42:20.219224] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2458. [D 20:42:20.224620] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2458. [D 20:42:20.224637] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 58/70. [D 20:42:20.226937] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.226952] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.226962] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.232679] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.232694] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.232704] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.232736] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2626 [D 20:42:20.232747] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:20.232760] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 59/70. [D 20:42:20.323523] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2618 [D 20:42:20.323541] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 60/70. [D 20:42:20.323640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2458. [D 20:42:20.323743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2459. [D 20:42:20.323756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2460. [D 20:42:20.323766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2461. [D 20:42:20.323781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2462. [D 20:42:20.323790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2463. [D 20:42:20.323800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2464. [D 20:42:20.323815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2465. [D 20:42:20.323825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2466. [D 20:42:20.323834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2467. [D 20:42:20.323864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2468. [D 20:42:20.323874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2469. [D 20:42:20.323886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2470. [D 20:42:20.323912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2471. [D 20:42:20.323922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2472. [D 20:42:20.323944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2473. [D 20:42:20.323954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2474. [D 20:42:20.323964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2475. [D 20:42:20.323985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2476. [D 20:42:20.323995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2477. [D 20:42:20.324005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2478. [D 20:42:20.324033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2479. [D 20:42:20.324043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2480. [D 20:42:20.324054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2481. [D 20:42:20.324075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2482. [D 20:42:20.324086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2483. [D 20:42:20.324096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2484. [D 20:42:20.324118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2485. [D 20:42:20.324128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2486. [D 20:42:20.324138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2487. [D 20:42:20.324161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2488. [D 20:42:20.324171] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2489. [D 20:42:20.329606] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2489. [D 20:42:20.329624] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 0/70. [D 20:42:20.331076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.331091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.331102] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.337485] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.337499] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.337509] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.337542] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2630 [D 20:42:20.337552] element 0: offset: 0x2aaaab20f830, size: 24 [D 20:42:20.337567] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 1/70. [D 20:42:20.403361] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2615 [D 20:42:20.403379] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 2/70. [D 20:42:20.403440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2489. [D 20:42:20.403549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2490. [D 20:42:20.403562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2491. [D 20:42:20.403574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2492. [D 20:42:20.403584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2493. [D 20:42:20.403594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2494. [D 20:42:20.403604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2495. [D 20:42:20.403626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2496. [D 20:42:20.403641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2497. [D 20:42:20.403651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2498. [D 20:42:20.403661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2499. [D 20:42:20.403672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2500. [D 20:42:20.403695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2501. [D 20:42:20.403706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2502. [D 20:42:20.403730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2503. [D 20:42:20.403740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2504. [D 20:42:20.403765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2505. [D 20:42:20.403775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2506. [D 20:42:20.403787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2507. [D 20:42:20.403797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2508. [D 20:42:20.403807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2509. [D 20:42:20.403820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2510. [D 20:42:20.403847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2511. [D 20:42:20.403860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2512. [D 20:42:20.403869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2513. [D 20:42:20.403879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2514. [D 20:42:20.403902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2515. [D 20:42:20.403911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2516. [D 20:42:20.403922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2517. [D 20:42:20.403932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2518. [D 20:42:20.403958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2519. [D 20:42:20.403969] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2520. [D 20:42:20.409404] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2520. [D 20:42:20.409422] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 3/70. [D 20:42:20.411756] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.411771] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.411782] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.417474] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.417488] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.417499] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.417531] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2633 [D 20:42:20.417542] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:20.417554] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 4/70. [D 20:42:20.498446] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2626 [D 20:42:20.498465] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 5/70. [D 20:42:20.498582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2520. [D 20:42:20.498692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2521. [D 20:42:20.498703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2522. [D 20:42:20.498714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2523. [D 20:42:20.498729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2524. [D 20:42:20.498738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2525. [D 20:42:20.498748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2526. [D 20:42:20.498763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2527. [D 20:42:20.498773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2528. [D 20:42:20.498782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2529. [D 20:42:20.498812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2530. [D 20:42:20.498823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2531. [D 20:42:20.498845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2532. [D 20:42:20.498856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2533. [D 20:42:20.498866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2534. [D 20:42:20.498890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2535. [D 20:42:20.498901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2536. [D 20:42:20.498911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2537. [D 20:42:20.498935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2538. [D 20:42:20.498946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2539. [D 20:42:20.498955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2540. [D 20:42:20.498965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2541. [D 20:42:20.498983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2542. [D 20:42:20.499003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2543. [D 20:42:20.499018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2544. [D 20:42:20.499029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2545. [D 20:42:20.499038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2546. [D 20:42:20.499049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2547. [D 20:42:20.499063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2548. [D 20:42:20.499072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2549. [D 20:42:20.499082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2550. [D 20:42:20.499108] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2551. [D 20:42:20.504550] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2551. [D 20:42:20.504568] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 6/70. [D 20:42:20.506857] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.506873] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.506883] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.512383] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.512400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.512411] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.512445] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2635 [D 20:42:20.512456] element 0: offset: 0x2aaaab225ec0, size: 24 [D 20:42:20.512469] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 7/70. [D 20:42:20.573663] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2624 [D 20:42:20.573681] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 8/70. [D 20:42:20.573744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 2551. [D 20:42:20.573820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 2552. [D 20:42:20.573832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 2553. [D 20:42:20.573842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 2554. [D 20:42:20.573853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 2555. [D 20:42:20.573862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 2556. [D 20:42:20.573878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2557. [D 20:42:20.573888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2558. [D 20:42:20.573898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2559. [D 20:42:20.573914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 2560. [D 20:42:20.573963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 2561. [D 20:42:20.573976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 2562. [D 20:42:20.574003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 2563. [D 20:42:20.574015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 2564. [D 20:42:20.574025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2565. [D 20:42:20.574035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2566. [D 20:42:20.574058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2567. [D 20:42:20.574068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2568. [D 20:42:20.574078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2569. [D 20:42:20.574088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2570. [D 20:42:20.574098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2571. [D 20:42:20.574113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2572. [D 20:42:20.574138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2573. [D 20:42:20.574149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2574. [D 20:42:20.574159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2575. [D 20:42:20.574169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2576. [D 20:42:20.574191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2577. [D 20:42:20.574201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2578. [D 20:42:20.574211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2579. [D 20:42:20.574227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2580. [D 20:42:20.574236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2581. [D 20:42:20.574246] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2582. [D 20:42:20.579674] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2582. [D 20:42:20.579691] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 9/70. [D 20:42:20.581902] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.581917] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.581927] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.653550] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2630 [D 20:42:20.653568] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 10/70. [D 20:42:20.653673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2582. [D 20:42:20.653750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2583. [D 20:42:20.653762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2584. [D 20:42:20.653773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2585. [D 20:42:20.653787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2586. [D 20:42:20.653797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2587. [D 20:42:20.653807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2588. [D 20:42:20.653822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2589. [D 20:42:20.653832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2590. [D 20:42:20.653842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2591. [D 20:42:20.653857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2592. [D 20:42:20.653872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2593. [D 20:42:20.653882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2594. [D 20:42:20.653894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2595. [D 20:42:20.653911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2596. [D 20:42:20.653921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2597. [D 20:42:20.653972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2598. [D 20:42:20.653982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2599. [D 20:42:20.653992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2600. [D 20:42:20.654003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2601. [D 20:42:20.654013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2602. [D 20:42:20.654037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2603. [D 20:42:20.654051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2604. [D 20:42:20.654061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2605. [D 20:42:20.654070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2606. [D 20:42:20.654099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2607. [D 20:42:20.654109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2608. [D 20:42:20.654123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2609. [D 20:42:20.654132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2610. [D 20:42:20.654145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2611. [D 20:42:20.654169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2612. [D 20:42:20.654179] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2613. [D 20:42:20.659608] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2613. [D 20:42:20.659625] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 11/70. [D 20:42:20.661918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.661934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.661944] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:20.667079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.667095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.667105] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:20.667138] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2639 [D 20:42:20.667149] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:20.667161] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 12/70. [D 20:42:20.712691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.712760] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.712770] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.712808] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2642 [D 20:42:20.712820] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:20.712834] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 13/70. [D 20:42:20.741768] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2633 [D 20:42:20.741786] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 14/70. [D 20:42:20.741848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2613. [D 20:42:20.741925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2614. [D 20:42:20.741936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2615. [D 20:42:20.741947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2616. [D 20:42:20.741957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2617. [D 20:42:20.741967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2618. [D 20:42:20.741983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2619. [D 20:42:20.741993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2620. [D 20:42:20.742003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2621. [D 20:42:20.742019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2622. [D 20:42:20.742028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2623. [D 20:42:20.742038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2624. [D 20:42:20.742048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2625. [D 20:42:20.742058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2626. [D 20:42:20.742068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2627. [D 20:42:20.742078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2628. [D 20:42:20.742126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2629. [D 20:42:20.742139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2630. [D 20:42:20.742149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2631. [D 20:42:20.742165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2632. [D 20:42:20.742175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2633. [D 20:42:20.742185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2634. [D 20:42:20.742196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2635. [D 20:42:20.742222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2636. [D 20:42:20.742232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2637. [D 20:42:20.742242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2638. [D 20:42:20.742253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2639. [D 20:42:20.742263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2640. [D 20:42:20.742273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2641. [D 20:42:20.742284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2642. [D 20:42:20.742294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2643. [D 20:42:20.742321] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2644. [D 20:42:20.747783] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2644. [D 20:42:20.747801] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 15/70. [D 20:42:20.750115] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.750130] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.750140] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.755739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.755753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.755764] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.755796] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2645 [D 20:42:20.755807] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:20.755819] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 16/70. [D 20:42:20.817288] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2635 [D 20:42:20.817306] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 17/70. [D 20:42:20.817369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2644. [D 20:42:20.817450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2645. [D 20:42:20.817462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2646. [D 20:42:20.817472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2647. [D 20:42:20.817483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2648. [D 20:42:20.817492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2649. [D 20:42:20.817508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2650. [D 20:42:20.817518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2651. [D 20:42:20.817527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2652. [D 20:42:20.817543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2653. [D 20:42:20.817593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2654. [D 20:42:20.817606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2655. [D 20:42:20.817632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2656. [D 20:42:20.817642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2657. [D 20:42:20.817652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2658. [D 20:42:20.817681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2659. [D 20:42:20.817691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2660. [D 20:42:20.817705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2661. [D 20:42:20.817715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2662. [D 20:42:20.817727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2663. [D 20:42:20.817742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2664. [D 20:42:20.817766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2665. [D 20:42:20.817780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2666. [D 20:42:20.817790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2667. [D 20:42:20.817812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2668. [D 20:42:20.817822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2669. [D 20:42:20.817832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2670. [D 20:42:20.817846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2671. [D 20:42:20.817856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2672. [D 20:42:20.817865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2673. [D 20:42:20.817893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2674. [D 20:42:20.817903] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2675. [D 20:42:20.823313] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2675. [D 20:42:20.823332] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 18/70. [D 20:42:20.825481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.825496] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.825506] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.831351] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.831365] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.831376] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.831409] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2647 [D 20:42:20.831420] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:20.831433] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 19/70. [D 20:42:20.897193] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2645 [D 20:42:20.897212] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 20/70. [D 20:42:20.897269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2675. [D 20:42:20.897367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2676. [D 20:42:20.897381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2677. [D 20:42:20.897391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2678. [D 20:42:20.897402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2679. [D 20:42:20.897413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2680. [D 20:42:20.897423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2681. [D 20:42:20.897433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2682. [D 20:42:20.897443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2683. [D 20:42:20.897469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2684. [D 20:42:20.897478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2685. [D 20:42:20.897507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2686. [D 20:42:20.897517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2687. [D 20:42:20.897541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2688. [D 20:42:20.897554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2689. [D 20:42:20.897567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2690. [D 20:42:20.897577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2691. [D 20:42:20.897586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2692. [D 20:42:20.897596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2693. [D 20:42:20.897624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2694. [D 20:42:20.897635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2695. [D 20:42:20.897649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2696. [D 20:42:20.897670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2697. [D 20:42:20.897683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2698. [D 20:42:20.897702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2699. [D 20:42:20.897713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2700. [D 20:42:20.897723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2701. [D 20:42:20.897733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2702. [D 20:42:20.897757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2703. [D 20:42:20.897768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2704. [D 20:42:20.897779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2705. [D 20:42:20.897789] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2706. [D 20:42:20.903224] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2706. [D 20:42:20.903242] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 21/70. [D 20:42:20.905563] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.905578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.905588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.911037] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.911051] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.911062] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.911122] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2651 [D 20:42:20.911136] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:20.911148] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 22/70. [D 20:42:20.955116] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2647 [D 20:42:20.955134] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 23/70. [D 20:42:20.955194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2706. [D 20:42:20.955265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2707. [D 20:42:20.955318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2708. [D 20:42:20.955329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2709. [D 20:42:20.955340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2710. [D 20:42:20.955351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2711. [D 20:42:20.955360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2712. [D 20:42:20.955381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2713. [D 20:42:20.955397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2714. [D 20:42:20.955406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2715. [D 20:42:20.955416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2716. [D 20:42:20.955445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2717. [D 20:42:20.955455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2718. [D 20:42:20.955485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2719. [D 20:42:20.955495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2720. [D 20:42:20.955505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2721. [D 20:42:20.955515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2722. [D 20:42:20.955525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2723. [D 20:42:20.955535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2724. [D 20:42:20.955544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2725. [D 20:42:20.955569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2726. [D 20:42:20.955579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2727. [D 20:42:20.955588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2728. [D 20:42:20.955611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2729. [D 20:42:20.955621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2730. [D 20:42:20.955631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2731. [D 20:42:20.955653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2732. [D 20:42:20.955663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2733. [D 20:42:20.955674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2734. [D 20:42:20.955683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2735. [D 20:42:20.955693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2736. [D 20:42:20.955703] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2737. [D 20:42:20.961118] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2737. [D 20:42:20.961135] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 24/70. [D 20:42:20.963342] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.963357] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.963368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.967156] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.967171] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.967181] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.967214] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2653 [D 20:42:20.967225] element 0: offset: 0x2aaaab20f830, size: 24 [D 20:42:20.969080] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 25/70. [D 20:42:21.012721] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2651 [D 20:42:21.012741] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 26/70. [D 20:42:21.012799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2737. [D 20:42:21.012881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2738. [D 20:42:21.012892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2739. [D 20:42:21.012903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2740. [D 20:42:21.012914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2741. [D 20:42:21.012924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2742. [D 20:42:21.012940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2743. [D 20:42:21.012950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2744. [D 20:42:21.012960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2745. [D 20:42:21.012976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2746. [D 20:42:21.013026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2747. [D 20:42:21.013039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2748. [D 20:42:21.013049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2749. [D 20:42:21.013059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2750. [D 20:42:21.013071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2751. [D 20:42:21.013088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2752. [D 20:42:21.013098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2753. [D 20:42:21.013107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2754. [D 20:42:21.013118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2755. [D 20:42:21.013128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2756. [D 20:42:21.013155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2757. [D 20:42:21.013169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2758. [D 20:42:21.013179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2759. [D 20:42:21.013189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2760. [D 20:42:21.013205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2761. [D 20:42:21.013215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2762. [D 20:42:21.013225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2763. [D 20:42:21.013252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2764. [D 20:42:21.013261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2765. [D 20:42:21.013276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2766. [D 20:42:21.013285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2767. [D 20:42:21.013295] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2768. [D 20:42:21.018738] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2768. [D 20:42:21.018754] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 27/70. [D 20:42:21.020895] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.020910] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.020921] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.026415] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.026430] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.026440] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.026472] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2657 [D 20:42:21.026483] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:21.026496] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 28/70. [D 20:42:21.092543] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2653 [D 20:42:21.092561] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 29/70. [D 20:42:21.092619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2768. [D 20:42:21.092691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2769. [D 20:42:21.092712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2770. [D 20:42:21.092723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2771. [D 20:42:21.092734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2772. [D 20:42:21.092743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2773. [D 20:42:21.092757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2774. [D 20:42:21.092767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2775. [D 20:42:21.092777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2776. [D 20:42:21.092792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2777. [D 20:42:21.092845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2778. [D 20:42:21.092856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2779. [D 20:42:21.092879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2780. [D 20:42:21.092890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2781. [D 20:42:21.092901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2782. [D 20:42:21.092910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2783. [D 20:42:21.092921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2784. [D 20:42:21.092931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2785. [D 20:42:21.092941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2786. [D 20:42:21.092967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2787. [D 20:42:21.092977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2788. [D 20:42:21.092987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2789. [D 20:42:21.093003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2790. [D 20:42:21.093027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2791. [D 20:42:21.093038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2792. [D 20:42:21.093048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2793. [D 20:42:21.093058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2794. [D 20:42:21.093085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2795. [D 20:42:21.093095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2796. [D 20:42:21.093107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2797. [D 20:42:21.093117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2798. [D 20:42:21.093129] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2799. [D 20:42:21.098548] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2799. [D 20:42:21.098565] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 30/70. [D 20:42:21.100702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.100717] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.100728] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.132601] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2639 [D 20:42:21.132619] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 31/70. [D 20:42:21.132681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2799. [D 20:42:21.132758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2800. [D 20:42:21.132769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2801. [D 20:42:21.132785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2802. [D 20:42:21.132796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2803. [D 20:42:21.132806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2804. [D 20:42:21.132823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2805. [D 20:42:21.132833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2806. [D 20:42:21.132842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2807. [D 20:42:21.132896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2808. [D 20:42:21.132906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2809. [D 20:42:21.132916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2810. [D 20:42:21.132930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2811. [D 20:42:21.132953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2812. [D 20:42:21.132965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2813. [D 20:42:21.132975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2814. [D 20:42:21.132985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2815. [D 20:42:21.132998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2816. [D 20:42:21.133008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2817. [D 20:42:21.133018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2818. [D 20:42:21.133034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2819. [D 20:42:21.133044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2820. [D 20:42:21.133053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2821. [D 20:42:21.133063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2822. [D 20:42:21.133074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2823. [D 20:42:21.133084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2824. [D 20:42:21.133093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2825. [D 20:42:21.133114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2826. [D 20:42:21.133124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2827. [D 20:42:21.133134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2828. [D 20:42:21.133144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2829. [D 20:42:21.133161] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2830. [D 20:42:21.138619] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2830. [D 20:42:21.138637] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 32/70. [D 20:42:21.140771] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.140786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.140797] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:21.199349] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2657 [D 20:42:21.199367] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 33/70. [D 20:42:21.199439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2830. [D 20:42:21.199547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2831. [D 20:42:21.199559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2832. [D 20:42:21.199570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2833. [D 20:42:21.199581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2834. [D 20:42:21.199591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2835. [D 20:42:21.199601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2836. [D 20:42:21.199611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2837. [D 20:42:21.199621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2838. [D 20:42:21.199631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2839. [D 20:42:21.199641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2840. [D 20:42:21.199672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2841. [D 20:42:21.199683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2842. [D 20:42:21.199706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2843. [D 20:42:21.199722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2844. [D 20:42:21.199733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2845. [D 20:42:21.199752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2846. [D 20:42:21.199766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2847. [D 20:42:21.199786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2848. [D 20:42:21.199796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2849. [D 20:42:21.199807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2850. [D 20:42:21.199817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2851. [D 20:42:21.199841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2852. [D 20:42:21.199852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2853. [D 20:42:21.199863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2854. [D 20:42:21.199872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2855. [D 20:42:21.199892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2856. [D 20:42:21.199908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2857. [D 20:42:21.199929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2858. [D 20:42:21.199940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2859. [D 20:42:21.199950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2860. [D 20:42:21.199972] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2861. [D 20:42:21.205419] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2861. [D 20:42:21.205435] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 34/70. [D 20:42:21.207155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.207170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.207180] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:21.213984] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.214020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.214030] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:21.214065] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2660 [D 20:42:21.214077] element 0: offset: 0x2aaaab218230, size: 24 [D 20:42:21.214090] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 35/70. [D 20:42:21.234591] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.234653] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.234663] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:21.234699] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2662 [D 20:42:21.234713] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:21.234727] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 36/70. [D 20:42:21.246233] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2642 [D 20:42:21.246252] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 37/70. [D 20:42:21.246306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 2861. [D 20:42:21.246338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 2862. [D 20:42:21.246349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 2863. [D 20:42:21.246360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 2864. [D 20:42:21.246370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 2865. [D 20:42:21.246380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 2866. [D 20:42:21.246390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2867. [D 20:42:21.246399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2868. [D 20:42:21.246410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2869. [D 20:42:21.246427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 2870. [D 20:42:21.246436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 2871. [D 20:42:21.246446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 2872. [D 20:42:21.246456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 2873. [D 20:42:21.246466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 2874. [D 20:42:21.246476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2875. [D 20:42:21.246486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2876. [D 20:42:21.246518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2877. [D 20:42:21.246528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2878. [D 20:42:21.246538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2879. [D 20:42:21.246554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2880. [D 20:42:21.246564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2881. [D 20:42:21.246574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2882. [D 20:42:21.246602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2883. [D 20:42:21.246612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2884. [D 20:42:21.246626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2885. [D 20:42:21.246636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2886. [D 20:42:21.246660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2887. [D 20:42:21.246670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2888. [D 20:42:21.246682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2889. [D 20:42:21.246704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2890. [D 20:42:21.246714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2891. [D 20:42:21.246735] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2892. [D 20:42:21.252200] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2892. [D 20:42:21.252218] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 38/70. [D 20:42:21.254504] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.254518] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.254527] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:21.259151] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.259165] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.259176] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:21.259202] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2666 [D 20:42:21.259212] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:21.261097] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 39/70. [D 20:42:21.270729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.270789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.270799] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.270837] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2669 [D 20:42:21.270850] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:21.270864] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 40/70. [D 20:42:21.326104] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2662 [D 20:42:21.326140] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 41/70. [D 20:42:21.326203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2892. [D 20:42:21.326276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2893. [D 20:42:21.326287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 2894. [D 20:42:21.326297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 2895. [D 20:42:21.326312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 2896. [D 20:42:21.326366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 2897. [D 20:42:21.326377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 2898. [D 20:42:21.326387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2899. [D 20:42:21.326410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2900. [D 20:42:21.326420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2901. [D 20:42:21.326431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 2902. [D 20:42:21.326441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 2903. [D 20:42:21.326451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 2904. [D 20:42:21.326461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 2905. [D 20:42:21.326484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 2906. [D 20:42:21.326506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 2907. [D 20:42:21.326516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 2908. [D 20:42:21.326535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 2909. [D 20:42:21.326546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 2910. [D 20:42:21.326556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 2911. [D 20:42:21.326566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 2912. [D 20:42:21.326577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 2913. [D 20:42:21.326587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 2914. [D 20:42:21.326597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 2915. [D 20:42:21.326607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 2916. [D 20:42:21.326618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 2917. [D 20:42:21.326645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 2918. [D 20:42:21.326661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 2919. [D 20:42:21.326682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 2920. [D 20:42:21.326696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 2921. [D 20:42:21.326714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 2922. [D 20:42:21.326725] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 2923. [D 20:42:21.332133] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2923. [D 20:42:21.332150] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 42/70. [D 20:42:21.334468] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.334483] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.334493] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.339118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.339133] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.339144] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.339177] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2671 [D 20:42:21.339188] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:21.339200] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 43/70. [D 20:42:21.405323] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2671 [D 20:42:21.405342] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 44/70. [D 20:42:21.405402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2923. [D 20:42:21.405471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2924. [D 20:42:21.405491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 2925. [D 20:42:21.405501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 2926. [D 20:42:21.405511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 2927. [D 20:42:21.405522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 2928. [D 20:42:21.405537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 2929. [D 20:42:21.405547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2930. [D 20:42:21.405557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2931. [D 20:42:21.405572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2932. [D 20:42:21.405622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 2933. [D 20:42:21.405632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 2934. [D 20:42:21.405642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 2935. [D 20:42:21.405652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 2936. [D 20:42:21.405662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 2937. [D 20:42:21.405679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 2938. [D 20:42:21.405689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 2939. [D 20:42:21.405699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 2940. [D 20:42:21.405710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 2941. [D 20:42:21.405720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 2942. [D 20:42:21.405747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 2943. [D 20:42:21.405760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 2944. [D 20:42:21.405770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 2945. [D 20:42:21.405780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 2946. [D 20:42:21.405790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 2947. [D 20:42:21.405800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 2948. [D 20:42:21.405810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 2949. [D 20:42:21.405820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 2950. [D 20:42:21.405845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 2951. [D 20:42:21.405855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 2952. [D 20:42:21.405865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 2953. [D 20:42:21.405876] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 2954. [D 20:42:21.411398] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2954. [D 20:42:21.411416] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 45/70. [D 20:42:21.413750] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.413765] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.413775] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.419140] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.419154] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.419165] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.419198] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2674 [D 20:42:21.419209] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:21.419221] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 46/70. [D 20:42:21.467054] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2660 [D 20:42:21.467072] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 47/70. [D 20:42:21.467132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 2954. [D 20:42:21.467203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 2955. [D 20:42:21.467215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 2956. [D 20:42:21.467225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 2957. [D 20:42:21.467236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 2958. [D 20:42:21.467247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 2959. [D 20:42:21.467256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2960. [D 20:42:21.467266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2961. [D 20:42:21.467276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2962. [D 20:42:21.467286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 2963. [D 20:42:21.467296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 2964. [D 20:42:21.467361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 2965. [D 20:42:21.467373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 2966. [D 20:42:21.467395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 2967. [D 20:42:21.467406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2968. [D 20:42:21.467416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2969. [D 20:42:21.467432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2970. [D 20:42:21.467442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 2971. [D 20:42:21.467451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 2972. [D 20:42:21.467482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 2973. [D 20:42:21.467494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 2974. [D 20:42:21.467507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 2975. [D 20:42:21.467517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2976. [D 20:42:21.467527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2977. [D 20:42:21.467540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2978. [D 20:42:21.467566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 2979. [D 20:42:21.467579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 2980. [D 20:42:21.467589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 2981. [D 20:42:21.467598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 2982. [D 20:42:21.467621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 2983. [D 20:42:21.467631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2984. [D 20:42:21.467641] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2985. [D 20:42:21.473055] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2985. [D 20:42:21.473071] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 48/70. [D 20:42:21.475151] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.475166] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.475177] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.529088] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2674 [D 20:42:21.529106] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 49/70. [D 20:42:21.529163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2985. [D 20:42:21.529230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2986. [D 20:42:21.529268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 2987. [D 20:42:21.529280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 2988. [D 20:42:21.529290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 2989. [D 20:42:21.529304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 2990. [D 20:42:21.529314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 2991. [D 20:42:21.529327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2992. [D 20:42:21.529354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2993. [D 20:42:21.529365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2994. [D 20:42:21.529388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 2995. [D 20:42:21.529405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 2996. [D 20:42:21.529427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 2997. [D 20:42:21.529441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 2998. [D 20:42:21.529460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 2999. [D 20:42:21.529471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3000. [D 20:42:21.529481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3001. [D 20:42:21.529502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3002. [D 20:42:21.529514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 3003. [D 20:42:21.529524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 3004. [D 20:42:21.529548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 3005. [D 20:42:21.529558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 3006. [D 20:42:21.529582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 3007. [D 20:42:21.529592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3008. [D 20:42:21.529613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3009. [D 20:42:21.529623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3010. [D 20:42:21.529633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 3011. [D 20:42:21.529655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 3012. [D 20:42:21.529665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 3013. [D 20:42:21.529676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 3014. [D 20:42:21.529702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 3015. [D 20:42:21.529716] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3016. [D 20:42:21.535090] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3016. [D 20:42:21.535108] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 50/70. [D 20:42:21.537324] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.537339] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.537349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:21.543322] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.543338] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.543349] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:21.543382] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2677 [D 20:42:21.543393] element 0: offset: 0x2aaaab234fe0, size: 24 [D 20:42:21.543405] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 51/70. [D 20:42:21.591022] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2666 [D 20:42:21.591040] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 52/70. [D 20:42:21.591098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3016. [D 20:42:21.591196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3017. [D 20:42:21.591210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3018. [D 20:42:21.591221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3019. [D 20:42:21.591231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3020. [D 20:42:21.591242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3021. [D 20:42:21.591253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3022. [D 20:42:21.591263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3023. [D 20:42:21.591299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3024. [D 20:42:21.591310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3025. [D 20:42:21.591332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3026. [D 20:42:21.591343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3027. [D 20:42:21.591353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3028. [D 20:42:21.591374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3029. [D 20:42:21.591387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3030. [D 20:42:21.591405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3031. [D 20:42:21.591416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3032. [D 20:42:21.591427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3033. [D 20:42:21.591450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3034. [D 20:42:21.591460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3035. [D 20:42:21.591470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3036. [D 20:42:21.591493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3037. [D 20:42:21.591503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3038. [D 20:42:21.591529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3039. [D 20:42:21.591539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3040. [D 20:42:21.591549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3041. [D 20:42:21.591954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3042. [D 20:42:21.591966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3043. [D 20:42:21.591976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3044. [D 20:42:21.591998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3045. [D 20:42:21.592009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3046. [D 20:42:21.592019] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3047. [D 20:42:21.597050] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3047. [D 20:42:21.597067] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 53/70. [D 20:42:21.599429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.599444] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.599455] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:21.606141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.606188] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.606198] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:21.606235] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2681 [D 20:42:21.606248] element 0: offset: 0x2aaaab218230, size: 24 [D 20:42:21.606262] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 54/70. [D 20:42:21.606285] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.606299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.606308] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.606322] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2684 [D 20:42:21.606332] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:21.606342] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 55/70. [D 20:42:21.644549] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2669 [D 20:42:21.644567] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 56/70. [D 20:42:21.644625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3047. [D 20:42:21.644704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3048. [D 20:42:21.644716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3049. [D 20:42:21.644726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3050. [D 20:42:21.644737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3051. [D 20:42:21.644793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3052. [D 20:42:21.644804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3053. [D 20:42:21.644814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3054. [D 20:42:21.644837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3055. [D 20:42:21.644847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3056. [D 20:42:21.644868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3057. [D 20:42:21.644878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3058. [D 20:42:21.644889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3059. [D 20:42:21.644913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3060. [D 20:42:21.644923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3061. [D 20:42:21.644943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3062. [D 20:42:21.644953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3063. [D 20:42:21.644975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3064. [D 20:42:21.644986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3065. [D 20:42:21.645006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3066. [D 20:42:21.645017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3067. [D 20:42:21.645027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3068. [D 20:42:21.645037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3069. [D 20:42:21.645046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3070. [D 20:42:21.645056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3071. [D 20:42:21.645066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3072. [D 20:42:21.645084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3073. [D 20:42:21.645107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3074. [D 20:42:21.645118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3075. [D 20:42:21.645129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3076. [D 20:42:21.645138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3077. [D 20:42:21.645148] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3078. [D 20:42:21.650558] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3078. [D 20:42:21.650575] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 57/70. [D 20:42:21.652890] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.652905] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.652916] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.657940] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.657955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.657965] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.657998] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2687 [D 20:42:21.658009] element 0: offset: 0x2aaaab225980, size: 24 [D 20:42:21.658023] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 58/70. [D 20:42:21.777226] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2677 [D 20:42:21.777246] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 59/70. [D 20:42:21.777384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 3078. [D 20:42:21.777490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 3079. [D 20:42:21.777501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 3080. [D 20:42:21.777512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 3081. [D 20:42:21.777526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 3082. [D 20:42:21.777536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 3083. [D 20:42:21.777546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 3084. [D 20:42:21.777561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3085. [D 20:42:21.777570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3086. [D 20:42:21.777580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3087. [D 20:42:21.777609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 3088. [D 20:42:21.777621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 3089. [D 20:42:21.777632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 3090. [D 20:42:21.777660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 3091. [D 20:42:21.777670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 3092. [D 20:42:21.777689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3093. [D 20:42:21.777699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3094. [D 20:42:21.777709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3095. [D 20:42:21.777732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 3096. [D 20:42:21.777742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 3097. [D 20:42:21.777752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 3098. [D 20:42:21.777779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 3099. [D 20:42:21.777789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 3100. [D 20:42:21.777804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3101. [D 20:42:21.777825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3102. [D 20:42:21.777839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3103. [D 20:42:21.777858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 3104. [D 20:42:21.777869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 3105. [D 20:42:21.777879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 3106. [D 20:42:21.777903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 3107. [D 20:42:21.777913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 3108. [D 20:42:21.777923] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3109. [D 20:42:21.783349] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3109. [D 20:42:21.783367] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 60/70. [D 20:42:21.785684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.785699] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.785709] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.791560] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.791575] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.791585] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.791619] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2689 [D 20:42:21.791630] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:21.791642] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 0/70. [D 20:42:21.844117] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2681 [D 20:42:21.844135] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 1/70. [D 20:42:21.844194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3109. [D 20:42:21.844260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3110. [D 20:42:21.844280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3111. [D 20:42:21.844290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3112. [D 20:42:21.844300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3113. [D 20:42:21.844310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3114. [D 20:42:21.844325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3115. [D 20:42:21.844335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3116. [D 20:42:21.844344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3117. [D 20:42:21.844360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3118. [D 20:42:21.844408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3119. [D 20:42:21.844418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3120. [D 20:42:21.844428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3121. [D 20:42:21.844452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3122. [D 20:42:21.844462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3123. [D 20:42:21.844472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3124. [D 20:42:21.844486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3125. [D 20:42:21.844496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3126. [D 20:42:21.844506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3127. [D 20:42:21.844534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3128. [D 20:42:21.844544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3129. [D 20:42:21.844554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3130. [D 20:42:21.844564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3131. [D 20:42:21.844574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3132. [D 20:42:21.844584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3133. [D 20:42:21.844609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3134. [D 20:42:21.844624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3135. [D 20:42:21.844635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3136. [D 20:42:21.844645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3137. [D 20:42:21.844667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3138. [D 20:42:21.844678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3139. [D 20:42:21.844688] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3140. [D 20:42:21.850120] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3140. [D 20:42:21.850137] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 2/70. [D 20:42:21.852398] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.852412] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.852424] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.858613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.858627] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.858637] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.858669] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2693 [D 20:42:21.858680] element 0: offset: 0x2aaaab225ec0, size: 24 [D 20:42:21.858692] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 3/70. [D 20:42:22.135928] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2684 [D 20:42:22.135947] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 4/70. [D 20:42:22.136066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3140. [D 20:42:22.136144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3141. [D 20:42:22.136156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3142. [D 20:42:22.136166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3143. [D 20:42:22.136177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3144. [D 20:42:22.136187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3145. [D 20:42:22.136196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3146. [D 20:42:22.136206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3147. [D 20:42:22.136216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3148. [D 20:42:22.136226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3149. [D 20:42:22.136235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3150. [D 20:42:22.136314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3151. [D 20:42:22.136339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3152. [D 20:42:22.136349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3153. [D 20:42:22.136359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3154. [D 20:42:22.136369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3155. [D 20:42:22.136385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3156. [D 20:42:22.136394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3157. [D 20:42:22.136404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3158. [D 20:42:22.136420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3159. [D 20:42:22.136429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3160. [D 20:42:22.136439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3161. [D 20:42:22.136449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3162. [D 20:42:22.136459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3163. [D 20:42:22.136469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3164. [D 20:42:22.136479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3165. [D 20:42:22.136489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3166. [D 20:42:22.136499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3167. [D 20:42:22.136508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3168. [D 20:42:22.136518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3169. [D 20:42:22.136544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3170. [D 20:42:22.136554] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3171. [D 20:42:22.142002] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3171. [D 20:42:22.142019] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 5/70. [D 20:42:22.144296] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.144312] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.144321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.149731] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.149746] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.149757] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.149789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2696 [D 20:42:22.149800] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:22.149812] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 6/70. [D 20:42:22.159760] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2687 [D 20:42:22.159778] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 7/70. [D 20:42:22.159824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3171. [D 20:42:22.159855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3172. [D 20:42:22.159866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3173. [D 20:42:22.159876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3174. [D 20:42:22.159887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3175. [D 20:42:22.159897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3176. [D 20:42:22.159906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3177. [D 20:42:22.159923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3178. [D 20:42:22.159933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3179. [D 20:42:22.159942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3180. [D 20:42:22.159952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3181. [D 20:42:22.159968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3182. [D 20:42:22.159978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3183. [D 20:42:22.159988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3184. [D 20:42:22.160029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3185. [D 20:42:22.160040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3186. [D 20:42:22.160050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3187. [D 20:42:22.160065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3188. [D 20:42:22.160089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3189. [D 20:42:22.160100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3190. [D 20:42:22.160110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3191. [D 20:42:22.160119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3192. [D 20:42:22.160142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3193. [D 20:42:22.160152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3194. [D 20:42:22.160162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3195. [D 20:42:22.160177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3196. [D 20:42:22.160187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3197. [D 20:42:22.160196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3198. [D 20:42:22.160215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3199. [D 20:42:22.160225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3200. [D 20:42:22.160235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3201. [D 20:42:22.160244] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3202. [D 20:42:22.165712] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3202. [D 20:42:22.165729] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 8/70. [D 20:42:22.168000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.168014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.168024] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.171205] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.171219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.171229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.171251] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2699 [D 20:42:22.171261] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:22.173345] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 9/70. [D 20:42:22.238554] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2689 [D 20:42:22.238572] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 10/70. [D 20:42:22.238632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 3202. [D 20:42:22.238701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 3203. [D 20:42:22.238750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 3204. [D 20:42:22.238761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 3205. [D 20:42:22.238771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 3206. [D 20:42:22.238782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 3207. [D 20:42:22.238791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 3208. [D 20:42:22.238801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3209. [D 20:42:22.238826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3210. [D 20:42:22.238836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3211. [D 20:42:22.238846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 3212. [D 20:42:22.238862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 3213. [D 20:42:22.238872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 3214. [D 20:42:22.238881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 3215. [D 20:42:22.238891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 3216. [D 20:42:22.238914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3217. [D 20:42:22.238924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3218. [D 20:42:22.238934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3219. [D 20:42:22.238956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 3220. [D 20:42:22.238966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 3221. [D 20:42:22.238976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 3222. [D 20:42:22.238998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 3223. [D 20:42:22.239008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 3224. [D 20:42:22.239023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3225. [D 20:42:22.239033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3226. [D 20:42:22.239042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3227. [D 20:42:22.239070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 3228. [D 20:42:22.239080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 3229. [D 20:42:22.239093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 3230. [D 20:42:22.239103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 3231. [D 20:42:22.239127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 3232. [D 20:42:22.239137] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3233. [D 20:42:22.244561] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3233. [D 20:42:22.244579] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 11/70. [D 20:42:22.246901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.246916] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.246926] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.252344] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.252360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.252370] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.252403] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2701 [D 20:42:22.252414] element 0: offset: 0x2aaaab218230, size: 24 [D 20:42:22.252427] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 12/70. [D 20:42:22.330676] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2696 [D 20:42:22.330694] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 13/70. [D 20:42:22.330787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3233. [D 20:42:22.330897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3234. [D 20:42:22.330909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3235. [D 20:42:22.330919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3236. [D 20:42:22.330930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3237. [D 20:42:22.330940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3238. [D 20:42:22.330949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3239. [D 20:42:22.330959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3240. [D 20:42:22.330969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3241. [D 20:42:22.330979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3242. [D 20:42:22.330989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3243. [D 20:42:22.331021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3244. [D 20:42:22.331031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3245. [D 20:42:22.331058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3246. [D 20:42:22.331067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3247. [D 20:42:22.331080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3248. [D 20:42:22.331104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3249. [D 20:42:22.331117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3250. [D 20:42:22.331127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3251. [D 20:42:22.331136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3252. [D 20:42:22.331161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3253. [D 20:42:22.331170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3254. [D 20:42:22.331185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3255. [D 20:42:22.331211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3256. [D 20:42:22.331222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3257. [D 20:42:22.331231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3258. [D 20:42:22.331258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3259. [D 20:42:22.331267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3260. [D 20:42:22.331291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3261. [D 20:42:22.331301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3262. [D 20:42:22.331322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3263. [D 20:42:22.331332] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3264. [D 20:42:22.336752] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3264. [D 20:42:22.336768] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 14/70. [D 20:42:22.339093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.339108] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.339118] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.340874] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2693 [D 20:42:22.340893] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 15/70. [D 20:42:22.341939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3264. [D 20:42:22.341959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3265. [D 20:42:22.341970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3266. [D 20:42:22.341980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3267. [D 20:42:22.341992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3268. [D 20:42:22.342007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3269. [D 20:42:22.342017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3270. [D 20:42:22.342026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3271. [D 20:42:22.342037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3272. [D 20:42:22.342046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3273. [D 20:42:22.342056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3274. [D 20:42:22.342066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3275. [D 20:42:22.342089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3276. [D 20:42:22.342098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3277. [D 20:42:22.342108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3278. [D 20:42:22.342122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3279. [D 20:42:22.342131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3280. [D 20:42:22.342141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3281. [D 20:42:22.342151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3282. [D 20:42:22.342175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3283. [D 20:42:22.342185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3284. [D 20:42:22.342194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3285. [D 20:42:22.342205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3286. [D 20:42:22.342214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3287. [D 20:42:22.342224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3288. [D 20:42:22.342248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3289. [D 20:42:22.342258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3290. [D 20:42:22.342268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3291. [D 20:42:22.342278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3292. [D 20:42:22.342288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3293. [D 20:42:22.342298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3294. [D 20:42:22.342307] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3295. [D 20:42:22.344698] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.344712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.344722] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.344755] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2705 [D 20:42:22.344766] element 0: offset: 0x2aaaab203630, size: 24 [D 20:42:22.344778] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 16/70. [D 20:42:22.347828] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3295. [D 20:42:22.347843] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 17/70. [D 20:42:22.350220] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.350235] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.350244] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.356474] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.356504] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.356514] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.356543] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2708 [D 20:42:22.356554] element 0: offset: 0x2aaaab210aa0, size: 24 [D 20:42:22.356567] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 18/70. [D 20:42:22.407383] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2699 [D 20:42:22.407402] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 19/70. [D 20:42:22.407460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3295. [D 20:42:22.407540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3296. [D 20:42:22.407551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3297. [D 20:42:22.407561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3298. [D 20:42:22.407576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3299. [D 20:42:22.407586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3300. [D 20:42:22.407596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3301. [D 20:42:22.407610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3302. [D 20:42:22.407620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3303. [D 20:42:22.407630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3304. [D 20:42:22.407645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3305. [D 20:42:22.407660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3306. [D 20:42:22.407670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3307. [D 20:42:22.407679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3308. [D 20:42:22.407695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3309. [D 20:42:22.407704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3310. [D 20:42:22.407714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3311. [D 20:42:22.407724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3312. [D 20:42:22.407741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3313. [D 20:42:22.407751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3314. [D 20:42:22.407761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3315. [D 20:42:22.407771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3316. [D 20:42:22.407782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3317. [D 20:42:22.407791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3318. [D 20:42:22.407801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3319. [D 20:42:22.407855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3320. [D 20:42:22.407866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3321. [D 20:42:22.407876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3322. [D 20:42:22.407900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3323. [D 20:42:22.407910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3324. [D 20:42:22.407921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3325. [D 20:42:22.407930] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3326. [D 20:42:22.413396] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3326. [D 20:42:22.413414] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 20/70. [D 20:42:22.415228] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.415245] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.415254] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.418808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.418822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.418830] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.418857] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2711 [D 20:42:22.418867] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:22.418878] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 21/70. [D 20:42:22.491333] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2708 [D 20:42:22.491351] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 22/70. [D 20:42:22.491469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3326. [D 20:42:22.491579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3327. [D 20:42:22.491590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3328. [D 20:42:22.491601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3329. [D 20:42:22.491615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3330. [D 20:42:22.491625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3331. [D 20:42:22.491635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3332. [D 20:42:22.491649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3333. [D 20:42:22.491659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3334. [D 20:42:22.491668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3335. [D 20:42:22.491699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3336. [D 20:42:22.491710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3337. [D 20:42:22.491724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3338. [D 20:42:22.491738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3339. [D 20:42:22.491748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3340. [D 20:42:22.491758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3341. [D 20:42:22.491780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3342. [D 20:42:22.491790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3343. [D 20:42:22.491815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3344. [D 20:42:22.491826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3345. [D 20:42:22.491840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3346. [D 20:42:22.491862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3347. [D 20:42:22.491875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3348. [D 20:42:22.491885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3349. [D 20:42:22.491895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3350. [D 20:42:22.491907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3351. [D 20:42:22.491923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3352. [D 20:42:22.491933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3353. [D 20:42:22.491943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3354. [D 20:42:22.491952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3355. [D 20:42:22.491980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3356. [D 20:42:22.491990] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3357. [D 20:42:22.497432] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3357. [D 20:42:22.497448] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 23/70. [D 20:42:22.497517] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.497532] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.497540] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.503932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.503946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.503954] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.503972] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2714 [D 20:42:22.503982] element 0: offset: 0x2aaaab2302e0, size: 24 [D 20:42:22.503992] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 24/70. [D 20:42:22.576021] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2711 [D 20:42:22.576038] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 25/70. [D 20:42:22.576154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3357. [D 20:42:22.576263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3358. [D 20:42:22.576274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3359. [D 20:42:22.576285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3360. [D 20:42:22.576295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3361. [D 20:42:22.576306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3362. [D 20:42:22.576316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3363. [D 20:42:22.576326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3364. [D 20:42:22.576335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3365. [D 20:42:22.576345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3366. [D 20:42:22.576354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3367. [D 20:42:22.576386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3368. [D 20:42:22.576396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3369. [D 20:42:22.576410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3370. [D 20:42:22.576420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3371. [D 20:42:22.576430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3372. [D 20:42:22.576439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3373. [D 20:42:22.576469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3374. [D 20:42:22.576479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3375. [D 20:42:22.576493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3376. [D 20:42:22.576503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3377. [D 20:42:22.576512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3378. [D 20:42:22.576534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3379. [D 20:42:22.576544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3380. [D 20:42:22.576554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3381. [D 20:42:22.576565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3382. [D 20:42:22.576575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3383. [D 20:42:22.576585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3384. [D 20:42:22.576611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3385. [D 20:42:22.576626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3386. [D 20:42:22.576637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3387. [D 20:42:22.576647] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3388. [D 20:42:22.582119] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3388. [D 20:42:22.582137] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 26/70. [D 20:42:22.582201] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.582216] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.582224] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.587593] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.587606] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.587615] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.587631] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2717 [D 20:42:22.587640] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:22.587650] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 27/70. [D 20:42:22.665079] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2714 [D 20:42:22.665096] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 28/70. [D 20:42:22.665194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3388. [D 20:42:22.665304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3389. [D 20:42:22.665316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3390. [D 20:42:22.665326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3391. [D 20:42:22.665341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3392. [D 20:42:22.665351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3393. [D 20:42:22.665361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3394. [D 20:42:22.665375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3395. [D 20:42:22.665385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3396. [D 20:42:22.665394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3397. [D 20:42:22.665424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3398. [D 20:42:22.665437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3399. [D 20:42:22.665466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3400. [D 20:42:22.665477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3401. [D 20:42:22.665487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3402. [D 20:42:22.665497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3403. [D 20:42:22.665506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3404. [D 20:42:22.665517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3405. [D 20:42:22.665541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3406. [D 20:42:22.665551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3407. [D 20:42:22.665571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3408. [D 20:42:22.665581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3409. [D 20:42:22.665591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3410. [D 20:42:22.665606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3411. [D 20:42:22.665615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3412. [D 20:42:22.665625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3413. [D 20:42:22.665653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3414. [D 20:42:22.665664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3415. [D 20:42:22.665685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3416. [D 20:42:22.665695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3417. [D 20:42:22.665709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3418. [D 20:42:22.665719] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3419. [D 20:42:22.671162] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3419. [D 20:42:22.671178] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 29/70. [D 20:42:22.671234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.671249] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.671258] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.677745] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.677759] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.677767] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.677783] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2720 [D 20:42:22.677792] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:22.677803] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 30/70. [D 20:42:22.706874] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2717 [D 20:42:22.706891] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 31/70. [D 20:42:22.706951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3419. [D 20:42:22.707060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3420. [D 20:42:22.707074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3421. [D 20:42:22.707085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3422. [D 20:42:22.707095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3423. [D 20:42:22.707106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3424. [D 20:42:22.707115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3425. [D 20:42:22.707138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3426. [D 20:42:22.707153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3427. [D 20:42:22.707163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3428. [D 20:42:22.707173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3429. [D 20:42:22.707198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3430. [D 20:42:22.707208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3431. [D 20:42:22.707217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3432. [D 20:42:22.707248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3433. [D 20:42:22.707258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3434. [D 20:42:22.707278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3435. [D 20:42:22.707288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3436. [D 20:42:22.707297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3437. [D 20:42:22.707307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3438. [D 20:42:22.707330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3439. [D 20:42:22.707340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3440. [D 20:42:22.707350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3441. [D 20:42:22.707372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3442. [D 20:42:22.707413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3443. [D 20:42:22.707424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3444. [D 20:42:22.707437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3445. [D 20:42:22.707447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3446. [D 20:42:22.707456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3447. [D 20:42:22.707481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3448. [D 20:42:22.707490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3449. [D 20:42:22.707505] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3450. [D 20:42:22.712919] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3450. [D 20:42:22.712935] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 32/70. [D 20:42:22.712998] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.713013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.713021] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.718418] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.718432] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.718440] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.718456] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2723 [D 20:42:22.718465] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:22.718477] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 33/70. [D 20:42:22.736249] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2701 [D 20:42:22.736265] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 34/70. [D 20:42:22.736325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 3450. [D 20:42:22.736391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 3451. [D 20:42:22.736439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 3452. [D 20:42:22.736451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 3453. [D 20:42:22.736461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 3454. [D 20:42:22.736476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 3455. [D 20:42:22.736487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 3456. [D 20:42:22.736512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3457. [D 20:42:22.736522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3458. [D 20:42:22.736532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3459. [D 20:42:22.736542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 3460. [D 20:42:22.736553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 3461. [D 20:42:22.736563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 3462. [D 20:42:22.736573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 3463. [D 20:42:22.736582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 3464. [D 20:42:22.736607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3465. [D 20:42:22.736617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3466. [D 20:42:22.736637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3467. [D 20:42:22.736647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 3468. [D 20:42:22.736657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 3469. [D 20:42:22.736685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 3470. [D 20:42:22.736695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 3471. [D 20:42:22.736709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 3472. [D 20:42:22.736719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3473. [D 20:42:22.736729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3474. [D 20:42:22.736755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3475. [D 20:42:22.736764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 3476. [D 20:42:22.736779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 3477. [D 20:42:22.736800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 3478. [D 20:42:22.736811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 3479. [D 20:42:22.736821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 3480. [D 20:42:22.736831] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3481. [D 20:42:22.742250] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3481. [D 20:42:22.742267] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 35/70. [D 20:42:22.742332] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.742347] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.742355] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.748013] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.748027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.748035] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.748051] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2725 [D 20:42:22.748060] element 0: offset: 0x2aaaab225ec0, size: 24 [D 20:42:22.748070] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 36/70. [D 20:42:22.762239] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2705 [D 20:42:22.762255] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 37/70. [D 20:42:22.762317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3481. [D 20:42:22.762389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3482. [D 20:42:22.762400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3483. [D 20:42:22.762410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3484. [D 20:42:22.762422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3485. [D 20:42:22.762431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3486. [D 20:42:22.762442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3487. [D 20:42:22.762453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3488. [D 20:42:22.762462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3489. [D 20:42:22.762472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3490. [D 20:42:22.762488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3491. [D 20:42:22.762498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3492. [D 20:42:22.762542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3493. [D 20:42:22.762554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3494. [D 20:42:22.762564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3495. [D 20:42:22.762580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3496. [D 20:42:22.762605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3497. [D 20:42:22.762620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3498. [D 20:42:22.762643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3499. [D 20:42:22.762656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3500. [D 20:42:22.762666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3501. [D 20:42:22.762676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3502. [D 20:42:22.762689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3503. [D 20:42:22.762714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3504. [D 20:42:22.762728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3505. [D 20:42:22.762738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3506. [D 20:42:22.762747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3507. [D 20:42:22.762773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3508. [D 20:42:22.762784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3509. [D 20:42:22.762797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3510. [D 20:42:22.762806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3511. [D 20:42:22.762816] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3512. [D 20:42:22.768245] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3512. [D 20:42:22.768261] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 38/70. [D 20:42:22.768327] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.768342] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.768350] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.773922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.773935] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.773943] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.773959] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2729 [D 20:42:22.773968] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:22.773979] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 39/70. [D 20:42:22.824197] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2729 [D 20:42:22.824214] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 40/70. [D 20:42:22.824269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3512. [D 20:42:22.824336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3513. [D 20:42:22.824355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3514. [D 20:42:22.824366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3515. [D 20:42:22.824377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3516. [D 20:42:22.824387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3517. [D 20:42:22.824403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3518. [D 20:42:22.824412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3519. [D 20:42:22.824422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3520. [D 20:42:22.824438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3521. [D 20:42:22.824488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3522. [D 20:42:22.824499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3523. [D 20:42:22.824509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3524. [D 20:42:22.824535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3525. [D 20:42:22.824545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3526. [D 20:42:22.824554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3527. [D 20:42:22.824569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3528. [D 20:42:22.824579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3529. [D 20:42:22.824589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3530. [D 20:42:22.824616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3531. [D 20:42:22.824625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3532. [D 20:42:22.824635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3533. [D 20:42:22.824651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3534. [D 20:42:22.824661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3535. [D 20:42:22.824686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3536. [D 20:42:22.824697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3537. [D 20:42:22.824707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3538. [D 20:42:22.824722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3539. [D 20:42:22.824731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3540. [D 20:42:22.824741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3541. [D 20:42:22.824771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3542. [D 20:42:22.824781] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3543. [D 20:42:22.830277] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3543. [D 20:42:22.830293] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 41/70. [D 20:42:22.830360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.830375] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.830383] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.836095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.836109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.836117] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.836133] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2732 [D 20:42:22.836142] element 0: offset: 0x2aaaab216880, size: 24 [D 20:42:22.836152] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 42/70. [D 20:42:22.897044] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2720 [D 20:42:22.897061] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 43/70. [D 20:42:22.897120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3543. [D 20:42:22.897189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3544. [D 20:42:22.897210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3545. [D 20:42:22.897223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3546. [D 20:42:22.897234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3547. [D 20:42:22.897244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3548. [D 20:42:22.897254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3549. [D 20:42:22.897263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3550. [D 20:42:22.897273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3551. [D 20:42:22.897288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3552. [D 20:42:22.897337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3553. [D 20:42:22.897348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3554. [D 20:42:22.897371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3555. [D 20:42:22.897385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3556. [D 20:42:22.897395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3557. [D 20:42:22.897405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3558. [D 20:42:22.897433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3559. [D 20:42:22.897442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3560. [D 20:42:22.897454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3561. [D 20:42:22.897464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3562. [D 20:42:22.897474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3563. [D 20:42:22.897491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3564. [D 20:42:22.897501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3565. [D 20:42:22.897511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3566. [D 20:42:22.897520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3567. [D 20:42:22.897537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3568. [D 20:42:22.897560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3569. [D 20:42:22.897571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3570. [D 20:42:22.897581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3571. [D 20:42:22.897591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3572. [D 20:42:22.897601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3573. [D 20:42:22.897611] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3574. [D 20:42:22.903047] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3574. [D 20:42:22.903064] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 44/70. [D 20:42:22.903128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.903143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.903151] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.909651] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.909665] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.909673] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.909688] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2735 [D 20:42:22.909697] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:22.909707] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 45/70. [D 20:42:22.973041] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2723 [D 20:42:22.973057] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 46/70. [D 20:42:22.973114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3574. [D 20:42:22.973220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3575. [D 20:42:22.973234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3576. [D 20:42:22.973245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3577. [D 20:42:22.973255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3578. [D 20:42:22.973266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3579. [D 20:42:22.973276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3580. [D 20:42:22.973285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3581. [D 20:42:22.973295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3582. [D 20:42:22.973305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3583. [D 20:42:22.973323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3584. [D 20:42:22.973333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3585. [D 20:42:22.973342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3586. [D 20:42:22.973366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3587. [D 20:42:22.973376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3588. [D 20:42:22.973386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3589. [D 20:42:22.973409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3590. [D 20:42:22.973418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3591. [D 20:42:22.973428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3592. [D 20:42:22.973438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3593. [D 20:42:22.973449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3594. [D 20:42:22.973459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3595. [D 20:42:22.973484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3596. [D 20:42:22.973494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3597. [D 20:42:22.973504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3598. [D 20:42:22.973514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3599. [D 20:42:22.973524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3600. [D 20:42:22.973547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3601. [D 20:42:22.973562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3602. [D 20:42:22.973572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3603. [D 20:42:22.973582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3604. [D 20:42:22.973591] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3605. [D 20:42:22.979039] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3605. [D 20:42:22.979056] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 47/70. [D 20:42:22.979120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.979135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.979143] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.984600] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.984614] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.984622] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.984638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2738 [D 20:42:22.984647] element 0: offset: 0x2aaaab235240, size: 24 [D 20:42:22.984657] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 48/70. [D 20:42:23.067599] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2725 [D 20:42:23.067616] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 49/70. [D 20:42:23.067733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 3605. [D 20:42:23.067834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 3606. [D 20:42:23.067846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 3607. [D 20:42:23.067856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 3608. [D 20:42:23.067871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 3609. [D 20:42:23.067880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 3610. [D 20:42:23.067890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 3611. [D 20:42:23.067906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3612. [D 20:42:23.067915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3613. [D 20:42:23.067925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3614. [D 20:42:23.067955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 3615. [D 20:42:23.067965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 3616. [D 20:42:23.067992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 3617. [D 20:42:23.068008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 3618. [D 20:42:23.068030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 3619. [D 20:42:23.068045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3620. [D 20:42:23.068055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3621. [D 20:42:23.068077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3622. [D 20:42:23.068088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 3623. [D 20:42:23.068098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 3624. [D 20:42:23.068124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 3625. [D 20:42:23.068134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 3626. [D 20:42:23.068158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 3627. [D 20:42:23.068169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3628. [D 20:42:23.068194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3629. [D 20:42:23.068204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3630. [D 20:42:23.068226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 3631. [D 20:42:23.068236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 3632. [D 20:42:23.068246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 3633. [D 20:42:23.068256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 3634. [D 20:42:23.068266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 3635. [D 20:42:23.068276] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3636. [D 20:42:23.073689] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3636. [D 20:42:23.073706] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 50/70. [D 20:42:23.073769] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.073784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.073792] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.079681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.079695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.079703] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.079719] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2740 [D 20:42:23.079728] element 0: offset: 0x2aaaab225a40, size: 24 [D 20:42:23.079738] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 51/70. [D 20:42:23.139186] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2740 [D 20:42:23.139203] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 52/70. [D 20:42:23.139260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 3636. [D 20:42:23.139329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 3637. [D 20:42:23.139381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 3638. [D 20:42:23.139393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 3639. [D 20:42:23.139404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 3640. [D 20:42:23.139414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 3641. [D 20:42:23.139424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 3642. [D 20:42:23.139433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3643. [D 20:42:23.139458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3644. [D 20:42:23.139468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3645. [D 20:42:23.139477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 3646. [D 20:42:23.139488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 3647. [D 20:42:23.139497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 3648. [D 20:42:23.139508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 3649. [D 20:42:23.139518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 3650. [D 20:42:23.139528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3651. [D 20:42:23.139554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3652. [D 20:42:23.139564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3653. [D 20:42:23.139586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 3654. [D 20:42:23.139596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 3655. [D 20:42:23.139606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 3656. [D 20:42:23.139633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 3657. [D 20:42:23.139643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 3658. [D 20:42:23.139656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3659. [D 20:42:23.139666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3660. [D 20:42:23.139675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3661. [D 20:42:23.139701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 3662. [D 20:42:23.139711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 3663. [D 20:42:23.139725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 3664. [D 20:42:23.139753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 3665. [D 20:42:23.139763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 3666. [D 20:42:23.139773] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3667. [D 20:42:23.145230] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3667. [D 20:42:23.145247] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 53/70. [D 20:42:23.145310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.145325] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.145333] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.205820] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2732 [D 20:42:23.205837] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 54/70. [D 20:42:23.205900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3667. [D 20:42:23.206007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3668. [D 20:42:23.206021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3669. [D 20:42:23.206031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3670. [D 20:42:23.206042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3671. [D 20:42:23.206053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3672. [D 20:42:23.206063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3673. [D 20:42:23.206072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3674. [D 20:42:23.206083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3675. [D 20:42:23.206107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3676. [D 20:42:23.206118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3677. [D 20:42:23.206144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3678. [D 20:42:23.206154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3679. [D 20:42:23.206167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3680. [D 20:42:23.206177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3681. [D 20:42:23.206187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3682. [D 20:42:23.206197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3683. [D 20:42:23.206225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3684. [D 20:42:23.206236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3685. [D 20:42:23.206260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3686. [D 20:42:23.206270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3687. [D 20:42:23.206283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3688. [D 20:42:23.206302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3689. [D 20:42:23.206317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3690. [D 20:42:23.206327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3691. [D 20:42:23.206349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3692. [D 20:42:23.206360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3693. [D 20:42:23.206370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3694. [D 20:42:23.206399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3695. [D 20:42:23.206410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3696. [D 20:42:23.206422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3697. [D 20:42:23.206432] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3698. [D 20:42:23.211872] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3698. [D 20:42:23.211890] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 55/70. [D 20:42:23.211957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.211972] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.211980] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:23.218276] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.218290] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.218298] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:23.218314] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2744 [D 20:42:23.218323] element 0: offset: 0x2aaaab218230, size: 24 [D 20:42:23.218334] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 56/70. [D 20:42:23.257998] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2735 [D 20:42:23.258015] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 57/70. [D 20:42:23.258076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3698. [D 20:42:23.258146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3699. [D 20:42:23.258202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3700. [D 20:42:23.258213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3701. [D 20:42:23.258224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3702. [D 20:42:23.258234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3703. [D 20:42:23.258244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3704. [D 20:42:23.258254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3705. [D 20:42:23.258264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3706. [D 20:42:23.258274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3707. [D 20:42:23.258291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3708. [D 20:42:23.258301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3709. [D 20:42:23.258323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3710. [D 20:42:23.258335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3711. [D 20:42:23.258345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3712. [D 20:42:23.258355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3713. [D 20:42:23.258377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3714. [D 20:42:23.258386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3715. [D 20:42:23.258397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3716. [D 20:42:23.258407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3717. [D 20:42:23.258417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3718. [D 20:42:23.258427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3719. [D 20:42:23.258452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3720. [D 20:42:23.258461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3721. [D 20:42:23.258472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3722. [D 20:42:23.258482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3723. [D 20:42:23.258491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3724. [D 20:42:23.258514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3725. [D 20:42:23.258524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3726. [D 20:42:23.258534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3727. [D 20:42:23.258554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3728. [D 20:42:23.258564] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3729. [D 20:42:23.264011] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3729. [D 20:42:23.264028] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 58/70. [D 20:42:23.264095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.264110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.264118] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:23.282932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.282945] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.282954] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:23.282970] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2746 [D 20:42:23.282979] element 0: offset: 0x2aaaab203630, size: 24 [D 20:42:23.282989] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 59/70. [D 20:42:23.325408] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2738 [D 20:42:23.325425] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 60/70. [D 20:42:23.325485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3729. [D 20:42:23.325584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3730. [D 20:42:23.325598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3731. [D 20:42:23.325610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3732. [D 20:42:23.325620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3733. [D 20:42:23.325630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3734. [D 20:42:23.325641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3735. [D 20:42:23.325650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3736. [D 20:42:23.325683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3737. [D 20:42:23.325693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3738. [D 20:42:23.325703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3739. [D 20:42:23.325727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3740. [D 20:42:23.325738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3741. [D 20:42:23.325760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3742. [D 20:42:23.325770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3743. [D 20:42:23.325781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3744. [D 20:42:23.325803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3745. [D 20:42:23.325812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3746. [D 20:42:23.325834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3747. [D 20:42:23.325845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3748. [D 20:42:23.325855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3749. [D 20:42:23.325874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3750. [D 20:42:23.325885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3751. [D 20:42:23.325908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3752. [D 20:42:23.325919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3753. [D 20:42:23.325929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3754. [D 20:42:23.325949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3755. [D 20:42:23.325964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3756. [D 20:42:23.325985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3757. [D 20:42:23.325999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3758. [D 20:42:23.326009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3759. [D 20:42:23.326031] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3760. [D 20:42:23.331442] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3760. [D 20:42:23.331458] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 0/70. [D 20:42:23.331526] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.331541] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.331550] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:23.337198] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.337212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.337220] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:23.337236] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2750 [D 20:42:23.337245] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:23.337255] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 1/70. [D 20:42:23.396406] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.396420] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.396429] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.396445] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2753 [D 20:42:23.396454] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:23.396464] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 2/70. [D 20:42:23.399733] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2746 [D 20:42:23.399750] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 3/70. [D 20:42:23.399808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3760. [D 20:42:23.399889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3761. [D 20:42:23.399901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 3762. [D 20:42:23.399911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 3763. [D 20:42:23.399922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 3764. [D 20:42:23.399932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 3765. [D 20:42:23.399947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 3766. [D 20:42:23.399957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3767. [D 20:42:23.399967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3768. [D 20:42:23.399999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3769. [D 20:42:23.400031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 3770. [D 20:42:23.400043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 3771. [D 20:42:23.400053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 3772. [D 20:42:23.400063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 3773. [D 20:42:23.400073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 3774. [D 20:42:23.400084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3775. [D 20:42:23.400096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3776. [D 20:42:23.400124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3777. [D 20:42:23.400151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 3778. [D 20:42:23.400162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 3779. [D 20:42:23.400171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 3780. [D 20:42:23.400186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 3781. [D 20:42:23.400196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 3782. [D 20:42:23.400206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3783. [D 20:42:23.400230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3784. [D 20:42:23.400241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3785. [D 20:42:23.400251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 3786. [D 20:42:23.400273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 3787. [D 20:42:23.400283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 3788. [D 20:42:23.400293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 3789. [D 20:42:23.400303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 3790. [D 20:42:23.400327] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3791. [D 20:42:23.410737] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3791. [D 20:42:23.410760] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 4/70. [D 20:42:23.410863] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.410879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.410888] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.416421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.416435] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.416443] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.416459] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2755 [D 20:42:23.416468] element 0: offset: 0x2aaaab225a40, size: 24 [D 20:42:23.416478] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 5/70. [D 20:42:23.431276] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2744 [D 20:42:23.431296] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 6/70. [D 20:42:23.431363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 3791. [D 20:42:23.431430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 3792. [D 20:42:23.431478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 3793. [D 20:42:23.431488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 3794. [D 20:42:23.431499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 3795. [D 20:42:23.431516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 3796. [D 20:42:23.431526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3797. [D 20:42:23.431554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3798. [D 20:42:23.431564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3799. [D 20:42:23.431574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 3800. [D 20:42:23.431602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 3801. [D 20:42:23.431612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 3802. [D 20:42:23.431625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 3803. [D 20:42:23.431646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 3804. [D 20:42:23.431661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3805. [D 20:42:23.431681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3806. [D 20:42:23.431695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3807. [D 20:42:23.431704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 3808. [D 20:42:23.431728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 3809. [D 20:42:23.431738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 3810. [D 20:42:23.431748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 3811. [D 20:42:23.431760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 3812. [D 20:42:23.431776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3813. [D 20:42:23.431799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3814. [D 20:42:23.431809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3815. [D 20:42:23.431819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 3816. [D 20:42:23.431829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 3817. [D 20:42:23.431839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 3818. [D 20:42:23.431856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 3819. [D 20:42:23.431878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 3820. [D 20:42:23.431889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3821. [D 20:42:23.431910] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3822. [D 20:42:23.437287] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3822. [D 20:42:23.437304] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 7/70. [D 20:42:23.437371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.437385] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.437394] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.443739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.443752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.443761] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.443776] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2759 [D 20:42:23.443786] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:23.443796] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 8/70. [D 20:42:23.505058] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2759 [D 20:42:23.505075] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 9/70. [D 20:42:23.505136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 3822. [D 20:42:23.505202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 3823. [D 20:42:23.505256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 3824. [D 20:42:23.505267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 3825. [D 20:42:23.505278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 3826. [D 20:42:23.505288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 3827. [D 20:42:23.505298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3828. [D 20:42:23.505323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3829. [D 20:42:23.505337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3830. [D 20:42:23.505347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 3831. [D 20:42:23.505357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 3832. [D 20:42:23.505383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 3833. [D 20:42:23.505393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 3834. [D 20:42:23.505418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 3835. [D 20:42:23.505428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3836. [D 20:42:23.505441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3837. [D 20:42:23.505462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3838. [D 20:42:23.505475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 3839. [D 20:42:23.505485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 3840. [D 20:42:23.505508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 3841. [D 20:42:23.505518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 3842. [D 20:42:23.505527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 3843. [D 20:42:23.505551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3844. [D 20:42:23.505561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3845. [D 20:42:23.505587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3846. [D 20:42:23.505601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 3847. [D 20:42:23.505624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 3848. [D 20:42:23.505635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 3849. [D 20:42:23.505646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 3850. [D 20:42:23.505655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 3851. [D 20:42:23.505680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3852. [D 20:42:23.505690] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3853. [D 20:42:23.511113] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3853. [D 20:42:23.511134] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 10/70. [D 20:42:23.511198] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.511213] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.511221] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.517483] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.517497] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.517505] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.517521] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2762 [D 20:42:23.517530] element 0: offset: 0x2aaaab216880, size: 24 [D 20:42:23.517543] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 11/70. [D 20:42:23.559676] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2755 [D 20:42:23.559692] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 12/70. [D 20:42:23.559749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3853. [D 20:42:23.559828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3854. [D 20:42:23.559839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 3855. [D 20:42:23.559849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 3856. [D 20:42:23.559861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 3857. [D 20:42:23.559870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 3858. [D 20:42:23.559886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 3859. [D 20:42:23.559896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3860. [D 20:42:23.559906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3861. [D 20:42:23.559921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3862. [D 20:42:23.559973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 3863. [D 20:42:23.559983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 3864. [D 20:42:23.560013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 3865. [D 20:42:23.560023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 3866. [D 20:42:23.560034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 3867. [D 20:42:23.560044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3868. [D 20:42:23.560053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3869. [D 20:42:23.560064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3870. [D 20:42:23.560074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 3871. [D 20:42:23.560084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 3872. [D 20:42:23.560094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 3873. [D 20:42:23.560104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 3874. [D 20:42:23.560123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 3875. [D 20:42:23.560133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3876. [D 20:42:23.560143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3877. [D 20:42:23.560167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3878. [D 20:42:23.560177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 3879. [D 20:42:23.560187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 3880. [D 20:42:23.560202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 3881. [D 20:42:23.560212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 3882. [D 20:42:23.560222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 3883. [D 20:42:23.560253] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3884. [D 20:42:23.565684] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3884. [D 20:42:23.565701] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 13/70. [D 20:42:23.565767] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.565782] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.565790] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.571128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.571141] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.571150] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.571166] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2764 [D 20:42:23.571175] element 0: offset: 0x2aaaab225ec0, size: 24 [D 20:42:23.571185] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 14/70. [D 20:42:23.628144] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2750 [D 20:42:23.628161] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 15/70. [D 20:42:23.628226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3884. [D 20:42:23.628304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3885. [D 20:42:23.628316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3886. [D 20:42:23.628326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3887. [D 20:42:23.628337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3888. [D 20:42:23.628347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3889. [D 20:42:23.628361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3890. [D 20:42:23.628371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3891. [D 20:42:23.628381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3892. [D 20:42:23.628396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3893. [D 20:42:23.628447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3894. [D 20:42:23.628459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3895. [D 20:42:23.628469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3896. [D 20:42:23.628494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3897. [D 20:42:23.628504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3898. [D 20:42:23.628514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3899. [D 20:42:23.628527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3900. [D 20:42:23.628537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3901. [D 20:42:23.628547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3902. [D 20:42:23.628572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3903. [D 20:42:23.628582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3904. [D 20:42:23.628596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3905. [D 20:42:23.628606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3906. [D 20:42:23.628616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3907. [D 20:42:23.628647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3908. [D 20:42:23.628657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3909. [D 20:42:23.628672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3910. [D 20:42:23.628683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3911. [D 20:42:23.628706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3912. [D 20:42:23.628717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3913. [D 20:42:23.628727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3914. [D 20:42:23.628737] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3915. [D 20:42:23.634161] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3915. [D 20:42:23.634178] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 16/70. [D 20:42:23.634241] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.634255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.634264] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.689424] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2762 [D 20:42:23.689440] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 17/70. [D 20:42:23.689500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 3915. [D 20:42:23.689568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 3916. [D 20:42:23.689589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 3917. [D 20:42:23.689599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 3918. [D 20:42:23.689610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 3919. [D 20:42:23.689620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 3920. [D 20:42:23.689635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3921. [D 20:42:23.689645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3922. [D 20:42:23.689654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3923. [D 20:42:23.689665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 3924. [D 20:42:23.689716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 3925. [D 20:42:23.689729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 3926. [D 20:42:23.689739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 3927. [D 20:42:23.689766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 3928. [D 20:42:23.689776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3929. [D 20:42:23.689786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3930. [D 20:42:23.689798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3931. [D 20:42:23.689807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 3932. [D 20:42:23.689817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 3933. [D 20:42:23.689843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 3934. [D 20:42:23.689858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 3935. [D 20:42:23.689869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 3936. [D 20:42:23.689879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3937. [D 20:42:23.689889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3938. [D 20:42:23.689899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3939. [D 20:42:23.689923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 3940. [D 20:42:23.689936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 3941. [D 20:42:23.689946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 3942. [D 20:42:23.689956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 3943. [D 20:42:23.689979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 3944. [D 20:42:23.689989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3945. [D 20:42:23.689999] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3946. [D 20:42:23.695434] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3946. [D 20:42:23.695451] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 18/70. [D 20:42:23.695521] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.695536] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.695544] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:23.721469] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2764 [D 20:42:23.721485] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 19/70. [D 20:42:23.721550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3946. [D 20:42:23.721626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3947. [D 20:42:23.721641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 3948. [D 20:42:23.721652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 3949. [D 20:42:23.721666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 3950. [D 20:42:23.721676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 3951. [D 20:42:23.721686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 3952. [D 20:42:23.721699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3953. [D 20:42:23.721709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3954. [D 20:42:23.721719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3955. [D 20:42:23.721773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 3956. [D 20:42:23.721784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 3957. [D 20:42:23.721794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 3958. [D 20:42:23.721804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 3959. [D 20:42:23.721815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 3960. [D 20:42:23.721825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3961. [D 20:42:23.721835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3962. [D 20:42:23.721845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3963. [D 20:42:23.721863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 3964. [D 20:42:23.721873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 3965. [D 20:42:23.721883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 3966. [D 20:42:23.721915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 3967. [D 20:42:23.721924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 3968. [D 20:42:23.721934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3969. [D 20:42:23.721950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3970. [D 20:42:23.721960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3971. [D 20:42:23.721984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 3972. [D 20:42:23.721994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 3973. [D 20:42:23.722004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 3974. [D 20:42:23.722019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 3975. [D 20:42:23.722029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 3976. [D 20:42:23.722039] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3977. [D 20:42:23.727493] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3977. [D 20:42:23.727511] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 20/70. [D 20:42:23.727579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.727594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.727603] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:23.733848] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.733862] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.733870] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:23.733887] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2767 [D 20:42:23.733897] element 0: offset: 0x2aaaab205390, size: 24 [D 20:42:23.733907] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 21/70. [D 20:42:23.757664] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2753 [D 20:42:23.757681] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 22/70. [D 20:42:23.757746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3977. [D 20:42:23.757822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3978. [D 20:42:23.757833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3979. [D 20:42:23.757844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3980. [D 20:42:23.757855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3981. [D 20:42:23.757865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3982. [D 20:42:23.757881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3983. [D 20:42:23.757891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3984. [D 20:42:23.757901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3985. [D 20:42:23.757917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3986. [D 20:42:23.757966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3987. [D 20:42:23.757979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3988. [D 20:42:23.758004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3989. [D 20:42:23.758016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3990. [D 20:42:23.758025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3991. [D 20:42:23.758036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3992. [D 20:42:23.758047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3993. [D 20:42:23.758057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3994. [D 20:42:23.758067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3995. [D 20:42:23.758095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3996. [D 20:42:23.758107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3997. [D 20:42:23.758122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3998. [D 20:42:23.758132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3999. [D 20:42:23.758142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4000. [D 20:42:23.758171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4001. [D 20:42:23.758181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4002. [D 20:42:23.758193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4003. [D 20:42:23.758203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4004. [D 20:42:23.758213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4005. [D 20:42:23.758226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4006. [D 20:42:23.758236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4007. [D 20:42:23.758246] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4008. [D 20:42:23.762281] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.762297] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.762306] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:23.762322] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2771 [D 20:42:23.762331] element 0: offset: 0x2aaaab218230, size: 24 [D 20:42:23.762342] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 23/70. [D 20:42:23.763678] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 4008. [D 20:42:23.763698] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 24/70. [D 20:42:23.763774] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.763789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.763797] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:23.770207] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.770220] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.770229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:23.770245] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2774 [D 20:42:23.770254] element 0: offset: 0x61f310, size: 24 [D 20:42:23.770264] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 25/70. [D 20:42:23.827065] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.827080] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.827088] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.827104] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2777 [D 20:42:23.827114] element 0: offset: 0x5b0030, size: 24 [D 20:42:23.827123] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 26/70. [D 20:42:23.830565] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2767 [D 20:42:23.830582] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 27/70. [D 20:42:23.830639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 4008. [D 20:42:23.830708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 4009. [D 20:42:23.830739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 4010. [D 20:42:23.830750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 4011. [D 20:42:23.830761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 4012. [D 20:42:23.830771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 4013. [D 20:42:23.830782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 4014. [D 20:42:23.830791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4015. [D 20:42:23.830802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4016. [D 20:42:23.830812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4017. [D 20:42:23.830834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 4018. [D 20:42:23.830850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 4019. [D 20:42:23.830873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 4020. [D 20:42:23.830887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 4021. [D 20:42:23.830910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 4022. [D 20:42:23.830924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4023. [D 20:42:23.830944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4024. [D 20:42:23.830957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4025. [D 20:42:23.830976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 4026. [D 20:42:23.830991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 4027. [D 20:42:23.831010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 4028. [D 20:42:23.831021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 4029. [D 20:42:23.831031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 4030. [D 20:42:23.831041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4031. [D 20:42:23.831051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4032. [D 20:42:23.831074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4033. [D 20:42:23.831083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 4034. [D 20:42:23.831104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 4035. [D 20:42:23.831124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 4036. [D 20:42:23.831136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 4037. [D 20:42:23.831146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 4038. [D 20:42:23.831156] openib_post_sr_rdmaw: ibv_post_send wr_id 67ef00 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4039. [D 20:42:23.841528] openib_check_cq: completed rdma wr_id 67ef00, nic_wr_credit 4039. [D 20:42:23.841545] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 28/70. [D 20:42:23.841653] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.841669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.841678] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.847658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.847672] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.847680] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.847696] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2779 [D 20:42:23.847706] element 0: offset: 0x662650, size: 24 [D 20:42:23.847716] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 29/70. [D 20:42:24.134073] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2779 [D 20:42:24.134090] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 30/70. [D 20:42:24.134244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 4039. [D 20:42:24.134315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 4040. [D 20:42:24.134326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 4041. [D 20:42:24.134336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 4042. [D 20:42:24.134351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 4043. [D 20:42:24.134360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 4044. [D 20:42:24.134370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 4045. [D 20:42:24.134385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4046. [D 20:42:24.134395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4047. [D 20:42:24.134405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4048. [D 20:42:24.134418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 4049. [D 20:42:24.134497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 4050. [D 20:42:24.134508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 4051. [D 20:42:24.134517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 4052. [D 20:42:24.134528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 4053. [D 20:42:24.134538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4054. [D 20:42:24.134548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4055. [D 20:42:24.134558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4056. [D 20:42:24.134569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 4057. [D 20:42:24.134579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 4058. [D 20:42:24.134589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 4059. [D 20:42:24.134617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 4060. [D 20:42:24.134628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 4061. [D 20:42:24.134639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4062. [D 20:42:24.134649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4063. [D 20:42:24.134659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4064. [D 20:42:24.134669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 4065. [D 20:42:24.134679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 4066. [D 20:42:24.134689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 4067. [D 20:42:24.134699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 4068. [D 20:42:24.134724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 4069. [D 20:42:24.134734] openib_post_sr_rdmaw: ibv_post_send wr_id 63e820 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4070. [D 20:42:24.140208] openib_check_cq: completed rdma wr_id 63e820, nic_wr_credit 4070. [D 20:42:24.140225] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 31/70. [D 20:42:24.140292] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.140306] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.140315] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.146136] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.146150] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.146158] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.146174] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2782 [D 20:42:24.146183] element 0: offset: 0x61fab0, size: 24 [D 20:42:24.146193] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 32/70. [D 20:42:24.197521] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2774 [D 20:42:24.197538] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 33/70. [D 20:42:24.197598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4070. [D 20:42:24.197673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4071. [D 20:42:24.197685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4072. [D 20:42:24.197695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4073. [D 20:42:24.197707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4074. [D 20:42:24.197721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4075. [D 20:42:24.197734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4076. [D 20:42:24.197744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4077. [D 20:42:24.197754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4078. [D 20:42:24.197770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4079. [D 20:42:24.197779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4080. [D 20:42:24.197789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4081. [D 20:42:24.197799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4082. [D 20:42:24.197817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4083. [D 20:42:24.197827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4084. [D 20:42:24.197837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4085. [D 20:42:24.197885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4086. [D 20:42:24.197896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4087. [D 20:42:24.197906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4088. [D 20:42:24.197916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4089. [D 20:42:24.197940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4090. [D 20:42:24.197951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4091. [D 20:42:24.197962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4092. [D 20:42:24.197971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4093. [D 20:42:24.197982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4094. [D 20:42:24.197992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4095. [D 20:42:24.198002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4096. [D 20:42:24.198011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4097. [D 20:42:24.198037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4098. [D 20:42:24.198046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4099. [D 20:42:24.198057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4100. [D 20:42:24.198068] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4101. [D 20:42:24.203529] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 4101. [D 20:42:24.203547] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 34/70. [D 20:42:24.203613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.203628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.203636] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.209891] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.209904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.209912] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.209928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2786 [D 20:42:24.209937] element 0: offset: 0x67efc0, size: 24 [D 20:42:24.209948] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 35/70. [D 20:42:24.251845] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2771 [D 20:42:24.251863] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 36/70. [D 20:42:24.251924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4101. [D 20:42:24.251991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4102. [D 20:42:24.252002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4103. [D 20:42:24.252013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4104. [D 20:42:24.252023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4105. [D 20:42:24.252033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4106. [D 20:42:24.252044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4107. [D 20:42:24.252054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4108. [D 20:42:24.252063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4109. [D 20:42:24.252081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4110. [D 20:42:24.252091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4111. [D 20:42:24.252101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4112. [D 20:42:24.252111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4113. [D 20:42:24.252121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4114. [D 20:42:24.252130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4115. [D 20:42:24.252140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4116. [D 20:42:24.252190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4117. [D 20:42:24.252201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4118. [D 20:42:24.252211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4119. [D 20:42:24.252246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4120. [D 20:42:24.252257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4121. [D 20:42:24.252267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4122. [D 20:42:24.252277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4123. [D 20:42:24.252293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4124. [D 20:42:24.252303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4125. [D 20:42:24.252313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4126. [D 20:42:24.252337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4127. [D 20:42:24.252346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4128. [D 20:42:24.252357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4129. [D 20:42:24.252367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4130. [D 20:42:24.252377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4131. [D 20:42:24.252404] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4132. [D 20:42:24.257847] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 4132. [D 20:42:24.257864] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 37/70. [D 20:42:24.257929] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.257943] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.257951] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.263419] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.263433] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.263441] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.263457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2789 [D 20:42:24.263467] element 0: offset: 0x662650, size: 24 [D 20:42:24.263477] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 38/70. [D 20:42:24.337095] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2789 [D 20:42:24.337113] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 39/70. [D 20:42:24.337224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4132. [D 20:42:24.337326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4133. [D 20:42:24.337337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4134. [D 20:42:24.337347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4135. [D 20:42:24.337362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4136. [D 20:42:24.337372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4137. [D 20:42:24.337382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4138. [D 20:42:24.337396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4139. [D 20:42:24.337406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4140. [D 20:42:24.337416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4141. [D 20:42:24.337432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4142. [D 20:42:24.337441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4143. [D 20:42:24.337451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4144. [D 20:42:24.337461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4145. [D 20:42:24.337488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4146. [D 20:42:24.337498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4147. [D 20:42:24.337519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4148. [D 20:42:24.337530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4149. [D 20:42:24.337546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4150. [D 20:42:24.337574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4151. [D 20:42:24.337589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4152. [D 20:42:24.337608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4153. [D 20:42:24.337623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4154. [D 20:42:24.337633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4155. [D 20:42:24.337655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4156. [D 20:42:24.337666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4157. [D 20:42:24.337676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4158. [D 20:42:24.337703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4159. [D 20:42:24.337713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4160. [D 20:42:24.337742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4161. [D 20:42:24.337753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4162. [D 20:42:24.337776] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4163. [D 20:42:24.343238] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 4163. [D 20:42:24.343255] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 40/70. [D 20:42:24.343321] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.343335] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.343343] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.348928] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.348941] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.348950] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.348965] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2792 [D 20:42:24.348974] element 0: offset: 0x61f310, size: 24 [D 20:42:24.348984] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 41/70. [D 20:42:24.421406] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2782 [D 20:42:24.421423] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 42/70. [D 20:42:24.421541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 4163. [D 20:42:24.421649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 4164. [D 20:42:24.421661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 4165. [D 20:42:24.421672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 4166. [D 20:42:24.421686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 4167. [D 20:42:24.421696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 4168. [D 20:42:24.421706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 4169. [D 20:42:24.421720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4170. [D 20:42:24.421730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4171. [D 20:42:24.421739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4172. [D 20:42:24.421774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 4173. [D 20:42:24.421786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 4174. [D 20:42:24.421808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 4175. [D 20:42:24.421823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 4176. [D 20:42:24.421842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 4177. [D 20:42:24.421853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4178. [D 20:42:24.421864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4179. [D 20:42:24.421882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4180. [D 20:42:24.421898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 4181. [D 20:42:24.421908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 4182. [D 20:42:24.421934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 4183. [D 20:42:24.421944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 4184. [D 20:42:24.421967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 4185. [D 20:42:24.421977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4186. [D 20:42:24.421998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4187. [D 20:42:24.422008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4188. [D 20:42:24.422029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 4189. [D 20:42:24.422040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 4190. [D 20:42:24.422050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 4191. [D 20:42:24.422060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 4192. [D 20:42:24.422081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 4193. [D 20:42:24.422090] openib_post_sr_rdmaw: ibv_post_send wr_id 63fda0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4194. [D 20:42:24.427569] openib_check_cq: completed rdma wr_id 63fda0, nic_wr_credit 4194. [D 20:42:24.427587] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 43/70. [D 20:42:24.427653] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.427668] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.427676] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.433509] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.433522] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.433531] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.433546] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2794 [D 20:42:24.433555] element 0: offset: 0x662650, size: 24 [D 20:42:24.433565] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 44/70. [D 20:42:24.470374] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2792 [D 20:42:24.470391] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 45/70. [D 20:42:24.470454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4194. [D 20:42:24.470522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4195. [D 20:42:24.470577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4196. [D 20:42:24.470587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4197. [D 20:42:24.470599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4198. [D 20:42:24.470609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4199. [D 20:42:24.470619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4200. [D 20:42:24.470640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4201. [D 20:42:24.470656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4202. [D 20:42:24.470666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4203. [D 20:42:24.470676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4204. [D 20:42:24.470705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4205. [D 20:42:24.470715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4206. [D 20:42:24.470738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4207. [D 20:42:24.470749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4208. [D 20:42:24.470759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4209. [D 20:42:24.470781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4210. [D 20:42:24.470797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4211. [D 20:42:24.470819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4212. [D 20:42:24.470830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4213. [D 20:42:24.470840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4214. [D 20:42:24.470863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4215. [D 20:42:24.470874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4216. [D 20:42:24.470884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4217. [D 20:42:24.470903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4218. [D 20:42:24.470913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4219. [D 20:42:24.470934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4220. [D 20:42:24.470946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4221. [D 20:42:24.470956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4222. [D 20:42:24.470976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4223. [D 20:42:24.470987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4224. [D 20:42:24.471011] openib_post_sr_rdmaw: ibv_post_send wr_id 63fda0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4225. [D 20:42:24.476432] openib_check_cq: completed rdma wr_id 63fda0, nic_wr_credit 4225. [D 20:42:24.476450] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 46/70. [D 20:42:24.476516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.476531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.476539] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.481954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.481967] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.481975] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.481991] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2798 [D 20:42:24.482001] element 0: offset: 0x61fab0, size: 24 [D 20:42:24.482013] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 47/70. [D 20:42:24.533998] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2786 [D 20:42:24.534015] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 48/70. [D 20:42:24.534072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4225. [D 20:42:24.534138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4226. [D 20:42:24.534158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4227. [D 20:42:24.534168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4228. [D 20:42:24.534179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4229. [D 20:42:24.534189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4230. [D 20:42:24.534205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4231. [D 20:42:24.534214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4232. [D 20:42:24.534224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4233. [D 20:42:24.534234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4234. [D 20:42:24.534286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4235. [D 20:42:24.534297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4236. [D 20:42:24.534308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4237. [D 20:42:24.534332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4238. [D 20:42:24.534342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4239. [D 20:42:24.534352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4240. [D 20:42:24.534367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4241. [D 20:42:24.534377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4242. [D 20:42:24.534387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4243. [D 20:42:24.534419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4244. [D 20:42:24.534430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4245. [D 20:42:24.534440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4246. [D 20:42:24.534450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4247. [D 20:42:24.534460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4248. [D 20:42:24.534471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4249. [D 20:42:24.534494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4250. [D 20:42:24.534504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4251. [D 20:42:24.534514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4252. [D 20:42:24.534524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4253. [D 20:42:24.534534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4254. [D 20:42:24.534551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4255. [D 20:42:24.534575] openib_post_sr_rdmaw: ibv_post_send wr_id 63da60 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4256. [D 20:42:24.539997] openib_check_cq: completed rdma wr_id 63da60, nic_wr_credit 4256. [D 20:42:24.540015] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 49/70. [D 20:42:24.540081] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.540095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.540103] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.546093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.546107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.546115] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.546131] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2801 [D 20:42:24.546141] element 0: offset: 0x61ee50, size: 24 [D 20:42:24.546150] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 50/70. [D 20:42:24.594131] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2777 [D 20:42:24.594148] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 51/70. [D 20:42:24.594209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 4256. [D 20:42:24.594287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 4257. [D 20:42:24.594298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 4258. [D 20:42:24.594309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 4259. [D 20:42:24.594320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 4260. [D 20:42:24.594330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 4261. [D 20:42:24.594346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 4262. [D 20:42:24.594356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 4263. [D 20:42:24.594366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 4264. [D 20:42:24.594382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 4265. [D 20:42:24.594431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 4266. [D 20:42:24.594444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 4267. [D 20:42:24.594454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 4268. [D 20:42:24.594464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 4269. [D 20:42:24.594474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 4270. [D 20:42:24.594492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 4271. [D 20:42:24.594501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 4272. [D 20:42:24.594511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 4273. [D 20:42:24.594527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 4274. [D 20:42:24.594537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 4275. [D 20:42:24.594565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 4276. [D 20:42:24.594578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 4277. [D 20:42:24.594588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 4278. [D 20:42:24.594597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4279. [D 20:42:24.594613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4280. [D 20:42:24.594623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4281. [D 20:42:24.594632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4282. [D 20:42:24.594663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4283. [D 20:42:24.594678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4284. [D 20:42:24.594689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4285. [D 20:42:24.594698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4286. [D 20:42:24.594714] openib_post_sr_rdmaw: ibv_post_send wr_id 63e4f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4287. [D 20:42:24.600140] openib_check_cq: completed rdma wr_id 63e4f0, nic_wr_credit 4287. [D 20:42:24.600157] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 52/70. [D 20:42:24.600223] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.600238] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.600246] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.605833] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.605846] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.605855] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.605871] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2804 [D 20:42:24.605880] element 0: offset: 0x63e800, size: 24 [D 20:42:24.605890] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 53/70. [D 20:42:24.653422] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2798 [D 20:42:24.653439] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 54/70. [D 20:42:24.653505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4287. [D 20:42:24.653573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4288. [D 20:42:24.653593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4289. [D 20:42:24.653603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4290. [D 20:42:24.653615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4291. [D 20:42:24.653625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4292. [D 20:42:24.653641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4293. [D 20:42:24.653651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4294. [D 20:42:24.653661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4295. [D 20:42:24.653703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4296. [D 20:42:24.653717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4297. [D 20:42:24.653727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4298. [D 20:42:24.653737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4299. [D 20:42:24.653748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4300. [D 20:42:24.653769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4301. [D 20:42:24.653784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4302. [D 20:42:24.653798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4303. [D 20:42:24.653813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4304. [D 20:42:24.653824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4305. [D 20:42:24.653845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4306. [D 20:42:24.653859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4307. [D 20:42:24.653869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4308. [D 20:42:24.653879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4309. [D 20:42:24.653894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4310. [D 20:42:24.653928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4311. [D 20:42:24.653940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4312. [D 20:42:24.653950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4313. [D 20:42:24.653965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4314. [D 20:42:24.653976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4315. [D 20:42:24.653996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4316. [D 20:42:24.654010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4317. [D 20:42:24.654020] openib_post_sr_rdmaw: ibv_post_send wr_id 62ac20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4318. [D 20:42:24.659429] openib_check_cq: completed rdma wr_id 62ac20, nic_wr_credit 4318. [D 20:42:24.659446] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 55/70. [D 20:42:24.659511] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.659525] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.659534] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.664996] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.665010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.665018] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.665034] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2807 [D 20:42:24.665043] element 0: offset: 0x691fe0, size: 24 [D 20:42:24.665053] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 56/70. [D 20:42:24.732967] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2794 [D 20:42:24.732985] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 57/70. [D 20:42:24.733047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 4318. [D 20:42:24.733115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 4319. [D 20:42:24.733166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 4320. [D 20:42:24.733177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 4321. [D 20:42:24.733188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 4322. [D 20:42:24.733203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 4323. [D 20:42:24.733214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 4324. [D 20:42:24.733243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4325. [D 20:42:24.733253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4326. [D 20:42:24.733263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4327. [D 20:42:24.733290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 4328. [D 20:42:24.733300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 4329. [D 20:42:24.733313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 4330. [D 20:42:24.733341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 4331. [D 20:42:24.733352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 4332. [D 20:42:24.733372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4333. [D 20:42:24.733382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4334. [D 20:42:24.733392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4335. [D 20:42:24.733417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 4336. [D 20:42:24.733427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 4337. [D 20:42:24.733437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 4338. [D 20:42:24.733460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 4339. [D 20:42:24.733470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 4340. [D 20:42:24.733481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4341. [D 20:42:24.733491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4342. [D 20:42:24.733511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4343. [D 20:42:24.733528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 4344. [D 20:42:24.733549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 4345. [D 20:42:24.733564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 4346. [D 20:42:24.733574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 4347. [D 20:42:24.733583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 4348. [D 20:42:24.733593] openib_post_sr_rdmaw: ibv_post_send wr_id 62acc0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4349. [D 20:42:24.738969] openib_check_cq: completed rdma wr_id 62acc0, nic_wr_credit 4349. [D 20:42:24.738985] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 58/70. [D 20:42:24.739049] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.739063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.739072] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.744929] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.744943] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.744951] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.744967] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2809 [D 20:42:24.744977] element 0: offset: 0x6151c0, size: 24 [D 20:42:24.744987] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 59/70. [D 20:42:24.810420] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2801 [D 20:42:24.810438] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 60/70. [D 20:42:24.810495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4349. [D 20:42:24.810591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4350. [D 20:42:24.810605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4351. [D 20:42:24.810616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4352. [D 20:42:24.810627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4353. [D 20:42:24.810638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4354. [D 20:42:24.810647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4355. [D 20:42:24.810657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4356. [D 20:42:24.810697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4357. [D 20:42:24.810708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4358. [D 20:42:24.810731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4359. [D 20:42:24.810741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4360. [D 20:42:24.810762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4361. [D 20:42:24.810773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4362. [D 20:42:24.810784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4363. [D 20:42:24.810794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4364. [D 20:42:24.810804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4365. [D 20:42:24.810819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4366. [D 20:42:24.810842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4367. [D 20:42:24.810853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4368. [D 20:42:24.810881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4369. [D 20:42:24.810892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4370. [D 20:42:24.810917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4371. [D 20:42:24.810927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4372. [D 20:42:24.810938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4373. [D 20:42:24.810959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4374. [D 20:42:24.810973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4375. [D 20:42:24.810983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4376. [D 20:42:24.810993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4377. [D 20:42:24.811003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4378. [D 20:42:24.811018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4379. [D 20:42:24.811028] openib_post_sr_rdmaw: ibv_post_send wr_id 657210 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4380. [D 20:42:24.816445] openib_check_cq: completed rdma wr_id 657210, nic_wr_credit 4380. [D 20:42:24.816463] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 0/70. [D 20:42:24.816531] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.816546] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.816554] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.822696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.822709] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.822718] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.822734] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2813 [D 20:42:24.822743] element 0: offset: 0x67eee0, size: 24 [D 20:42:24.822753] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 1/70. [D 20:42:24.882388] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2804 [D 20:42:24.882405] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 2/70. [D 20:42:24.882469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 4380. [D 20:42:24.882578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 4381. [D 20:42:24.882592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 4382. [D 20:42:24.882603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 4383. [D 20:42:24.882613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 4384. [D 20:42:24.882624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 4385. [D 20:42:24.882637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 4386. [D 20:42:24.882661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 4387. [D 20:42:24.882674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 4388. [D 20:42:24.882684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 4389. [D 20:42:24.882694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 4390. [D 20:42:24.882719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 4391. [D 20:42:24.882729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 4392. [D 20:42:24.882743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 4393. [D 20:42:24.882752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 4394. [D 20:42:24.882762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 4395. [D 20:42:24.882772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 4396. [D 20:42:24.882789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 4397. [D 20:42:24.882812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 4398. [D 20:42:24.882825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 4399. [D 20:42:24.882856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 4400. [D 20:42:24.882866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 4401. [D 20:42:24.882893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 4402. [D 20:42:24.882902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4403. [D 20:42:24.882924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4404. [D 20:42:24.882934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4405. [D 20:42:24.882944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4406. [D 20:42:24.882958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4407. [D 20:42:24.882968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4408. [D 20:42:24.882978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4409. [D 20:42:24.882988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4410. [D 20:42:24.883005] openib_post_sr_rdmaw: ibv_post_send wr_id 64dc90 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4411. [D 20:42:24.888436] openib_check_cq: completed rdma wr_id 64dc90, nic_wr_credit 4411. [D 20:42:24.888453] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 3/70. [D 20:42:24.888518] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.888533] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.888541] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.894139] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.894153] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.894161] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.894177] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2816 [D 20:42:24.894186] element 0: offset: 0x61f310, size: 24 [D 20:42:24.894196] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 4/70. [D 20:42:24.969390] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2807 [D 20:42:24.969407] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 5/70. [D 20:42:24.969522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4411. [D 20:42:24.969598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4412. [D 20:42:24.969609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4413. [D 20:42:24.969619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4414. [D 20:42:24.969634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4415. [D 20:42:24.969644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4416. [D 20:42:24.969653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4417. [D 20:42:24.969668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4418. [D 20:42:24.969678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4419. [D 20:42:24.969687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4420. [D 20:42:24.969742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4421. [D 20:42:24.969753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4422. [D 20:42:24.969764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4423. [D 20:42:24.969774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4424. [D 20:42:24.969793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4425. [D 20:42:24.969803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4426. [D 20:42:24.969813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4427. [D 20:42:24.969830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4428. [D 20:42:24.969840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4429. [D 20:42:24.969853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4430. [D 20:42:24.969876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4431. [D 20:42:24.969886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4432. [D 20:42:24.969896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4433. [D 20:42:24.969912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4434. [D 20:42:24.969922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4435. [D 20:42:24.969932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4436. [D 20:42:24.969942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4437. [D 20:42:24.969969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4438. [D 20:42:24.969979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4439. [D 20:42:24.969990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4440. [D 20:42:24.970000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4441. [D 20:42:24.970010] openib_post_sr_rdmaw: ibv_post_send wr_id 63e3b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4442. [D 20:42:24.975454] openib_check_cq: completed rdma wr_id 63e3b0, nic_wr_credit 4442. [D 20:42:24.975472] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 6/70. [D 20:42:24.975539] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.975553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.975561] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.981275] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.981288] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.981296] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.981313] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2819 [D 20:42:24.981322] element 0: offset: 0x63dc60, size: 24 [D 20:42:24.981332] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 7/70. [D 20:42:25.019153] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2819 [D 20:42:25.019170] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 8/70. [D 20:42:25.019235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4442. [D 20:42:25.019302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4443. [D 20:42:25.019321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4444. [D 20:42:25.019332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4445. [D 20:42:25.019343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4446. [D 20:42:25.019353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4447. [D 20:42:25.019368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4448. [D 20:42:25.019378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4449. [D 20:42:25.019388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4450. [D 20:42:25.019406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4451. [D 20:42:25.019454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4452. [D 20:42:25.019468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4453. [D 20:42:25.019487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4454. [D 20:42:25.019497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4455. [D 20:42:25.019507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4456. [D 20:42:25.019517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4457. [D 20:42:25.019558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4458. [D 20:42:25.019570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4459. [D 20:42:25.019592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4460. [D 20:42:25.019602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4461. [D 20:42:25.019613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4462. [D 20:42:25.019623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4463. [D 20:42:25.019633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4464. [D 20:42:25.019644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4465. [D 20:42:25.019654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4466. [D 20:42:25.019664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4467. [D 20:42:25.019674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4468. [D 20:42:25.019691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4469. [D 20:42:25.019701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4470. [D 20:42:25.019711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4471. [D 20:42:25.019734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4472. [D 20:42:25.019745] openib_post_sr_rdmaw: ibv_post_send wr_id 63d880 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4473. [D 20:42:25.025216] openib_check_cq: completed rdma wr_id 63d880, nic_wr_credit 4473. [D 20:42:25.025233] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 9/70. [D 20:42:25.025297] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.025311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.025320] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.031050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.031063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.031072] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.031087] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2822 [D 20:42:25.031097] element 0: offset: 0x6572d0, size: 24 [D 20:42:25.031107] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 10/70. [D 20:42:25.093156] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2813 [D 20:42:25.093172] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 11/70. [D 20:42:25.093232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4473. [D 20:42:25.093308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4474. [D 20:42:25.093320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4475. [D 20:42:25.093330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4476. [D 20:42:25.093341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4477. [D 20:42:25.093351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4478. [D 20:42:25.093361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4479. [D 20:42:25.093371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4480. [D 20:42:25.093381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4481. [D 20:42:25.093391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4482. [D 20:42:25.093433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4483. [D 20:42:25.093447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4484. [D 20:42:25.093457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4485. [D 20:42:25.093472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4486. [D 20:42:25.093508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4487. [D 20:42:25.093521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4488. [D 20:42:25.093531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4489. [D 20:42:25.093543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4490. [D 20:42:25.093558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4491. [D 20:42:25.093568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4492. [D 20:42:25.093578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4493. [D 20:42:25.093588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4494. [D 20:42:25.093605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4495. [D 20:42:25.093615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4496. [D 20:42:25.093625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4497. [D 20:42:25.093650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4498. [D 20:42:25.093660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4499. [D 20:42:25.093671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4500. [D 20:42:25.093681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4501. [D 20:42:25.093691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4502. [D 20:42:25.093702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4503. [D 20:42:25.093728] openib_post_sr_rdmaw: ibv_post_send wr_id 62a860 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4504. [D 20:42:25.099162] openib_check_cq: completed rdma wr_id 62a860, nic_wr_credit 4504. [D 20:42:25.099179] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 12/70. [D 20:42:25.099243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.099257] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.099265] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.105524] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.105537] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.105546] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.105562] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2825 [D 20:42:25.105571] element 0: offset: 0x5b0030, size: 24 [D 20:42:25.105581] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 13/70. [D 20:42:25.140357] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2809 [D 20:42:25.140373] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 14/70. [D 20:42:25.140434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 4504. [D 20:42:25.140502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 4505. [D 20:42:25.140522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 4506. [D 20:42:25.140533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 4507. [D 20:42:25.140543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 4508. [D 20:42:25.140553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 4509. [D 20:42:25.140569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 4510. [D 20:42:25.140579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4511. [D 20:42:25.140589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4512. [D 20:42:25.140604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4513. [D 20:42:25.140652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 4514. [D 20:42:25.140663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 4515. [D 20:42:25.140673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 4516. [D 20:42:25.140697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 4517. [D 20:42:25.140707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 4518. [D 20:42:25.140717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4519. [D 20:42:25.140730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4520. [D 20:42:25.140758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4521. [D 20:42:25.140772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 4522. [D 20:42:25.140781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 4523. [D 20:42:25.140792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 4524. [D 20:42:25.140805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 4525. [D 20:42:25.140830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 4526. [D 20:42:25.140843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4527. [D 20:42:25.140852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4528. [D 20:42:25.140862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4529. [D 20:42:25.140878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 4530. [D 20:42:25.140902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 4531. [D 20:42:25.140916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 4532. [D 20:42:25.140926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 4533. [D 20:42:25.140936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 4534. [D 20:42:25.140949] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4535. [D 20:42:25.146358] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 4535. [D 20:42:25.146375] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 15/70. [D 20:42:25.146440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.146454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.146462] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.212118] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2816 [D 20:42:25.212135] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 16/70. [D 20:42:25.212233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 4535. [D 20:42:25.212325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 4536. [D 20:42:25.212337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 4537. [D 20:42:25.212347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 4538. [D 20:42:25.212358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 4539. [D 20:42:25.212368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 4540. [D 20:42:25.212378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 4541. [D 20:42:25.212388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 4542. [D 20:42:25.212398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 4543. [D 20:42:25.212407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 4544. [D 20:42:25.212417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 4545. [D 20:42:25.212454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 4546. [D 20:42:25.212465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 4547. [D 20:42:25.212494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 4548. [D 20:42:25.212505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 4549. [D 20:42:25.212524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 4550. [D 20:42:25.212536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 4551. [D 20:42:25.212545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 4552. [D 20:42:25.212556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 4553. [D 20:42:25.212566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 4554. [D 20:42:25.212591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 4555. [D 20:42:25.212607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 4556. [D 20:42:25.212617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 4557. [D 20:42:25.212627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4558. [D 20:42:25.212649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4559. [D 20:42:25.212672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4560. [D 20:42:25.212685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4561. [D 20:42:25.212707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4562. [D 20:42:25.212719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4563. [D 20:42:25.212728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4564. [D 20:42:25.212751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4565. [D 20:42:25.212761] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4566. [D 20:42:25.218194] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 4566. [D 20:42:25.218212] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 17/70. [D 20:42:25.218275] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.218289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.218298] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.224309] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.224322] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.224331] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.224347] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2828 [D 20:42:25.224357] element 0: offset: 0x61fab0, size: 24 [D 20:42:25.224369] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 18/70. [D 20:42:25.277325] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2822 [D 20:42:25.277342] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 19/70. [D 20:42:25.277397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4566. [D 20:42:25.277464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4567. [D 20:42:25.277518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4568. [D 20:42:25.277529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4569. [D 20:42:25.277540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4570. [D 20:42:25.277550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4571. [D 20:42:25.277560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4572. [D 20:42:25.277580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4573. [D 20:42:25.277596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4574. [D 20:42:25.277606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4575. [D 20:42:25.277615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4576. [D 20:42:25.277626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4577. [D 20:42:25.277649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4578. [D 20:42:25.277659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4579. [D 20:42:25.277683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4580. [D 20:42:25.277693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4581. [D 20:42:25.277713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4582. [D 20:42:25.277724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4583. [D 20:42:25.277735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4584. [D 20:42:25.277745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4585. [D 20:42:25.277767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4586. [D 20:42:25.277777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4587. [D 20:42:25.277787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4588. [D 20:42:25.277810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4589. [D 20:42:25.277820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4590. [D 20:42:25.277830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4591. [D 20:42:25.277851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4592. [D 20:42:25.277861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4593. [D 20:42:25.277872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4594. [D 20:42:25.277898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4595. [D 20:42:25.277915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4596. [D 20:42:25.277934] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4597. [D 20:42:25.283325] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 4597. [D 20:42:25.283343] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 20/70. [D 20:42:25.285384] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.285395] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.285403] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.285418] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2830 [D 20:42:25.285427] element 0: offset: 0x67efc0, size: 24 [D 20:42:25.285436] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 21/70. [D 20:42:25.285451] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.285460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.285469] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.289397] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.289410] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.289419] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.289434] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2834 [D 20:42:25.289443] element 0: offset: 0x63dc60, size: 24 [D 20:42:25.289453] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 22/70. [D 20:42:25.343624] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2825 [D 20:42:25.343645] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 23/70. [D 20:42:25.343708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4597. [D 20:42:25.343778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4598. [D 20:42:25.343827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4599. [D 20:42:25.343838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4600. [D 20:42:25.343849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4601. [D 20:42:25.343859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4602. [D 20:42:25.343869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4603. [D 20:42:25.343879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4604. [D 20:42:25.343902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4605. [D 20:42:25.343912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4606. [D 20:42:25.343922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4607. [D 20:42:25.343939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4608. [D 20:42:25.343948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4609. [D 20:42:25.343960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4610. [D 20:42:25.343969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4611. [D 20:42:25.343979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4612. [D 20:42:25.343989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4613. [D 20:42:25.344001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4614. [D 20:42:25.344011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4615. [D 20:42:25.344036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4616. [D 20:42:25.344053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4617. [D 20:42:25.344062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4618. [D 20:42:25.344088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4619. [D 20:42:25.344099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4620. [D 20:42:25.344109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4621. [D 20:42:25.344120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4622. [D 20:42:25.344142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4623. [D 20:42:25.344153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4624. [D 20:42:25.344163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4625. [D 20:42:25.344186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4626. [D 20:42:25.344197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4627. [D 20:42:25.344207] openib_post_sr_rdmaw: ibv_post_send wr_id 63e320 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4628. [D 20:42:25.349631] openib_check_cq: completed rdma wr_id 63e320, nic_wr_credit 4628. [D 20:42:25.349647] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 24/70. [D 20:42:25.349717] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.349732] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.349741] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.355903] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.355916] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.355925] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.355943] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2837 [D 20:42:25.355953] element 0: offset: 0x61ee50, size: 24 [D 20:42:25.355963] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 25/70. [D 20:42:25.444331] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2834 [D 20:42:25.444348] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 26/70. [D 20:42:25.444469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4628. [D 20:42:25.444577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4629. [D 20:42:25.444589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4630. [D 20:42:25.444600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4631. [D 20:42:25.444614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4632. [D 20:42:25.444624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4633. [D 20:42:25.444634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4634. [D 20:42:25.444650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4635. [D 20:42:25.444660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4636. [D 20:42:25.444670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4637. [D 20:42:25.444701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4638. [D 20:42:25.444716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4639. [D 20:42:25.444741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4640. [D 20:42:25.444753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4641. [D 20:42:25.444763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4642. [D 20:42:25.444773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4643. [D 20:42:25.444783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4644. [D 20:42:25.444793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4645. [D 20:42:25.444815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4646. [D 20:42:25.444826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4647. [D 20:42:25.444842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4648. [D 20:42:25.444864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4649. [D 20:42:25.444878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4650. [D 20:42:25.444909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4651. [D 20:42:25.444931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4652. [D 20:42:25.444942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4653. [D 20:42:25.444953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4654. [D 20:42:25.444963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4655. [D 20:42:25.444972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4656. [D 20:42:25.444983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4657. [D 20:42:25.444993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4658. [D 20:42:25.445003] openib_post_sr_rdmaw: ibv_post_send wr_id 625590 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4659. [D 20:42:25.450437] openib_check_cq: completed rdma wr_id 625590, nic_wr_credit 4659. [D 20:42:25.450454] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 27/70. [D 20:42:25.450518] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.450532] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.450541] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.474414] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2837 [D 20:42:25.474431] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 28/70. [D 20:42:25.474496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4659. [D 20:42:25.474602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4660. [D 20:42:25.474614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4661. [D 20:42:25.474625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4662. [D 20:42:25.474640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4663. [D 20:42:25.474649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4664. [D 20:42:25.474659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4665. [D 20:42:25.474675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4666. [D 20:42:25.474685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4667. [D 20:42:25.474694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4668. [D 20:42:25.474705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4669. [D 20:42:25.474730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4670. [D 20:42:25.474741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4671. [D 20:42:25.474767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4672. [D 20:42:25.474781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4673. [D 20:42:25.474803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4674. [D 20:42:25.474816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4675. [D 20:42:25.474838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4676. [D 20:42:25.474849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4677. [D 20:42:25.474859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4678. [D 20:42:25.474880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4679. [D 20:42:25.474890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4680. [D 20:42:25.474900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4681. [D 20:42:25.474922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4682. [D 20:42:25.474931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4683. [D 20:42:25.474952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4684. [D 20:42:25.474962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4685. [D 20:42:25.474974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4686. [D 20:42:25.475001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4687. [D 20:42:25.475011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4688. [D 20:42:25.475026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4689. [D 20:42:25.475046] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4690. [D 20:42:25.480465] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 4690. [D 20:42:25.480481] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 29/70. [D 20:42:25.480545] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.480560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.480568] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.486881] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.486895] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.486903] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.486920] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2840 [D 20:42:25.486929] element 0: offset: 0x63e800, size: 24 [D 20:42:25.486940] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 30/70. [D 20:42:25.520927] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2828 [D 20:42:25.520944] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 31/70. [D 20:42:25.521003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 4690. [D 20:42:25.521071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 4691. [D 20:42:25.521123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 4692. [D 20:42:25.521135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 4693. [D 20:42:25.521145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 4694. [D 20:42:25.521161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 4695. [D 20:42:25.521171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4696. [D 20:42:25.521193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4697. [D 20:42:25.521207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4698. [D 20:42:25.521216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 4699. [D 20:42:25.521226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 4700. [D 20:42:25.521254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 4701. [D 20:42:25.521264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 4702. [D 20:42:25.521288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 4703. [D 20:42:25.521299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4704. [D 20:42:25.521309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4705. [D 20:42:25.521332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4706. [D 20:42:25.521342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 4707. [D 20:42:25.521352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 4708. [D 20:42:25.521374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 4709. [D 20:42:25.521387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 4710. [D 20:42:25.521408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 4711. [D 20:42:25.521419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4712. [D 20:42:25.521428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4713. [D 20:42:25.521447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4714. [D 20:42:25.521462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 4715. [D 20:42:25.521483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 4716. [D 20:42:25.521498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 4717. [D 20:42:25.521518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 4718. [D 20:42:25.521529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 4719. [D 20:42:25.521539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4720. [D 20:42:25.521558] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4721. [D 20:42:25.526932] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 4721. [D 20:42:25.526949] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 32/70. [D 20:42:25.527015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.527030] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.527038] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.533179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.533193] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.533201] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.533217] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2843 [D 20:42:25.533227] element 0: offset: 0x6572d0, size: 24 [D 20:42:25.533236] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 33/70. [D 20:42:25.563458] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2830 [D 20:42:25.563475] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 34/70. [D 20:42:25.563536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 4721. [D 20:42:25.563632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 4722. [D 20:42:25.563645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 4723. [D 20:42:25.563656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 4724. [D 20:42:25.563667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 4725. [D 20:42:25.563677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 4726. [D 20:42:25.563687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 4727. [D 20:42:25.563697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 4728. [D 20:42:25.563733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 4729. [D 20:42:25.563746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 4730. [D 20:42:25.563770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 4731. [D 20:42:25.563780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 4732. [D 20:42:25.563792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 4733. [D 20:42:25.563816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 4734. [D 20:42:25.563829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 4735. [D 20:42:25.563851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 4736. [D 20:42:25.563863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 4737. [D 20:42:25.563882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 4738. [D 20:42:25.563897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 4739. [D 20:42:25.563907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 4740. [D 20:42:25.563934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 4741. [D 20:42:25.563944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 4742. [D 20:42:25.563972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 4743. [D 20:42:25.563993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 4744. [D 20:42:25.564004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 4745. [D 20:42:25.564014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 4746. [D 20:42:25.564037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 4747. [D 20:42:25.564047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 4748. [D 20:42:25.564067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 4749. [D 20:42:25.564078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 4750. [D 20:42:25.564088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 4751. [D 20:42:25.564110] openib_post_sr_rdmaw: ibv_post_send wr_id 63d880 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 4752. [D 20:42:25.569497] openib_check_cq: completed rdma wr_id 63d880, nic_wr_credit 4752. [D 20:42:25.569515] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 35/70. [D 20:42:25.569580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.569594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.569603] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.575264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.575278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.575286] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.575302] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2845 [D 20:42:25.575311] element 0: offset: 0x5b0030, size: 24 [D 20:42:25.575322] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 36/70. [D 20:42:25.581475] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.581489] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.581497] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.581512] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2849 [D 20:42:25.581522] element 0: offset: 0x67eee0, size: 24 [D 20:42:25.581531] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 37/70. [D 20:42:25.708140] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2840 [D 20:42:25.708158] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 38/70. [D 20:42:25.708332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4752. [D 20:42:25.708400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4753. [D 20:42:25.708411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4754. [D 20:42:25.708422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4755. [D 20:42:25.708437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4756. [D 20:42:25.708446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4757. [D 20:42:25.708456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4758. [D 20:42:25.708466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4759. [D 20:42:25.708477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4760. [D 20:42:25.708487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4761. [D 20:42:25.708496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4762. [D 20:42:25.708525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4763. [D 20:42:25.708535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4764. [D 20:42:25.708559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4765. [D 20:42:25.708569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4766. [D 20:42:25.708581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4767. [D 20:42:25.708590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4768. [D 20:42:25.708603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4769. [D 20:42:25.708617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4770. [D 20:42:25.708641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4771. [D 20:42:25.708653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4772. [D 20:42:25.708663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4773. [D 20:42:25.708687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4774. [D 20:42:25.708697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4775. [D 20:42:25.708712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4776. [D 20:42:25.708724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4777. [D 20:42:25.708734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4778. [D 20:42:25.708758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4779. [D 20:42:25.708768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4780. [D 20:42:25.708783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4781. [D 20:42:25.708807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4782. [D 20:42:25.708818] openib_post_sr_rdmaw: ibv_post_send wr_id 63d880 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4783. [D 20:42:25.714259] openib_check_cq: completed rdma wr_id 63d880, nic_wr_credit 4783. [D 20:42:25.714277] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 39/70. [D 20:42:25.714345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.714359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.714368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.735746] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2849 [D 20:42:25.735764] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 40/70. [D 20:42:25.735834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 4783. [D 20:42:25.735912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 4784. [D 20:42:25.735924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 4785. [D 20:42:25.735934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 4786. [D 20:42:25.735949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 4787. [D 20:42:25.735959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 4788. [D 20:42:25.735969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 4789. [D 20:42:25.735984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 4790. [D 20:42:25.735994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 4791. [D 20:42:25.736003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 4792. [D 20:42:25.736060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 4793. [D 20:42:25.736071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 4794. [D 20:42:25.736081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 4795. [D 20:42:25.736092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 4796. [D 20:42:25.736116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 4797. [D 20:42:25.736127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 4798. [D 20:42:25.736137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 4799. [D 20:42:25.736147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 4800. [D 20:42:25.736158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 4801. [D 20:42:25.736168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 4802. [D 20:42:25.736194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 4803. [D 20:42:25.736209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 4804. [D 20:42:25.736219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 4805. [D 20:42:25.736228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4806. [D 20:42:25.736257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4807. [D 20:42:25.736268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4808. [D 20:42:25.736281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4809. [D 20:42:25.736291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4810. [D 20:42:25.736300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4811. [D 20:42:25.736314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4812. [D 20:42:25.736338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4813. [D 20:42:25.736348] openib_post_sr_rdmaw: ibv_post_send wr_id 625590 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4814. [D 20:42:25.741829] openib_check_cq: completed rdma wr_id 625590, nic_wr_credit 4814. [D 20:42:25.741847] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 41/70. [D 20:42:25.741913] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.741927] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.741935] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.747506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.747520] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.747528] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.747547] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2852 [D 20:42:25.747556] element 0: offset: 0x63dc60, size: 24 [D 20:42:25.747566] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 42/70. [D 20:42:25.820214] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2845 [D 20:42:25.820231] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 43/70. [D 20:42:25.820295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 4814. [D 20:42:25.820361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 4815. [D 20:42:25.820413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 4816. [D 20:42:25.820424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 4817. [D 20:42:25.820435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 4818. [D 20:42:25.820450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 4819. [D 20:42:25.820461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 4820. [D 20:42:25.820483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 4821. [D 20:42:25.820496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 4822. [D 20:42:25.820506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 4823. [D 20:42:25.820516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 4824. [D 20:42:25.820539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 4825. [D 20:42:25.820549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 4826. [D 20:42:25.820560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 4827. [D 20:42:25.820582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 4828. [D 20:42:25.820592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 4829. [D 20:42:25.820602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 4830. [D 20:42:25.820612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 4831. [D 20:42:25.820622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 4832. [D 20:42:25.820632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 4833. [D 20:42:25.820667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 4834. [D 20:42:25.820677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 4835. [D 20:42:25.820703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 4836. [D 20:42:25.820713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 4837. [D 20:42:25.820740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 4838. [D 20:42:25.820751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 4839. [D 20:42:25.820762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 4840. [D 20:42:25.820783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 4841. [D 20:42:25.820794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 4842. [D 20:42:25.820805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 4843. [D 20:42:25.820825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 4844. [D 20:42:25.820840] openib_post_sr_rdmaw: ibv_post_send wr_id 625590 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 4845. [D 20:42:25.826221] openib_check_cq: completed rdma wr_id 625590, nic_wr_credit 4845. [D 20:42:25.826238] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 44/70. [D 20:42:25.826302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.826317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.826325] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.832242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.832255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.832264] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.832279] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2854 [D 20:42:25.832288] element 0: offset: 0x61fab0, size: 24 [D 20:42:25.832301] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 45/70. [D 20:42:25.848999] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.849013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.849021] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.849036] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2858 [D 20:42:25.849046] element 0: offset: 0x691fe0, size: 24 [D 20:42:25.849055] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 46/70. [D 20:42:25.855762] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2843 [D 20:42:25.855779] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 47/70. [D 20:42:25.855844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 4845. [D 20:42:25.855919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 4846. [D 20:42:25.855930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 4847. [D 20:42:25.855941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 4848. [D 20:42:25.855956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 4849. [D 20:42:25.855965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 4850. [D 20:42:25.855975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4851. [D 20:42:25.855985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4852. [D 20:42:25.855996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4853. [D 20:42:25.856006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 4854. [D 20:42:25.856015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 4855. [D 20:42:25.856030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 4856. [D 20:42:25.856040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 4857. [D 20:42:25.856050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 4858. [D 20:42:25.856060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4859. [D 20:42:25.856071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4860. [D 20:42:25.856080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4861. [D 20:42:25.856090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 4862. [D 20:42:25.856136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 4863. [D 20:42:25.856146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 4864. [D 20:42:25.856156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 4865. [D 20:42:25.856167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 4866. [D 20:42:25.856196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4867. [D 20:42:25.856209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4868. [D 20:42:25.856219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4869. [D 20:42:25.856229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 4870. [D 20:42:25.856243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 4871. [D 20:42:25.856252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 4872. [D 20:42:25.856262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 4873. [D 20:42:25.856293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 4874. [D 20:42:25.856304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4875. [D 20:42:25.856314] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4876. [D 20:42:25.867493] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 4876. [D 20:42:25.867534] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 48/70. [D 20:42:25.867602] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.867616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.867625] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.873673] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.873686] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.873694] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.873711] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2861 [D 20:42:25.873720] element 0: offset: 0x654770, size: 24 [D 20:42:25.873731] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 49/70. [D 20:42:25.884191] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2852 [D 20:42:25.884208] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 50/70. [D 20:42:25.884375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4876. [D 20:42:25.884444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4877. [D 20:42:25.884455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4878. [D 20:42:25.884466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4879. [D 20:42:25.884480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4880. [D 20:42:25.884490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4881. [D 20:42:25.884500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4882. [D 20:42:25.884514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4883. [D 20:42:25.884524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4884. [D 20:42:25.884533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4885. [D 20:42:25.884550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4886. [D 20:42:25.884559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4887. [D 20:42:25.884569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4888. [D 20:42:25.884579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4889. [D 20:42:25.884602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4890. [D 20:42:25.884612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4891. [D 20:42:25.884622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4892. [D 20:42:25.884645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4893. [D 20:42:25.884655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4894. [D 20:42:25.884665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4895. [D 20:42:25.884689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4896. [D 20:42:25.884699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4897. [D 20:42:25.884710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4898. [D 20:42:25.884729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4899. [D 20:42:25.884744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4900. [D 20:42:25.884754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4901. [D 20:42:25.884763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4902. [D 20:42:25.884785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4903. [D 20:42:25.884795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4904. [D 20:42:25.884805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4905. [D 20:42:25.884830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4906. [D 20:42:25.884841] openib_post_sr_rdmaw: ibv_post_send wr_id 627dc0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4907. [D 20:42:25.892212] openib_check_cq: completed rdma wr_id 627dc0, nic_wr_credit 4907. [D 20:42:25.892231] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 51/70. [D 20:42:25.892295] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.892310] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.892318] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.897732] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.897746] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.897754] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.897771] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2864 [D 20:42:25.897780] element 0: offset: 0x67eee0, size: 24 [D 20:42:25.897790] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 52/70. [D 20:42:25.956727] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2861 [D 20:42:25.956745] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 53/70. [D 20:42:25.956808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 4907. [D 20:42:25.956916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 4908. [D 20:42:25.956930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 4909. [D 20:42:25.956941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 4910. [D 20:42:25.956951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 4911. [D 20:42:25.956961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 4912. [D 20:42:25.956972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4913. [D 20:42:25.956982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4914. [D 20:42:25.956992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4915. [D 20:42:25.957001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 4916. [D 20:42:25.957020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 4917. [D 20:42:25.957030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 4918. [D 20:42:25.957040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 4919. [D 20:42:25.957049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 4920. [D 20:42:25.957060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4921. [D 20:42:25.957071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4922. [D 20:42:25.957081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4923. [D 20:42:25.957105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 4924. [D 20:42:25.957115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 4925. [D 20:42:25.957125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 4926. [D 20:42:25.957135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 4927. [D 20:42:25.957165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 4928. [D 20:42:25.957176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4929. [D 20:42:25.957190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4930. [D 20:42:25.957208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4931. [D 20:42:25.957219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 4932. [D 20:42:25.957229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 4933. [D 20:42:25.957239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 4934. [D 20:42:25.957249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 4935. [D 20:42:25.957259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 4936. [D 20:42:25.957269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4937. [D 20:42:25.957279] openib_post_sr_rdmaw: ibv_post_send wr_id 661aa0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4938. [D 20:42:25.962849] openib_check_cq: completed rdma wr_id 661aa0, nic_wr_credit 4938. [D 20:42:25.962866] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 54/70. [D 20:42:25.962931] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.962946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.962954] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.968917] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.968931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.968939] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.968956] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2867 [D 20:42:25.968965] element 0: offset: 0x61ee50, size: 24 [D 20:42:25.968976] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 55/70. [D 20:42:26.025968] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2864 [D 20:42:26.025986] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 56/70. [D 20:42:26.026046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4938. [D 20:42:26.026119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4939. [D 20:42:26.026173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4940. [D 20:42:26.026184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4941. [D 20:42:26.026195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4942. [D 20:42:26.026206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4943. [D 20:42:26.026216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4944. [D 20:42:26.026236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4945. [D 20:42:26.026247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4946. [D 20:42:26.026257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4947. [D 20:42:26.026266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4948. [D 20:42:26.026276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4949. [D 20:42:26.026301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4950. [D 20:42:26.026311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4951. [D 20:42:26.026331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4952. [D 20:42:26.026342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4953. [D 20:42:26.026351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4954. [D 20:42:26.026376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4955. [D 20:42:26.026387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4956. [D 20:42:26.026400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4957. [D 20:42:26.026419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4958. [D 20:42:26.026434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4959. [D 20:42:26.026444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4960. [D 20:42:26.026466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4961. [D 20:42:26.026476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4962. [D 20:42:26.026486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4963. [D 20:42:26.026514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4964. [D 20:42:26.026523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4965. [D 20:42:26.026537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4966. [D 20:42:26.026562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4967. [D 20:42:26.026573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4968. [D 20:42:26.026583] openib_post_sr_rdmaw: ibv_post_send wr_id 627dc0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4969. [D 20:42:26.032026] openib_check_cq: completed rdma wr_id 627dc0, nic_wr_credit 4969. [D 20:42:26.032044] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 57/70. [D 20:42:26.032111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.032125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.032134] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.037548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.037562] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.037570] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.037586] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2870 [D 20:42:26.037595] element 0: offset: 0x5b0030, size: 24 [D 20:42:26.037607] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 58/70. [D 20:42:26.100891] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2867 [D 20:42:26.100908] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 59/70. [D 20:42:26.100966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 4969. [D 20:42:26.101063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 4970. [D 20:42:26.101077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 4971. [D 20:42:26.101088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 4972. [D 20:42:26.101099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 4973. [D 20:42:26.101109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 4974. [D 20:42:26.101120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4975. [D 20:42:26.101130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4976. [D 20:42:26.101140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4977. [D 20:42:26.101178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 4978. [D 20:42:26.101203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 4979. [D 20:42:26.101213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 4980. [D 20:42:26.101235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 4981. [D 20:42:26.101245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 4982. [D 20:42:26.101257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4983. [D 20:42:26.101276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4984. [D 20:42:26.101287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4985. [D 20:42:26.101297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 4986. [D 20:42:26.101327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 4987. [D 20:42:26.101337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 4988. [D 20:42:26.101359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 4989. [D 20:42:26.101369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 4990. [D 20:42:26.101390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4991. [D 20:42:26.101401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4992. [D 20:42:26.101410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4993. [D 20:42:26.101432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 4994. [D 20:42:26.101443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 4995. [D 20:42:26.101455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 4996. [D 20:42:26.101477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 4997. [D 20:42:26.101488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 4998. [D 20:42:26.101508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4999. [D 20:42:26.101518] openib_post_sr_rdmaw: ibv_post_send wr_id 627dc0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5000. [D 20:42:26.106993] openib_check_cq: completed rdma wr_id 627dc0, nic_wr_credit 5000. [D 20:42:26.107011] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 60/70. [D 20:42:26.107074] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.107088] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.107097] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.113079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.113093] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.113102] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.113118] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2873 [D 20:42:26.113127] element 0: offset: 0x6572d0, size: 24 [D 20:42:26.113137] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 0/70. [D 20:42:26.180356] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2870 [D 20:42:26.180373] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 1/70. [D 20:42:26.180433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5000. [D 20:42:26.180503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5001. [D 20:42:26.180557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5002. [D 20:42:26.180569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5003. [D 20:42:26.180580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5004. [D 20:42:26.180590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5005. [D 20:42:26.180600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5006. [D 20:42:26.180610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5007. [D 20:42:26.180620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5008. [D 20:42:26.180630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5009. [D 20:42:26.180648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5010. [D 20:42:26.180658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5011. [D 20:42:26.180681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5012. [D 20:42:26.180692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5013. [D 20:42:26.180702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5014. [D 20:42:26.180712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5015. [D 20:42:26.180722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5016. [D 20:42:26.180732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5017. [D 20:42:26.180741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5018. [D 20:42:26.180751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5019. [D 20:42:26.180762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5020. [D 20:42:26.180773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5021. [D 20:42:26.180783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5022. [D 20:42:26.180793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5023. [D 20:42:26.180802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5024. [D 20:42:26.180813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5025. [D 20:42:26.180837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5026. [D 20:42:26.180847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5027. [D 20:42:26.180867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5028. [D 20:42:26.180878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5029. [D 20:42:26.180887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5030. [D 20:42:26.180914] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5031. [D 20:42:26.186406] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5031. [D 20:42:26.186422] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 2/70. [D 20:42:26.186488] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.186502] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.186510] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.191943] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.191957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.191965] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.191981] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2876 [D 20:42:26.191991] element 0: offset: 0x63dc60, size: 24 [D 20:42:26.192001] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 3/70. [D 20:42:26.243438] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2876 [D 20:42:26.243455] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 4/70. [D 20:42:26.243519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5031. [D 20:42:26.243589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5032. [D 20:42:26.243601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5033. [D 20:42:26.243611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5034. [D 20:42:26.243621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5035. [D 20:42:26.243638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5036. [D 20:42:26.243648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5037. [D 20:42:26.243658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5038. [D 20:42:26.243668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5039. [D 20:42:26.243678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5040. [D 20:42:26.243688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5041. [D 20:42:26.243698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5042. [D 20:42:26.243771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5043. [D 20:42:26.243782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5044. [D 20:42:26.243792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5045. [D 20:42:26.243802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5046. [D 20:42:26.243813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5047. [D 20:42:26.243824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5048. [D 20:42:26.243834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5049. [D 20:42:26.243844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5050. [D 20:42:26.243868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5051. [D 20:42:26.243878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5052. [D 20:42:26.243888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5053. [D 20:42:26.243914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5054. [D 20:42:26.243924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5055. [D 20:42:26.243948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5056. [D 20:42:26.243961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5057. [D 20:42:26.243974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5058. [D 20:42:26.243985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5059. [D 20:42:26.243995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5060. [D 20:42:26.244005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5061. [D 20:42:26.244020] openib_post_sr_rdmaw: ibv_post_send wr_id 627dc0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5062. [D 20:42:26.249498] openib_check_cq: completed rdma wr_id 627dc0, nic_wr_credit 5062. [D 20:42:26.249515] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 5/70. [D 20:42:26.249579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.249593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.249602] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.255130] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.255144] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.255152] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.255169] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2879 [D 20:42:26.255178] element 0: offset: 0x654770, size: 24 [D 20:42:26.255188] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 6/70. [D 20:42:26.274710] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2858 [D 20:42:26.274726] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 7/70. [D 20:42:26.274790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5062. [D 20:42:26.274857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5063. [D 20:42:26.274909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5064. [D 20:42:26.274920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5065. [D 20:42:26.274931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5066. [D 20:42:26.274941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5067. [D 20:42:26.274951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5068. [D 20:42:26.274977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5069. [D 20:42:26.274992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5070. [D 20:42:26.275002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5071. [D 20:42:26.275012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5072. [D 20:42:26.275034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5073. [D 20:42:26.275044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5074. [D 20:42:26.275065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5075. [D 20:42:26.275075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5076. [D 20:42:26.275085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5077. [D 20:42:26.275099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5078. [D 20:42:26.275122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5079. [D 20:42:26.275134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5080. [D 20:42:26.275153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5081. [D 20:42:26.275168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5082. [D 20:42:26.275178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5083. [D 20:42:26.275201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5084. [D 20:42:26.275211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5085. [D 20:42:26.275235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5086. [D 20:42:26.275246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5087. [D 20:42:26.275256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5088. [D 20:42:26.275281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5089. [D 20:42:26.275291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5090. [D 20:42:26.275302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5091. [D 20:42:26.275324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5092. [D 20:42:26.275334] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5093. [D 20:42:26.280708] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5093. [D 20:42:26.280725] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 8/70. [D 20:42:26.280791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.280805] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.280814] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.286588] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.286602] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.286610] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.286626] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2882 [D 20:42:26.286635] element 0: offset: 0x628160, size: 24 [D 20:42:26.286646] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 9/70. [D 20:42:26.336328] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2854 [D 20:42:26.336344] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 10/70. [D 20:42:26.336405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5093. [D 20:42:26.336496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5094. [D 20:42:26.336510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5095. [D 20:42:26.336521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5096. [D 20:42:26.336532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5097. [D 20:42:26.336542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5098. [D 20:42:26.336552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5099. [D 20:42:26.336562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5100. [D 20:42:26.336602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5101. [D 20:42:26.336614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5102. [D 20:42:26.336634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 5103. [D 20:42:26.336644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 5104. [D 20:42:26.336668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 5105. [D 20:42:26.336679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 5106. [D 20:42:26.336689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 5107. [D 20:42:26.336710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5108. [D 20:42:26.336721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5109. [D 20:42:26.336734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5110. [D 20:42:26.336755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5111. [D 20:42:26.336766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5112. [D 20:42:26.336776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5113. [D 20:42:26.336786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5114. [D 20:42:26.336808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5115. [D 20:42:26.336818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5116. [D 20:42:26.336828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5117. [D 20:42:26.336842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5118. [D 20:42:26.336851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5119. [D 20:42:26.336861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5120. [D 20:42:26.336871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5121. [D 20:42:26.336888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5122. [D 20:42:26.336898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5123. [D 20:42:26.336907] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5124. [D 20:42:26.342352] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5124. [D 20:42:26.342369] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 11/70. [D 20:42:26.342434] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.342448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.342457] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.347894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.347907] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.347915] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.347933] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2884 [D 20:42:26.347942] element 0: offset: 0x627f50, size: 24 [D 20:42:26.347952] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 12/70. [D 20:42:26.406560] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2873 [D 20:42:26.406577] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 13/70. [D 20:42:26.406634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 5124. [D 20:42:26.406731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5125. [D 20:42:26.406743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5126. [D 20:42:26.406755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5127. [D 20:42:26.406766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5128. [D 20:42:26.406776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5129. [D 20:42:26.406786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5130. [D 20:42:26.406796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5131. [D 20:42:26.406806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5132. [D 20:42:26.406842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5133. [D 20:42:26.406852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5134. [D 20:42:26.406874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5135. [D 20:42:26.406889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5136. [D 20:42:26.406910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5137. [D 20:42:26.406923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5138. [D 20:42:26.406933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5139. [D 20:42:26.406944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5140. [D 20:42:26.406956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5141. [D 20:42:26.406966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5142. [D 20:42:26.406976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5143. [D 20:42:26.406986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5144. [D 20:42:26.406997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5145. [D 20:42:26.407006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5146. [D 20:42:26.407016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5147. [D 20:42:26.407041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5148. [D 20:42:26.407052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5149. [D 20:42:26.407062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5150. [D 20:42:26.407072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5151. [D 20:42:26.407083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5152. [D 20:42:26.407093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5153. [D 20:42:26.407103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5154. [D 20:42:26.407118] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5155. [D 20:42:26.412585] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5155. [D 20:42:26.412602] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 14/70. [D 20:42:26.412669] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.412683] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.412691] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.550601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.550615] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.550623] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.550638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2888 [D 20:42:26.550648] element 0: offset: 0x61f310, size: 24 [D 20:42:26.550658] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 15/70. [D 20:42:26.563187] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2879 [D 20:42:26.563203] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 16/70. [D 20:42:26.563262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5155. [D 20:42:26.563331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5156. [D 20:42:26.563350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5157. [D 20:42:26.563361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5158. [D 20:42:26.563417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5159. [D 20:42:26.563427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5160. [D 20:42:26.563438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5161. [D 20:42:26.563448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5162. [D 20:42:26.563458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5163. [D 20:42:26.563467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5164. [D 20:42:26.563498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5165. [D 20:42:26.563508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5166. [D 20:42:26.563517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5167. [D 20:42:26.563542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5168. [D 20:42:26.563552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5169. [D 20:42:26.563562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5170. [D 20:42:26.563572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5171. [D 20:42:26.563587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5172. [D 20:42:26.563597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5173. [D 20:42:26.563619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5174. [D 20:42:26.563630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5175. [D 20:42:26.563640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5176. [D 20:42:26.563650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5177. [D 20:42:26.563660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5178. [D 20:42:26.563670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5179. [D 20:42:26.563685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5180. [D 20:42:26.563717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5181. [D 20:42:26.563727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5182. [D 20:42:26.563738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5183. [D 20:42:26.563747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5184. [D 20:42:26.563770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5185. [D 20:42:26.563781] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5186. [D 20:42:26.569186] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5186. [D 20:42:26.569202] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 17/70. [D 20:42:26.569267] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.569281] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.569289] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.574806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.574819] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.574828] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.574843] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2891 [D 20:42:26.574853] element 0: offset: 0x67efc0, size: 24 [D 20:42:26.574862] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 18/70. [D 20:42:26.641354] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2882 [D 20:42:26.641371] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 19/70. [D 20:42:26.641428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5186. [D 20:42:26.641495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5187. [D 20:42:26.641506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5188. [D 20:42:26.641517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5189. [D 20:42:26.641527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5190. [D 20:42:26.641537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5191. [D 20:42:26.641547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5192. [D 20:42:26.641557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5193. [D 20:42:26.641567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5194. [D 20:42:26.641577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5195. [D 20:42:26.641587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5196. [D 20:42:26.641651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5197. [D 20:42:26.641662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5198. [D 20:42:26.641672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5199. [D 20:42:26.641682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5200. [D 20:42:26.641692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5201. [D 20:42:26.641708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5202. [D 20:42:26.641718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5203. [D 20:42:26.641728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5204. [D 20:42:26.641738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5205. [D 20:42:26.641748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5206. [D 20:42:26.641758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5207. [D 20:42:26.641785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5208. [D 20:42:26.641795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5209. [D 20:42:26.641805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5210. [D 20:42:26.641821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5211. [D 20:42:26.641831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5212. [D 20:42:26.641841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5213. [D 20:42:26.641868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5214. [D 20:42:26.641878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5215. [D 20:42:26.641892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5216. [D 20:42:26.641902] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5217. [D 20:42:26.647349] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5217. [D 20:42:26.647366] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 20/70. [D 20:42:26.647430] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.647445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.647453] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.653285] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.653299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.653307] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.653323] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2894 [D 20:42:26.653332] element 0: offset: 0x64da00, size: 24 [D 20:42:26.653342] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 21/70. [D 20:42:26.707519] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2884 [D 20:42:26.707536] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 22/70. [D 20:42:26.707594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5217. [D 20:42:26.707684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5218. [D 20:42:26.707698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5219. [D 20:42:26.707709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5220. [D 20:42:26.707720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5221. [D 20:42:26.707730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5222. [D 20:42:26.707740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5223. [D 20:42:26.707749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5224. [D 20:42:26.707765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5225. [D 20:42:26.707791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5226. [D 20:42:26.707807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 5227. [D 20:42:26.707824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 5228. [D 20:42:26.707834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 5229. [D 20:42:26.707856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 5230. [D 20:42:26.707866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 5231. [D 20:42:26.707876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5232. [D 20:42:26.707898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5233. [D 20:42:26.707908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5234. [D 20:42:26.707918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5235. [D 20:42:26.707946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5236. [D 20:42:26.707956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5237. [D 20:42:26.707969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5238. [D 20:42:26.707980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5239. [D 20:42:26.707989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5240. [D 20:42:26.707999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5241. [D 20:42:26.708026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5242. [D 20:42:26.708037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5243. [D 20:42:26.708062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5244. [D 20:42:26.708073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5245. [D 20:42:26.708085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5246. [D 20:42:26.708095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5247. [D 20:42:26.708105] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5248. [D 20:42:26.713516] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5248. [D 20:42:26.713534] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 23/70. [D 20:42:26.713598] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.713613] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.713621] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.719219] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.719233] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.719241] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.719257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2896 [D 20:42:26.719267] element 0: offset: 0x63e800, size: 24 [D 20:42:26.719276] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 24/70. [D 20:42:26.777778] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2896 [D 20:42:26.777795] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 25/70. [D 20:42:26.777858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5248. [D 20:42:26.777954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5249. [D 20:42:26.777968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5250. [D 20:42:26.777979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5251. [D 20:42:26.777990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5252. [D 20:42:26.778001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5253. [D 20:42:26.778011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5254. [D 20:42:26.778021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5255. [D 20:42:26.778059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5256. [D 20:42:26.778069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5257. [D 20:42:26.778080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 5258. [D 20:42:26.778090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 5259. [D 20:42:26.778099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 5260. [D 20:42:26.778110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 5261. [D 20:42:26.778133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 5262. [D 20:42:26.778143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5263. [D 20:42:26.778174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5264. [D 20:42:26.778185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5265. [D 20:42:26.778196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5266. [D 20:42:26.778216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5267. [D 20:42:26.778230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5268. [D 20:42:26.778252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5269. [D 20:42:26.778266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5270. [D 20:42:26.778276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5271. [D 20:42:26.778296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5272. [D 20:42:26.778307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5273. [D 20:42:26.778327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5274. [D 20:42:26.778338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5275. [D 20:42:26.778348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5276. [D 20:42:26.778371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5277. [D 20:42:26.778382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5278. [D 20:42:26.778392] openib_post_sr_rdmaw: ibv_post_send wr_id 646ad0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5279. [D 20:42:26.783862] openib_check_cq: completed rdma wr_id 646ad0, nic_wr_credit 5279. [D 20:42:26.783879] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 26/70. [D 20:42:26.783946] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.783961] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.783969] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.789534] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.789548] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.789556] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.789572] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2899 [D 20:42:26.789582] element 0: offset: 0x67eee0, size: 24 [D 20:42:26.789591] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 27/70. [D 20:42:26.845176] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2891 [D 20:42:26.845193] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 28/70. [D 20:42:26.845253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5279. [D 20:42:26.845323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5280. [D 20:42:26.845378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5281. [D 20:42:26.845388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5282. [D 20:42:26.845399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5283. [D 20:42:26.845411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5284. [D 20:42:26.845426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5285. [D 20:42:26.845449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5286. [D 20:42:26.845461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5287. [D 20:42:26.845471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5288. [D 20:42:26.845481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5289. [D 20:42:26.845507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5290. [D 20:42:26.845517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5291. [D 20:42:26.845530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5292. [D 20:42:26.845540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5293. [D 20:42:26.845550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5294. [D 20:42:26.845559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5295. [D 20:42:26.845575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5296. [D 20:42:26.845597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5297. [D 20:42:26.845608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5298. [D 20:42:26.845628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5299. [D 20:42:26.845640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5300. [D 20:42:26.845650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5301. [D 20:42:26.845669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5302. [D 20:42:26.845686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5303. [D 20:42:26.845696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5304. [D 20:42:26.845722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5305. [D 20:42:26.845732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5306. [D 20:42:26.845742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5307. [D 20:42:26.845773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5308. [D 20:42:26.845784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5309. [D 20:42:26.845794] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5310. [D 20:42:26.851181] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5310. [D 20:42:26.851197] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 29/70. [D 20:42:26.851261] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.851275] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.851284] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.856824] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.856837] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.856846] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.856862] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2903 [D 20:42:26.856871] element 0: offset: 0x61ee50, size: 24 [D 20:42:26.856881] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 30/70. [D 20:42:26.913448] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2888 [D 20:42:26.913465] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 31/70. [D 20:42:26.913527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 5310. [D 20:42:26.913597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5311. [D 20:42:26.913652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5312. [D 20:42:26.913663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5313. [D 20:42:26.913674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5314. [D 20:42:26.913684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5315. [D 20:42:26.913694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5316. [D 20:42:26.913716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5317. [D 20:42:26.913732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5318. [D 20:42:26.913741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5319. [D 20:42:26.913751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5320. [D 20:42:26.913775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5321. [D 20:42:26.913786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5322. [D 20:42:26.913796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5323. [D 20:42:26.913818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5324. [D 20:42:26.913829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5325. [D 20:42:26.913839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5326. [D 20:42:26.913865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5327. [D 20:42:26.913875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5328. [D 20:42:26.913898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5329. [D 20:42:26.913910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5330. [D 20:42:26.913920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5331. [D 20:42:26.913942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5332. [D 20:42:26.913952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5333. [D 20:42:26.913972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5334. [D 20:42:26.913983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5335. [D 20:42:26.913993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5336. [D 20:42:26.914004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5337. [D 20:42:26.914021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5338. [D 20:42:26.914031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5339. [D 20:42:26.914058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5340. [D 20:42:26.914068] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5341. [D 20:42:26.919454] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5341. [D 20:42:26.919472] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 32/70. [D 20:42:26.919529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.919544] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.919552] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.925517] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.925531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.925539] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.925556] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2906 [D 20:42:26.925565] element 0: offset: 0x654770, size: 24 [D 20:42:26.925575] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 33/70. [D 20:42:27.033881] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2894 [D 20:42:27.033898] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 34/70. [D 20:42:27.034017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5341. [D 20:42:27.034122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5342. [D 20:42:27.034133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5343. [D 20:42:27.034143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5344. [D 20:42:27.034158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5345. [D 20:42:27.034167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5346. [D 20:42:27.034177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5347. [D 20:42:27.034193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5348. [D 20:42:27.034203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5349. [D 20:42:27.034216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5350. [D 20:42:27.034245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5351. [D 20:42:27.034256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5352. [D 20:42:27.034278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5353. [D 20:42:27.034289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5354. [D 20:42:27.034299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5355. [D 20:42:27.034323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5356. [D 20:42:27.034333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5357. [D 20:42:27.034343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5358. [D 20:42:27.034366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5359. [D 20:42:27.034375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5360. [D 20:42:27.034385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5361. [D 20:42:27.034407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5362. [D 20:42:27.034417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5363. [D 20:42:27.034439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5364. [D 20:42:27.034449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5365. [D 20:42:27.034471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5366. [D 20:42:27.034481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5367. [D 20:42:27.034503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5368. [D 20:42:27.034514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5369. [D 20:42:27.034526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5370. [D 20:42:27.034553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5371. [D 20:42:27.034563] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5372. [D 20:42:27.039976] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5372. [D 20:42:27.039993] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 35/70. [D 20:42:27.040060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.040074] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.040083] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.046127] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.046141] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.046149] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.046165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2909 [D 20:42:27.046175] element 0: offset: 0x628160, size: 24 [D 20:42:27.046185] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 36/70. [D 20:42:27.104923] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2903 [D 20:42:27.104940] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 37/70. [D 20:42:27.105000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5372. [D 20:42:27.105070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5373. [D 20:42:27.105129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5374. [D 20:42:27.105140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5375. [D 20:42:27.105151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5376. [D 20:42:27.105161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5377. [D 20:42:27.105171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5378. [D 20:42:27.105193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5379. [D 20:42:27.105206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5380. [D 20:42:27.105216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5381. [D 20:42:27.105226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5382. [D 20:42:27.105241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5383. [D 20:42:27.105251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5384. [D 20:42:27.105261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5385. [D 20:42:27.105271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5386. [D 20:42:27.105293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5387. [D 20:42:27.105304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5388. [D 20:42:27.105313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5389. [D 20:42:27.105330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5390. [D 20:42:27.105340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5391. [D 20:42:27.105350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5392. [D 20:42:27.105375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5393. [D 20:42:27.105392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5394. [D 20:42:27.105401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5395. [D 20:42:27.105422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5396. [D 20:42:27.105432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5397. [D 20:42:27.105442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5398. [D 20:42:27.105462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5399. [D 20:42:27.105473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5400. [D 20:42:27.105483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5401. [D 20:42:27.105499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5402. [D 20:42:27.105519] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5403. [D 20:42:27.110927] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5403. [D 20:42:27.110945] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 38/70. [D 20:42:27.111009] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.111023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.111031] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.158492] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2899 [D 20:42:27.158508] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 39/70. [D 20:42:27.158571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5403. [D 20:42:27.158677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5404. [D 20:42:27.158691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5405. [D 20:42:27.158701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5406. [D 20:42:27.158712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5407. [D 20:42:27.158723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5408. [D 20:42:27.158733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5409. [D 20:42:27.158743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5410. [D 20:42:27.158753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5411. [D 20:42:27.158768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5412. [D 20:42:27.158779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 5413. [D 20:42:27.158789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 5414. [D 20:42:27.158813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 5415. [D 20:42:27.158824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 5416. [D 20:42:27.158834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 5417. [D 20:42:27.158844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5418. [D 20:42:27.158868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5419. [D 20:42:27.158877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5420. [D 20:42:27.158887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5421. [D 20:42:27.158910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5422. [D 20:42:27.158921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5423. [D 20:42:27.158931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5424. [D 20:42:27.158940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5425. [D 20:42:27.158951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5426. [D 20:42:27.158963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5427. [D 20:42:27.158972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5428. [D 20:42:27.158982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5429. [D 20:42:27.159005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5430. [D 20:42:27.159015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5431. [D 20:42:27.159026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5432. [D 20:42:27.159048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5433. [D 20:42:27.159057] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5434. [D 20:42:27.164542] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5434. [D 20:42:27.164559] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 40/70. [D 20:42:27.164625] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.164639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.164647] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:27.170454] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.170468] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.170476] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:27.170493] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2911 [D 20:42:27.170502] element 0: offset: 0x62a370, size: 24 [D 20:42:27.170512] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 41/70. [D 20:42:27.216821] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2909 [D 20:42:27.216838] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 42/70. [D 20:42:27.216899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5434. [D 20:42:27.216966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5435. [D 20:42:27.217020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5436. [D 20:42:27.217031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5437. [D 20:42:27.217042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5438. [D 20:42:27.217057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5439. [D 20:42:27.217068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5440. [D 20:42:27.217095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5441. [D 20:42:27.217106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5442. [D 20:42:27.217117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5443. [D 20:42:27.217127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5444. [D 20:42:27.217151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5445. [D 20:42:27.217160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5446. [D 20:42:27.217185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5447. [D 20:42:27.217196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5448. [D 20:42:27.217209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5449. [D 20:42:27.217236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5450. [D 20:42:27.217246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5451. [D 20:42:27.217271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5452. [D 20:42:27.217281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5453. [D 20:42:27.217302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5454. [D 20:42:27.217313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5455. [D 20:42:27.217324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5456. [D 20:42:27.217334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5457. [D 20:42:27.217363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5458. [D 20:42:27.217376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5459. [D 20:42:27.217397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5460. [D 20:42:27.217409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5461. [D 20:42:27.217419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5462. [D 20:42:27.217428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5463. [D 20:42:27.217450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5464. [D 20:42:27.217460] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5465. [D 20:42:27.222827] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5465. [D 20:42:27.222845] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 43/70. [D 20:42:27.222908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.222922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.222930] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:27.229315] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.229329] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.229337] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:27.229354] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2915 [D 20:42:27.229363] element 0: offset: 0x691fe0, size: 24 [D 20:42:27.229373] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 44/70. [D 20:42:27.245366] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.245380] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.245388] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.245404] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2918 [D 20:42:27.245413] element 0: offset: 0x63e800, size: 24 [D 20:42:27.245423] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 45/70. [D 20:42:27.250986] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2906 [D 20:42:27.251002] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 46/70. [D 20:42:27.251154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 5465. [D 20:42:27.251220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5466. [D 20:42:27.251232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5467. [D 20:42:27.251242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5468. [D 20:42:27.251256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5469. [D 20:42:27.251266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5470. [D 20:42:27.251275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5471. [D 20:42:27.251291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5472. [D 20:42:27.251300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5473. [D 20:42:27.251310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5474. [D 20:42:27.251326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5475. [D 20:42:27.251335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5476. [D 20:42:27.251345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5477. [D 20:42:27.251383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5478. [D 20:42:27.251395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5479. [D 20:42:27.251405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5480. [D 20:42:27.251416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5481. [D 20:42:27.251444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5482. [D 20:42:27.251455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5483. [D 20:42:27.251465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5484. [D 20:42:27.251475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5485. [D 20:42:27.251499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5486. [D 20:42:27.251514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5487. [D 20:42:27.251524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5488. [D 20:42:27.251534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5489. [D 20:42:27.251544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5490. [D 20:42:27.251573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5491. [D 20:42:27.251584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5492. [D 20:42:27.251598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5493. [D 20:42:27.251607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5494. [D 20:42:27.251617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5495. [D 20:42:27.251633] openib_post_sr_rdmaw: ibv_post_send wr_id 62d5f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5496. [D 20:42:27.260950] openib_check_cq: completed rdma wr_id 62d5f0, nic_wr_credit 5496. [D 20:42:27.260969] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 47/70. [D 20:42:27.261036] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.261050] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.261058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.266964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.266977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.266985] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.267001] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2921 [D 20:42:27.267011] element 0: offset: 0x67efc0, size: 24 [D 20:42:27.267021] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 48/70. [D 20:42:27.303748] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2911 [D 20:42:27.303765] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 49/70. [D 20:42:27.303823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5496. [D 20:42:27.303894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5497. [D 20:42:27.303948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 5498. [D 20:42:27.303959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 5499. [D 20:42:27.303970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 5500. [D 20:42:27.303981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 5501. [D 20:42:27.303990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 5502. [D 20:42:27.304011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5503. [D 20:42:27.304022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5504. [D 20:42:27.304032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5505. [D 20:42:27.304042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 5506. [D 20:42:27.304052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 5507. [D 20:42:27.304078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 5508. [D 20:42:27.304087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 5509. [D 20:42:27.304108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 5510. [D 20:42:27.304118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5511. [D 20:42:27.304127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5512. [D 20:42:27.304155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5513. [D 20:42:27.304165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 5514. [D 20:42:27.304178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 5515. [D 20:42:27.304188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 5516. [D 20:42:27.304198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 5517. [D 20:42:27.304222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 5518. [D 20:42:27.304232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5519. [D 20:42:27.304242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5520. [D 20:42:27.304258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5521. [D 20:42:27.304293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 5522. [D 20:42:27.304314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 5523. [D 20:42:27.304329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 5524. [D 20:42:27.304348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 5525. [D 20:42:27.304358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 5526. [D 20:42:27.304369] openib_post_sr_rdmaw: ibv_post_send wr_id 62d720 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5527. [D 20:42:27.309752] openib_check_cq: completed rdma wr_id 62d720, nic_wr_credit 5527. [D 20:42:27.309770] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 50/70. [D 20:42:27.309836] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.309850] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.309859] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.315510] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.315523] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.315531] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.315548] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2923 [D 20:42:27.315560] element 0: offset: 0x61f310, size: 24 [D 20:42:27.315570] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 51/70. [D 20:42:27.354071] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2923 [D 20:42:27.354088] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 52/70. [D 20:42:27.354146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5527. [D 20:42:27.354212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5528. [D 20:42:27.354270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 5529. [D 20:42:27.354284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 5530. [D 20:42:27.354295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 5531. [D 20:42:27.354306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 5532. [D 20:42:27.354316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 5533. [D 20:42:27.354327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5534. [D 20:42:27.354337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5535. [D 20:42:27.354363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5536. [D 20:42:27.354374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 5537. [D 20:42:27.354385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 5538. [D 20:42:27.354394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 5539. [D 20:42:27.354404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 5540. [D 20:42:27.354420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 5541. [D 20:42:27.354446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5542. [D 20:42:27.354456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5543. [D 20:42:27.354467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5544. [D 20:42:27.354477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 5545. [D 20:42:27.354499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 5546. [D 20:42:27.354511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 5547. [D 20:42:27.354521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 5548. [D 20:42:27.354535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 5549. [D 20:42:27.354545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5550. [D 20:42:27.354555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5551. [D 20:42:27.354581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5552. [D 20:42:27.354591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 5553. [D 20:42:27.354605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 5554. [D 20:42:27.354615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 5555. [D 20:42:27.354625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 5556. [D 20:42:27.354655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 5557. [D 20:42:27.354665] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5558. [D 20:42:27.360143] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5558. [D 20:42:27.360161] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 53/70. [D 20:42:27.362305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.362321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.362331] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.402087] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2921 [D 20:42:27.402105] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 54/70. [D 20:42:27.402166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 5558. [D 20:42:27.402233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5559. [D 20:42:27.402296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5560. [D 20:42:27.402308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5561. [D 20:42:27.402318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5562. [D 20:42:27.402329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5563. [D 20:42:27.402339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5564. [D 20:42:27.402349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5565. [D 20:42:27.402361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5566. [D 20:42:27.402377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5567. [D 20:42:27.402387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5568. [D 20:42:27.402396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5569. [D 20:42:27.402407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5570. [D 20:42:27.402424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5571. [D 20:42:27.402434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5572. [D 20:42:27.402444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5573. [D 20:42:27.402461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5574. [D 20:42:27.402471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5575. [D 20:42:27.402495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5576. [D 20:42:27.402506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5577. [D 20:42:27.402516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5578. [D 20:42:27.402527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5579. [D 20:42:27.402537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5580. [D 20:42:27.402546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5581. [D 20:42:27.402556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5582. [D 20:42:27.402588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5583. [D 20:42:27.402598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5584. [D 20:42:27.402611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5585. [D 20:42:27.402621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5586. [D 20:42:27.402630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5587. [D 20:42:27.402646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5588. [D 20:42:27.402656] openib_post_sr_rdmaw: ibv_post_send wr_id 62d720 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5589. [D 20:42:27.408093] openib_check_cq: completed rdma wr_id 62d720, nic_wr_credit 5589. [D 20:42:27.408110] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 55/70. [D 20:42:27.410369] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.410384] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.410394] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:27.416719] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.416734] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.416745] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:27.416779] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2927 [D 20:42:27.416791] element 0: offset: 0x64da00, size: 24 [D 20:42:27.416803] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 56/70. [D 20:42:27.459307] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2915 [D 20:42:27.459325] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 57/70. [D 20:42:27.459386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 5589. [D 20:42:27.459462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 5590. [D 20:42:27.459473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 5591. [D 20:42:27.459484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 5592. [D 20:42:27.459495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 5593. [D 20:42:27.459505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 5594. [D 20:42:27.459521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 5595. [D 20:42:27.459531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 5596. [D 20:42:27.459541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 5597. [D 20:42:27.459556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 5598. [D 20:42:27.459613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 5599. [D 20:42:27.459624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 5600. [D 20:42:27.459639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 5601. [D 20:42:27.459649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 5602. [D 20:42:27.459661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 5603. [D 20:42:27.459677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 5604. [D 20:42:27.459703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 5605. [D 20:42:27.459718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 5606. [D 20:42:27.459728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 5607. [D 20:42:27.459738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 5608. [D 20:42:27.459752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 5609. [D 20:42:27.459762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 5610. [D 20:42:27.459772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 5611. [D 20:42:27.459787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 5612. [D 20:42:27.459812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 5613. [D 20:42:27.459825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 5614. [D 20:42:27.459835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 5615. [D 20:42:27.459845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 5616. [D 20:42:27.459869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 5617. [D 20:42:27.459879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 5618. [D 20:42:27.459893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 5619. [D 20:42:27.459903] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 5620. [D 20:42:27.465326] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5620. [D 20:42:27.465344] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 58/70. [D 20:42:27.467550] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.467605] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.467616] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:27.473879] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.473893] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.473903] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:27.473936] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2930 [D 20:42:27.473947] element 0: offset: 0x67eee0, size: 24 [D 20:42:27.473959] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 59/70. [D 20:42:27.498383] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.498445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.498456] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.498493] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2932 [D 20:42:27.498504] element 0: offset: 0x61ee50, size: 24 [D 20:42:27.498520] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 60/70. [D 20:42:27.517892] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2927 [D 20:42:27.517910] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 0/70. [D 20:42:27.517975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 5620. [D 20:42:27.518055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5621. [D 20:42:27.518066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5622. [D 20:42:27.518077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5623. [D 20:42:27.518088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5624. [D 20:42:27.518097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5625. [D 20:42:27.518112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5626. [D 20:42:27.518122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5627. [D 20:42:27.518132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5628. [D 20:42:27.518147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5629. [D 20:42:27.518214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5630. [D 20:42:27.518225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5631. [D 20:42:27.518235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5632. [D 20:42:27.518245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5633. [D 20:42:27.518255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5634. [D 20:42:27.518265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5635. [D 20:42:27.518296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5636. [D 20:42:27.518307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5637. [D 20:42:27.518318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5638. [D 20:42:27.518329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5639. [D 20:42:27.518338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5640. [D 20:42:27.518349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5641. [D 20:42:27.518359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5642. [D 20:42:27.518369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5643. [D 20:42:27.518379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5644. [D 20:42:27.518389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5645. [D 20:42:27.518408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5646. [D 20:42:27.518418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5647. [D 20:42:27.518443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5648. [D 20:42:27.518453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5649. [D 20:42:27.518463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5650. [D 20:42:27.518472] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5651. [D 20:42:27.523907] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5651. [D 20:42:27.523924] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 1/70. [D 20:42:27.526120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.526135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.526145] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.531999] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.532035] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.532046] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.532082] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2936 [D 20:42:27.532093] element 0: offset: 0x649100, size: 24 [D 20:42:27.532106] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 2/70. [D 20:42:27.552852] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2918 [D 20:42:27.552870] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 3/70. [D 20:42:27.552931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5651. [D 20:42:27.553001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5652. [D 20:42:27.553021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5653. [D 20:42:27.553034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5654. [D 20:42:27.553045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5655. [D 20:42:27.553055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5656. [D 20:42:27.553065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5657. [D 20:42:27.553075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5658. [D 20:42:27.553090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5659. [D 20:42:27.553100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5660. [D 20:42:27.553156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5661. [D 20:42:27.553179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5662. [D 20:42:27.553190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5663. [D 20:42:27.553200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5664. [D 20:42:27.553210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5665. [D 20:42:27.553226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5666. [D 20:42:27.553250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5667. [D 20:42:27.553262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5668. [D 20:42:27.553272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5669. [D 20:42:27.553282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5670. [D 20:42:27.553309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5671. [D 20:42:27.553319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5672. [D 20:42:27.553334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5673. [D 20:42:27.553343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5674. [D 20:42:27.553353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5675. [D 20:42:27.553376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5676. [D 20:42:27.553386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5677. [D 20:42:27.553396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5678. [D 20:42:27.553407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5679. [D 20:42:27.553417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5680. [D 20:42:27.553445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5681. [D 20:42:27.553456] openib_post_sr_rdmaw: ibv_post_send wr_id 648f70 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5682. [D 20:42:27.558856] openib_check_cq: completed rdma wr_id 648f70, nic_wr_credit 5682. [D 20:42:27.558873] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 4/70. [D 20:42:27.559600] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.559615] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.559625] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.566400] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.566415] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.566426] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.566460] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2939 [D 20:42:27.566471] element 0: offset: 0x627f50, size: 24 [D 20:42:27.566483] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 5/70. [D 20:42:27.601632] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2930 [D 20:42:27.601650] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 6/70. [D 20:42:27.601708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5682. [D 20:42:27.601775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5683. [D 20:42:27.601795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5684. [D 20:42:27.601809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5685. [D 20:42:27.601819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5686. [D 20:42:27.601830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5687. [D 20:42:27.601839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5688. [D 20:42:27.601849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5689. [D 20:42:27.601861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5690. [D 20:42:27.601877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5691. [D 20:42:27.601887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5692. [D 20:42:27.601897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5693. [D 20:42:27.601906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5694. [D 20:42:27.601919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5695. [D 20:42:27.601938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5696. [D 20:42:27.601986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5697. [D 20:42:27.601997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5698. [D 20:42:27.602007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5699. [D 20:42:27.602017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5700. [D 20:42:27.602028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5701. [D 20:42:27.602039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5702. [D 20:42:27.602048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5703. [D 20:42:27.602080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5704. [D 20:42:27.602091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5705. [D 20:42:27.602102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5706. [D 20:42:27.602112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5707. [D 20:42:27.602122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5708. [D 20:42:27.602132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5709. [D 20:42:27.602160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5710. [D 20:42:27.602170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5711. [D 20:42:27.602181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5712. [D 20:42:27.602191] openib_post_sr_rdmaw: ibv_post_send wr_id 646ad0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5713. [D 20:42:27.607633] openib_check_cq: completed rdma wr_id 646ad0, nic_wr_credit 5713. [D 20:42:27.607651] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 7/70. [D 20:42:27.609967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.609981] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.609991] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.616181] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.616198] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.616210] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.616244] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2942 [D 20:42:27.616255] element 0: offset: 0x62a370, size: 24 [D 20:42:27.616266] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 8/70. [D 20:42:27.661363] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2939 [D 20:42:27.661382] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 9/70. [D 20:42:27.661443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5713. [D 20:42:27.661513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5714. [D 20:42:27.661534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5715. [D 20:42:27.661544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5716. [D 20:42:27.661555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5717. [D 20:42:27.661565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5718. [D 20:42:27.661581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5719. [D 20:42:27.661591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5720. [D 20:42:27.661600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5721. [D 20:42:27.661655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5722. [D 20:42:27.661666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5723. [D 20:42:27.661678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5724. [D 20:42:27.661703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5725. [D 20:42:27.661713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5726. [D 20:42:27.661724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5727. [D 20:42:27.661738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5728. [D 20:42:27.661748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5729. [D 20:42:27.661757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5730. [D 20:42:27.661790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5731. [D 20:42:27.661800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5732. [D 20:42:27.661811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5733. [D 20:42:27.661821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5734. [D 20:42:27.661837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5735. [D 20:42:27.661847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5736. [D 20:42:27.661868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5737. [D 20:42:27.661878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5738. [D 20:42:27.661888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5739. [D 20:42:27.661900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5740. [D 20:42:27.661929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5741. [D 20:42:27.661939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5742. [D 20:42:27.661950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5743. [D 20:42:27.661960] openib_post_sr_rdmaw: ibv_post_send wr_id 648f70 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5744. [D 20:42:27.667367] openib_check_cq: completed rdma wr_id 648f70, nic_wr_credit 5744. [D 20:42:27.667384] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 10/70. [D 20:42:27.669591] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.669606] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.669617] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.674826] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.674841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.674852] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.674886] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2945 [D 20:42:27.674897] element 0: offset: 0x627dd0, size: 24 [D 20:42:27.674911] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 11/70. [D 20:42:27.989003] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2936 [D 20:42:27.989022] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 12/70. [D 20:42:27.989155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 5744. [D 20:42:27.989236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5745. [D 20:42:27.989247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5746. [D 20:42:27.989258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5747. [D 20:42:27.989272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5748. [D 20:42:27.989282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5749. [D 20:42:27.989294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5750. [D 20:42:27.989309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5751. [D 20:42:27.989319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5752. [D 20:42:27.989329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5753. [D 20:42:27.989403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5754. [D 20:42:27.989413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5755. [D 20:42:27.989426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5756. [D 20:42:27.989441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5757. [D 20:42:27.989451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5758. [D 20:42:27.989460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5759. [D 20:42:27.989476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5760. [D 20:42:27.989494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5761. [D 20:42:27.989504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5762. [D 20:42:27.989519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5763. [D 20:42:27.989529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5764. [D 20:42:27.989549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5765. [D 20:42:27.989560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5766. [D 20:42:27.989571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5767. [D 20:42:27.989581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5768. [D 20:42:27.989591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5769. [D 20:42:27.989609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5770. [D 20:42:27.989619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5771. [D 20:42:27.989643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5772. [D 20:42:27.989655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5773. [D 20:42:27.989665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5774. [D 20:42:27.989676] openib_post_sr_rdmaw: ibv_post_send wr_id 648f70 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5775. [D 20:42:27.995156] openib_check_cq: completed rdma wr_id 648f70, nic_wr_credit 5775. [D 20:42:27.995174] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 13/70. [D 20:42:27.997422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.997438] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.997448] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.003612] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.003628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.003638] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.003684] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2948 [D 20:42:28.003698] element 0: offset: 0x5b0030, size: 24 [D 20:42:28.003710] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 14/70. [D 20:42:28.089949] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2942 [D 20:42:28.089967] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 15/70. [D 20:42:28.090064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5775. [D 20:42:28.090140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5776. [D 20:42:28.090151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5777. [D 20:42:28.090162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5778. [D 20:42:28.090175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5779. [D 20:42:28.090185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5780. [D 20:42:28.090195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5781. [D 20:42:28.090210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5782. [D 20:42:28.090220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5783. [D 20:42:28.090229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5784. [D 20:42:28.090287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5785. [D 20:42:28.090298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5786. [D 20:42:28.090308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5787. [D 20:42:28.090332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5788. [D 20:42:28.090342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5789. [D 20:42:28.090353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5790. [D 20:42:28.090363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5791. [D 20:42:28.090373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5792. [D 20:42:28.090393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5793. [D 20:42:28.090420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5794. [D 20:42:28.090434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5795. [D 20:42:28.090445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5796. [D 20:42:28.090454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5797. [D 20:42:28.090481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5798. [D 20:42:28.090492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5799. [D 20:42:28.090503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5800. [D 20:42:28.090513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5801. [D 20:42:28.090528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5802. [D 20:42:28.090553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5803. [D 20:42:28.090564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5804. [D 20:42:28.090574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5805. [D 20:42:28.090584] openib_post_sr_rdmaw: ibv_post_send wr_id 648f70 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5806. [D 20:42:28.095997] openib_check_cq: completed rdma wr_id 648f70, nic_wr_credit 5806. [D 20:42:28.096014] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 16/70. [D 20:42:28.098298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.098313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.098323] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.104595] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.104609] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.104619] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.104652] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2951 [D 20:42:28.104663] element 0: offset: 0x63e800, size: 24 [D 20:42:28.104675] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 17/70. [D 20:42:28.172598] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2945 [D 20:42:28.172616] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 18/70. [D 20:42:28.172674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5806. [D 20:42:28.172745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5807. [D 20:42:28.172755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5808. [D 20:42:28.172766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5809. [D 20:42:28.172777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5810. [D 20:42:28.172787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5811. [D 20:42:28.172796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5812. [D 20:42:28.172807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5813. [D 20:42:28.172817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5814. [D 20:42:28.172827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5815. [D 20:42:28.172837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5816. [D 20:42:28.172899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5817. [D 20:42:28.172910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5818. [D 20:42:28.172931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5819. [D 20:42:28.172945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5820. [D 20:42:28.172955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5821. [D 20:42:28.172965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5822. [D 20:42:28.172979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5823. [D 20:42:28.172989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5824. [D 20:42:28.172999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5825. [D 20:42:28.173024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5826. [D 20:42:28.173034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5827. [D 20:42:28.173044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5828. [D 20:42:28.173054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5829. [D 20:42:28.173064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5830. [D 20:42:28.173075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5831. [D 20:42:28.173099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5832. [D 20:42:28.173110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5833. [D 20:42:28.173119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5834. [D 20:42:28.173130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5835. [D 20:42:28.173146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5836. [D 20:42:28.173165] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5837. [D 20:42:28.178600] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 5837. [D 20:42:28.178616] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 19/70. [D 20:42:28.181004] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.181020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.181030] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.186005] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.186020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.186030] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.186064] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2954 [D 20:42:28.186075] element 0: offset: 0x654770, size: 24 [D 20:42:28.186087] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 20/70. [D 20:42:28.242498] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2954 [D 20:42:28.242516] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 21/70. [D 20:42:28.242577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5837. [D 20:42:28.242658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5838. [D 20:42:28.242670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5839. [D 20:42:28.242683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5840. [D 20:42:28.242693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5841. [D 20:42:28.242704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5842. [D 20:42:28.242714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5843. [D 20:42:28.242724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5844. [D 20:42:28.242734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5845. [D 20:42:28.242745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5846. [D 20:42:28.242755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5847. [D 20:42:28.242765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5848. [D 20:42:28.242775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5849. [D 20:42:28.242794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5850. [D 20:42:28.242804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5851. [D 20:42:28.242814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5852. [D 20:42:28.242867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5853. [D 20:42:28.242878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5854. [D 20:42:28.242888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5855. [D 20:42:28.242898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5856. [D 20:42:28.242909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5857. [D 20:42:28.242919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5858. [D 20:42:28.242928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5859. [D 20:42:28.242938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5860. [D 20:42:28.242957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5861. [D 20:42:28.242967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5862. [D 20:42:28.242987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5863. [D 20:42:28.243001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5864. [D 20:42:28.243011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5865. [D 20:42:28.243021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5866. [D 20:42:28.243036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5867. [D 20:42:28.243046] openib_post_sr_rdmaw: ibv_post_send wr_id 63d880 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5868. [D 20:42:28.248591] openib_check_cq: completed rdma wr_id 63d880, nic_wr_credit 5868. [D 20:42:28.248609] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 22/70. [D 20:42:28.250817] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.250832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.250842] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.255649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.255663] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.255674] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.255706] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2957 [D 20:42:28.255717] element 0: offset: 0x63fd80, size: 24 [D 20:42:28.255729] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 23/70. [D 20:42:28.320791] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2948 [D 20:42:28.320810] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 24/70. [D 20:42:28.320869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 5868. [D 20:42:28.320938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5869. [D 20:42:28.320958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5870. [D 20:42:28.320972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5871. [D 20:42:28.320982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5872. [D 20:42:28.320993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5873. [D 20:42:28.321004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5874. [D 20:42:28.321014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5875. [D 20:42:28.321024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5876. [D 20:42:28.321034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5877. [D 20:42:28.321086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5878. [D 20:42:28.321097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5879. [D 20:42:28.321108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5880. [D 20:42:28.321129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5881. [D 20:42:28.321139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5882. [D 20:42:28.321149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5883. [D 20:42:28.321165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5884. [D 20:42:28.321191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5885. [D 20:42:28.321202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5886. [D 20:42:28.321213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5887. [D 20:42:28.321222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5888. [D 20:42:28.321233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5889. [D 20:42:28.321243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5890. [D 20:42:28.321253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5891. [D 20:42:28.321280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5892. [D 20:42:28.321290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5893. [D 20:42:28.321300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5894. [D 20:42:28.321323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5895. [D 20:42:28.321333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5896. [D 20:42:28.321343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5897. [D 20:42:28.321354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5898. [D 20:42:28.321364] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5899. [D 20:42:28.326837] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5899. [D 20:42:28.326854] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 25/70. [D 20:42:28.329042] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.329057] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.329068] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.335058] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.335073] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.335084] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.335117] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2960 [D 20:42:28.335127] element 0: offset: 0x61f310, size: 24 [D 20:42:28.335139] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 26/70. [D 20:42:28.391141] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2932 [D 20:42:28.391160] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 27/70. [D 20:42:28.391222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5899. [D 20:42:28.391299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5900. [D 20:42:28.391310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5901. [D 20:42:28.391321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5902. [D 20:42:28.391332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5903. [D 20:42:28.391342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5904. [D 20:42:28.391358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5905. [D 20:42:28.391368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5906. [D 20:42:28.391378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5907. [D 20:42:28.391393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5908. [D 20:42:28.391443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 5909. [D 20:42:28.391455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 5910. [D 20:42:28.391465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 5911. [D 20:42:28.391491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 5912. [D 20:42:28.391501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 5913. [D 20:42:28.391512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5914. [D 20:42:28.391522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5915. [D 20:42:28.391532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5916. [D 20:42:28.391543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5917. [D 20:42:28.391571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5918. [D 20:42:28.391586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5919. [D 20:42:28.391595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5920. [D 20:42:28.391605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5921. [D 20:42:28.391619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5922. [D 20:42:28.391636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5923. [D 20:42:28.391647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5924. [D 20:42:28.391694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5925. [D 20:42:28.391708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5926. [D 20:42:28.391719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5927. [D 20:42:28.391729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5928. [D 20:42:28.391739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5929. [D 20:42:28.391749] openib_post_sr_rdmaw: ibv_post_send wr_id 63d880 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5930. [D 20:42:28.397164] openib_check_cq: completed rdma wr_id 63d880, nic_wr_credit 5930. [D 20:42:28.397181] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 28/70. [D 20:42:28.399496] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.399511] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.399521] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.403644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.403662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.403673] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.403708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2962 [D 20:42:28.403718] element 0: offset: 0x64da00, size: 24 [D 20:42:28.403731] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 29/70. [D 20:42:28.463705] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2951 [D 20:42:28.463723] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 30/70. [D 20:42:28.463782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5930. [D 20:42:28.463849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5931. [D 20:42:28.463869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5932. [D 20:42:28.463879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5933. [D 20:42:28.463890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5934. [D 20:42:28.463900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5935. [D 20:42:28.463916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5936. [D 20:42:28.463925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5937. [D 20:42:28.463935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5938. [D 20:42:28.463950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5939. [D 20:42:28.463960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5940. [D 20:42:28.463970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5941. [D 20:42:28.463980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5942. [D 20:42:28.463990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5943. [D 20:42:28.464000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5944. [D 20:42:28.464010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5945. [D 20:42:28.464020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5946. [D 20:42:28.464073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5947. [D 20:42:28.464084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5948. [D 20:42:28.464094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5949. [D 20:42:28.464117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5950. [D 20:42:28.464127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5951. [D 20:42:28.464137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5952. [D 20:42:28.464151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5953. [D 20:42:28.464161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5954. [D 20:42:28.464171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5955. [D 20:42:28.464195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5956. [D 20:42:28.464205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5957. [D 20:42:28.464215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5958. [D 20:42:28.464225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5959. [D 20:42:28.464235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5960. [D 20:42:28.464245] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5961. [D 20:42:28.469704] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 5961. [D 20:42:28.469720] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 31/70. [D 20:42:28.472016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.472031] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.472041] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.524015] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2957 [D 20:42:28.524033] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 32/70. [D 20:42:28.524093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5961. [D 20:42:28.524162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5962. [D 20:42:28.524182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5963. [D 20:42:28.524192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5964. [D 20:42:28.524203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5965. [D 20:42:28.524213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5966. [D 20:42:28.524227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5967. [D 20:42:28.524237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5968. [D 20:42:28.524247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5969. [D 20:42:28.524263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5970. [D 20:42:28.524314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5971. [D 20:42:28.524325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5972. [D 20:42:28.524352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5973. [D 20:42:28.524363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5974. [D 20:42:28.524372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5975. [D 20:42:28.524383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5976. [D 20:42:28.524408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5977. [D 20:42:28.524418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5978. [D 20:42:28.524431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5979. [D 20:42:28.524441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5980. [D 20:42:28.524451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5981. [D 20:42:28.524466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5982. [D 20:42:28.524476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5983. [D 20:42:28.524486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5984. [D 20:42:28.524496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5985. [D 20:42:28.524514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5986. [D 20:42:28.524524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5987. [D 20:42:28.524551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5988. [D 20:42:28.524561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5989. [D 20:42:28.524571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5990. [D 20:42:28.524581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5991. [D 20:42:28.524591] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5992. [D 20:42:28.530018] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 5992. [D 20:42:28.530034] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 33/70. [D 20:42:28.532358] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.532374] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.532385] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:28.537804] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.537824] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.537833] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:28.537868] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2966 [D 20:42:28.537879] element 0: offset: 0x627dd0, size: 24 [D 20:42:28.537892] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 34/70. [D 20:42:28.606133] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.606197] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.606207] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.606245] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2969 [D 20:42:28.606256] element 0: offset: 0x67efc0, size: 24 [D 20:42:28.606272] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 35/70. [D 20:42:28.621430] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2962 [D 20:42:28.621450] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 36/70. [D 20:42:28.621507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5992. [D 20:42:28.621572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5993. [D 20:42:28.621624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5994. [D 20:42:28.621634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5995. [D 20:42:28.621645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5996. [D 20:42:28.621656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5997. [D 20:42:28.621666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5998. [D 20:42:28.621676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5999. [D 20:42:28.621700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6000. [D 20:42:28.621710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6001. [D 20:42:28.621720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 6002. [D 20:42:28.621748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 6003. [D 20:42:28.621758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 6004. [D 20:42:28.621783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 6005. [D 20:42:28.621794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 6006. [D 20:42:28.621806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6007. [D 20:42:28.621830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6008. [D 20:42:28.621842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6009. [D 20:42:28.621852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6010. [D 20:42:28.621876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6011. [D 20:42:28.621886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6012. [D 20:42:28.621907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6013. [D 20:42:28.621917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6014. [D 20:42:28.621927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6015. [D 20:42:28.621954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6016. [D 20:42:28.621964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6017. [D 20:42:28.621974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6018. [D 20:42:28.621995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6019. [D 20:42:28.622005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6020. [D 20:42:28.622015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6021. [D 20:42:28.622030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6022. [D 20:42:28.622041] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6023. [D 20:42:28.627473] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 6023. [D 20:42:28.627491] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 37/70. [D 20:42:28.629789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.629804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.629815] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.635347] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.635361] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.635371] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.635403] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2971 [D 20:42:28.635414] element 0: offset: 0x654770, size: 24 [D 20:42:28.635426] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 38/70. [D 20:42:28.640400] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2960 [D 20:42:28.640419] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 39/70. [D 20:42:28.640580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 6023. [D 20:42:28.640634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 6024. [D 20:42:28.640645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 6025. [D 20:42:28.640656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 6026. [D 20:42:28.640666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 6027. [D 20:42:28.640677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 6028. [D 20:42:28.640687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 6029. [D 20:42:28.640697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 6030. [D 20:42:28.640707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 6031. [D 20:42:28.640716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 6032. [D 20:42:28.640726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 6033. [D 20:42:28.640758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 6034. [D 20:42:28.640768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 6035. [D 20:42:28.640780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 6036. [D 20:42:28.640802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 6037. [D 20:42:28.640813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 6038. [D 20:42:28.640823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 6039. [D 20:42:28.640844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 6040. [D 20:42:28.640854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 6041. [D 20:42:28.640864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 6042. [D 20:42:28.640892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 6043. [D 20:42:28.640902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 6044. [D 20:42:28.640916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 6045. [D 20:42:28.640927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 6046. [D 20:42:28.640936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 6047. [D 20:42:28.640963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 6048. [D 20:42:28.640973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 6049. [D 20:42:28.640987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 6050. [D 20:42:28.640996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 6051. [D 20:42:28.641019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 6052. [D 20:42:28.641029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 6053. [D 20:42:28.641049] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 6054. [D 20:42:28.648544] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6054. [D 20:42:28.648563] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 40/70. [D 20:42:28.650976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.650992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.651002] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.655668] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.655687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.655698] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.655732] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2975 [D 20:42:28.655743] element 0: offset: 0x5b0030, size: 24 [D 20:42:28.655757] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 41/70. [D 20:42:28.685283] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2971 [D 20:42:28.685302] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 42/70. [D 20:42:28.685361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6054. [D 20:42:28.685458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6055. [D 20:42:28.685472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 6056. [D 20:42:28.685484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 6057. [D 20:42:28.685494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 6058. [D 20:42:28.685505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 6059. [D 20:42:28.685516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 6060. [D 20:42:28.685526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6061. [D 20:42:28.685562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6062. [D 20:42:28.685573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6063. [D 20:42:28.685595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 6064. [D 20:42:28.685606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 6065. [D 20:42:28.685617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 6066. [D 20:42:28.685644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 6067. [D 20:42:28.685655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 6068. [D 20:42:28.685675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6069. [D 20:42:28.685690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6070. [D 20:42:28.685712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6071. [D 20:42:28.685723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6072. [D 20:42:28.685733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6073. [D 20:42:28.685752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6074. [D 20:42:28.685767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6075. [D 20:42:28.685788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6076. [D 20:42:28.685803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6077. [D 20:42:28.685825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6078. [D 20:42:28.685838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6079. [D 20:42:28.685861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6080. [D 20:42:28.685873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6081. [D 20:42:28.685883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6082. [D 20:42:28.685908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6083. [D 20:42:28.685917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6084. [D 20:42:28.685942] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6085. [D 20:42:28.691313] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 6085. [D 20:42:28.691330] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 43/70. [D 20:42:28.693538] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.693553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.693563] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.699125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.699140] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.699150] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.699182] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2977 [D 20:42:28.699193] element 0: offset: 0x61f7d0, size: 24 [D 20:42:28.699205] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 44/70. [D 20:42:28.734572] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2966 [D 20:42:28.734591] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 45/70. [D 20:42:28.734657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6085. [D 20:42:28.734735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6086. [D 20:42:28.734746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6087. [D 20:42:28.734756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6088. [D 20:42:28.734767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6089. [D 20:42:28.734777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6090. [D 20:42:28.734793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6091. [D 20:42:28.734803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6092. [D 20:42:28.734813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6093. [D 20:42:28.734866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6094. [D 20:42:28.734877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6095. [D 20:42:28.734890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6096. [D 20:42:28.734916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6097. [D 20:42:28.734927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6098. [D 20:42:28.734936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6099. [D 20:42:28.734967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6100. [D 20:42:28.734984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6101. [D 20:42:28.734994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6102. [D 20:42:28.735004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6103. [D 20:42:28.735020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6104. [D 20:42:28.735030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6105. [D 20:42:28.735040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6106. [D 20:42:28.735050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6107. [D 20:42:28.735061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6108. [D 20:42:28.735071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6109. [D 20:42:28.735097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6110. [D 20:42:28.735113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6111. [D 20:42:28.735124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6112. [D 20:42:28.735133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6113. [D 20:42:28.735148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6114. [D 20:42:28.735158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6115. [D 20:42:28.735168] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6116. [D 20:42:28.740590] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 6116. [D 20:42:28.740607] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 46/70. [D 20:42:28.742815] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.742830] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.742841] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.748440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.748457] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.748467] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.748501] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2981 [D 20:42:28.748512] element 0: offset: 0x62a370, size: 24 [D 20:42:28.748526] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 47/70. [D 20:42:28.786442] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2975 [D 20:42:28.786460] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 48/70. [D 20:42:28.786528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 6116. [D 20:42:28.786607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 6117. [D 20:42:28.786618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 6118. [D 20:42:28.786629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 6119. [D 20:42:28.786640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 6120. [D 20:42:28.786650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 6121. [D 20:42:28.786664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 6122. [D 20:42:28.786674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 6123. [D 20:42:28.786684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 6124. [D 20:42:28.786699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 6125. [D 20:42:28.786750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 6126. [D 20:42:28.786763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 6127. [D 20:42:28.786773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 6128. [D 20:42:28.786783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 6129. [D 20:42:28.786799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 6130. [D 20:42:28.786809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 6131. [D 20:42:28.786819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 6132. [D 20:42:28.786829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 6133. [D 20:42:28.786840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 6134. [D 20:42:28.786852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 6135. [D 20:42:28.786862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 6136. [D 20:42:28.786872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 6137. [D 20:42:28.786883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 6138. [D 20:42:28.786893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 6139. [D 20:42:28.786903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 6140. [D 20:42:28.786913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 6141. [D 20:42:28.786941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 6142. [D 20:42:28.786952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 6143. [D 20:42:28.786962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 6144. [D 20:42:28.786972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 6145. [D 20:42:28.786982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 6146. [D 20:42:28.786993] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 6147. [D 20:42:28.792465] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6147. [D 20:42:28.792484] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 49/70. [D 20:42:28.794690] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.794705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.794715] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.859158] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2977 [D 20:42:28.859176] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 50/70. [D 20:42:28.859239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6147. [D 20:42:28.859312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6148. [D 20:42:28.859324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 6149. [D 20:42:28.859335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 6150. [D 20:42:28.859345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 6151. [D 20:42:28.859355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 6152. [D 20:42:28.859371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 6153. [D 20:42:28.859381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6154. [D 20:42:28.859391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6155. [D 20:42:28.859407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6156. [D 20:42:28.859456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 6157. [D 20:42:28.859469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 6158. [D 20:42:28.859494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 6159. [D 20:42:28.859504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 6160. [D 20:42:28.859514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 6161. [D 20:42:28.859525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6162. [D 20:42:28.859549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6163. [D 20:42:28.859559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6164. [D 20:42:28.859573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6165. [D 20:42:28.859583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6166. [D 20:42:28.859593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6167. [D 20:42:28.859608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6168. [D 20:42:28.859618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6169. [D 20:42:28.859628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6170. [D 20:42:28.859638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6171. [D 20:42:28.859656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6172. [D 20:42:28.859678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6173. [D 20:42:28.859688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6174. [D 20:42:28.859698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6175. [D 20:42:28.859708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6176. [D 20:42:28.859725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6177. [D 20:42:28.859737] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6178. [D 20:42:28.865171] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6178. [D 20:42:28.865188] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 51/70. [D 20:42:28.867499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.867514] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.867524] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:28.871688] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.871703] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.871714] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:28.871748] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2983 [D 20:42:28.871759] element 0: offset: 0x691fe0, size: 24 [D 20:42:28.871773] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 52/70. [D 20:42:28.931547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.931612] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.931622] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.931659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2987 [D 20:42:28.931676] element 0: offset: 0x61f310, size: 24 [D 20:42:28.931691] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 53/70. [D 20:42:28.946372] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2981 [D 20:42:28.946391] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 54/70. [D 20:42:28.946448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6178. [D 20:42:28.946497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6179. [D 20:42:28.946509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6180. [D 20:42:28.946519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6181. [D 20:42:28.946545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6182. [D 20:42:28.946554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6183. [D 20:42:28.946565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6184. [D 20:42:28.946576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6185. [D 20:42:28.946586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6186. [D 20:42:28.946596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6187. [D 20:42:28.946633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6188. [D 20:42:28.946645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6189. [D 20:42:28.946655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6190. [D 20:42:28.946670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6191. [D 20:42:28.946681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6192. [D 20:42:28.946709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6193. [D 20:42:28.946719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6194. [D 20:42:28.946729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6195. [D 20:42:28.946753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6196. [D 20:42:28.946763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6197. [D 20:42:28.946773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6198. [D 20:42:28.946787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6199. [D 20:42:28.946797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6200. [D 20:42:28.946807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6201. [D 20:42:28.946823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6202. [D 20:42:28.946844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6203. [D 20:42:28.946855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6204. [D 20:42:28.946866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6205. [D 20:42:28.946876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6206. [D 20:42:28.946900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6207. [D 20:42:28.946910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6208. [D 20:42:28.946920] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6209. [D 20:42:28.952425] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6209. [D 20:42:28.952441] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 55/70. [D 20:42:28.954746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.954761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.954771] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.960350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.960365] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.960376] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.960405] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2990 [D 20:42:28.960416] element 0: offset: 0x649100, size: 24 [D 20:42:28.960427] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 56/70. [D 20:42:28.997492] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2990 [D 20:42:28.997510] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 57/70. [D 20:42:28.997572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6209. [D 20:42:28.997652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6210. [D 20:42:28.997664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6211. [D 20:42:28.997677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6212. [D 20:42:28.997688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6213. [D 20:42:28.997698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6214. [D 20:42:28.997708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6215. [D 20:42:28.997718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6216. [D 20:42:28.997734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6217. [D 20:42:28.997744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6218. [D 20:42:28.997754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6219. [D 20:42:28.997764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6220. [D 20:42:28.997774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6221. [D 20:42:28.997793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6222. [D 20:42:28.997803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6223. [D 20:42:28.997813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6224. [D 20:42:28.997823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6225. [D 20:42:28.997833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6226. [D 20:42:28.997844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6227. [D 20:42:28.997854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6228. [D 20:42:28.997864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6229. [D 20:42:28.997874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6230. [D 20:42:28.997884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6231. [D 20:42:28.997894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6232. [D 20:42:28.997904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6233. [D 20:42:28.997959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6234. [D 20:42:28.997969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6235. [D 20:42:28.997979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6236. [D 20:42:28.998004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6237. [D 20:42:28.998014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6238. [D 20:42:28.998025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6239. [D 20:42:28.998035] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6240. [D 20:42:29.003579] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6240. [D 20:42:29.003597] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 58/70. [D 20:42:29.005918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.005933] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.005944] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.027888] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2969 [D 20:42:29.027906] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 59/70. [D 20:42:29.027963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 6240. [D 20:42:29.028028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 6241. [D 20:42:29.028080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 6242. [D 20:42:29.028092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 6243. [D 20:42:29.028103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 6244. [D 20:42:29.028113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 6245. [D 20:42:29.028124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 6246. [D 20:42:29.028134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 6247. [D 20:42:29.028145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 6248. [D 20:42:29.028154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 6249. [D 20:42:29.028165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 6250. [D 20:42:29.028174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 6251. [D 20:42:29.028206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 6252. [D 20:42:29.028217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 6253. [D 20:42:29.028228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 6254. [D 20:42:29.028238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 6255. [D 20:42:29.028248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 6256. [D 20:42:29.028274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 6257. [D 20:42:29.028284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 6258. [D 20:42:29.028299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 6259. [D 20:42:29.028309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 6260. [D 20:42:29.028319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 6261. [D 20:42:29.028337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 6262. [D 20:42:29.028347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 6263. [D 20:42:29.028357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 6264. [D 20:42:29.028367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 6265. [D 20:42:29.028384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 6266. [D 20:42:29.028405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 6267. [D 20:42:29.028415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 6268. [D 20:42:29.028426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 6269. [D 20:42:29.028436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 6270. [D 20:42:29.028446] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 6271. [D 20:42:29.033891] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6271. [D 20:42:29.033908] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 60/70. [D 20:42:29.035720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.035735] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.035746] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:29.042234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.042249] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.042260] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:29.042293] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2993 [D 20:42:29.042304] element 0: offset: 0x61f7d0, size: 24 [D 20:42:29.042319] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 0/70. [D 20:42:29.089182] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2993 [D 20:42:29.089200] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 1/70. [D 20:42:29.089267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6271. [D 20:42:29.089344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6272. [D 20:42:29.089355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6273. [D 20:42:29.089366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6274. [D 20:42:29.089377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6275. [D 20:42:29.089387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6276. [D 20:42:29.089403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6277. [D 20:42:29.089413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6278. [D 20:42:29.089422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6279. [D 20:42:29.089439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6280. [D 20:42:29.089490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6281. [D 20:42:29.089502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6282. [D 20:42:29.089529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6283. [D 20:42:29.089539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6284. [D 20:42:29.089549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6285. [D 20:42:29.089559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6286. [D 20:42:29.089583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6287. [D 20:42:29.089593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6288. [D 20:42:29.089603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6289. [D 20:42:29.089613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6290. [D 20:42:29.089624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6291. [D 20:42:29.089634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6292. [D 20:42:29.089644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6293. [D 20:42:29.089654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6294. [D 20:42:29.089664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6295. [D 20:42:29.089683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6296. [D 20:42:29.089693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6297. [D 20:42:29.089719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6298. [D 20:42:29.089730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6299. [D 20:42:29.089740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6300. [D 20:42:29.089756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6301. [D 20:42:29.089766] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6302. [D 20:42:29.095205] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6302. [D 20:42:29.095222] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 2/70. [D 20:42:29.097388] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.097404] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.097414] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:29.103700] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.103715] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.103725] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:29.103759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2996 [D 20:42:29.103783] element 0: offset: 0x63e800, size: 24 [D 20:42:29.104047] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 3/70. [D 20:42:29.142039] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.142104] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.142114] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.142152] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2999 [D 20:42:29.142165] element 0: offset: 0x66e790, size: 24 [D 20:42:29.142179] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 4/70. [D 20:42:29.151309] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2987 [D 20:42:29.151328] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 5/70. [D 20:42:29.151464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6302. [D 20:42:29.151494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 6303. [D 20:42:29.151506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 6304. [D 20:42:29.151516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 6305. [D 20:42:29.151527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 6306. [D 20:42:29.151537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 6307. [D 20:42:29.151547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6308. [D 20:42:29.151562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6309. [D 20:42:29.151573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6310. [D 20:42:29.151582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 6311. [D 20:42:29.151593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 6312. [D 20:42:29.151608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 6313. [D 20:42:29.151639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 6314. [D 20:42:29.151649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 6315. [D 20:42:29.151659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6316. [D 20:42:29.151685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6317. [D 20:42:29.151729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6318. [D 20:42:29.151755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6319. [D 20:42:29.151768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6320. [D 20:42:29.151778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6321. [D 20:42:29.151789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6322. [D 20:42:29.151799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6323. [D 20:42:29.151808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6324. [D 20:42:29.151818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6325. [D 20:42:29.151842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6326. [D 20:42:29.151853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6327. [D 20:42:29.151868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6328. [D 20:42:29.151879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6329. [D 20:42:29.151900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6330. [D 20:42:29.151910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6331. [D 20:42:29.151920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6332. [D 20:42:29.151930] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6333. [D 20:42:29.158656] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 6333. [D 20:42:29.158672] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 6/70. [D 20:42:29.160949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.160963] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.160973] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.166445] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.166459] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.166470] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.166493] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3002 [D 20:42:29.166503] element 0: offset: 0x62a370, size: 24 [D 20:42:29.166514] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 7/70. [D 20:42:29.247680] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2996 [D 20:42:29.247702] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 8/70. [D 20:42:29.247856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6333. [D 20:42:29.247923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6334. [D 20:42:29.247935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6335. [D 20:42:29.247945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6336. [D 20:42:29.247960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6337. [D 20:42:29.247970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6338. [D 20:42:29.247979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6339. [D 20:42:29.247994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6340. [D 20:42:29.248004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6341. [D 20:42:29.248014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6342. [D 20:42:29.248054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6343. [D 20:42:29.248065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6344. [D 20:42:29.248075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6345. [D 20:42:29.248085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6346. [D 20:42:29.248122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6347. [D 20:42:29.248135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6348. [D 20:42:29.248145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6349. [D 20:42:29.248155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6350. [D 20:42:29.248165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6351. [D 20:42:29.248175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6352. [D 20:42:29.248185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6353. [D 20:42:29.248200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6354. [D 20:42:29.248211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6355. [D 20:42:29.248221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6356. [D 20:42:29.248231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6357. [D 20:42:29.248241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6358. [D 20:42:29.248266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6359. [D 20:42:29.248277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6360. [D 20:42:29.248290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6361. [D 20:42:29.248300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6362. [D 20:42:29.248310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6363. [D 20:42:29.248339] openib_post_sr_rdmaw: ibv_post_send wr_id 66e540 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6364. [D 20:42:29.253776] openib_check_cq: completed rdma wr_id 66e540, nic_wr_credit 6364. [D 20:42:29.253793] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 9/70. [D 20:42:29.256110] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.256125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.256135] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.262633] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.262647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.262658] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.262690] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3005 [D 20:42:29.262701] element 0: offset: 0x649100, size: 24 [D 20:42:29.262713] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 10/70. [D 20:42:29.287635] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2983 [D 20:42:29.287654] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 11/70. [D 20:42:29.287716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 6364. [D 20:42:29.287785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 6365. [D 20:42:29.287804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 6366. [D 20:42:29.287815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 6367. [D 20:42:29.287826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 6368. [D 20:42:29.287836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 6369. [D 20:42:29.287851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 6370. [D 20:42:29.287861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6371. [D 20:42:29.287871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6372. [D 20:42:29.287887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6373. [D 20:42:29.287938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 6374. [D 20:42:29.287949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 6375. [D 20:42:29.287976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 6376. [D 20:42:29.287986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 6377. [D 20:42:29.287996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 6378. [D 20:42:29.288028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6379. [D 20:42:29.288039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6380. [D 20:42:29.288050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6381. [D 20:42:29.288060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 6382. [D 20:42:29.288071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 6383. [D 20:42:29.288082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 6384. [D 20:42:29.288103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 6385. [D 20:42:29.288118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 6386. [D 20:42:29.288128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6387. [D 20:42:29.288138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6388. [D 20:42:29.288148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6389. [D 20:42:29.288165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 6390. [D 20:42:29.288175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 6391. [D 20:42:29.288185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 6392. [D 20:42:29.288195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 6393. [D 20:42:29.288206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 6394. [D 20:42:29.288216] openib_post_sr_rdmaw: ibv_post_send wr_id 643340 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6395. [D 20:42:29.293644] openib_check_cq: completed rdma wr_id 643340, nic_wr_credit 6395. [D 20:42:29.293662] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 12/70. [D 20:42:29.295776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.295792] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.295802] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.301644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.301659] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.301669] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.301701] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3007 [D 20:42:29.301712] element 0: offset: 0x67efc0, size: 24 [D 20:42:29.301724] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 13/70. [D 20:42:29.437930] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3007 [D 20:42:29.437948] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 14/70. [D 20:42:29.438067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 6395. [D 20:42:29.438171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 6396. [D 20:42:29.438182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 6397. [D 20:42:29.438193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 6398. [D 20:42:29.438208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 6399. [D 20:42:29.438218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 6400. [D 20:42:29.438227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 6401. [D 20:42:29.438242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6402. [D 20:42:29.438252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6403. [D 20:42:29.438262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6404. [D 20:42:29.438294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 6405. [D 20:42:29.438305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 6406. [D 20:42:29.438327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 6407. [D 20:42:29.438341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 6408. [D 20:42:29.438360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 6409. [D 20:42:29.438371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6410. [D 20:42:29.438381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6411. [D 20:42:29.438391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6412. [D 20:42:29.438401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 6413. [D 20:42:29.438412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 6414. [D 20:42:29.438421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 6415. [D 20:42:29.438431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 6416. [D 20:42:29.438441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 6417. [D 20:42:29.438451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6418. [D 20:42:29.438462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6419. [D 20:42:29.438472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6420. [D 20:42:29.438482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 6421. [D 20:42:29.438502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 6422. [D 20:42:29.438520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 6423. [D 20:42:29.438530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 6424. [D 20:42:29.438552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 6425. [D 20:42:29.438562] openib_post_sr_rdmaw: ibv_post_send wr_id 643340 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6426. [D 20:42:29.444094] openib_check_cq: completed rdma wr_id 643340, nic_wr_credit 6426. [D 20:42:29.444112] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 15/70. [D 20:42:29.446417] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.446431] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.446441] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.451724] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.451738] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.451749] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.451781] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3010 [D 20:42:29.451792] element 0: offset: 0x61f7d0, size: 24 [D 20:42:29.451804] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 16/70. [D 20:42:29.546988] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3002 [D 20:42:29.547006] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 17/70. [D 20:42:29.547113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6426. [D 20:42:29.547223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 6427. [D 20:42:29.547235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 6428. [D 20:42:29.547246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 6429. [D 20:42:29.547260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 6430. [D 20:42:29.547270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 6431. [D 20:42:29.547280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6432. [D 20:42:29.547295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6433. [D 20:42:29.547305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6434. [D 20:42:29.547315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 6435. [D 20:42:29.547344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 6436. [D 20:42:29.547355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 6437. [D 20:42:29.547382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 6438. [D 20:42:29.547393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 6439. [D 20:42:29.547403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6440. [D 20:42:29.547430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6441. [D 20:42:29.547441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6442. [D 20:42:29.547462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6443. [D 20:42:29.547472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6444. [D 20:42:29.547483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6445. [D 20:42:29.547510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6446. [D 20:42:29.547521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6447. [D 20:42:29.547533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6448. [D 20:42:29.547552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6449. [D 20:42:29.547563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6450. [D 20:42:29.547573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6451. [D 20:42:29.547598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6452. [D 20:42:29.547609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6453. [D 20:42:29.547629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6454. [D 20:42:29.547643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6455. [D 20:42:29.547662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6456. [D 20:42:29.547673] openib_post_sr_rdmaw: ibv_post_send wr_id 6433c0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6457. [D 20:42:29.553084] openib_check_cq: completed rdma wr_id 6433c0, nic_wr_credit 6457. [D 20:42:29.553101] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 18/70. [D 20:42:29.555422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.555437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.555448] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.560842] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.560856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.560867] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.560899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3014 [D 20:42:29.560910] element 0: offset: 0x62a220, size: 24 [D 20:42:29.560922] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 19/70. [D 20:42:29.606400] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3005 [D 20:42:29.606419] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 20/70. [D 20:42:29.606482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6457. [D 20:42:29.606549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6458. [D 20:42:29.606570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6459. [D 20:42:29.606580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6460. [D 20:42:29.606591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6461. [D 20:42:29.606601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6462. [D 20:42:29.606615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6463. [D 20:42:29.606625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6464. [D 20:42:29.606634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6465. [D 20:42:29.606651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6466. [D 20:42:29.606664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6467. [D 20:42:29.606674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6468. [D 20:42:29.606684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6469. [D 20:42:29.606700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6470. [D 20:42:29.606710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6471. [D 20:42:29.606720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6472. [D 20:42:29.606770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6473. [D 20:42:29.606781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6474. [D 20:42:29.606791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6475. [D 20:42:29.606801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6476. [D 20:42:29.606825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6477. [D 20:42:29.606836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6478. [D 20:42:29.606847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6479. [D 20:42:29.606856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6480. [D 20:42:29.606867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6481. [D 20:42:29.606877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6482. [D 20:42:29.606887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6483. [D 20:42:29.606912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6484. [D 20:42:29.606929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6485. [D 20:42:29.606939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6486. [D 20:42:29.606949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6487. [D 20:42:29.606959] openib_post_sr_rdmaw: ibv_post_send wr_id 66e540 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6488. [D 20:42:29.612455] openib_check_cq: completed rdma wr_id 66e540, nic_wr_credit 6488. [D 20:42:29.612471] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 21/70. [D 20:42:29.614631] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.614646] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.614658] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.619747] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.619762] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.619772] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.619805] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3017 [D 20:42:29.619816] element 0: offset: 0x654830, size: 24 [D 20:42:29.621219] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 22/70. [D 20:42:29.687355] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3010 [D 20:42:29.687373] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 23/70. [D 20:42:29.687429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 6488. [D 20:42:29.687497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 6489. [D 20:42:29.687517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 6490. [D 20:42:29.687528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 6491. [D 20:42:29.687539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 6492. [D 20:42:29.687549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 6493. [D 20:42:29.687562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 6494. [D 20:42:29.687572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6495. [D 20:42:29.687582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6496. [D 20:42:29.687599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6497. [D 20:42:29.687647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 6498. [D 20:42:29.687660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 6499. [D 20:42:29.687670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 6500. [D 20:42:29.687695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 6501. [D 20:42:29.687705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 6502. [D 20:42:29.687715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6503. [D 20:42:29.687726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6504. [D 20:42:29.687735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6505. [D 20:42:29.687766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 6506. [D 20:42:29.687776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 6507. [D 20:42:29.687787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 6508. [D 20:42:29.687797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 6509. [D 20:42:29.687807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 6510. [D 20:42:29.687818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6511. [D 20:42:29.687828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6512. [D 20:42:29.687852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6513. [D 20:42:29.687866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 6514. [D 20:42:29.687876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 6515. [D 20:42:29.687899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 6516. [D 20:42:29.687909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 6517. [D 20:42:29.687919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 6518. [D 20:42:29.687934] openib_post_sr_rdmaw: ibv_post_send wr_id 657130 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6519. [D 20:42:29.693353] openib_check_cq: completed rdma wr_id 657130, nic_wr_credit 6519. [D 20:42:29.693369] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 24/70. [D 20:42:29.695541] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.695556] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.695566] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.701222] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.701237] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.701247] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.701281] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3019 [D 20:42:29.701292] element 0: offset: 0x627f50, size: 24 [D 20:42:29.701306] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 25/70. [D 20:42:29.777557] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3017 [D 20:42:29.777576] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 26/70. [D 20:42:29.777665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6519. [D 20:42:29.777740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6520. [D 20:42:29.777752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6521. [D 20:42:29.777762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6522. [D 20:42:29.777777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6523. [D 20:42:29.777786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6524. [D 20:42:29.777797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6525. [D 20:42:29.777810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6526. [D 20:42:29.777820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6527. [D 20:42:29.777829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6528. [D 20:42:29.777869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6529. [D 20:42:29.777880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6530. [D 20:42:29.777890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6531. [D 20:42:29.777900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6532. [D 20:42:29.777933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6533. [D 20:42:29.777944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6534. [D 20:42:29.777955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6535. [D 20:42:29.777964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6536. [D 20:42:29.777975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6537. [D 20:42:29.777986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6538. [D 20:42:29.778010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6539. [D 20:42:29.778021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6540. [D 20:42:29.778031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6541. [D 20:42:29.778041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6542. [D 20:42:29.778056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6543. [D 20:42:29.778076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6544. [D 20:42:29.778087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6545. [D 20:42:29.778097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6546. [D 20:42:29.778107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6547. [D 20:42:29.778118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6548. [D 20:42:29.778142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6549. [D 20:42:29.778158] openib_post_sr_rdmaw: ibv_post_send wr_id 657260 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6550. [D 20:42:29.783634] openib_check_cq: completed rdma wr_id 657260, nic_wr_credit 6550. [D 20:42:29.783650] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 27/70. [D 20:42:29.785998] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.786013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.786023] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.791773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.791789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.791800] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.791833] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3023 [D 20:42:29.791844] element 0: offset: 0x627dd0, size: 24 [D 20:42:29.791856] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 28/70. [D 20:42:29.845048] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3014 [D 20:42:29.845067] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 29/70. [D 20:42:29.845127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6550. [D 20:42:29.845208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 6551. [D 20:42:29.845219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 6552. [D 20:42:29.845229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 6553. [D 20:42:29.845240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 6554. [D 20:42:29.845250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 6555. [D 20:42:29.845267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6556. [D 20:42:29.845276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6557. [D 20:42:29.845286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6558. [D 20:42:29.845302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 6559. [D 20:42:29.845355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 6560. [D 20:42:29.845365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 6561. [D 20:42:29.845376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 6562. [D 20:42:29.845401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 6563. [D 20:42:29.845411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6564. [D 20:42:29.845425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6565. [D 20:42:29.845435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6566. [D 20:42:29.845445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6567. [D 20:42:29.845474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6568. [D 20:42:29.845485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6569. [D 20:42:29.845496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6570. [D 20:42:29.845505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6571. [D 20:42:29.845516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6572. [D 20:42:29.845527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6573. [D 20:42:29.845553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6574. [D 20:42:29.845568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6575. [D 20:42:29.845578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6576. [D 20:42:29.845588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6577. [D 20:42:29.845604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6578. [D 20:42:29.845631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6579. [D 20:42:29.845646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6580. [D 20:42:29.845656] openib_post_sr_rdmaw: ibv_post_send wr_id 657260 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6581. [D 20:42:29.851064] openib_check_cq: completed rdma wr_id 657260, nic_wr_credit 6581. [D 20:42:29.851081] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 30/70. [D 20:42:29.853273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.853289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.853300] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.858894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.858946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.858955] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.858993] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3026 [D 20:42:29.859005] element 0: offset: 0x67efc0, size: 24 [D 20:42:29.859018] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 31/70. [D 20:42:29.904661] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3023 [D 20:42:29.904680] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 32/70. [D 20:42:29.904741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6581. [D 20:42:29.904808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6582. [D 20:42:29.904828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6583. [D 20:42:29.904841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6584. [D 20:42:29.904852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6585. [D 20:42:29.904862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6586. [D 20:42:29.904872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6587. [D 20:42:29.904882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6588. [D 20:42:29.904895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6589. [D 20:42:29.904935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6590. [D 20:42:29.904946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6591. [D 20:42:29.904956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6592. [D 20:42:29.904966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6593. [D 20:42:29.905003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6594. [D 20:42:29.905015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6595. [D 20:42:29.905025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6596. [D 20:42:29.905035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6597. [D 20:42:29.905060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6598. [D 20:42:29.905071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6599. [D 20:42:29.905081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6600. [D 20:42:29.905091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6601. [D 20:42:29.905101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6602. [D 20:42:29.905111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6603. [D 20:42:29.905136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6604. [D 20:42:29.905151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6605. [D 20:42:29.905161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6606. [D 20:42:29.905171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6607. [D 20:42:29.905187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6608. [D 20:42:29.905210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6609. [D 20:42:29.905225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6610. [D 20:42:29.905235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6611. [D 20:42:29.905245] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6612. [D 20:42:29.910716] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 6612. [D 20:42:29.910734] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 33/70. [D 20:42:29.911824] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.911839] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.911850] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.919294] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.919308] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.919320] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.919352] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3029 [D 20:42:29.919363] element 0: offset: 0x5b0030, size: 24 [D 20:42:29.919375] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 34/70. [D 20:42:29.932030] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2999 [D 20:42:29.932048] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 35/70. [D 20:42:29.932108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 6612. [D 20:42:29.932178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 6613. [D 20:42:29.932198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 6614. [D 20:42:29.932212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 6615. [D 20:42:29.932222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 6616. [D 20:42:29.932232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 6617. [D 20:42:29.932243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 6618. [D 20:42:29.932253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 6619. [D 20:42:29.932268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 6620. [D 20:42:29.932278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 6621. [D 20:42:29.932288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 6622. [D 20:42:29.932298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 6623. [D 20:42:29.932314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 6624. [D 20:42:29.932324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 6625. [D 20:42:29.932334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 6626. [D 20:42:29.932391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 6627. [D 20:42:29.932402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 6628. [D 20:42:29.932412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 6629. [D 20:42:29.932436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 6630. [D 20:42:29.932446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 6631. [D 20:42:29.932457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 6632. [D 20:42:29.932468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 6633. [D 20:42:29.932478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 6634. [D 20:42:29.932488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 6635. [D 20:42:29.932498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 6636. [D 20:42:29.932508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 6637. [D 20:42:29.932518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 6638. [D 20:42:29.932554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 6639. [D 20:42:29.932564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 6640. [D 20:42:29.932574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 6641. [D 20:42:29.932590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 6642. [D 20:42:29.932613] openib_post_sr_rdmaw: ibv_post_send wr_id 657260 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 6643. [D 20:42:29.938035] openib_check_cq: completed rdma wr_id 657260, nic_wr_credit 6643. [D 20:42:29.938051] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 36/70. [D 20:42:29.940358] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.940373] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.940384] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.945663] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.945684] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.945694] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.945727] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3032 [D 20:42:29.945738] element 0: offset: 0x61f7d0, size: 24 [D 20:42:29.945753] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 37/70. [D 20:42:29.972027] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3019 [D 20:42:29.972046] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 38/70. [D 20:42:29.972106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 6643. [D 20:42:29.972176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 6644. [D 20:42:29.972196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 6645. [D 20:42:29.972206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 6646. [D 20:42:29.972217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 6647. [D 20:42:29.972227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 6648. [D 20:42:29.972242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 6649. [D 20:42:29.972252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6650. [D 20:42:29.972261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6651. [D 20:42:29.972277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6652. [D 20:42:29.972325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 6653. [D 20:42:29.972336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 6654. [D 20:42:29.972346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 6655. [D 20:42:29.972371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 6656. [D 20:42:29.972381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 6657. [D 20:42:29.972391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6658. [D 20:42:29.972404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6659. [D 20:42:29.972414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6660. [D 20:42:29.972424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 6661. [D 20:42:29.972451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 6662. [D 20:42:29.972462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 6663. [D 20:42:29.972475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 6664. [D 20:42:29.972485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 6665. [D 20:42:29.972498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6666. [D 20:42:29.972526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6667. [D 20:42:29.972537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6668. [D 20:42:29.972548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 6669. [D 20:42:29.972559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 6670. [D 20:42:29.972580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 6671. [D 20:42:29.972593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 6672. [D 20:42:29.972603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 6673. [D 20:42:29.972612] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6674. [D 20:42:29.978031] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 6674. [D 20:42:29.978048] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 39/70. [D 20:42:29.980390] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.980406] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.980417] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.026424] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3026 [D 20:42:30.026443] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 40/70. [D 20:42:30.026507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6674. [D 20:42:30.026597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 6675. [D 20:42:30.026611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 6676. [D 20:42:30.026622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 6677. [D 20:42:30.026633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 6678. [D 20:42:30.026643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 6679. [D 20:42:30.026654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6680. [D 20:42:30.026664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6681. [D 20:42:30.026691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6682. [D 20:42:30.026702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 6683. [D 20:42:30.026713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 6684. [D 20:42:30.026739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 6685. [D 20:42:30.026754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 6686. [D 20:42:30.026775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 6687. [D 20:42:30.026788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6688. [D 20:42:30.026807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6689. [D 20:42:30.026818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6690. [D 20:42:30.026828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6691. [D 20:42:30.026851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6692. [D 20:42:30.026861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6693. [D 20:42:30.026872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6694. [D 20:42:30.026882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6695. [D 20:42:30.026892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6696. [D 20:42:30.026921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6697. [D 20:42:30.026932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6698. [D 20:42:30.026942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6699. [D 20:42:30.026964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6700. [D 20:42:30.026990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6701. [D 20:42:30.027001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6702. [D 20:42:30.027012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6703. [D 20:42:30.027022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6704. [D 20:42:30.027032] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6705. [D 20:42:30.032458] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6705. [D 20:42:30.032475] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 41/70. [D 20:42:30.034772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.034787] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.034797] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:30.040822] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.040836] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.040847] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:30.040880] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3035 [D 20:42:30.040891] element 0: offset: 0x691fe0, size: 24 [D 20:42:30.040903] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 42/70. [D 20:42:30.098032] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3029 [D 20:42:30.098051] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 43/70. [D 20:42:30.098109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6705. [D 20:42:30.098177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6706. [D 20:42:30.098188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6707. [D 20:42:30.098199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6708. [D 20:42:30.098209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6709. [D 20:42:30.098225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6710. [D 20:42:30.098235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6711. [D 20:42:30.098245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6712. [D 20:42:30.098260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6713. [D 20:42:30.098270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6714. [D 20:42:30.098280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6715. [D 20:42:30.098347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6716. [D 20:42:30.098360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6717. [D 20:42:30.098373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6718. [D 20:42:30.098394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6719. [D 20:42:30.098406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6720. [D 20:42:30.098416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6721. [D 20:42:30.098426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6722. [D 20:42:30.098441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6723. [D 20:42:30.098466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6724. [D 20:42:30.098478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6725. [D 20:42:30.098496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6726. [D 20:42:30.098507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6727. [D 20:42:30.098517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6728. [D 20:42:30.098536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6729. [D 20:42:30.098550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6730. [D 20:42:30.098572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6731. [D 20:42:30.098586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6732. [D 20:42:30.098608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6733. [D 20:42:30.098619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6734. [D 20:42:30.098629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6735. [D 20:42:30.098652] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6736. [D 20:42:30.104044] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 6736. [D 20:42:30.104061] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 44/70. [D 20:42:30.106378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.106393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.106403] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:30.112965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.112980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.112991] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:30.113023] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3038 [D 20:42:30.113035] element 0: offset: 0x627dd0, size: 24 [D 20:42:30.113047] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 45/70. [D 20:42:30.115855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.115870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.115880] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.115895] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3040 [D 20:42:30.115909] element 0: offset: 0x61ee50, size: 24 [D 20:42:30.115918] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 46/70. [D 20:42:30.172686] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3032 [D 20:42:30.172704] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 47/70. [D 20:42:30.172768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 6736. [D 20:42:30.172879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 6737. [D 20:42:30.172894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 6738. [D 20:42:30.172905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 6739. [D 20:42:30.172915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 6740. [D 20:42:30.172926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 6741. [D 20:42:30.172936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 6742. [D 20:42:30.172961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 6743. [D 20:42:30.172972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 6744. [D 20:42:30.172982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 6745. [D 20:42:30.172992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 6746. [D 20:42:30.173002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 6747. [D 20:42:30.173025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 6748. [D 20:42:30.173039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 6749. [D 20:42:30.173060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 6750. [D 20:42:30.173074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 6751. [D 20:42:30.173101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 6752. [D 20:42:30.173112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 6753. [D 20:42:30.173122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 6754. [D 20:42:30.173132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 6755. [D 20:42:30.173142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 6756. [D 20:42:30.173152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 6757. [D 20:42:30.173175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 6758. [D 20:42:30.173190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 6759. [D 20:42:30.173200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 6760. [D 20:42:30.173226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 6761. [D 20:42:30.173246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 6762. [D 20:42:30.173256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 6763. [D 20:42:30.173266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 6764. [D 20:42:30.173285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 6765. [D 20:42:30.173301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 6766. [D 20:42:30.173311] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 6767. [D 20:42:30.178736] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6767. [D 20:42:30.178755] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 48/70. [D 20:42:30.181786] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.181801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.181812] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.187818] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.187850] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.187860] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.187896] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3044 [D 20:42:30.187907] element 0: offset: 0x66e790, size: 24 [D 20:42:30.187921] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 49/70. [D 20:42:30.244189] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3044 [D 20:42:30.244207] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 50/70. [D 20:42:30.244273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 6767. [D 20:42:30.244384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 6768. [D 20:42:30.244398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 6769. [D 20:42:30.244409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 6770. [D 20:42:30.244419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 6771. [D 20:42:30.244430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 6772. [D 20:42:30.244440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 6773. [D 20:42:30.244450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 6774. [D 20:42:30.244460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 6775. [D 20:42:30.244470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 6776. [D 20:42:30.244487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 6777. [D 20:42:30.244497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 6778. [D 20:42:30.244520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 6779. [D 20:42:30.244532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 6780. [D 20:42:30.244542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 6781. [D 20:42:30.244570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 6782. [D 20:42:30.244581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 6783. [D 20:42:30.244591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 6784. [D 20:42:30.244602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 6785. [D 20:42:30.244612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 6786. [D 20:42:30.244623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 6787. [D 20:42:30.244646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 6788. [D 20:42:30.244656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 6789. [D 20:42:30.244666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 6790. [D 20:42:30.244676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 6791. [D 20:42:30.244686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 6792. [D 20:42:30.244717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 6793. [D 20:42:30.244728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 6794. [D 20:42:30.244740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 6795. [D 20:42:30.244759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 6796. [D 20:42:30.244770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 6797. [D 20:42:30.244780] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 6798. [D 20:42:30.250299] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6798. [D 20:42:30.250315] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 51/70. [D 20:42:30.251855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.251870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.251881] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.257954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.257969] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.257979] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.258012] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3047 [D 20:42:30.258023] element 0: offset: 0x67efc0, size: 24 [D 20:42:30.258037] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 52/70. [D 20:42:30.300587] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3038 [D 20:42:30.300606] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 53/70. [D 20:42:30.300668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6798. [D 20:42:30.300737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6799. [D 20:42:30.300798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6800. [D 20:42:30.300810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6801. [D 20:42:30.300821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6802. [D 20:42:30.300831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6803. [D 20:42:30.300853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6804. [D 20:42:30.300864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6805. [D 20:42:30.300874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6806. [D 20:42:30.300884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6807. [D 20:42:30.300900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6808. [D 20:42:30.300923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6809. [D 20:42:30.300939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6810. [D 20:42:30.300961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6811. [D 20:42:30.300972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6812. [D 20:42:30.300997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6813. [D 20:42:30.301008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6814. [D 20:42:30.301021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6815. [D 20:42:30.301049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6816. [D 20:42:30.301059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6817. [D 20:42:30.301079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6818. [D 20:42:30.301089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6819. [D 20:42:30.301099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6820. [D 20:42:30.301123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6821. [D 20:42:30.301134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6822. [D 20:42:30.301143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6823. [D 20:42:30.301166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6824. [D 20:42:30.301176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6825. [D 20:42:30.301198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6826. [D 20:42:30.301208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6827. [D 20:42:30.301218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6828. [D 20:42:30.301229] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6829. [D 20:42:30.306592] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6829. [D 20:42:30.306609] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 54/70. [D 20:42:30.308964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.308979] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.308990] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.336260] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3047 [D 20:42:30.336279] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 55/70. [D 20:42:30.336342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 6829. [D 20:42:30.336420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 6830. [D 20:42:30.336432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 6831. [D 20:42:30.336445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 6832. [D 20:42:30.336455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 6833. [D 20:42:30.336466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 6834. [D 20:42:30.336475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 6835. [D 20:42:30.336486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 6836. [D 20:42:30.336496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 6837. [D 20:42:30.336512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 6838. [D 20:42:30.336522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 6839. [D 20:42:30.336532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 6840. [D 20:42:30.336542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 6841. [D 20:42:30.336552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 6842. [D 20:42:30.336562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 6843. [D 20:42:30.336572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 6844. [D 20:42:30.336622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 6845. [D 20:42:30.336634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 6846. [D 20:42:30.336644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 6847. [D 20:42:30.336655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 6848. [D 20:42:30.336665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 6849. [D 20:42:30.336686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 6850. [D 20:42:30.336701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 6851. [D 20:42:30.336711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 6852. [D 20:42:30.336721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 6853. [D 20:42:30.336748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 6854. [D 20:42:30.336758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 6855. [D 20:42:30.336772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 6856. [D 20:42:30.336782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 6857. [D 20:42:30.336795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 6858. [D 20:42:30.336822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 6859. [D 20:42:30.336832] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 6860. [D 20:42:30.342278] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6860. [D 20:42:30.342295] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 56/70. [D 20:42:30.344656] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.344671] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.344682] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:30.350350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.350364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.350375] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:30.350408] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3050 [D 20:42:30.350419] element 0: offset: 0x61f310, size: 24 [D 20:42:30.350431] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 57/70. [D 20:42:30.397134] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3035 [D 20:42:30.397152] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 58/70. [D 20:42:30.397221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 6860. [D 20:42:30.397313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 6861. [D 20:42:30.397327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 6862. [D 20:42:30.397338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 6863. [D 20:42:30.397349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 6864. [D 20:42:30.397359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 6865. [D 20:42:30.397370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 6866. [D 20:42:30.397380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 6867. [D 20:42:30.397391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 6868. [D 20:42:30.397416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 6869. [D 20:42:30.397426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 6870. [D 20:42:30.397453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 6871. [D 20:42:30.397464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 6872. [D 20:42:30.397485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 6873. [D 20:42:30.397496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 6874. [D 20:42:30.397507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 6875. [D 20:42:30.397529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 6876. [D 20:42:30.397539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 6877. [D 20:42:30.397549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 6878. [D 20:42:30.397571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 6879. [D 20:42:30.397581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 6880. [D 20:42:30.397591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 6881. [D 20:42:30.397616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 6882. [D 20:42:30.397626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 6883. [D 20:42:30.397649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 6884. [D 20:42:30.397659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 6885. [D 20:42:30.397674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 6886. [D 20:42:30.397684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 6887. [D 20:42:30.397694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 6888. [D 20:42:30.397704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 6889. [D 20:42:30.397722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 6890. [D 20:42:30.397745] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 6891. [D 20:42:30.403171] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6891. [D 20:42:30.403188] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 59/70. [D 20:42:30.405306] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.405321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.405332] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:30.411835] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.411850] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.411860] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:30.411892] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3053 [D 20:42:30.411904] element 0: offset: 0x5b0030, size: 24 [D 20:42:30.411916] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 60/70. [D 20:42:30.448838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.448904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.448914] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.448952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3056 [D 20:42:30.448966] element 0: offset: 0x63e800, size: 24 [D 20:42:30.448979] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 0/70. [D 20:42:30.454021] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3050 [D 20:42:30.454039] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 1/70. [D 20:42:30.454187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6891. [D 20:42:30.454256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6892. [D 20:42:30.454267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6893. [D 20:42:30.454278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6894. [D 20:42:30.454292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6895. [D 20:42:30.454302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6896. [D 20:42:30.454314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6897. [D 20:42:30.454329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6898. [D 20:42:30.454339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6899. [D 20:42:30.454348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6900. [D 20:42:30.454365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6901. [D 20:42:30.454374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6902. [D 20:42:30.454384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6903. [D 20:42:30.454438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6904. [D 20:42:30.454460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6905. [D 20:42:30.454471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6906. [D 20:42:30.454482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6907. [D 20:42:30.454492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6908. [D 20:42:30.454508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6909. [D 20:42:30.454540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6910. [D 20:42:30.454550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6911. [D 20:42:30.454560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6912. [D 20:42:30.454576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6913. [D 20:42:30.454586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6914. [D 20:42:30.454596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6915. [D 20:42:30.454620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6916. [D 20:42:30.454631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6917. [D 20:42:30.454654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6918. [D 20:42:30.454664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6919. [D 20:42:30.454674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6920. [D 20:42:30.454684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6921. [D 20:42:30.454694] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6922. [D 20:42:30.462349] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6922. [D 20:42:30.462366] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 2/70. [D 20:42:30.464649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.464665] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.464675] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.470201] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.470215] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.470226] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.470258] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3059 [D 20:42:30.470269] element 0: offset: 0x61f7d0, size: 24 [D 20:42:30.470281] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 3/70. [D 20:42:30.496428] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3040 [D 20:42:30.496446] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 4/70. [D 20:42:30.496507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6922. [D 20:42:30.496615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6923. [D 20:42:30.496628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 6924. [D 20:42:30.496640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 6925. [D 20:42:30.496650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 6926. [D 20:42:30.496661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 6927. [D 20:42:30.496671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 6928. [D 20:42:30.496681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6929. [D 20:42:30.496691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6930. [D 20:42:30.496701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6931. [D 20:42:30.496718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 6932. [D 20:42:30.496728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 6933. [D 20:42:30.496738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 6934. [D 20:42:30.496747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 6935. [D 20:42:30.496758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 6936. [D 20:42:30.496768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6937. [D 20:42:30.496778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6938. [D 20:42:30.496803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6939. [D 20:42:30.496813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6940. [D 20:42:30.496823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6941. [D 20:42:30.496834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6942. [D 20:42:30.496844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6943. [D 20:42:30.496854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6944. [D 20:42:30.496864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6945. [D 20:42:30.496895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6946. [D 20:42:30.496912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6947. [D 20:42:30.496922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6948. [D 20:42:30.496932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6949. [D 20:42:30.496956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6950. [D 20:42:30.496966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6951. [D 20:42:30.496987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6952. [D 20:42:30.496997] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6953. [D 20:42:30.502474] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6953. [D 20:42:30.502491] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 5/70. [D 20:42:30.504817] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.504832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.504843] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.510258] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.510272] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.510283] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.510356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3061 [D 20:42:30.510370] element 0: offset: 0x67efc0, size: 24 [D 20:42:30.510381] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 6/70. [D 20:42:30.585271] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3061 [D 20:42:30.585290] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 7/70. [D 20:42:30.585467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6953. [D 20:42:30.585535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6954. [D 20:42:30.585546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 6955. [D 20:42:30.585557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 6956. [D 20:42:30.585567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 6957. [D 20:42:30.585578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 6958. [D 20:42:30.585588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 6959. [D 20:42:30.585598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6960. [D 20:42:30.585607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6961. [D 20:42:30.585617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6962. [D 20:42:30.585627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 6963. [D 20:42:30.585659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 6964. [D 20:42:30.585675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 6965. [D 20:42:30.585697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 6966. [D 20:42:30.585712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 6967. [D 20:42:30.585734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6968. [D 20:42:30.585746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6969. [D 20:42:30.585756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6970. [D 20:42:30.585778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6971. [D 20:42:30.585787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6972. [D 20:42:30.585797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6973. [D 20:42:30.585812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6974. [D 20:42:30.585822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6975. [D 20:42:30.585832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6976. [D 20:42:30.585842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6977. [D 20:42:30.585874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6978. [D 20:42:30.585884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6979. [D 20:42:30.585894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6980. [D 20:42:30.585916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6981. [D 20:42:30.585927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6982. [D 20:42:30.585937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6983. [D 20:42:30.585959] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6984. [D 20:42:30.591464] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6984. [D 20:42:30.591482] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 8/70. [D 20:42:30.593838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.593853] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.593863] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.599299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.599317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.599328] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.599362] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3064 [D 20:42:30.599373] element 0: offset: 0x655bd0, size: 24 [D 20:42:30.599387] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 9/70. [D 20:42:30.673640] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3059 [D 20:42:30.673659] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 10/70. [D 20:42:30.673766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6984. [D 20:42:30.673883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6985. [D 20:42:30.673894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6986. [D 20:42:30.673905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6987. [D 20:42:30.673920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6988. [D 20:42:30.673930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6989. [D 20:42:30.673945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6990. [D 20:42:30.673956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6991. [D 20:42:30.673966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6992. [D 20:42:30.673976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6993. [D 20:42:30.674002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6994. [D 20:42:30.674013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6995. [D 20:42:30.674035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6996. [D 20:42:30.674046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6997. [D 20:42:30.674056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6998. [D 20:42:30.674079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6999. [D 20:42:30.674090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7000. [D 20:42:30.674100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7001. [D 20:42:30.674125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7002. [D 20:42:30.674135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7003. [D 20:42:30.674160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7004. [D 20:42:30.674170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7005. [D 20:42:30.674192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7006. [D 20:42:30.674202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7007. [D 20:42:30.674212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7008. [D 20:42:30.674235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7009. [D 20:42:30.674245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7010. [D 20:42:30.674266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7011. [D 20:42:30.674277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7012. [D 20:42:30.674287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7013. [D 20:42:30.674298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7014. [D 20:42:30.674319] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7015. [D 20:42:30.679787] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7015. [D 20:42:30.679806] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 11/70. [D 20:42:30.682121] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.682136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.682146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.687783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.687798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.687809] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.687840] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3068 [D 20:42:30.687854] element 0: offset: 0x62a350, size: 24 [D 20:42:30.687866] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 12/70. [D 20:42:30.736454] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3053 [D 20:42:30.736473] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 13/70. [D 20:42:30.736532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 7015. [D 20:42:30.736608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7016. [D 20:42:30.736619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7017. [D 20:42:30.736630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7018. [D 20:42:30.736641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7019. [D 20:42:30.736651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7020. [D 20:42:30.736667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7021. [D 20:42:30.736677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7022. [D 20:42:30.736686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7023. [D 20:42:30.736740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7024. [D 20:42:30.736752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7025. [D 20:42:30.736765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7026. [D 20:42:30.736775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7027. [D 20:42:30.736801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7028. [D 20:42:30.736811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7029. [D 20:42:30.736825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7030. [D 20:42:30.736835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7031. [D 20:42:30.736845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7032. [D 20:42:30.736875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7033. [D 20:42:30.736890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7034. [D 20:42:30.736900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7035. [D 20:42:30.736911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7036. [D 20:42:30.736926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7037. [D 20:42:30.736936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7038. [D 20:42:30.736962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7039. [D 20:42:30.736972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7040. [D 20:42:30.736982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7041. [D 20:42:30.736995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7042. [D 20:42:30.737006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7043. [D 20:42:30.737029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7044. [D 20:42:30.737040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7045. [D 20:42:30.737050] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7046. [D 20:42:30.742457] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7046. [D 20:42:30.742474] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 14/70. [D 20:42:30.744791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.744806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.744817] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.750580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.750595] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.750606] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.750638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3071 [D 20:42:30.750649] element 0: offset: 0x61f310, size: 24 [D 20:42:30.750661] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 15/70. [D 20:42:30.817857] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3068 [D 20:42:30.817875] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 16/70. [D 20:42:30.817933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7046. [D 20:42:30.818005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7047. [D 20:42:30.818025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7048. [D 20:42:30.818038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7049. [D 20:42:30.818049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7050. [D 20:42:30.818059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7051. [D 20:42:30.818069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7052. [D 20:42:30.818079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7053. [D 20:42:30.818090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7054. [D 20:42:30.818100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7055. [D 20:42:30.818155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7056. [D 20:42:30.818167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7057. [D 20:42:30.818191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7058. [D 20:42:30.818201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7059. [D 20:42:30.818211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7060. [D 20:42:30.818227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7061. [D 20:42:30.818237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7062. [D 20:42:30.818247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7063. [D 20:42:30.818257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7064. [D 20:42:30.818267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7065. [D 20:42:30.818277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7066. [D 20:42:30.818287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7067. [D 20:42:30.818297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7068. [D 20:42:30.818322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7069. [D 20:42:30.818333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7070. [D 20:42:30.818343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7071. [D 20:42:30.818358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7072. [D 20:42:30.818368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7073. [D 20:42:30.818378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7074. [D 20:42:30.818401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7075. [D 20:42:30.818411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7076. [D 20:42:30.818421] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7077. [D 20:42:30.823914] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7077. [D 20:42:30.823932] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 17/70. [D 20:42:30.826246] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.826261] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.826271] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.831800] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.831815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.831826] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.831859] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3074 [D 20:42:30.831873] element 0: offset: 0x66e790, size: 24 [D 20:42:30.831885] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 18/70. [D 20:42:30.884141] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3071 [D 20:42:30.884160] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 19/70. [D 20:42:30.884221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 7077. [D 20:42:30.884292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7078. [D 20:42:30.884323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7079. [D 20:42:30.884334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7080. [D 20:42:30.884345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7081. [D 20:42:30.884356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7082. [D 20:42:30.884367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7083. [D 20:42:30.884377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7084. [D 20:42:30.884387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7085. [D 20:42:30.884415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7086. [D 20:42:30.884426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7087. [D 20:42:30.884436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7088. [D 20:42:30.884446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7089. [D 20:42:30.884456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7090. [D 20:42:30.884466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7091. [D 20:42:30.884489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7092. [D 20:42:30.884499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7093. [D 20:42:30.884510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7094. [D 20:42:30.884532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7095. [D 20:42:30.884541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7096. [D 20:42:30.884567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7097. [D 20:42:30.884577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7098. [D 20:42:30.884591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7099. [D 20:42:30.884601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7100. [D 20:42:30.884616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7101. [D 20:42:30.884642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7102. [D 20:42:30.884656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7103. [D 20:42:30.884667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7104. [D 20:42:30.884689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7105. [D 20:42:30.884699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7106. [D 20:42:30.884709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7107. [D 20:42:30.884733] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7108. [D 20:42:30.890228] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7108. [D 20:42:30.890244] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 20/70. [D 20:42:30.892547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.892562] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.892573] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.898548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.898562] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.898571] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.898604] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3077 [D 20:42:30.898615] element 0: offset: 0x61ee50, size: 24 [D 20:42:30.898627] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 21/70. [D 20:42:30.969316] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3064 [D 20:42:30.969335] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 22/70. [D 20:42:30.969438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 7108. [D 20:42:30.969544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 7109. [D 20:42:30.969556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 7110. [D 20:42:30.969566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 7111. [D 20:42:30.969577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 7112. [D 20:42:30.969587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 7113. [D 20:42:30.969597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 7114. [D 20:42:30.969613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 7115. [D 20:42:30.969623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 7116. [D 20:42:30.969633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 7117. [D 20:42:30.969643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 7118. [D 20:42:30.969671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 7119. [D 20:42:30.969681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 7120. [D 20:42:30.969702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 7121. [D 20:42:30.969712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 7122. [D 20:42:30.969723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 7123. [D 20:42:30.969745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 7124. [D 20:42:30.969756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 7125. [D 20:42:30.969766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 7126. [D 20:42:30.969776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 7127. [D 20:42:30.969787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 7128. [D 20:42:30.969810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 7129. [D 20:42:30.969821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 7130. [D 20:42:30.969831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 7131. [D 20:42:30.969841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 7132. [D 20:42:30.969853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 7133. [D 20:42:30.969878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 7134. [D 20:42:30.969888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 7135. [D 20:42:30.969899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 7136. [D 20:42:30.969909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 7137. [D 20:42:30.969933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 7138. [D 20:42:30.969944] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 7139. [D 20:42:30.975402] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7139. [D 20:42:30.975419] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 23/70. [D 20:42:30.975905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.975920] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.975930] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.983082] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.983097] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.983107] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.983140] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3079 [D 20:42:30.983150] element 0: offset: 0x67efc0, size: 24 [D 20:42:30.983162] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 24/70. [D 20:42:31.058377] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3079 [D 20:42:31.058396] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 25/70. [D 20:42:31.058509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 7139. [D 20:42:31.058616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 7140. [D 20:42:31.058628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 7141. [D 20:42:31.058639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 7142. [D 20:42:31.058649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 7143. [D 20:42:31.058660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 7144. [D 20:42:31.058670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 7145. [D 20:42:31.058680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 7146. [D 20:42:31.058690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 7147. [D 20:42:31.058700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 7148. [D 20:42:31.058709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 7149. [D 20:42:31.058741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 7150. [D 20:42:31.058751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 7151. [D 20:42:31.058772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 7152. [D 20:42:31.058782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 7153. [D 20:42:31.058792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 7154. [D 20:42:31.058814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 7155. [D 20:42:31.058825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 7156. [D 20:42:31.058838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 7157. [D 20:42:31.058852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 7158. [D 20:42:31.058862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 7159. [D 20:42:31.058885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 7160. [D 20:42:31.058897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 7161. [D 20:42:31.058911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 7162. [D 20:42:31.058926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 7163. [D 20:42:31.058960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 7164. [D 20:42:31.058982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 7165. [D 20:42:31.058993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 7166. [D 20:42:31.059003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 7167. [D 20:42:31.059021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 7168. [D 20:42:31.059037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 7169. [D 20:42:31.059047] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 7170. [D 20:42:31.064541] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7170. [D 20:42:31.064559] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 26/70. [D 20:42:31.066878] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.066893] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.066903] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.072391] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.072407] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.072417] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.072451] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3082 [D 20:42:31.072462] element 0: offset: 0x5b0030, size: 24 [D 20:42:31.072473] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 27/70. [D 20:42:31.124804] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3074 [D 20:42:31.124822] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 28/70. [D 20:42:31.124883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7170. [D 20:42:31.124953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7171. [D 20:42:31.125008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7172. [D 20:42:31.125019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7173. [D 20:42:31.125030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7174. [D 20:42:31.125040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7175. [D 20:42:31.125050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7176. [D 20:42:31.125071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7177. [D 20:42:31.125086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7178. [D 20:42:31.125096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7179. [D 20:42:31.125106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7180. [D 20:42:31.125139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7181. [D 20:42:31.125149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7182. [D 20:42:31.125173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7183. [D 20:42:31.125186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7184. [D 20:42:31.125196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7185. [D 20:42:31.125221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7186. [D 20:42:31.125231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7187. [D 20:42:31.125242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7188. [D 20:42:31.125264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7189. [D 20:42:31.125274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7190. [D 20:42:31.125285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7191. [D 20:42:31.125309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7192. [D 20:42:31.125319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7193. [D 20:42:31.125329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7194. [D 20:42:31.125354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7195. [D 20:42:31.125365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7196. [D 20:42:31.125375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7197. [D 20:42:31.125385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7198. [D 20:42:31.125396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7199. [D 20:42:31.125406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7200. [D 20:42:31.125428] openib_post_sr_rdmaw: ibv_post_send wr_id 6517b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7201. [D 20:42:31.130850] openib_check_cq: completed rdma wr_id 6517b0, nic_wr_credit 7201. [D 20:42:31.130866] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 29/70. [D 20:42:31.131960] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.131975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.131986] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.150765] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3077 [D 20:42:31.150784] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 30/70. [D 20:42:31.150847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 7201. [D 20:42:31.150915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7202. [D 20:42:31.150943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7203. [D 20:42:31.150953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7204. [D 20:42:31.150964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7205. [D 20:42:31.150975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7206. [D 20:42:31.150986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7207. [D 20:42:31.150996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7208. [D 20:42:31.151006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7209. [D 20:42:31.151016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7210. [D 20:42:31.151065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7211. [D 20:42:31.151075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7212. [D 20:42:31.151108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7213. [D 20:42:31.151121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7214. [D 20:42:31.151131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7215. [D 20:42:31.151141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7216. [D 20:42:31.151152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7217. [D 20:42:31.151162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7218. [D 20:42:31.151172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7219. [D 20:42:31.151188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7220. [D 20:42:31.151198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7221. [D 20:42:31.151208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7222. [D 20:42:31.151218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7223. [D 20:42:31.151228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7224. [D 20:42:31.151255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7225. [D 20:42:31.151265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7226. [D 20:42:31.151275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7227. [D 20:42:31.151285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7228. [D 20:42:31.151300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7229. [D 20:42:31.151324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7230. [D 20:42:31.151339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7231. [D 20:42:31.151351] openib_post_sr_rdmaw: ibv_post_send wr_id 6517b0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7232. [D 20:42:31.156781] openib_check_cq: completed rdma wr_id 6517b0, nic_wr_credit 7232. [D 20:42:31.156799] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 31/70. [D 20:42:31.159003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.159018] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.159028] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:31.275741] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.275765] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.275776] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:31.275810] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3086 [D 20:42:31.275821] element 0: offset: 0x62a350, size: 24 [D 20:42:31.275834] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 32/70. [D 20:42:31.293393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.293456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.293466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.293503] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3089 [D 20:42:31.293514] element 0: offset: 0x64b790, size: 24 [D 20:42:31.293528] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 33/70. [D 20:42:31.300959] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3056 [D 20:42:31.300978] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 34/70. [D 20:42:31.301155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 7232. [D 20:42:31.301220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 7233. [D 20:42:31.301232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 7234. [D 20:42:31.301242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 7235. [D 20:42:31.301257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 7236. [D 20:42:31.301267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 7237. [D 20:42:31.301277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 7238. [D 20:42:31.301291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 7239. [D 20:42:31.301301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 7240. [D 20:42:31.301311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 7241. [D 20:42:31.301342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 7242. [D 20:42:31.301353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 7243. [D 20:42:31.301380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 7244. [D 20:42:31.301391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 7245. [D 20:42:31.301402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 7246. [D 20:42:31.301424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 7247. [D 20:42:31.301434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 7248. [D 20:42:31.301444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 7249. [D 20:42:31.301468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 7250. [D 20:42:31.301478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 7251. [D 20:42:31.301512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 7252. [D 20:42:31.301535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 7253. [D 20:42:31.301545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 7254. [D 20:42:31.301555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 7255. [D 20:42:31.301577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 7256. [D 20:42:31.301587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 7257. [D 20:42:31.301611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 7258. [D 20:42:31.301622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 7259. [D 20:42:31.301636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 7260. [D 20:42:31.301660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 7261. [D 20:42:31.301674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 7262. [D 20:42:31.301684] openib_post_sr_rdmaw: ibv_post_send wr_id 632a50 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 7263. [D 20:42:31.308683] openib_check_cq: completed rdma wr_id 632a50, nic_wr_credit 7263. [D 20:42:31.308733] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 35/70. [D 20:42:31.311011] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.311027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.311038] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.316797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.316827] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.316837] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.316871] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3092 [D 20:42:31.316882] element 0: offset: 0x62a780, size: 24 [D 20:42:31.316896] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 36/70. [D 20:42:31.336096] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3082 [D 20:42:31.336114] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 37/70. [D 20:42:31.336174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 7263. [D 20:42:31.336269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 7264. [D 20:42:31.336283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 7265. [D 20:42:31.336294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 7266. [D 20:42:31.336305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 7267. [D 20:42:31.336315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 7268. [D 20:42:31.336326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 7269. [D 20:42:31.336336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 7270. [D 20:42:31.336374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 7271. [D 20:42:31.336385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 7272. [D 20:42:31.336409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 7273. [D 20:42:31.336425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 7274. [D 20:42:31.336447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 7275. [D 20:42:31.336461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 7276. [D 20:42:31.336471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 7277. [D 20:42:31.336498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 7278. [D 20:42:31.336508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 7279. [D 20:42:31.336530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 7280. [D 20:42:31.336541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 7281. [D 20:42:31.336563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 7282. [D 20:42:31.336578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 7283. [D 20:42:31.336599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 7284. [D 20:42:31.336613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 7285. [D 20:42:31.336637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 7286. [D 20:42:31.336652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 7287. [D 20:42:31.336676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 7288. [D 20:42:31.336688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 7289. [D 20:42:31.336708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 7290. [D 20:42:31.336722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 7291. [D 20:42:31.336732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 7292. [D 20:42:31.336755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 7293. [D 20:42:31.336765] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 7294. [D 20:42:31.342123] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7294. [D 20:42:31.342140] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 38/70. [D 20:42:31.343938] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.343953] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.343963] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.349988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.350002] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.350013] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.350044] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3094 [D 20:42:31.350055] element 0: offset: 0x691fe0, size: 24 [D 20:42:31.350067] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 39/70. [D 20:42:31.403471] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3086 [D 20:42:31.403514] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 40/70. [D 20:42:31.403577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 7294. [D 20:42:31.403649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7295. [D 20:42:31.403661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7296. [D 20:42:31.403672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7297. [D 20:42:31.403686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7298. [D 20:42:31.403696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7299. [D 20:42:31.403706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7300. [D 20:42:31.403716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7301. [D 20:42:31.403726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7302. [D 20:42:31.403736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7303. [D 20:42:31.403800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7304. [D 20:42:31.403811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7305. [D 20:42:31.403825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7306. [D 20:42:31.403835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7307. [D 20:42:31.403845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7308. [D 20:42:31.403861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7309. [D 20:42:31.403871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7310. [D 20:42:31.403881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7311. [D 20:42:31.403896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7312. [D 20:42:31.403906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7313. [D 20:42:31.403922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7314. [D 20:42:31.403932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7315. [D 20:42:31.403942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7316. [D 20:42:31.403951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7317. [D 20:42:31.403973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7318. [D 20:42:31.403997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7319. [D 20:42:31.404013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7320. [D 20:42:31.404035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7321. [D 20:42:31.404046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7322. [D 20:42:31.404056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7323. [D 20:42:31.404066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7324. [D 20:42:31.404077] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7325. [D 20:42:31.409507] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7325. [D 20:42:31.409523] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 41/70. [D 20:42:31.411820] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.411835] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.411845] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.415927] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.415941] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.415952] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.415984] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3098 [D 20:42:31.415995] element 0: offset: 0x61ee50, size: 24 [D 20:42:31.416010] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 42/70. [D 20:42:31.509359] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3089 [D 20:42:31.509378] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 43/70. [D 20:42:31.509445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7325. [D 20:42:31.509543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7326. [D 20:42:31.509557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7327. [D 20:42:31.509569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7328. [D 20:42:31.509580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7329. [D 20:42:31.509591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7330. [D 20:42:31.509601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7331. [D 20:42:31.509611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7332. [D 20:42:31.509621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7333. [D 20:42:31.509631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7334. [D 20:42:31.509642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7335. [D 20:42:31.509652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7336. [D 20:42:31.509662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7337. [D 20:42:31.509705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7338. [D 20:42:31.509726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7339. [D 20:42:31.509736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7340. [D 20:42:31.509751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7341. [D 20:42:31.509774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7342. [D 20:42:31.509785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7343. [D 20:42:31.509795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7344. [D 20:42:31.509811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7345. [D 20:42:31.509838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7346. [D 20:42:31.509848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7347. [D 20:42:31.509858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7348. [D 20:42:31.509869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7349. [D 20:42:31.509880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7350. [D 20:42:31.509905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7351. [D 20:42:31.509915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7352. [D 20:42:31.509926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7353. [D 20:42:31.509936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7354. [D 20:42:31.509962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7355. [D 20:42:31.509972] openib_post_sr_rdmaw: ibv_post_send wr_id 6b2260 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7356. [D 20:42:31.515402] openib_check_cq: completed rdma wr_id 6b2260, nic_wr_credit 7356. [D 20:42:31.515419] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 44/70. [D 20:42:31.517562] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.517578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.517589] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.523260] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.523275] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.523285] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.523317] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3101 [D 20:42:31.523328] element 0: offset: 0x63e800, size: 24 [D 20:42:31.523340] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 45/70. [D 20:42:31.548215] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3092 [D 20:42:31.548233] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 46/70. [D 20:42:31.548291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 7356. [D 20:42:31.548358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 7357. [D 20:42:31.548413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 7358. [D 20:42:31.548424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 7359. [D 20:42:31.548435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 7360. [D 20:42:31.548446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 7361. [D 20:42:31.548456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 7362. [D 20:42:31.548479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 7363. [D 20:42:31.548490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 7364. [D 20:42:31.548500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 7365. [D 20:42:31.548511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 7366. [D 20:42:31.548521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 7367. [D 20:42:31.548531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 7368. [D 20:42:31.548541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 7369. [D 20:42:31.548551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 7370. [D 20:42:31.548577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 7371. [D 20:42:31.548587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 7372. [D 20:42:31.548597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 7373. [D 20:42:31.548617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 7374. [D 20:42:31.548628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 7375. [D 20:42:31.548638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 7376. [D 20:42:31.548659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 7377. [D 20:42:31.548669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 7378. [D 20:42:31.548679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 7379. [D 20:42:31.548690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 7380. [D 20:42:31.548710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 7381. [D 20:42:31.548724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 7382. [D 20:42:31.548734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 7383. [D 20:42:31.548757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 7384. [D 20:42:31.548767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 7385. [D 20:42:31.548777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 7386. [D 20:42:31.548793] openib_post_sr_rdmaw: ibv_post_send wr_id 6b2110 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 7387. [D 20:42:31.554213] openib_check_cq: completed rdma wr_id 6b2110, nic_wr_credit 7387. [D 20:42:31.554230] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 47/70. [D 20:42:31.555964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.555979] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.555990] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.562238] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.562252] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.562262] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.562295] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3104 [D 20:42:31.562306] element 0: offset: 0x5b0030, size: 24 [D 20:42:31.562318] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 48/70. [D 20:42:31.640037] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3104 [D 20:42:31.640056] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 49/70. [D 20:42:31.640137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 7387. [D 20:42:31.640212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 7388. [D 20:42:31.640224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 7389. [D 20:42:31.640234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 7390. [D 20:42:31.640249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 7391. [D 20:42:31.640258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 7392. [D 20:42:31.640268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 7393. [D 20:42:31.640284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 7394. [D 20:42:31.640294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 7395. [D 20:42:31.640304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 7396. [D 20:42:31.640358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 7397. [D 20:42:31.640371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 7398. [D 20:42:31.640381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 7399. [D 20:42:31.640391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 7400. [D 20:42:31.640415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 7401. [D 20:42:31.640425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 7402. [D 20:42:31.640436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 7403. [D 20:42:31.640445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 7404. [D 20:42:31.640455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 7405. [D 20:42:31.640465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 7406. [D 20:42:31.640489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 7407. [D 20:42:31.640499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 7408. [D 20:42:31.640516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 7409. [D 20:42:31.640526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 7410. [D 20:42:31.640536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 7411. [D 20:42:31.640547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 7412. [D 20:42:31.640557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 7413. [D 20:42:31.640583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 7414. [D 20:42:31.640593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 7415. [D 20:42:31.640603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 7416. [D 20:42:31.640631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 7417. [D 20:42:31.640642] openib_post_sr_rdmaw: ibv_post_send wr_id 6b2110 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 7418. [D 20:42:31.646126] openib_check_cq: completed rdma wr_id 6b2110, nic_wr_credit 7418. [D 20:42:31.646144] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 50/70. [D 20:42:31.648457] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.648472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.648482] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.654093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.654111] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.654122] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.654154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3107 [D 20:42:31.654166] element 0: offset: 0x62a350, size: 24 [D 20:42:31.654180] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 51/70. [D 20:42:31.722408] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3094 [D 20:42:31.722426] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 52/70. [D 20:42:31.722486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 7418. [D 20:42:31.722560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 7419. [D 20:42:31.722571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 7420. [D 20:42:31.722581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 7421. [D 20:42:31.722592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 7422. [D 20:42:31.722603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 7423. [D 20:42:31.722619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 7424. [D 20:42:31.722629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 7425. [D 20:42:31.722639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 7426. [D 20:42:31.722655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 7427. [D 20:42:31.722711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 7428. [D 20:42:31.722721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 7429. [D 20:42:31.722740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 7430. [D 20:42:31.722755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 7431. [D 20:42:31.722765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 7432. [D 20:42:31.722775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 7433. [D 20:42:31.722789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 7434. [D 20:42:31.722799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 7435. [D 20:42:31.722809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 7436. [D 20:42:31.722835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 7437. [D 20:42:31.722845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 7438. [D 20:42:31.722859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 7439. [D 20:42:31.722869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 7440. [D 20:42:31.722894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 7441. [D 20:42:31.722903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 7442. [D 20:42:31.722914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 7443. [D 20:42:31.722942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 7444. [D 20:42:31.722952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 7445. [D 20:42:31.722966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 7446. [D 20:42:31.722976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 7447. [D 20:42:31.722991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 7448. [D 20:42:31.723002] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 7449. [D 20:42:31.728413] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 7449. [D 20:42:31.728430] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 53/70. [D 20:42:31.730716] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.730731] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.730741] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.736179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.736194] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.736205] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.736237] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3109 [D 20:42:31.736249] element 0: offset: 0x66e640, size: 24 [D 20:42:31.736261] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 54/70. [D 20:42:31.801792] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3101 [D 20:42:31.801812] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 55/70. [D 20:42:31.801875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7449. [D 20:42:31.801947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7450. [D 20:42:31.801967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7451. [D 20:42:31.801980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7452. [D 20:42:31.801990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7453. [D 20:42:31.802001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7454. [D 20:42:31.802010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7455. [D 20:42:31.802021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7456. [D 20:42:31.802031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7457. [D 20:42:31.802045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7458. [D 20:42:31.802098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7459. [D 20:42:31.802109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7460. [D 20:42:31.802131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7461. [D 20:42:31.802143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7462. [D 20:42:31.802153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7463. [D 20:42:31.802163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7464. [D 20:42:31.802177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7465. [D 20:42:31.802186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7466. [D 20:42:31.802197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7467. [D 20:42:31.802207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7468. [D 20:42:31.802217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7469. [D 20:42:31.802229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7470. [D 20:42:31.802239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7471. [D 20:42:31.802249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7472. [D 20:42:31.802259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7473. [D 20:42:31.802285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7474. [D 20:42:31.802294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7475. [D 20:42:31.802308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7476. [D 20:42:31.802318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7477. [D 20:42:31.802328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7478. [D 20:42:31.802356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7479. [D 20:42:31.802366] openib_post_sr_rdmaw: ibv_post_send wr_id 63dfe0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7480. [D 20:42:31.807808] openib_check_cq: completed rdma wr_id 63dfe0, nic_wr_credit 7480. [D 20:42:31.807826] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 56/70. [D 20:42:31.810031] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.810046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.810056] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.815704] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.815719] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.815729] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.815762] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3113 [D 20:42:31.815774] element 0: offset: 0x62a780, size: 24 [D 20:42:31.815788] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 57/70. [D 20:42:31.825209] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3098 [D 20:42:31.825228] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 58/70. [D 20:42:31.825404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 7480. [D 20:42:31.825472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7481. [D 20:42:31.825483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7482. [D 20:42:31.825494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7483. [D 20:42:31.825508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7484. [D 20:42:31.825518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7485. [D 20:42:31.825527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7486. [D 20:42:31.825538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7487. [D 20:42:31.825548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7488. [D 20:42:31.825558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7489. [D 20:42:31.825568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7490. [D 20:42:31.825583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7491. [D 20:42:31.825593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7492. [D 20:42:31.825602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7493. [D 20:42:31.825630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7494. [D 20:42:31.825641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7495. [D 20:42:31.825655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7496. [D 20:42:31.825665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7497. [D 20:42:31.825675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7498. [D 20:42:31.825702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7499. [D 20:42:31.825715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7500. [D 20:42:31.825728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7501. [D 20:42:31.825737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7502. [D 20:42:31.825759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7503. [D 20:42:31.825770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7504. [D 20:42:31.825780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7505. [D 20:42:31.825794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7506. [D 20:42:31.825804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7507. [D 20:42:31.825814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7508. [D 20:42:31.825842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7509. [D 20:42:31.825858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7510. [D 20:42:31.825868] openib_post_sr_rdmaw: ibv_post_send wr_id 662410 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7511. [D 20:42:31.832128] openib_check_cq: completed rdma wr_id 662410, nic_wr_credit 7511. [D 20:42:31.832145] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 59/70. [D 20:42:31.834473] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.834488] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.834497] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.840261] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.840292] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.840302] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.840338] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3116 [D 20:42:31.840349] element 0: offset: 0x5b0030, size: 24 [D 20:42:31.840363] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 60/70. [D 20:42:31.857613] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3107 [D 20:42:31.857630] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 0/70. [D 20:42:31.857691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 7511. [D 20:42:31.857756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 7512. [D 20:42:31.857813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 7513. [D 20:42:31.857825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 7514. [D 20:42:31.857835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 7515. [D 20:42:31.857846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 7516. [D 20:42:31.857856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 7517. [D 20:42:31.857866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 7518. [D 20:42:31.857877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 7519. [D 20:42:31.857887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 7520. [D 20:42:31.857897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 7521. [D 20:42:31.857907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 7522. [D 20:42:31.857925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 7523. [D 20:42:31.857940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 7524. [D 20:42:31.857950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 7525. [D 20:42:31.857960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 7526. [D 20:42:31.857976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 7527. [D 20:42:31.857986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 7528. [D 20:42:31.858008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 7529. [D 20:42:31.858019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 7530. [D 20:42:31.858029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 7531. [D 20:42:31.858040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 7532. [D 20:42:31.858050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 7533. [D 20:42:31.858060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 7534. [D 20:42:31.858069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 7535. [D 20:42:31.858102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 7536. [D 20:42:31.858113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 7537. [D 20:42:31.858127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 7538. [D 20:42:31.858137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 7539. [D 20:42:31.858147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 7540. [D 20:42:31.858171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 7541. [D 20:42:31.858181] openib_post_sr_rdmaw: ibv_post_send wr_id 662410 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 7542. [D 20:42:31.863612] openib_check_cq: completed rdma wr_id 662410, nic_wr_credit 7542. [D 20:42:31.863628] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 1/70. [D 20:42:31.865764] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.865779] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.865789] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.871651] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.871665] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.871677] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.871709] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3119 [D 20:42:31.871720] element 0: offset: 0x691fe0, size: 24 [D 20:42:31.871732] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 2/70. [D 20:42:31.909806] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3109 [D 20:42:31.909824] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 3/70. [D 20:42:31.909882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 7542. [D 20:42:31.909949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 7543. [D 20:42:31.910002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 7544. [D 20:42:31.910014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 7545. [D 20:42:31.910025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 7546. [D 20:42:31.910035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 7547. [D 20:42:31.910045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 7548. [D 20:42:31.910055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 7549. [D 20:42:31.910068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 7550. [D 20:42:31.910084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 7551. [D 20:42:31.910094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 7552. [D 20:42:31.910104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 7553. [D 20:42:31.910135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 7554. [D 20:42:31.910146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 7555. [D 20:42:31.910157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 7556. [D 20:42:31.910167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 7557. [D 20:42:31.910177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 7558. [D 20:42:31.910207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 7559. [D 20:42:31.910217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 7560. [D 20:42:31.910228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 7561. [D 20:42:31.910239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 7562. [D 20:42:31.910254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 7563. [D 20:42:31.910265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 7564. [D 20:42:31.910275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 7565. [D 20:42:31.910285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 7566. [D 20:42:31.910296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 7567. [D 20:42:31.910308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 7568. [D 20:42:31.910317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 7569. [D 20:42:31.910347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 7570. [D 20:42:31.910357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 7571. [D 20:42:31.910367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 7572. [D 20:42:31.910383] openib_post_sr_rdmaw: ibv_post_send wr_id 662410 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 7573. [D 20:42:31.915803] openib_check_cq: completed rdma wr_id 662410, nic_wr_credit 7573. [D 20:42:31.915820] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 4/70. [D 20:42:31.918062] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.918077] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.918088] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.923572] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.923586] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.923596] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.923628] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3121 [D 20:42:31.923640] element 0: offset: 0x64b790, size: 24 [D 20:42:31.923651] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 5/70. [D 20:42:32.046895] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3119 [D 20:42:32.046914] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 6/70. [D 20:42:32.046974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 7573. [D 20:42:32.047042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 7574. [D 20:42:32.047053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 7575. [D 20:42:32.047064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 7576. [D 20:42:32.047074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 7577. [D 20:42:32.047088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 7578. [D 20:42:32.047098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 7579. [D 20:42:32.047108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 7580. [D 20:42:32.047118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 7581. [D 20:42:32.047128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 7582. [D 20:42:32.047138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 7583. [D 20:42:32.047184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 7584. [D 20:42:32.047195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 7585. [D 20:42:32.047205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 7586. [D 20:42:32.047215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 7587. [D 20:42:32.047250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 7588. [D 20:42:32.047260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 7589. [D 20:42:32.047270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 7590. [D 20:42:32.047281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 7591. [D 20:42:32.047305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 7592. [D 20:42:32.047316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 7593. [D 20:42:32.047325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 7594. [D 20:42:32.047335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 7595. [D 20:42:32.047351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 7596. [D 20:42:32.047361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 7597. [D 20:42:32.047381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 7598. [D 20:42:32.047392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 7599. [D 20:42:32.047403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 7600. [D 20:42:32.047413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 7601. [D 20:42:32.047438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 7602. [D 20:42:32.047448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 7603. [D 20:42:32.047458] openib_post_sr_rdmaw: ibv_post_send wr_id 662410 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 7604. [D 20:42:32.052971] openib_check_cq: completed rdma wr_id 662410, nic_wr_credit 7604. [D 20:42:32.052989] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 7/70. [D 20:42:32.055329] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:32.055344] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.055354] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:32.059969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:32.059983] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.059994] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:32.060026] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3125 [D 20:42:32.060037] element 0: offset: 0x61f310, size: 24 [D 20:42:32.060049] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 8/70. [D 20:42:32.130428] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3113 [D 20:42:32.130447] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 9/70. [D 20:42:32.130505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7604. [D 20:42:32.130576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7605. [D 20:42:32.130622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7606. [D 20:42:32.130633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7607. [D 20:42:32.130644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7608. [D 20:42:32.130654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7609. [D 20:42:32.130664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7610. [D 20:42:32.130674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7611. [D 20:42:32.130696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7612. [D 20:42:32.130707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7613. [D 20:42:32.130716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7614. [D 20:42:32.130733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7615. [D 20:42:32.130742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7616. [D 20:42:32.130752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7617. [D 20:42:32.130768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7618. [D 20:42:32.130778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7619. [D 20:42:32.130788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7620. [D 20:42:32.130797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7621. [D 20:42:32.130821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7622. [D 20:42:32.130831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7623. [D 20:42:32.130841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7624. [D 20:42:32.130857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7625. [D 20:42:32.130867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7626. [D 20:42:32.130876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7627. [D 20:42:32.130886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7628. [D 20:42:32.130918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7629. [D 20:42:32.130928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7630. [D 20:42:32.130942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7631. [D 20:42:32.130952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7632. [D 20:42:32.130962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7633. [D 20:42:32.130986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7634. [D 20:42:32.130995] openib_post_sr_rdmaw: ibv_post_send wr_id 6a8370 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7635. [D 20:42:32.136434] openib_check_cq: completed rdma wr_id 6a8370, nic_wr_credit 7635. [D 20:42:32.136453] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 10/70. [D 20:42:32.138682] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:32.138698] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.138708] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:32.144583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:32.144598] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.144609] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:32.144642] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3128 [D 20:42:32.144654] element 0: offset: 0x61f800, size: 24 [D 20:42:32.144666] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 11/70. [D 20:42:32.727900] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3128 [D 20:42:32.727919] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 12/70. [D 20:42:32.728018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7635. [D 20:42:32.728130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7636. [D 20:42:32.728142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7637. [D 20:42:32.728152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7638. [D 20:42:32.728166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7639. [D 20:42:32.728176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7640. [D 20:42:32.728185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7641. [D 20:42:32.728201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7642. [D 20:42:32.728211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7643. [D 20:42:32.728220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7644. [D 20:42:32.728247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7645. [D 20:42:32.728257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7646. [D 20:42:32.728280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7647. [D 20:42:32.728290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7648. [D 20:42:32.728316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7649. [D 20:42:32.728326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7650. [D 20:42:32.728351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7651. [D 20:42:32.728362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7652. [D 20:42:32.728384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7653. [D 20:42:32.728395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7654. [D 20:42:32.728418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7655. [D 20:42:32.728427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7656. [D 20:42:32.728454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7657. [D 20:42:32.728464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7658. [D 20:42:32.728474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7659. [D 20:42:32.728484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7660. [D 20:42:32.728494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7661. [D 20:42:32.728517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7662. [D 20:42:32.728528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7663. [D 20:42:32.728548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7664. [D 20:42:32.728558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7665. [D 20:42:32.728578] openib_post_sr_rdmaw: ibv_post_send wr_id 6a8370 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7666. [D 20:42:32.734042] openib_check_cq: completed rdma wr_id 6a8370, nic_wr_credit 7666. [D 20:42:32.734060] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 13/70. [D 20:42:32.736357] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:32.736373] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.736383] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:32.742133] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:32.742147] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.742157] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:32.742191] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3131 [D 20:42:32.742201] element 0: offset: 0x627f50, size: 24 [D 20:42:32.742213] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 14/70. [D 20:42:32.822992] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3116 [D 20:42:32.823011] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 15/70. [D 20:42:32.823082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 7666. [D 20:42:32.823181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7667. [D 20:42:32.823194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7668. [D 20:42:32.823206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7669. [D 20:42:32.823219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7670. [D 20:42:32.823230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7671. [D 20:42:32.823240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7672. [D 20:42:32.823249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7673. [D 20:42:32.823285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7674. [D 20:42:32.823294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7675. [D 20:42:32.823320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7676. [D 20:42:32.823330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7677. [D 20:42:32.823353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7678. [D 20:42:32.823366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7679. [D 20:42:32.823379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7680. [D 20:42:32.823404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7681. [D 20:42:32.823417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7682. [D 20:42:32.823439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7683. [D 20:42:32.823452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7684. [D 20:42:32.823471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7685. [D 20:42:32.823486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7686. [D 20:42:32.823505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7687. [D 20:42:32.823516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7688. [D 20:42:32.823526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7689. [D 20:42:32.823545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7690. [D 20:42:32.823559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7691. [D 20:42:32.823581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7692. [D 20:42:32.823596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7693. [D 20:42:32.823606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7694. [D 20:42:32.823615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7695. [D 20:42:32.823625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7696. [D 20:42:32.823654] openib_post_sr_rdmaw: ibv_post_send wr_id 63dfb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7697. [D 20:42:32.829035] openib_check_cq: completed rdma wr_id 63dfb0, nic_wr_credit 7697. [D 20:42:32.829053] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 16/70. [D 20:42:32.831348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:32.831363] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.831373] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:32.834209] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3121 [D 20:42:32.834229] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 17/70. [D 20:42:32.834776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 7697. [D 20:42:32.834801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 7698. [D 20:42:32.834811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 7699. [D 20:42:32.834822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 7700. [D 20:42:32.834837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 7701. [D 20:42:32.834847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 7702. [D 20:42:32.834857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 7703. [D 20:42:32.834868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 7704. [D 20:42:32.834878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 7705. [D 20:42:32.834887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 7706. [D 20:42:32.834897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 7707. [D 20:42:32.834928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 7708. [D 20:42:32.834938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 7709. [D 20:42:32.834963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 7710. [D 20:42:32.834973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 7711. [D 20:42:32.834985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 7712. [D 20:42:32.835006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 7713. [D 20:42:32.835018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 7714. [D 20:42:32.835028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 7715. [D 20:42:32.835038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 7716. [D 20:42:32.835063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 7717. [D 20:42:32.835074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 7718. [D 20:42:32.835086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 7719. [D 20:42:32.835096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 7720. [D 20:42:32.835106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 7721. [D 20:42:32.835120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 7722. [D 20:42:32.835131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 7723. [D 20:42:32.835152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 7724. [D 20:42:32.835163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 7725. [D 20:42:32.835174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 7726. [D 20:42:32.835195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 7727. [D 20:42:32.835206] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 7728. [D 20:42:32.836000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:32.836015] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.836025] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:32.836061] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3134 [D 20:42:32.836072] element 0: offset: 0x61ee50, size: 24 [D 20:42:32.837701] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 18/70. [D 20:42:32.840667] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7728. [D 20:42:32.840682] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 19/70. [D 20:42:32.843043] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:32.843056] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.843066] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:32.907961] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3131 [D 20:42:32.907981] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 20/70. [D 20:42:32.908045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7728. [D 20:42:32.908115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7729. [D 20:42:32.908126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7730. [D 20:42:32.908136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7731. [D 20:42:32.908193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7732. [D 20:42:32.908204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7733. [D 20:42:32.908214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7734. [D 20:42:32.908239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7735. [D 20:42:32.908249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7736. [D 20:42:32.908259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7737. [D 20:42:32.908282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7738. [D 20:42:32.908293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7739. [D 20:42:32.908303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7740. [D 20:42:32.908325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7741. [D 20:42:32.908339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7742. [D 20:42:32.908361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7743. [D 20:42:32.908375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7744. [D 20:42:32.908397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7745. [D 20:42:32.908410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7746. [D 20:42:32.908430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7747. [D 20:42:32.908440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7748. [D 20:42:32.908454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7749. [D 20:42:32.908476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7750. [D 20:42:32.908490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7751. [D 20:42:32.908510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7752. [D 20:42:32.908520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7753. [D 20:42:32.908530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7754. [D 20:42:32.908556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7755. [D 20:42:32.908567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7756. [D 20:42:32.908586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7757. [D 20:42:32.908600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7758. [D 20:42:32.908610] openib_post_sr_rdmaw: ibv_post_send wr_id 63e100 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7759. [D 20:42:32.913985] openib_check_cq: completed rdma wr_id 63e100, nic_wr_credit 7759. [D 20:42:32.914002] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 21/70. [D 20:42:32.916324] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:32.916339] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.916350] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:32.922687] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:32.922702] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.922712] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:32.922745] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3137 [D 20:42:32.922756] element 0: offset: 0x691fe0, size: 24 [D 20:42:32.922770] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 22/70. [D 20:42:32.975852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:32.975914] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.975924] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:32.975962] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3139 [D 20:42:32.975972] element 0: offset: 0x648fe0, size: 24 [D 20:42:32.975986] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 23/70. [D 20:42:32.976410] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3125 [D 20:42:32.976431] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 24/70. [D 20:42:32.976504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 7759. [D 20:42:32.976527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 7760. [D 20:42:32.976537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 7761. [D 20:42:32.976547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 7762. [D 20:42:32.976558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 7763. [D 20:42:32.976568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 7764. [D 20:42:32.976577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 7765. [D 20:42:32.976837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 7766. [D 20:42:32.976851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 7767. [D 20:42:32.976861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 7768. [D 20:42:32.976872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 7769. [D 20:42:32.976881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 7770. [D 20:42:32.976891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 7771. [D 20:42:32.976901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 7772. [D 20:42:32.976911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 7773. [D 20:42:32.976921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 7774. [D 20:42:32.976930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 7775. [D 20:42:32.976957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 7776. [D 20:42:32.976967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 7777. [D 20:42:32.976977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 7778. [D 20:42:32.976987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 7779. [D 20:42:32.976997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 7780. [D 20:42:32.977006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 7781. [D 20:42:32.977036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 7782. [D 20:42:32.977046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 7783. [D 20:42:32.977064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 7784. [D 20:42:32.977075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 7785. [D 20:42:32.977085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 7786. [D 20:42:32.977095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 7787. [D 20:42:32.977113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 7788. [D 20:42:32.977122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 7789. [D 20:42:32.977132] openib_post_sr_rdmaw: ibv_post_send wr_id 63e100 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 7790. [D 20:42:32.987146] openib_check_cq: completed rdma wr_id 63e100, nic_wr_credit 7790. [D 20:42:32.987175] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 25/70. [D 20:42:32.989384] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:32.989400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.989411] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:32.995444] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:32.995459] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:32.995469] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:32.995502] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3143 [D 20:42:32.995513] element 0: offset: 0x62a350, size: 24 [D 20:42:32.995525] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 26/70. [D 20:42:33.035221] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3134 [D 20:42:33.035241] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 27/70. [D 20:42:33.035298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 7790. [D 20:42:33.035366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7791. [D 20:42:33.035386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7792. [D 20:42:33.035399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7793. [D 20:42:33.035409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7794. [D 20:42:33.035419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7795. [D 20:42:33.035429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7796. [D 20:42:33.035439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7797. [D 20:42:33.035448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7798. [D 20:42:33.035463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7799. [D 20:42:33.035512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7800. [D 20:42:33.035522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7801. [D 20:42:33.035533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7802. [D 20:42:33.035554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7803. [D 20:42:33.035563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7804. [D 20:42:33.035574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7805. [D 20:42:33.035583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7806. [D 20:42:33.035598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7807. [D 20:42:33.035608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7808. [D 20:42:33.035617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7809. [D 20:42:33.035627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7810. [D 20:42:33.035637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7811. [D 20:42:33.035647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7812. [D 20:42:33.035657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7813. [D 20:42:33.035685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7814. [D 20:42:33.035695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7815. [D 20:42:33.035705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7816. [D 20:42:33.035715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7817. [D 20:42:33.035726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7818. [D 20:42:33.035736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7819. [D 20:42:33.035745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7820. [D 20:42:33.035771] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7821. [D 20:42:33.041224] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7821. [D 20:42:33.041242] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 28/70. [D 20:42:33.043555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.043570] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.043580] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:33.049351] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.049366] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.049376] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:33.049410] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3146 [D 20:42:33.049421] element 0: offset: 0x66e640, size: 24 [D 20:42:33.049435] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 29/70. [D 20:42:33.119436] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3143 [D 20:42:33.119455] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 30/70. [D 20:42:33.119513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 7821. [D 20:42:33.119579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 7822. [D 20:42:33.119598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 7823. [D 20:42:33.119609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 7824. [D 20:42:33.119619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 7825. [D 20:42:33.119629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 7826. [D 20:42:33.119644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 7827. [D 20:42:33.119654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 7828. [D 20:42:33.119664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 7829. [D 20:42:33.119680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 7830. [D 20:42:33.119727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 7831. [D 20:42:33.119740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 7832. [D 20:42:33.119766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 7833. [D 20:42:33.119778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 7834. [D 20:42:33.119788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 7835. [D 20:42:33.119797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 7836. [D 20:42:33.119821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 7837. [D 20:42:33.119830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 7838. [D 20:42:33.119841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 7839. [D 20:42:33.119851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 7840. [D 20:42:33.119860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 7841. [D 20:42:33.119875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 7842. [D 20:42:33.119886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 7843. [D 20:42:33.119920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 7844. [D 20:42:33.119931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 7845. [D 20:42:33.119940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 7846. [D 20:42:33.119950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 7847. [D 20:42:33.119961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 7848. [D 20:42:33.119973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 7849. [D 20:42:33.119982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 7850. [D 20:42:33.119992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 7851. [D 20:42:33.120003] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 7852. [D 20:42:33.125433] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 7852. [D 20:42:33.125451] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 31/70. [D 20:42:33.127711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.127726] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.127736] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:33.132036] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.132076] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.132086] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:33.132122] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3149 [D 20:42:33.132134] element 0: offset: 0x63e8c0, size: 24 [D 20:42:33.132148] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 32/70. [D 20:42:33.178480] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3146 [D 20:42:33.178499] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 33/70. [D 20:42:33.178561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 7852. [D 20:42:33.178629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7853. [D 20:42:33.178649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7854. [D 20:42:33.178659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7855. [D 20:42:33.178670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7856. [D 20:42:33.178679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7857. [D 20:42:33.178694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7858. [D 20:42:33.178705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7859. [D 20:42:33.178714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7860. [D 20:42:33.178724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7861. [D 20:42:33.178734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7862. [D 20:42:33.178748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7863. [D 20:42:33.178757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7864. [D 20:42:33.178773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7865. [D 20:42:33.178784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7866. [D 20:42:33.178829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7867. [D 20:42:33.178840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7868. [D 20:42:33.178851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7869. [D 20:42:33.178860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7870. [D 20:42:33.178870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7871. [D 20:42:33.178886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7872. [D 20:42:33.178913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7873. [D 20:42:33.178923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7874. [D 20:42:33.178933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7875. [D 20:42:33.178961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7876. [D 20:42:33.178971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7877. [D 20:42:33.178986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7878. [D 20:42:33.178996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7879. [D 20:42:33.179006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7880. [D 20:42:33.179033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7881. [D 20:42:33.179043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7882. [D 20:42:33.179055] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7883. [D 20:42:33.184488] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7883. [D 20:42:33.184505] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 34/70. [D 20:42:33.186661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.186675] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.186685] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:33.192797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.192811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.192821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:33.192854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3152 [D 20:42:33.192865] element 0: offset: 0x61f310, size: 24 [D 20:42:33.192876] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 35/70. [D 20:42:33.239208] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3149 [D 20:42:33.239227] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 36/70. [D 20:42:33.239299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 7883. [D 20:42:33.239399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 7884. [D 20:42:33.239413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 7885. [D 20:42:33.239424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 7886. [D 20:42:33.239435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 7887. [D 20:42:33.239445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 7888. [D 20:42:33.239455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 7889. [D 20:42:33.239464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 7890. [D 20:42:33.239489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 7891. [D 20:42:33.239498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 7892. [D 20:42:33.239508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 7893. [D 20:42:33.239537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 7894. [D 20:42:33.239547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 7895. [D 20:42:33.239571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 7896. [D 20:42:33.239582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 7897. [D 20:42:33.239593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 7898. [D 20:42:33.239614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 7899. [D 20:42:33.239628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 7900. [D 20:42:33.239638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 7901. [D 20:42:33.239660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 7902. [D 20:42:33.239670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 7903. [D 20:42:33.239679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 7904. [D 20:42:33.239702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 7905. [D 20:42:33.239711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 7906. [D 20:42:33.239735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 7907. [D 20:42:33.239746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 7908. [D 20:42:33.239756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 7909. [D 20:42:33.239766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 7910. [D 20:42:33.239775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 7911. [D 20:42:33.239801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 7912. [D 20:42:33.239811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 7913. [D 20:42:33.239834] openib_post_sr_rdmaw: ibv_post_send wr_id 643280 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 7914. [D 20:42:33.245253] openib_check_cq: completed rdma wr_id 643280, nic_wr_credit 7914. [D 20:42:33.245269] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 37/70. [D 20:42:33.247441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.247456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.247467] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:33.287896] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3152 [D 20:42:33.287915] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 38/70. [D 20:42:33.287970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 7914. [D 20:42:33.288040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7915. [D 20:42:33.288090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7916. [D 20:42:33.288101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7917. [D 20:42:33.288112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7918. [D 20:42:33.288122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7919. [D 20:42:33.288132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7920. [D 20:42:33.288142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7921. [D 20:42:33.288166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7922. [D 20:42:33.288176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7923. [D 20:42:33.288186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7924. [D 20:42:33.288201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7925. [D 20:42:33.288211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7926. [D 20:42:33.288221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7927. [D 20:42:33.288230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7928. [D 20:42:33.288254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7929. [D 20:42:33.288264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7930. [D 20:42:33.288274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7931. [D 20:42:33.288301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7932. [D 20:42:33.288311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7933. [D 20:42:33.288337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7934. [D 20:42:33.288346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7935. [D 20:42:33.288360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7936. [D 20:42:33.288370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7937. [D 20:42:33.288380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7938. [D 20:42:33.288394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7939. [D 20:42:33.288404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7940. [D 20:42:33.288413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7941. [D 20:42:33.288423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7942. [D 20:42:33.288433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7943. [D 20:42:33.288443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7944. [D 20:42:33.288466] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7945. [D 20:42:33.293897] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7945. [D 20:42:33.293914] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 39/70. [D 20:42:33.296121] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.296136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.296146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:33.302356] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.302370] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.302381] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:33.302413] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3155 [D 20:42:33.302424] element 0: offset: 0x5b0030, size: 24 [D 20:42:33.302436] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 40/70. [D 20:42:33.339360] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3139 [D 20:42:33.339378] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 41/70. [D 20:42:33.339441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 7945. [D 20:42:33.339522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 7946. [D 20:42:33.339533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 7947. [D 20:42:33.339544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 7948. [D 20:42:33.339554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 7949. [D 20:42:33.339564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 7950. [D 20:42:33.339578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 7951. [D 20:42:33.339588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 7952. [D 20:42:33.339598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 7953. [D 20:42:33.339614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 7954. [D 20:42:33.339665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 7955. [D 20:42:33.339698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 7956. [D 20:42:33.339710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 7957. [D 20:42:33.339719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 7958. [D 20:42:33.339729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 7959. [D 20:42:33.339759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 7960. [D 20:42:33.339769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 7961. [D 20:42:33.339780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 7962. [D 20:42:33.339790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 7963. [D 20:42:33.339800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 7964. [D 20:42:33.339811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 7965. [D 20:42:33.339820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 7966. [D 20:42:33.339845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 7967. [D 20:42:33.339855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 7968. [D 20:42:33.339865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 7969. [D 20:42:33.339889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 7970. [D 20:42:33.339899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 7971. [D 20:42:33.339909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 7972. [D 20:42:33.339918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 7973. [D 20:42:33.339928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 7974. [D 20:42:33.339939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 7975. [D 20:42:33.339963] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 7976. [D 20:42:33.345386] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7976. [D 20:42:33.345407] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 42/70. [D 20:42:33.347548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.347563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.347573] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:33.353382] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.353397] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.353407] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:33.353440] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3157 [D 20:42:33.353451] element 0: offset: 0x66e640, size: 24 [D 20:42:33.353465] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 43/70. [D 20:42:33.380401] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3137 [D 20:42:33.380420] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 44/70. [D 20:42:33.380487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7976. [D 20:42:33.380603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7977. [D 20:42:33.380615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7978. [D 20:42:33.380626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7979. [D 20:42:33.380640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7980. [D 20:42:33.380650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7981. [D 20:42:33.380660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7982. [D 20:42:33.380675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7983. [D 20:42:33.380685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7984. [D 20:42:33.380694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7985. [D 20:42:33.380710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7986. [D 20:42:33.380720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7987. [D 20:42:33.380730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7988. [D 20:42:33.380763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7989. [D 20:42:33.380774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7990. [D 20:42:33.380784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7991. [D 20:42:33.380794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7992. [D 20:42:33.380809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7993. [D 20:42:33.380819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7994. [D 20:42:33.380829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7995. [D 20:42:33.380845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7996. [D 20:42:33.380869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7997. [D 20:42:33.380897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7998. [D 20:42:33.380907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7999. [D 20:42:33.380918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 8000. [D 20:42:33.380928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 8001. [D 20:42:33.380938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 8002. [D 20:42:33.380948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 8003. [D 20:42:33.380958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 8004. [D 20:42:33.380968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 8005. [D 20:42:33.380978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 8006. [D 20:42:33.380996] openib_post_sr_rdmaw: ibv_post_send wr_id 63e100 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 8007. [D 20:42:33.383286] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.383301] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.383315] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:33.383352] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3161 [D 20:42:33.383365] element 0: offset: 0x61f310, size: 24 [D 20:42:33.383378] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 45/70. [D 20:42:33.388043] openib_check_cq: completed rdma wr_id 63e100, nic_wr_credit 8007. [D 20:42:33.388073] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 46/70. [D 20:42:33.390379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.390394] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.390404] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:33.396075] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.396093] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.396103] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:33.396135] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3164 [D 20:42:33.396146] element 0: offset: 0x61ee50, size: 24 [D 20:42:33.396158] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 47/70. [D 20:42:33.438223] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3155 [D 20:42:33.438241] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 48/70. [D 20:42:33.438300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 8007. [D 20:42:33.438368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 8008. [D 20:42:33.438379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 8009. [D 20:42:33.438389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 8010. [D 20:42:33.438400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 8011. [D 20:42:33.438410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 8012. [D 20:42:33.438420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8013. [D 20:42:33.438430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8014. [D 20:42:33.438440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8015. [D 20:42:33.438449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 8016. [D 20:42:33.438459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 8017. [D 20:42:33.438524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 8018. [D 20:42:33.438535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 8019. [D 20:42:33.438557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 8020. [D 20:42:33.438569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8021. [D 20:42:33.438579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8022. [D 20:42:33.438589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8023. [D 20:42:33.438602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 8024. [D 20:42:33.438612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 8025. [D 20:42:33.438621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 8026. [D 20:42:33.438644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 8027. [D 20:42:33.438655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 8028. [D 20:42:33.438665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8029. [D 20:42:33.438674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8030. [D 20:42:33.438691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8031. [D 20:42:33.438713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 8032. [D 20:42:33.438724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 8033. [D 20:42:33.438735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 8034. [D 20:42:33.438744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 8035. [D 20:42:33.438755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 8036. [D 20:42:33.438765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8037. [D 20:42:33.438775] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8038. [D 20:42:33.444225] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 8038. [D 20:42:33.444243] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 49/70. [D 20:42:33.446388] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.446403] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.446412] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:33.452487] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.452502] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.452512] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:33.452551] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3167 [D 20:42:33.452569] element 0: offset: 0x648fe0, size: 24 [D 20:42:33.452581] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 50/70. [D 20:42:33.504767] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3167 [D 20:42:33.504786] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 51/70. [D 20:42:33.504845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 8038. [D 20:42:33.504912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 8039. [D 20:42:33.504932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 8040. [D 20:42:33.504943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 8041. [D 20:42:33.504954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 8042. [D 20:42:33.504964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 8043. [D 20:42:33.504978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8044. [D 20:42:33.504988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8045. [D 20:42:33.504997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8046. [D 20:42:33.505008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 8047. [D 20:42:33.505058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 8048. [D 20:42:33.505068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 8049. [D 20:42:33.505081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 8050. [D 20:42:33.505102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 8051. [D 20:42:33.505116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8052. [D 20:42:33.505126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8053. [D 20:42:33.505136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8054. [D 20:42:33.505150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 8055. [D 20:42:33.505160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 8056. [D 20:42:33.505185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 8057. [D 20:42:33.505196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 8058. [D 20:42:33.505212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 8059. [D 20:42:33.505223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8060. [D 20:42:33.505248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8061. [D 20:42:33.505258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8062. [D 20:42:33.505268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 8063. [D 20:42:33.505294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 8064. [D 20:42:33.505305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 8065. [D 20:42:33.505315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 8066. [D 20:42:33.505325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 8067. [D 20:42:33.505335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8068. [D 20:42:33.505345] openib_post_sr_rdmaw: ibv_post_send wr_id 627a10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8069. [D 20:42:33.510848] openib_check_cq: completed rdma wr_id 627a10, nic_wr_credit 8069. [D 20:42:33.510865] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 52/70. [D 20:42:33.513069] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.513084] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.513094] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:33.573916] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3164 [D 20:42:33.573935] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 53/70. [D 20:42:33.574013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 8069. [D 20:42:33.574086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 8070. [D 20:42:33.574098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 8071. [D 20:42:33.574108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 8072. [D 20:42:33.574119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 8073. [D 20:42:33.574129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 8074. [D 20:42:33.574139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 8075. [D 20:42:33.574149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 8076. [D 20:42:33.574159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 8077. [D 20:42:33.574169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 8078. [D 20:42:33.574179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 8079. [D 20:42:33.574221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 8080. [D 20:42:33.574234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 8081. [D 20:42:33.574244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 8082. [D 20:42:33.574260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 8083. [D 20:42:33.574270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 8084. [D 20:42:33.574281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 8085. [D 20:42:33.574291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 8086. [D 20:42:33.574302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 8087. [D 20:42:33.574313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 8088. [D 20:42:33.574333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 8089. [D 20:42:33.574345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 8090. [D 20:42:33.574355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 8091. [D 20:42:33.574365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 8092. [D 20:42:33.574375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 8093. [D 20:42:33.574391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 8094. [D 20:42:33.574401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 8095. [D 20:42:33.574411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 8096. [D 20:42:33.574447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 8097. [D 20:42:33.574460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 8098. [D 20:42:33.574470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 8099. [D 20:42:33.574480] openib_post_sr_rdmaw: ibv_post_send wr_id 6abd30 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 8100. [D 20:42:33.579996] openib_check_cq: completed rdma wr_id 6abd30, nic_wr_credit 8100. [D 20:42:33.580014] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 54/70. [D 20:42:33.582227] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.582242] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.582252] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:33.588202] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.588217] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.588227] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:33.588261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3170 [D 20:42:33.588272] element 0: offset: 0x661d50, size: 24 [D 20:42:33.588286] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 55/70. [D 20:42:33.625430] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3157 [D 20:42:33.625449] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 56/70. [D 20:42:33.625507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 8100. [D 20:42:33.625577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 8101. [D 20:42:33.625640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 8102. [D 20:42:33.625651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 8103. [D 20:42:33.625661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 8104. [D 20:42:33.625672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 8105. [D 20:42:33.625682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 8106. [D 20:42:33.625692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 8107. [D 20:42:33.625708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 8108. [D 20:42:33.625718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 8109. [D 20:42:33.625728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 8110. [D 20:42:33.625738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 8111. [D 20:42:33.625770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 8112. [D 20:42:33.625780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 8113. [D 20:42:33.625790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 8114. [D 20:42:33.625805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 8115. [D 20:42:33.625815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 8116. [D 20:42:33.625835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 8117. [D 20:42:33.625845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 8118. [D 20:42:33.625855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 8119. [D 20:42:33.625865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 8120. [D 20:42:33.625876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 8121. [D 20:42:33.625886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 8122. [D 20:42:33.625896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 8123. [D 20:42:33.625922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 8124. [D 20:42:33.625932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 8125. [D 20:42:33.625942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 8126. [D 20:42:33.625956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 8127. [D 20:42:33.625966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 8128. [D 20:42:33.625988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 8129. [D 20:42:33.626003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 8130. [D 20:42:33.626013] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 8131. [D 20:42:33.631433] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8131. [D 20:42:33.631450] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 57/70. [D 20:42:33.632073] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.632088] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.632098] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:33.639146] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.639161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.639171] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:33.639204] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3172 [D 20:42:33.639215] element 0: offset: 0x62a780, size: 24 [D 20:42:33.639227] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 58/70. [D 20:42:33.677781] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3161 [D 20:42:33.677799] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 59/70. [D 20:42:33.677856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 8131. [D 20:42:33.677928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 8132. [D 20:42:33.677939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 8133. [D 20:42:33.677950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 8134. [D 20:42:33.677960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 8135. [D 20:42:33.677971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 8136. [D 20:42:33.677980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 8137. [D 20:42:33.677991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 8138. [D 20:42:33.678001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 8139. [D 20:42:33.678011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 8140. [D 20:42:33.678021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 8141. [D 20:42:33.678085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 8142. [D 20:42:33.678096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 8143. [D 20:42:33.678118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 8144. [D 20:42:33.678129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 8145. [D 20:42:33.678139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 8146. [D 20:42:33.678149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 8147. [D 20:42:33.678160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 8148. [D 20:42:33.678170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 8149. [D 20:42:33.678181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 8150. [D 20:42:33.678207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 8151. [D 20:42:33.678218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 8152. [D 20:42:33.678228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 8153. [D 20:42:33.678238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 8154. [D 20:42:33.678248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 8155. [D 20:42:33.678259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 8156. [D 20:42:33.678285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 8157. [D 20:42:33.678301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 8158. [D 20:42:33.678311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 8159. [D 20:42:33.678333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 8160. [D 20:42:33.678344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 8161. [D 20:42:33.678354] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 8162. [D 20:42:33.683787] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8162. [D 20:42:33.683804] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 60/70. [D 20:42:33.686053] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.686069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.686080] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:33.691634] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.691649] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.691659] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:33.691692] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3176 [D 20:42:33.691703] element 0: offset: 0x5b0030, size: 24 [D 20:42:33.691717] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 0/70. [D 20:42:33.719829] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3170 [D 20:42:33.719847] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 1/70. [D 20:42:33.719907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 8162. [D 20:42:33.719974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 8163. [D 20:42:33.720028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 8164. [D 20:42:33.720039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 8165. [D 20:42:33.720058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 8166. [D 20:42:33.720073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 8167. [D 20:42:33.720083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 8168. [D 20:42:33.720093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 8169. [D 20:42:33.720107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 8170. [D 20:42:33.720117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 8171. [D 20:42:33.720127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 8172. [D 20:42:33.720157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 8173. [D 20:42:33.720168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 8174. [D 20:42:33.720179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 8175. [D 20:42:33.720189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 8176. [D 20:42:33.720200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 8177. [D 20:42:33.720224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 8178. [D 20:42:33.720234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 8179. [D 20:42:33.720244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 8180. [D 20:42:33.720259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 8181. [D 20:42:33.720269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 8182. [D 20:42:33.720279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 8183. [D 20:42:33.720309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 8184. [D 20:42:33.720320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 8185. [D 20:42:33.720332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 8186. [D 20:42:33.720341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 8187. [D 20:42:33.720351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 8188. [D 20:42:33.720380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 8189. [D 20:42:33.720396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 8190. [D 20:42:33.720406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 8191. [D 20:42:33.720416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 8192. [D 20:42:33.720446] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 8193. [D 20:42:33.725828] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8193. [D 20:42:33.725845] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 2/70. [D 20:42:33.728182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.728198] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.728208] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:33.915556] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3172 [D 20:42:33.915575] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 3/70. [D 20:42:33.915642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 8193. [D 20:42:33.915720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 8194. [D 20:42:33.915732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 8195. [D 20:42:33.915742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 8196. [D 20:42:33.915753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 8197. [D 20:42:33.915762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 8198. [D 20:42:33.915772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 8199. [D 20:42:33.915782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 8200. [D 20:42:33.915792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 8201. [D 20:42:33.915802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 8202. [D 20:42:33.915811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 8203. [D 20:42:33.915868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 8204. [D 20:42:33.915879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 8205. [D 20:42:33.915892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 8206. [D 20:42:33.915916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 8207. [D 20:42:33.915927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 8208. [D 20:42:33.915937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 8209. [D 20:42:33.915947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 8210. [D 20:42:33.915979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 8211. [D 20:42:33.915992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 8212. [D 20:42:33.916002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 8213. [D 20:42:33.916014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 8214. [D 20:42:33.916029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 8215. [D 20:42:33.916039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 8216. [D 20:42:33.916049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 8217. [D 20:42:33.916058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 8218. [D 20:42:33.916072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 8219. [D 20:42:33.916081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 8220. [D 20:42:33.916110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 8221. [D 20:42:33.916120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 8222. [D 20:42:33.916130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 8223. [D 20:42:33.916139] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 8224. [D 20:42:33.921586] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 8224. [D 20:42:33.921604] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 4/70. [D 20:42:33.923890] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:33.923905] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.923915] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:33.928076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:33.928091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:33.928101] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:33.928133] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3178 [D 20:42:33.928144] element 0: offset: 0x64b790, size: 24 [D 20:42:33.930242] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 5/70. [D 20:42:34.004890] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3178 [D 20:42:34.004909] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 6/70. [D 20:42:34.004972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 8224. [D 20:42:34.005043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 8225. [D 20:42:34.005064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 8226. [D 20:42:34.005077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 8227. [D 20:42:34.005088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 8228. [D 20:42:34.005098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 8229. [D 20:42:34.005108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 8230. [D 20:42:34.005118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8231. [D 20:42:34.005130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8232. [D 20:42:34.005146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8233. [D 20:42:34.005198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 8234. [D 20:42:34.005209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 8235. [D 20:42:34.005235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 8236. [D 20:42:34.005245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 8237. [D 20:42:34.005255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 8238. [D 20:42:34.005269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8239. [D 20:42:34.005279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8240. [D 20:42:34.005304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8241. [D 20:42:34.005314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 8242. [D 20:42:34.005324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 8243. [D 20:42:34.005340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 8244. [D 20:42:34.005365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 8245. [D 20:42:34.005379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 8246. [D 20:42:34.005389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8247. [D 20:42:34.005399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8248. [D 20:42:34.005413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8249. [D 20:42:34.005422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 8250. [D 20:42:34.005450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 8251. [D 20:42:34.005460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 8252. [D 20:42:34.005470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 8253. [D 20:42:34.005485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 8254. [D 20:42:34.005494] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8255. [D 20:42:34.008988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.009004] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.009015] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:34.009051] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3182 [D 20:42:34.009065] element 0: offset: 0x66e640, size: 24 [D 20:42:34.009078] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 7/70. [D 20:42:34.010913] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8255. [D 20:42:34.010929] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 8/70. [D 20:42:34.013307] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.013321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.013332] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:34.019573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.019589] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.019599] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:34.019615] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3184 [D 20:42:34.019628] element 0: offset: 0x61f310, size: 24 [D 20:42:34.019637] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 9/70. [D 20:42:34.032889] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3176 [D 20:42:34.032908] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 10/70. [D 20:42:34.033059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 8255. [D 20:42:34.033159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 8256. [D 20:42:34.033170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 8257. [D 20:42:34.033180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 8258. [D 20:42:34.033194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 8259. [D 20:42:34.033204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 8260. [D 20:42:34.033214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 8261. [D 20:42:34.033228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 8262. [D 20:42:34.033237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 8263. [D 20:42:34.033247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 8264. [D 20:42:34.033263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 8265. [D 20:42:34.033273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 8266. [D 20:42:34.033282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 8267. [D 20:42:34.033315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 8268. [D 20:42:34.033325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 8269. [D 20:42:34.033336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 8270. [D 20:42:34.033346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 8271. [D 20:42:34.033356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 8272. [D 20:42:34.033367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 8273. [D 20:42:34.033393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 8274. [D 20:42:34.033406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 8275. [D 20:42:34.033415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 8276. [D 20:42:34.033425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 8277. [D 20:42:34.033441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 8278. [D 20:42:34.033460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 8279. [D 20:42:34.033476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 8280. [D 20:42:34.033486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 8281. [D 20:42:34.033496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 8282. [D 20:42:34.033520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 8283. [D 20:42:34.033531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 8284. [D 20:42:34.033543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 8285. [D 20:42:34.033558] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 8286. [D 20:42:34.041139] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 8286. [D 20:42:34.041155] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 11/70. [D 20:42:34.043451] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.043466] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.043476] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.043510] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3188 [D 20:42:34.043521] element 0: offset: 0x62a780, size: 24 [D 20:42:34.043534] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 12/70. [D 20:42:34.043569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.043581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.043591] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.049344] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.049361] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.049372] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.049389] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3191 [D 20:42:34.049402] element 0: offset: 0x661d50, size: 24 [D 20:42:34.049412] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 13/70. [D 20:42:34.086389] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3184 [D 20:42:34.086407] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 14/70. [D 20:42:34.086471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 8286. [D 20:42:34.086541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 8287. [D 20:42:34.086561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 8288. [D 20:42:34.086571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 8289. [D 20:42:34.086582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 8290. [D 20:42:34.086592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 8291. [D 20:42:34.086606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 8292. [D 20:42:34.086616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8293. [D 20:42:34.086626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8294. [D 20:42:34.086641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8295. [D 20:42:34.086651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 8296. [D 20:42:34.086702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 8297. [D 20:42:34.086712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 8298. [D 20:42:34.086722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 8299. [D 20:42:34.086747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 8300. [D 20:42:34.086756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8301. [D 20:42:34.086766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8302. [D 20:42:34.086776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8303. [D 20:42:34.086786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 8304. [D 20:42:34.086820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 8305. [D 20:42:34.086831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 8306. [D 20:42:34.086841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 8307. [D 20:42:34.086852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 8308. [D 20:42:34.086862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8309. [D 20:42:34.086872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8310. [D 20:42:34.086882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8311. [D 20:42:34.086891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 8312. [D 20:42:34.086901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 8313. [D 20:42:34.086911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 8314. [D 20:42:34.086921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 8315. [D 20:42:34.086932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 8316. [D 20:42:34.086941] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8317. [D 20:42:34.092393] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8317. [D 20:42:34.092409] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 15/70. [D 20:42:34.094572] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.094587] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.094597] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.100090] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.100104] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.100115] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.100148] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3193 [D 20:42:34.100159] element 0: offset: 0x655ed0, size: 24 [D 20:42:34.100489] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 16/70. [D 20:42:34.128386] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3191 [D 20:42:34.128405] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 17/70. [D 20:42:34.128467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 8317. [D 20:42:34.128535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 8318. [D 20:42:34.128555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 8319. [D 20:42:34.128568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 8320. [D 20:42:34.128579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 8321. [D 20:42:34.128589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 8322. [D 20:42:34.128599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 8323. [D 20:42:34.128609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 8324. [D 20:42:34.128619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 8325. [D 20:42:34.128633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 8326. [D 20:42:34.128681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 8327. [D 20:42:34.128692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 8328. [D 20:42:34.128717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 8329. [D 20:42:34.128728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 8330. [D 20:42:34.128738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 8331. [D 20:42:34.128748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 8332. [D 20:42:34.128758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 8333. [D 20:42:34.128768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 8334. [D 20:42:34.128778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 8335. [D 20:42:34.128788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 8336. [D 20:42:34.128816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 8337. [D 20:42:34.128826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 8338. [D 20:42:34.128836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 8339. [D 20:42:34.128846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 8340. [D 20:42:34.128870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 8341. [D 20:42:34.128880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 8342. [D 20:42:34.128890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 8343. [D 20:42:34.128901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 8344. [D 20:42:34.128925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 8345. [D 20:42:34.128936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 8346. [D 20:42:34.128947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 8347. [D 20:42:34.128956] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 8348. [D 20:42:34.134469] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8348. [D 20:42:34.134486] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 18/70. [D 20:42:34.136679] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.136695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.136705] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.142554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.142593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.142603] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.142639] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3197 [D 20:42:34.142651] element 0: offset: 0x691fe0, size: 24 [D 20:42:34.142663] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 19/70. [D 20:42:34.186822] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3193 [D 20:42:34.186841] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 20/70. [D 20:42:34.186896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 8348. [D 20:42:34.186962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 8349. [D 20:42:34.186973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 8350. [D 20:42:34.186983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 8351. [D 20:42:34.186993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 8352. [D 20:42:34.187003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 8353. [D 20:42:34.187013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 8354. [D 20:42:34.187023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8355. [D 20:42:34.187033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8356. [D 20:42:34.187043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8357. [D 20:42:34.187052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 8358. [D 20:42:34.187069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 8359. [D 20:42:34.187079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 8360. [D 20:42:34.187088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 8361. [D 20:42:34.187152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 8362. [D 20:42:34.187175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8363. [D 20:42:34.187186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8364. [D 20:42:34.187196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8365. [D 20:42:34.187206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 8366. [D 20:42:34.187235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 8367. [D 20:42:34.187245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 8368. [D 20:42:34.187258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 8369. [D 20:42:34.187267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 8370. [D 20:42:34.187277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8371. [D 20:42:34.187304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8372. [D 20:42:34.187317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8373. [D 20:42:34.187330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 8374. [D 20:42:34.187340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 8375. [D 20:42:34.187349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 8376. [D 20:42:34.187364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 8377. [D 20:42:34.187373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 8378. [D 20:42:34.187402] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8379. [D 20:42:34.192857] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8379. [D 20:42:34.192875] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 21/70. [D 20:42:34.195079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.195094] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.195104] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.200097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.200111] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.200121] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.200154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3199 [D 20:42:34.200165] element 0: offset: 0x5b0030, size: 24 [D 20:42:34.200176] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 22/70. [D 20:42:34.304237] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3197 [D 20:42:34.304256] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 23/70. [D 20:42:34.304410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 8379. [D 20:42:34.304478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 8380. [D 20:42:34.304489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 8381. [D 20:42:34.304499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 8382. [D 20:42:34.304513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 8383. [D 20:42:34.304523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 8384. [D 20:42:34.304533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 8385. [D 20:42:34.304547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 8386. [D 20:42:34.304557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 8387. [D 20:42:34.304567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 8388. [D 20:42:34.304625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 8389. [D 20:42:34.304637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 8390. [D 20:42:34.304647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 8391. [D 20:42:34.304658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 8392. [D 20:42:34.304676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 8393. [D 20:42:34.304686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 8394. [D 20:42:34.304696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 8395. [D 20:42:34.304713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 8396. [D 20:42:34.304723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 8397. [D 20:42:34.304732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 8398. [D 20:42:34.304759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 8399. [D 20:42:34.304770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 8400. [D 20:42:34.304780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 8401. [D 20:42:34.304808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 8402. [D 20:42:34.304834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 8403. [D 20:42:34.304845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 8404. [D 20:42:34.304855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 8405. [D 20:42:34.304864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 8406. [D 20:42:34.304880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 8407. [D 20:42:34.304889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 8408. [D 20:42:34.304899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 8409. [D 20:42:34.304915] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 8410. [D 20:42:34.310414] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8410. [D 20:42:34.310430] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 24/70. [D 20:42:34.312743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.312759] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.312769] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.315948] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3199 [D 20:42:34.315968] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 25/70. [D 20:42:34.316144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 8410. [D 20:42:34.316208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 8411. [D 20:42:34.316219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 8412. [D 20:42:34.316230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 8413. [D 20:42:34.316240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 8414. [D 20:42:34.316250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 8415. [D 20:42:34.316260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 8416. [D 20:42:34.316275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8417. [D 20:42:34.316286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8418. [D 20:42:34.316296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8419. [D 20:42:34.316306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 8420. [D 20:42:34.316355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 8421. [D 20:42:34.316365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 8422. [D 20:42:34.316375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 8423. [D 20:42:34.316391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 8424. [D 20:42:34.316401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8425. [D 20:42:34.316411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8426. [D 20:42:34.316420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8427. [D 20:42:34.316431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 8428. [D 20:42:34.316441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 8429. [D 20:42:34.316451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 8430. [D 20:42:34.316460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 8431. [D 20:42:34.316471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 8432. [D 20:42:34.316481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8433. [D 20:42:34.316490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8434. [D 20:42:34.316500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8435. [D 20:42:34.316525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 8436. [D 20:42:34.316535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 8437. [D 20:42:34.316550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 8438. [D 20:42:34.316561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 8439. [D 20:42:34.316571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 8440. [D 20:42:34.316581] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8441. [D 20:42:34.318992] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.319007] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.319017] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.319056] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3203 [D 20:42:34.319069] element 0: offset: 0x61ee50, size: 24 [D 20:42:34.319083] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 26/70. [D 20:42:34.323260] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8441. [D 20:42:34.323278] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 27/70. [D 20:42:34.325565] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.325579] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.325589] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.331275] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.331289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.331299] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.331320] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3205 [D 20:42:34.331332] element 0: offset: 0x62a410, size: 24 [D 20:42:34.331342] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 28/70. [D 20:42:34.361865] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3188 [D 20:42:34.361884] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 29/70. [D 20:42:34.361944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 8441. [D 20:42:34.362015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 8442. [D 20:42:34.362035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 8443. [D 20:42:34.362048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 8444. [D 20:42:34.362058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 8445. [D 20:42:34.362069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 8446. [D 20:42:34.362079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 8447. [D 20:42:34.362088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 8448. [D 20:42:34.362100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 8449. [D 20:42:34.362117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 8450. [D 20:42:34.362126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 8451. [D 20:42:34.362136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 8452. [D 20:42:34.362198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 8453. [D 20:42:34.362210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 8454. [D 20:42:34.362219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 8455. [D 20:42:34.362235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 8456. [D 20:42:34.362246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 8457. [D 20:42:34.362255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 8458. [D 20:42:34.362265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 8459. [D 20:42:34.362291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 8460. [D 20:42:34.362301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 8461. [D 20:42:34.362311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 8462. [D 20:42:34.362321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 8463. [D 20:42:34.362333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 8464. [D 20:42:34.362348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 8465. [D 20:42:34.362373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 8466. [D 20:42:34.362386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 8467. [D 20:42:34.362396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 8468. [D 20:42:34.362418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 8469. [D 20:42:34.362428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 8470. [D 20:42:34.362438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 8471. [D 20:42:34.362453] openib_post_sr_rdmaw: ibv_post_send wr_id 650750 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 8472. [D 20:42:34.367869] openib_check_cq: completed rdma wr_id 650750, nic_wr_credit 8472. [D 20:42:34.367885] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 30/70. [D 20:42:34.370243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.370258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.370269] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.375737] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.375752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.375763] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.375797] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3209 [D 20:42:34.375808] element 0: offset: 0x655ed0, size: 24 [D 20:42:34.375821] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 31/70. [D 20:42:34.388856] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3182 [D 20:42:34.388875] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 32/70. [D 20:42:34.388938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 8472. [D 20:42:34.389048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 8473. [D 20:42:34.389062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 8474. [D 20:42:34.389073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 8475. [D 20:42:34.389083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 8476. [D 20:42:34.389099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 8477. [D 20:42:34.389111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 8478. [D 20:42:34.389121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 8479. [D 20:42:34.389131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 8480. [D 20:42:34.389142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 8481. [D 20:42:34.389152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 8482. [D 20:42:34.389166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 8483. [D 20:42:34.389200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 8484. [D 20:42:34.389209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 8485. [D 20:42:34.389221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 8486. [D 20:42:34.389237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 8487. [D 20:42:34.389261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 8488. [D 20:42:34.389275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 8489. [D 20:42:34.389285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 8490. [D 20:42:34.389295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 8491. [D 20:42:34.389311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 8492. [D 20:42:34.389321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 8493. [D 20:42:34.389331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 8494. [D 20:42:34.389361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 8495. [D 20:42:34.389376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 8496. [D 20:42:34.389387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 8497. [D 20:42:34.389397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 8498. [D 20:42:34.389425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 8499. [D 20:42:34.389436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 8500. [D 20:42:34.389449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 8501. [D 20:42:34.389458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 8502. [D 20:42:34.389468] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 8503. [D 20:42:34.394909] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 8503. [D 20:42:34.394926] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 33/70. [D 20:42:34.396131] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.396146] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.396157] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.402928] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.402943] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.402952] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.402985] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3212 [D 20:42:34.402997] element 0: offset: 0x691fe0, size: 24 [D 20:42:34.403011] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 34/70. [D 20:42:34.430012] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3203 [D 20:42:34.430031] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 35/70. [D 20:42:34.430089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 8503. [D 20:42:34.430156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 8504. [D 20:42:34.430176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 8505. [D 20:42:34.430186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 8506. [D 20:42:34.430197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 8507. [D 20:42:34.430206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 8508. [D 20:42:34.430221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 8509. [D 20:42:34.430231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 8510. [D 20:42:34.430240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 8511. [D 20:42:34.430256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 8512. [D 20:42:34.430306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 8513. [D 20:42:34.430315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 8514. [D 20:42:34.430338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 8515. [D 20:42:34.430348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 8516. [D 20:42:34.430364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 8517. [D 20:42:34.430375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 8518. [D 20:42:34.430385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 8519. [D 20:42:34.430395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 8520. [D 20:42:34.430427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 8521. [D 20:42:34.430440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 8522. [D 20:42:34.430450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 8523. [D 20:42:34.430463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 8524. [D 20:42:34.430487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 8525. [D 20:42:34.430497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 8526. [D 20:42:34.430507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 8527. [D 20:42:34.430517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 8528. [D 20:42:34.430527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 8529. [D 20:42:34.430550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 8530. [D 20:42:34.430560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 8531. [D 20:42:34.430574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 8532. [D 20:42:34.430586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 8533. [D 20:42:34.430596] openib_post_sr_rdmaw: ibv_post_send wr_id 62d4c0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 8534. [D 20:42:34.436012] openib_check_cq: completed rdma wr_id 62d4c0, nic_wr_credit 8534. [D 20:42:34.436029] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 36/70. [D 20:42:34.438211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.438226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.438237] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.444130] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.444176] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.444186] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.444223] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3215 [D 20:42:34.444234] element 0: offset: 0x5b0030, size: 24 [D 20:42:34.444247] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 37/70. [D 20:42:34.477193] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3205 [D 20:42:34.477212] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 38/70. [D 20:42:34.477272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 8534. [D 20:42:34.477339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 8535. [D 20:42:34.477350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 8536. [D 20:42:34.477361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 8537. [D 20:42:34.477371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 8538. [D 20:42:34.477382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 8539. [D 20:42:34.477391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 8540. [D 20:42:34.477402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 8541. [D 20:42:34.477411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 8542. [D 20:42:34.477421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 8543. [D 20:42:34.477431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 8544. [D 20:42:34.477448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 8545. [D 20:42:34.477501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 8546. [D 20:42:34.477525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 8547. [D 20:42:34.477536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 8548. [D 20:42:34.477546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 8549. [D 20:42:34.477556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 8550. [D 20:42:34.477572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 8551. [D 20:42:34.477601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 8552. [D 20:42:34.477613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 8553. [D 20:42:34.477623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 8554. [D 20:42:34.477633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 8555. [D 20:42:34.477647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 8556. [D 20:42:34.477675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 8557. [D 20:42:34.477685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 8558. [D 20:42:34.477695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 8559. [D 20:42:34.477705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 8560. [D 20:42:34.477729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 8561. [D 20:42:34.477739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 8562. [D 20:42:34.477749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 8563. [D 20:42:34.477758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 8564. [D 20:42:34.477768] openib_post_sr_rdmaw: ibv_post_send wr_id 64b690 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 8565. [D 20:42:34.483201] openib_check_cq: completed rdma wr_id 64b690, nic_wr_credit 8565. [D 20:42:34.483219] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 39/70. [D 20:42:34.485482] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.485497] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.485508] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.561899] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3209 [D 20:42:34.561917] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 40/70. [D 20:42:34.562047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 8565. [D 20:42:34.562125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 8566. [D 20:42:34.562135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 8567. [D 20:42:34.562146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 8568. [D 20:42:34.562160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 8569. [D 20:42:34.562170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 8570. [D 20:42:34.562180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 8571. [D 20:42:34.562194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 8572. [D 20:42:34.562204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 8573. [D 20:42:34.562213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 8574. [D 20:42:34.562270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 8575. [D 20:42:34.562281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 8576. [D 20:42:34.562291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 8577. [D 20:42:34.562316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 8578. [D 20:42:34.562325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 8579. [D 20:42:34.562336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 8580. [D 20:42:34.562347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 8581. [D 20:42:34.562356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 8582. [D 20:42:34.562366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 8583. [D 20:42:34.562391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 8584. [D 20:42:34.562407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 8585. [D 20:42:34.562417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 8586. [D 20:42:34.562427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 8587. [D 20:42:34.562450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 8588. [D 20:42:34.562460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 8589. [D 20:42:34.562470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 8590. [D 20:42:34.562486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 8591. [D 20:42:34.562496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 8592. [D 20:42:34.562505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 8593. [D 20:42:34.562515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 8594. [D 20:42:34.562525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 8595. [D 20:42:34.562536] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 8596. [D 20:42:34.567983] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8596. [D 20:42:34.568000] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 41/70. [D 20:42:34.570290] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.570305] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.570315] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:34.576131] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.576152] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.576162] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:34.576196] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3218 [D 20:42:34.576207] element 0: offset: 0x66e640, size: 24 [D 20:42:34.576222] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 42/70. [D 20:42:34.617671] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.617736] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.617746] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.617783] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3220 [D 20:42:34.617795] element 0: offset: 0x61f310, size: 24 [D 20:42:34.617808] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 43/70. [D 20:42:34.620468] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3212 [D 20:42:34.620705] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 44/70. [D 20:42:34.620878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 8596. [D 20:42:34.620908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 8597. [D 20:42:34.620919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 8598. [D 20:42:34.620929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 8599. [D 20:42:34.620939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 8600. [D 20:42:34.620950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 8601. [D 20:42:34.620960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 8602. [D 20:42:34.620970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 8603. [D 20:42:34.620981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 8604. [D 20:42:34.620991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 8605. [D 20:42:34.621001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 8606. [D 20:42:34.621018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 8607. [D 20:42:34.621028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 8608. [D 20:42:34.621038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 8609. [D 20:42:34.621072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 8610. [D 20:42:34.621082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 8611. [D 20:42:34.621096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 8612. [D 20:42:34.621106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 8613. [D 20:42:34.621115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 8614. [D 20:42:34.621143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 8615. [D 20:42:34.621154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 8616. [D 20:42:34.621165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 8617. [D 20:42:34.621175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 8618. [D 20:42:34.621185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 8619. [D 20:42:34.621212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 8620. [D 20:42:34.621221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 8621. [D 20:42:34.621233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 8622. [D 20:42:34.621243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 8623. [D 20:42:34.621252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 8624. [D 20:42:34.621280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 8625. [D 20:42:34.621290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 8626. [D 20:42:34.621302] openib_post_sr_rdmaw: ibv_post_send wr_id 6570e0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 8627. [D 20:42:34.631220] openib_check_cq: completed rdma wr_id 6570e0, nic_wr_credit 8627. [D 20:42:34.631272] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 45/70. [D 20:42:34.633461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.633477] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.633487] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.639284] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.639298] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.639309] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.639343] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3224 [D 20:42:34.639353] element 0: offset: 0x61ee50, size: 24 [D 20:42:34.639365] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 46/70. [D 20:42:34.687289] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3215 [D 20:42:34.687324] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 47/70. [D 20:42:34.687391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 8627. [D 20:42:34.687460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 8628. [D 20:42:34.687480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 8629. [D 20:42:34.687491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 8630. [D 20:42:34.687502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 8631. [D 20:42:34.687512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 8632. [D 20:42:34.687526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 8633. [D 20:42:34.687540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 8634. [D 20:42:34.687551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 8635. [D 20:42:34.687565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 8636. [D 20:42:34.687575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 8637. [D 20:42:34.687585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 8638. [D 20:42:34.687594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 8639. [D 20:42:34.687604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 8640. [D 20:42:34.687624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 8641. [D 20:42:34.687674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 8642. [D 20:42:34.687685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 8643. [D 20:42:34.687695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 8644. [D 20:42:34.687704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 8645. [D 20:42:34.687721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 8646. [D 20:42:34.687731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 8647. [D 20:42:34.687740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 8648. [D 20:42:34.687772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 8649. [D 20:42:34.687789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 8650. [D 20:42:34.687799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 8651. [D 20:42:34.687809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 8652. [D 20:42:34.687840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 8653. [D 20:42:34.687853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 8654. [D 20:42:34.687866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 8655. [D 20:42:34.687876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 8656. [D 20:42:34.687885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 8657. [D 20:42:34.687896] openib_post_sr_rdmaw: ibv_post_send wr_id 62a780 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 8658. [D 20:42:34.693320] openib_check_cq: completed rdma wr_id 62a780, nic_wr_credit 8658. [D 20:42:34.693338] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 48/70. [D 20:42:34.695544] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.695559] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.695569] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.701478] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.701519] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.701528] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.701563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3227 [D 20:42:34.701574] element 0: offset: 0x661d50, size: 24 [D 20:42:34.701589] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 49/70. [D 20:42:34.753918] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3227 [D 20:42:34.753937] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 50/70. [D 20:42:34.753995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 8658. [D 20:42:34.754065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 8659. [D 20:42:34.754086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 8660. [D 20:42:34.754098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 8661. [D 20:42:34.754109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 8662. [D 20:42:34.754124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 8663. [D 20:42:34.754135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 8664. [D 20:42:34.754145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 8665. [D 20:42:34.754155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 8666. [D 20:42:34.754165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 8667. [D 20:42:34.754216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 8668. [D 20:42:34.754226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 8669. [D 20:42:34.754252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 8670. [D 20:42:34.754265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 8671. [D 20:42:34.754275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 8672. [D 20:42:34.754285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 8673. [D 20:42:34.754316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 8674. [D 20:42:34.754327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 8675. [D 20:42:34.754337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 8676. [D 20:42:34.754347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 8677. [D 20:42:34.754362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 8678. [D 20:42:34.754372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 8679. [D 20:42:34.754397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 8680. [D 20:42:34.754407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 8681. [D 20:42:34.754417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 8682. [D 20:42:34.754433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 8683. [D 20:42:34.754456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 8684. [D 20:42:34.754468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 8685. [D 20:42:34.754478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 8686. [D 20:42:34.754488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 8687. [D 20:42:34.754513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 8688. [D 20:42:34.754523] openib_post_sr_rdmaw: ibv_post_send wr_id 6278f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 8689. [D 20:42:34.759995] openib_check_cq: completed rdma wr_id 6278f0, nic_wr_credit 8689. [D 20:42:34.760012] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 51/70. [D 20:42:34.762350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.762366] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.762376] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.768140] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.768166] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.768176] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.768212] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3230 [D 20:42:34.768223] element 0: offset: 0x62a410, size: 24 [D 20:42:34.768282] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 52/70. [D 20:42:34.796171] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3218 [D 20:42:34.796189] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 53/70. [D 20:42:34.796246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 8689. [D 20:42:34.796317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 8690. [D 20:42:34.796337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 8691. [D 20:42:34.796348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 8692. [D 20:42:34.796358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 8693. [D 20:42:34.796368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 8694. [D 20:42:34.796383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8695. [D 20:42:34.796392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8696. [D 20:42:34.796402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8697. [D 20:42:34.796418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 8698. [D 20:42:34.796428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 8699. [D 20:42:34.796438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 8700. [D 20:42:34.796447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 8701. [D 20:42:34.796457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 8702. [D 20:42:34.796468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8703. [D 20:42:34.796478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8704. [D 20:42:34.796488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8705. [D 20:42:34.796541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 8706. [D 20:42:34.796552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 8707. [D 20:42:34.796561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 8708. [D 20:42:34.796572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 8709. [D 20:42:34.796596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 8710. [D 20:42:34.796606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8711. [D 20:42:34.796616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8712. [D 20:42:34.796626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8713. [D 20:42:34.796636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 8714. [D 20:42:34.796660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 8715. [D 20:42:34.796673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 8716. [D 20:42:34.796687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 8717. [D 20:42:34.796697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 8718. [D 20:42:34.796725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8719. [D 20:42:34.796739] openib_post_sr_rdmaw: ibv_post_send wr_id 6aa760 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8720. [D 20:42:34.802172] openib_check_cq: completed rdma wr_id 6aa760, nic_wr_credit 8720. [D 20:42:34.802188] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 54/70. [D 20:42:34.804402] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.804418] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.804428] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.810455] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.810470] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.810479] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.810512] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3233 [D 20:42:34.810523] element 0: offset: 0x63c6d0, size: 24 [D 20:42:34.810535] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 55/70. [D 20:42:34.839366] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3220 [D 20:42:34.839384] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 56/70. [D 20:42:34.839444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 8720. [D 20:42:34.839518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 8721. [D 20:42:34.839530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 8722. [D 20:42:34.839540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 8723. [D 20:42:34.839551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 8724. [D 20:42:34.839561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 8725. [D 20:42:34.839580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 8726. [D 20:42:34.839590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 8727. [D 20:42:34.839600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 8728. [D 20:42:34.839615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 8729. [D 20:42:34.839663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 8730. [D 20:42:34.839677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 8731. [D 20:42:34.839707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 8732. [D 20:42:34.839718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 8733. [D 20:42:34.839728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 8734. [D 20:42:34.839754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 8735. [D 20:42:34.839764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 8736. [D 20:42:34.839774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 8737. [D 20:42:34.839790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 8738. [D 20:42:34.839800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 8739. [D 20:42:34.839810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 8740. [D 20:42:34.839834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 8741. [D 20:42:34.839844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 8742. [D 20:42:34.839855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 8743. [D 20:42:34.839865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 8744. [D 20:42:34.839875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 8745. [D 20:42:34.839886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 8746. [D 20:42:34.839913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 8747. [D 20:42:34.839924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 8748. [D 20:42:34.839934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 8749. [D 20:42:34.839944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 8750. [D 20:42:34.839970] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 8751. [D 20:42:34.845374] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 8751. [D 20:42:34.845390] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 57/70. [D 20:42:34.847656] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.847671] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.847681] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.852141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.852155] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.852166] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.852199] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3235 [D 20:42:34.852210] element 0: offset: 0x5b0030, size: 24 [D 20:42:34.852224] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 58/70. [D 20:42:34.904701] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3235 [D 20:42:34.904719] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 59/70. [D 20:42:34.904779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 8751. [D 20:42:34.904854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 8752. [D 20:42:34.904866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 8753. [D 20:42:34.904876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 8754. [D 20:42:34.904887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 8755. [D 20:42:34.904897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 8756. [D 20:42:34.904913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 8757. [D 20:42:34.904923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 8758. [D 20:42:34.904932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 8759. [D 20:42:34.904948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 8760. [D 20:42:34.904996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 8761. [D 20:42:34.905007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 8762. [D 20:42:34.905027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 8763. [D 20:42:34.905038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 8764. [D 20:42:34.905049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 8765. [D 20:42:34.905059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 8766. [D 20:42:34.905069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 8767. [D 20:42:34.905094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 8768. [D 20:42:34.905105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 8769. [D 20:42:34.905115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 8770. [D 20:42:34.905125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 8771. [D 20:42:34.905134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 8772. [D 20:42:34.905151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 8773. [D 20:42:34.905175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 8774. [D 20:42:34.905189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 8775. [D 20:42:34.905198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 8776. [D 20:42:34.905222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 8777. [D 20:42:34.905232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 8778. [D 20:42:34.905248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 8779. [D 20:42:34.905259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 8780. [D 20:42:34.905269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 8781. [D 20:42:34.905279] openib_post_sr_rdmaw: ibv_post_send wr_id 6434c0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 8782. [D 20:42:34.910765] openib_check_cq: completed rdma wr_id 6434c0, nic_wr_credit 8782. [D 20:42:34.910782] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 60/70. [D 20:42:34.913080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.913095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.913105] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.918213] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.918229] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.918240] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.918274] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3238 [D 20:42:34.918285] element 0: offset: 0x66e640, size: 24 [D 20:42:34.918297] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 0/70. [D 20:42:34.984931] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3233 [D 20:42:34.984949] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 1/70. [D 20:42:34.985006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 8782. [D 20:42:34.985077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 8783. [D 20:42:34.985097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 8784. [D 20:42:34.985110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 8785. [D 20:42:34.985120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 8786. [D 20:42:34.985131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 8787. [D 20:42:34.985141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8788. [D 20:42:34.985151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8789. [D 20:42:34.985163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8790. [D 20:42:34.985179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 8791. [D 20:42:34.985189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 8792. [D 20:42:34.985199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 8793. [D 20:42:34.985208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 8794. [D 20:42:34.985223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 8795. [D 20:42:34.985234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8796. [D 20:42:34.985244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8797. [D 20:42:34.985295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8798. [D 20:42:34.985307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 8799. [D 20:42:34.985317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 8800. [D 20:42:34.985327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 8801. [D 20:42:34.985338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 8802. [D 20:42:34.985363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 8803. [D 20:42:34.985374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8804. [D 20:42:34.985384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8805. [D 20:42:34.985394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8806. [D 20:42:34.985417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 8807. [D 20:42:34.985427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 8808. [D 20:42:34.985441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 8809. [D 20:42:34.985451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 8810. [D 20:42:34.985460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 8811. [D 20:42:34.985483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8812. [D 20:42:34.985493] openib_post_sr_rdmaw: ibv_post_send wr_id 6434c0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8813. [D 20:42:34.990928] openib_check_cq: completed rdma wr_id 6434c0, nic_wr_credit 8813. [D 20:42:34.990945] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 2/70. [D 20:42:34.992168] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:34.992183] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.992193] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:34.999378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:34.999392] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:34.999402] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:34.999434] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3242 [D 20:42:34.999445] element 0: offset: 0x691fe0, size: 24 [D 20:42:34.999457] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 3/70. [D 20:42:35.047528] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3238 [D 20:42:35.047547] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 4/70. [D 20:42:35.047609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 8813. [D 20:42:35.047693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 8814. [D 20:42:35.047705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 8815. [D 20:42:35.047716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 8816. [D 20:42:35.047730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 8817. [D 20:42:35.047740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 8818. [D 20:42:35.047750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 8819. [D 20:42:35.047763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 8820. [D 20:42:35.047773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 8821. [D 20:42:35.047803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 8822. [D 20:42:35.047813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 8823. [D 20:42:35.047824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 8824. [D 20:42:35.047834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 8825. [D 20:42:35.047859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 8826. [D 20:42:35.047874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 8827. [D 20:42:35.047897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 8828. [D 20:42:35.047909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 8829. [D 20:42:35.047919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 8830. [D 20:42:35.047929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 8831. [D 20:42:35.047939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 8832. [D 20:42:35.047955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 8833. [D 20:42:35.047966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 8834. [D 20:42:35.047976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 8835. [D 20:42:35.047985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 8836. [D 20:42:35.048013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 8837. [D 20:42:35.048023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 8838. [D 20:42:35.048033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 8839. [D 20:42:35.048055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 8840. [D 20:42:35.048065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 8841. [D 20:42:35.048075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 8842. [D 20:42:35.048085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 8843. [D 20:42:35.048096] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 8844. [D 20:42:35.053554] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 8844. [D 20:42:35.053571] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 5/70. [D 20:42:35.055894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.055909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.055919] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.060988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.061003] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.061013] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.061047] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3244 [D 20:42:35.061058] element 0: offset: 0x655ed0, size: 24 [D 20:42:35.061072] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 6/70. [D 20:42:35.095258] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3230 [D 20:42:35.095277] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 7/70. [D 20:42:35.095334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 8844. [D 20:42:35.095403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 8845. [D 20:42:35.095457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 8846. [D 20:42:35.095468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 8847. [D 20:42:35.095479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 8848. [D 20:42:35.095489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 8849. [D 20:42:35.095499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 8850. [D 20:42:35.095519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 8851. [D 20:42:35.095529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 8852. [D 20:42:35.095540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 8853. [D 20:42:35.095550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 8854. [D 20:42:35.095565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 8855. [D 20:42:35.095589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 8856. [D 20:42:35.095618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 8857. [D 20:42:35.095630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 8858. [D 20:42:35.095640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 8859. [D 20:42:35.095662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 8860. [D 20:42:35.095673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 8861. [D 20:42:35.095683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 8862. [D 20:42:35.095704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 8863. [D 20:42:35.095717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 8864. [D 20:42:35.095727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 8865. [D 20:42:35.095736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 8866. [D 20:42:35.095746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 8867. [D 20:42:35.095757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 8868. [D 20:42:35.095778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 8869. [D 20:42:35.095789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 8870. [D 20:42:35.095816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 8871. [D 20:42:35.095826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 8872. [D 20:42:35.095841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 8873. [D 20:42:35.095862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 8874. [D 20:42:35.095875] openib_post_sr_rdmaw: ibv_post_send wr_id 63e7e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 8875. [D 20:42:35.101344] openib_check_cq: completed rdma wr_id 63e7e0, nic_wr_credit 8875. [D 20:42:35.101361] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 8/70. [D 20:42:35.103565] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.103580] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.103590] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.157108] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3242 [D 20:42:35.157129] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 9/70. [D 20:42:35.157184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 8875. [D 20:42:35.157254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 8876. [D 20:42:35.157265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 8877. [D 20:42:35.157276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 8878. [D 20:42:35.157286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 8879. [D 20:42:35.157296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 8880. [D 20:42:35.157306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8881. [D 20:42:35.157316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8882. [D 20:42:35.157326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8883. [D 20:42:35.157335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 8884. [D 20:42:35.157345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 8885. [D 20:42:35.157408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 8886. [D 20:42:35.157419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 8887. [D 20:42:35.157437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 8888. [D 20:42:35.157448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8889. [D 20:42:35.157457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8890. [D 20:42:35.157467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8891. [D 20:42:35.157479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 8892. [D 20:42:35.157495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 8893. [D 20:42:35.157505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 8894. [D 20:42:35.157533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 8895. [D 20:42:35.157542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 8896. [D 20:42:35.157552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8897. [D 20:42:35.157566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8898. [D 20:42:35.157576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8899. [D 20:42:35.157586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 8900. [D 20:42:35.157615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 8901. [D 20:42:35.157631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 8902. [D 20:42:35.157642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 8903. [D 20:42:35.157652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 8904. [D 20:42:35.157681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8905. [D 20:42:35.157692] openib_post_sr_rdmaw: ibv_post_send wr_id 625660 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8906. [D 20:42:35.163112] openib_check_cq: completed rdma wr_id 625660, nic_wr_credit 8906. [D 20:42:35.163128] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 10/70. [D 20:42:35.165448] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.165463] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.165474] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:35.171926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.171941] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.171951] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:35.171984] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3248 [D 20:42:35.171994] element 0: offset: 0x5b0030, size: 24 [D 20:42:35.172006] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 11/70. [D 20:42:35.216965] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3244 [D 20:42:35.216983] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 12/70. [D 20:42:35.217044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 8906. [D 20:42:35.217129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 8907. [D 20:42:35.217141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 8908. [D 20:42:35.217151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 8909. [D 20:42:35.217162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 8910. [D 20:42:35.217173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 8911. [D 20:42:35.217182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 8912. [D 20:42:35.217193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 8913. [D 20:42:35.217202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 8914. [D 20:42:35.217212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 8915. [D 20:42:35.217247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 8916. [D 20:42:35.217257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 8917. [D 20:42:35.217267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 8918. [D 20:42:35.217290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 8919. [D 20:42:35.217299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 8920. [D 20:42:35.217310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 8921. [D 20:42:35.217332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 8922. [D 20:42:35.217342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 8923. [D 20:42:35.217352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 8924. [D 20:42:35.217373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 8925. [D 20:42:35.217388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 8926. [D 20:42:35.217398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 8927. [D 20:42:35.217423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 8928. [D 20:42:35.217433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 8929. [D 20:42:35.217456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 8930. [D 20:42:35.217466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 8931. [D 20:42:35.217476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 8932. [D 20:42:35.217497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 8933. [D 20:42:35.217508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 8934. [D 20:42:35.217518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 8935. [D 20:42:35.217539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 8936. [D 20:42:35.217549] openib_post_sr_rdmaw: ibv_post_send wr_id 625660 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 8937. [D 20:42:35.222986] openib_check_cq: completed rdma wr_id 625660, nic_wr_credit 8937. [D 20:42:35.223002] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 13/70. [D 20:42:35.225258] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.225273] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.225283] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:35.230698] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.230713] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.230723] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:35.230755] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3250 [D 20:42:35.230766] element 0: offset: 0x61f800, size: 24 [D 20:42:35.230778] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 14/70. [D 20:42:35.232225] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.232240] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.232250] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.232266] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3254 [D 20:42:35.232275] element 0: offset: 0x61f310, size: 24 [D 20:42:35.232285] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 15/70. [D 20:42:35.289734] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3248 [D 20:42:35.289753] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 16/70. [D 20:42:35.289818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 8937. [D 20:42:35.289930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 8938. [D 20:42:35.289944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 8939. [D 20:42:35.289956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 8940. [D 20:42:35.289966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 8941. [D 20:42:35.289982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 8942. [D 20:42:35.290006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 8943. [D 20:42:35.290017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 8944. [D 20:42:35.290028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 8945. [D 20:42:35.290038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 8946. [D 20:42:35.290048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 8947. [D 20:42:35.290071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 8948. [D 20:42:35.290081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 8949. [D 20:42:35.290094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 8950. [D 20:42:35.290115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 8951. [D 20:42:35.290130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 8952. [D 20:42:35.290152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 8953. [D 20:42:35.290165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 8954. [D 20:42:35.290175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 8955. [D 20:42:35.290198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 8956. [D 20:42:35.290208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 8957. [D 20:42:35.290228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 8958. [D 20:42:35.290241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 8959. [D 20:42:35.290251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 8960. [D 20:42:35.290279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 8961. [D 20:42:35.290290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 8962. [D 20:42:35.290300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 8963. [D 20:42:35.290310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 8964. [D 20:42:35.290320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 8965. [D 20:42:35.290330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 8966. [D 20:42:35.290342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 8967. [D 20:42:35.290367] openib_post_sr_rdmaw: ibv_post_send wr_id 6aa760 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 8968. [D 20:42:35.295785] openib_check_cq: completed rdma wr_id 6aa760, nic_wr_credit 8968. [D 20:42:35.295803] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 17/70. [D 20:42:35.298018] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.298034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.298044] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.304079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.304136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.304146] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.304188] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3257 [D 20:42:35.304200] element 0: offset: 0x691fe0, size: 24 [D 20:42:35.304214] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 18/70. [D 20:42:35.307820] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3224 [D 20:42:35.307840] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 19/70. [D 20:42:35.308002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 8968. [D 20:42:35.308061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 8969. [D 20:42:35.308072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 8970. [D 20:42:35.308083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 8971. [D 20:42:35.308097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 8972. [D 20:42:35.308107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 8973. [D 20:42:35.308116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 8974. [D 20:42:35.308131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 8975. [D 20:42:35.308141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 8976. [D 20:42:35.308150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 8977. [D 20:42:35.308191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 8978. [D 20:42:35.308201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 8979. [D 20:42:35.308220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 8980. [D 20:42:35.308231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 8981. [D 20:42:35.308241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 8982. [D 20:42:35.308267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 8983. [D 20:42:35.308280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 8984. [D 20:42:35.308290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 8985. [D 20:42:35.308299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 8986. [D 20:42:35.308327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 8987. [D 20:42:35.308337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 8988. [D 20:42:35.308350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 8989. [D 20:42:35.308371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 8990. [D 20:42:35.308385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 8991. [D 20:42:35.308395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 8992. [D 20:42:35.308417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 8993. [D 20:42:35.308427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 8994. [D 20:42:35.308450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 8995. [D 20:42:35.308464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 8996. [D 20:42:35.308474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 8997. [D 20:42:35.308484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 8998. [D 20:42:35.308507] openib_post_sr_rdmaw: ibv_post_send wr_id 63fac0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 8999. [D 20:42:35.317605] openib_check_cq: completed rdma wr_id 63fac0, nic_wr_credit 8999. [D 20:42:35.317629] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 20/70. [D 20:42:35.319803] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.319818] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.319827] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.325511] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.325525] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.325536] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.325567] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3260 [D 20:42:35.325578] element 0: offset: 0x64b790, size: 24 [D 20:42:35.325590] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 21/70. [D 20:42:35.336608] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3250 [D 20:42:35.336627] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 22/70. [D 20:42:35.336692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 8999. [D 20:42:35.336797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9000. [D 20:42:35.336811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9001. [D 20:42:35.336822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9002. [D 20:42:35.336833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9003. [D 20:42:35.336843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9004. [D 20:42:35.336853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9005. [D 20:42:35.336863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9006. [D 20:42:35.336873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9007. [D 20:42:35.336882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 9008. [D 20:42:35.336900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 9009. [D 20:42:35.336910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 9010. [D 20:42:35.336920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 9011. [D 20:42:35.336946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 9012. [D 20:42:35.336956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 9013. [D 20:42:35.336977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 9014. [D 20:42:35.336987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 9015. [D 20:42:35.337000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 9016. [D 20:42:35.337015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 9017. [D 20:42:35.337025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 9018. [D 20:42:35.337034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 9019. [D 20:42:35.337063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 9020. [D 20:42:35.337073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 9021. [D 20:42:35.337086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 9022. [D 20:42:35.337096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 9023. [D 20:42:35.337117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 9024. [D 20:42:35.337128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 9025. [D 20:42:35.337138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 9026. [D 20:42:35.337152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 9027. [D 20:42:35.337162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 9028. [D 20:42:35.337172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 9029. [D 20:42:35.337203] openib_post_sr_rdmaw: ibv_post_send wr_id 6ae770 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 9030. [D 20:42:35.342652] openib_check_cq: completed rdma wr_id 6ae770, nic_wr_credit 9030. [D 20:42:35.342668] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 23/70. [D 20:42:35.344188] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.344203] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.344213] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.350119] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.350146] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.350156] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.350191] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3262 [D 20:42:35.350202] element 0: offset: 0x655ed0, size: 24 [D 20:42:35.350217] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 24/70. [D 20:42:35.391931] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3257 [D 20:42:35.391949] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 25/70. [D 20:42:35.392008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 9030. [D 20:42:35.392079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 9031. [D 20:42:35.392138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 9032. [D 20:42:35.392149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 9033. [D 20:42:35.392171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 9034. [D 20:42:35.392194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 9035. [D 20:42:35.392234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 9036. [D 20:42:35.392246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 9037. [D 20:42:35.392272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 9038. [D 20:42:35.392282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 9039. [D 20:42:35.392306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 9040. [D 20:42:35.392316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 9041. [D 20:42:35.392338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 9042. [D 20:42:35.392348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 9043. [D 20:42:35.392371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 9044. [D 20:42:35.392381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 9045. [D 20:42:35.392402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 9046. [D 20:42:35.392412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 9047. [D 20:42:35.392436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 9048. [D 20:42:35.392448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 9049. [D 20:42:35.392458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 9050. [D 20:42:35.392481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 9051. [D 20:42:35.392492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 9052. [D 20:42:35.392506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 9053. [D 20:42:35.392515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 9054. [D 20:42:35.392525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 9055. [D 20:42:35.392535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 9056. [D 20:42:35.392564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 9057. [D 20:42:35.392575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 9058. [D 20:42:35.392589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 9059. [D 20:42:35.392610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 9060. [D 20:42:35.392623] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 9061. [D 20:42:35.397935] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 9061. [D 20:42:35.397952] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 26/70. [D 20:42:35.400093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.400108] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.400118] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.404166] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.404180] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.404191] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.404224] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3266 [D 20:42:35.404235] element 0: offset: 0x61ee50, size: 24 [D 20:42:35.406412] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 27/70. [D 20:42:35.440698] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3254 [D 20:42:35.440717] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 28/70. [D 20:42:35.440782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 9061. [D 20:42:35.440859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 9062. [D 20:42:35.440870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 9063. [D 20:42:35.440881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 9064. [D 20:42:35.440891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 9065. [D 20:42:35.440901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 9066. [D 20:42:35.440917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 9067. [D 20:42:35.440927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 9068. [D 20:42:35.440936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 9069. [D 20:42:35.440952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 9070. [D 20:42:35.441001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 9071. [D 20:42:35.441012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 9072. [D 20:42:35.441022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 9073. [D 20:42:35.441051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 9074. [D 20:42:35.441061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 9075. [D 20:42:35.441071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 9076. [D 20:42:35.441085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 9077. [D 20:42:35.441094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 9078. [D 20:42:35.441104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 9079. [D 20:42:35.441132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 9080. [D 20:42:35.441142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 9081. [D 20:42:35.441156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 9082. [D 20:42:35.441166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 9083. [D 20:42:35.441175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 9084. [D 20:42:35.441189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 9085. [D 20:42:35.441204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 9086. [D 20:42:35.441213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 9087. [D 20:42:35.441223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 9088. [D 20:42:35.441238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 9089. [D 20:42:35.441248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 9090. [D 20:42:35.441270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 9091. [D 20:42:35.441280] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 9092. [D 20:42:35.446713] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 9092. [D 20:42:35.446730] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 29/70. [D 20:42:35.448939] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.448955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.448965] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.454685] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.454700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.454710] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.454742] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3269 [D 20:42:35.454753] element 0: offset: 0x61f800, size: 24 [D 20:42:35.454765] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 30/70. [D 20:42:35.508528] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3266 [D 20:42:35.508546] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 31/70. [D 20:42:35.508608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 9092. [D 20:42:35.508678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 9093. [D 20:42:35.508698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 9094. [D 20:42:35.508709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 9095. [D 20:42:35.508720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 9096. [D 20:42:35.508729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 9097. [D 20:42:35.508744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 9098. [D 20:42:35.508753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 9099. [D 20:42:35.508763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 9100. [D 20:42:35.508779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 9101. [D 20:42:35.508831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 9102. [D 20:42:35.508841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 9103. [D 20:42:35.508851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 9104. [D 20:42:35.508876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 9105. [D 20:42:35.508886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 9106. [D 20:42:35.508896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 9107. [D 20:42:35.508907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 9108. [D 20:42:35.508917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 9109. [D 20:42:35.508927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 9110. [D 20:42:35.508953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 9111. [D 20:42:35.508964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 9112. [D 20:42:35.508975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 9113. [D 20:42:35.508984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 9114. [D 20:42:35.508995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 9115. [D 20:42:35.509005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 9116. [D 20:42:35.509028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 9117. [D 20:42:35.509044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 9118. [D 20:42:35.509054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 9119. [D 20:42:35.509077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 9120. [D 20:42:35.509088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 9121. [D 20:42:35.509098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 9122. [D 20:42:35.509113] openib_post_sr_rdmaw: ibv_post_send wr_id 650470 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 9123. [D 20:42:35.514592] openib_check_cq: completed rdma wr_id 650470, nic_wr_credit 9123. [D 20:42:35.514610] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 32/70. [D 20:42:35.516235] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.516250] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.516261] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.590039] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3269 [D 20:42:35.590059] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 33/70. [D 20:42:35.590235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 9123. [D 20:42:35.590302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 9124. [D 20:42:35.590314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 9125. [D 20:42:35.590324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 9126. [D 20:42:35.590335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 9127. [D 20:42:35.590345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 9128. [D 20:42:35.590355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 9129. [D 20:42:35.590365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 9130. [D 20:42:35.590375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 9131. [D 20:42:35.590384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 9132. [D 20:42:35.590394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 9133. [D 20:42:35.590411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 9134. [D 20:42:35.590421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 9135. [D 20:42:35.590430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 9136. [D 20:42:35.590440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 9137. [D 20:42:35.590465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 9138. [D 20:42:35.590475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 9139. [D 20:42:35.590485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 9140. [D 20:42:35.590507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 9141. [D 20:42:35.590517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 9142. [D 20:42:35.590528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 9143. [D 20:42:35.590550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 9144. [D 20:42:35.590560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 9145. [D 20:42:35.590570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 9146. [D 20:42:35.590580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 9147. [D 20:42:35.590596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 9148. [D 20:42:35.590620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 9149. [D 20:42:35.590630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 9150. [D 20:42:35.590644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 9151. [D 20:42:35.590654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 9152. [D 20:42:35.590676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 9153. [D 20:42:35.590687] openib_post_sr_rdmaw: ibv_post_send wr_id 6434c0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 9154. [D 20:42:35.596241] openib_check_cq: completed rdma wr_id 6434c0, nic_wr_credit 9154. [D 20:42:35.596257] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 34/70. [D 20:42:35.598561] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.598576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.598586] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:35.604911] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.604925] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.604936] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:35.604971] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3272 [D 20:42:35.604981] element 0: offset: 0x691fe0, size: 24 [D 20:42:35.604995] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 35/70. [D 20:42:35.633936] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3262 [D 20:42:35.633955] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 36/70. [D 20:42:35.634018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 9154. [D 20:42:35.634085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9155. [D 20:42:35.634138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9156. [D 20:42:35.634149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9157. [D 20:42:35.634160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9158. [D 20:42:35.634170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9159. [D 20:42:35.634180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9160. [D 20:42:35.634190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9161. [D 20:42:35.634214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9162. [D 20:42:35.634224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 9163. [D 20:42:35.634234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 9164. [D 20:42:35.634262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 9165. [D 20:42:35.634273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 9166. [D 20:42:35.634285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 9167. [D 20:42:35.634306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 9168. [D 20:42:35.634320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 9169. [D 20:42:35.634342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 9170. [D 20:42:35.634356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 9171. [D 20:42:35.634374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 9172. [D 20:42:35.634385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 9173. [D 20:42:35.634395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 9174. [D 20:42:35.634416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 9175. [D 20:42:35.634428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 9176. [D 20:42:35.634437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 9177. [D 20:42:35.634463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 9178. [D 20:42:35.634472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 9179. [D 20:42:35.634499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 9180. [D 20:42:35.634509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 9181. [D 20:42:35.634532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 9182. [D 20:42:35.634542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 9183. [D 20:42:35.634564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 9184. [D 20:42:35.634574] openib_post_sr_rdmaw: ibv_post_send wr_id 62a880 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 9185. [D 20:42:35.639939] openib_check_cq: completed rdma wr_id 62a880, nic_wr_credit 9185. [D 20:42:35.639956] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 37/70. [D 20:42:35.640235] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.640250] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.640260] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:35.649293] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.649353] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.649362] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:35.649400] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3274 [D 20:42:35.649413] element 0: offset: 0x66e670, size: 24 [D 20:42:35.649427] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 38/70. [D 20:42:35.649450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.649465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.649475] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.649491] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3278 [D 20:42:35.649503] element 0: offset: 0x61f310, size: 24 [D 20:42:35.649513] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 39/70. [D 20:42:35.692530] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3274 [D 20:42:35.692549] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 40/70. [D 20:42:35.692609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 9185. [D 20:42:35.692677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9186. [D 20:42:35.692732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9187. [D 20:42:35.692743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9188. [D 20:42:35.692754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9189. [D 20:42:35.692764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9190. [D 20:42:35.692774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9191. [D 20:42:35.692801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9192. [D 20:42:35.692816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9193. [D 20:42:35.692826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 9194. [D 20:42:35.692836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 9195. [D 20:42:35.692858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 9196. [D 20:42:35.692868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 9197. [D 20:42:35.692878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 9198. [D 20:42:35.692901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 9199. [D 20:42:35.692912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 9200. [D 20:42:35.692921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 9201. [D 20:42:35.692941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 9202. [D 20:42:35.692958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 9203. [D 20:42:35.692967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 9204. [D 20:42:35.692990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 9205. [D 20:42:35.693000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 9206. [D 20:42:35.693009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 9207. [D 20:42:35.693035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 9208. [D 20:42:35.693045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 9209. [D 20:42:35.693055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 9210. [D 20:42:35.693065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 9211. [D 20:42:35.693088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 9212. [D 20:42:35.693098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 9213. [D 20:42:35.693108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 9214. [D 20:42:35.693130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 9215. [D 20:42:35.693139] openib_post_sr_rdmaw: ibv_post_send wr_id 625660 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 9216. [D 20:42:35.698542] openib_check_cq: completed rdma wr_id 625660, nic_wr_credit 9216. [D 20:42:35.698559] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 41/70. [D 20:42:35.700829] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.700844] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.700855] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.706031] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.706045] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.706055] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.706088] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3280 [D 20:42:35.706098] element 0: offset: 0x661d80, size: 24 [D 20:42:35.706112] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 42/70. [D 20:42:35.746961] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3272 [D 20:42:35.746982] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 43/70. [D 20:42:35.747039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 9216. [D 20:42:35.747108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 9217. [D 20:42:35.747161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 9218. [D 20:42:35.747173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 9219. [D 20:42:35.747184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 9220. [D 20:42:35.747194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 9221. [D 20:42:35.747204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 9222. [D 20:42:35.747214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 9223. [D 20:42:35.747224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 9224. [D 20:42:35.747234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 9225. [D 20:42:35.747251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 9226. [D 20:42:35.747260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 9227. [D 20:42:35.747284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 9228. [D 20:42:35.747297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 9229. [D 20:42:35.747307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 9230. [D 20:42:35.747330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 9231. [D 20:42:35.747344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 9232. [D 20:42:35.747353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 9233. [D 20:42:35.747363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 9234. [D 20:42:35.747379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 9235. [D 20:42:35.747389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 9236. [D 20:42:35.747416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 9237. [D 20:42:35.747426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 9238. [D 20:42:35.747435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 9239. [D 20:42:35.747452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 9240. [D 20:42:35.747474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 9241. [D 20:42:35.747485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 9242. [D 20:42:35.747495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 9243. [D 20:42:35.747514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 9244. [D 20:42:35.747528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 9245. [D 20:42:35.747537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 9246. [D 20:42:35.747547] openib_post_sr_rdmaw: ibv_post_send wr_id 625660 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 9247. [D 20:42:35.752966] openib_check_cq: completed rdma wr_id 625660, nic_wr_credit 9247. [D 20:42:35.752983] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 44/70. [D 20:42:35.755211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.755226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.755236] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.762075] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.762095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.762106] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.762139] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3284 [D 20:42:35.762150] element 0: offset: 0x5b0030, size: 24 [D 20:42:35.762163] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 45/70. [D 20:42:35.813274] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3280 [D 20:42:35.813294] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 46/70. [D 20:42:35.813351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 9247. [D 20:42:35.813420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9248. [D 20:42:35.813439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9249. [D 20:42:35.813450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9250. [D 20:42:35.813460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9251. [D 20:42:35.813470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9252. [D 20:42:35.813486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9253. [D 20:42:35.813496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9254. [D 20:42:35.813506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9255. [D 20:42:35.813522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 9256. [D 20:42:35.813571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 9257. [D 20:42:35.813581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 9258. [D 20:42:35.813592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 9259. [D 20:42:35.813614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 9260. [D 20:42:35.813624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 9261. [D 20:42:35.813634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 9262. [D 20:42:35.813646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 9263. [D 20:42:35.813663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 9264. [D 20:42:35.813689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 9265. [D 20:42:35.813700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 9266. [D 20:42:35.813710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 9267. [D 20:42:35.813720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 9268. [D 20:42:35.813744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 9269. [D 20:42:35.813755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 9270. [D 20:42:35.813765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 9271. [D 20:42:35.813776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 9272. [D 20:42:35.813786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 9273. [D 20:42:35.813809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 9274. [D 20:42:35.813820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 9275. [D 20:42:35.813830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 9276. [D 20:42:35.813843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 9277. [D 20:42:35.813853] openib_post_sr_rdmaw: ibv_post_send wr_id 625660 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 9278. [D 20:42:35.819345] openib_check_cq: completed rdma wr_id 625660, nic_wr_credit 9278. [D 20:42:35.819362] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 47/70. [D 20:42:35.820209] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.820224] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.820235] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:35.840602] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3260 [D 20:42:35.840621] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 48/70. [D 20:42:35.840682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 9278. [D 20:42:35.840789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 9279. [D 20:42:35.840804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 9280. [D 20:42:35.840814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 9281. [D 20:42:35.840825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 9282. [D 20:42:35.840835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 9283. [D 20:42:35.840845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 9284. [D 20:42:35.840855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 9285. [D 20:42:35.840865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 9286. [D 20:42:35.840883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 9287. [D 20:42:35.840892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 9288. [D 20:42:35.840902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 9289. [D 20:42:35.840929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 9290. [D 20:42:35.840940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 9291. [D 20:42:35.840954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 9292. [D 20:42:35.840964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 9293. [D 20:42:35.840974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 9294. [D 20:42:35.840988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 9295. [D 20:42:35.841003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 9296. [D 20:42:35.841012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 9297. [D 20:42:35.841028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 9298. [D 20:42:35.841038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 9299. [D 20:42:35.841063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 9300. [D 20:42:35.841075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 9301. [D 20:42:35.841085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 9302. [D 20:42:35.841095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 9303. [D 20:42:35.841110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 9304. [D 20:42:35.841120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 9305. [D 20:42:35.841130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 9306. [D 20:42:35.841156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 9307. [D 20:42:35.841166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 9308. [D 20:42:35.841179] openib_post_sr_rdmaw: ibv_post_send wr_id 63e740 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 9309. [D 20:42:35.846650] openib_check_cq: completed rdma wr_id 63e740, nic_wr_credit 9309. [D 20:42:35.846667] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 49/70. [D 20:42:35.848856] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.848872] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.848883] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:35.854808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.854840] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.854850] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:35.854885] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3287 [D 20:42:35.854896] element 0: offset: 0x655ed0, size: 24 [D 20:42:35.854910] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 50/70. [D 20:42:35.902077] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3284 [D 20:42:35.902095] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 51/70. [D 20:42:35.902159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 9309. [D 20:42:35.902228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 9310. [D 20:42:35.902247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 9311. [D 20:42:35.902258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 9312. [D 20:42:35.902269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 9313. [D 20:42:35.902279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 9314. [D 20:42:35.902293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 9315. [D 20:42:35.902302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 9316. [D 20:42:35.902312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 9317. [D 20:42:35.902328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 9318. [D 20:42:35.902377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 9319. [D 20:42:35.902389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 9320. [D 20:42:35.902399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 9321. [D 20:42:35.902424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 9322. [D 20:42:35.902434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 9323. [D 20:42:35.902444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 9324. [D 20:42:35.902455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 9325. [D 20:42:35.902465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 9326. [D 20:42:35.902475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 9327. [D 20:42:35.902494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 9328. [D 20:42:35.902504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 9329. [D 20:42:35.902514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 9330. [D 20:42:35.902532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 9331. [D 20:42:35.902542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 9332. [D 20:42:35.902552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 9333. [D 20:42:35.902579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 9334. [D 20:42:35.902590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 9335. [D 20:42:35.902600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 9336. [D 20:42:35.902611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 9337. [D 20:42:35.902621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 9338. [D 20:42:35.902631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 9339. [D 20:42:35.902641] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 9340. [D 20:42:35.908093] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 9340. [D 20:42:35.908110] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 52/70. [D 20:42:35.910243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.910258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.910269] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:35.916193] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.916208] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.916219] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:35.916251] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3290 [D 20:42:35.916262] element 0: offset: 0x691fe0, size: 24 [D 20:42:35.917528] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 53/70. [D 20:42:35.942032] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3278 [D 20:42:35.942050] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 54/70. [D 20:42:35.942117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 9340. [D 20:42:35.942198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 9341. [D 20:42:35.942210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 9342. [D 20:42:35.942221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 9343. [D 20:42:35.942235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 9344. [D 20:42:35.942245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 9345. [D 20:42:35.942255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 9346. [D 20:42:35.942269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 9347. [D 20:42:35.942278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 9348. [D 20:42:35.942288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 9349. [D 20:42:35.942344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 9350. [D 20:42:35.942355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 9351. [D 20:42:35.942365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 9352. [D 20:42:35.942375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 9353. [D 20:42:35.942391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 9354. [D 20:42:35.942402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 9355. [D 20:42:35.942411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 9356. [D 20:42:35.942421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 9357. [D 20:42:35.942439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 9358. [D 20:42:35.942449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 9359. [D 20:42:35.942459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 9360. [D 20:42:35.942486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 9361. [D 20:42:35.942496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 9362. [D 20:42:35.942506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 9363. [D 20:42:35.942517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 9364. [D 20:42:35.942527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 9365. [D 20:42:35.942537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 9366. [D 20:42:35.942562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 9367. [D 20:42:35.942573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 9368. [D 20:42:35.942583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 9369. [D 20:42:35.942593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 9370. [D 20:42:35.942621] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 9371. [D 20:42:35.948063] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 9371. [D 20:42:35.948080] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 55/70. [D 20:42:35.950185] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.950201] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.950212] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:35.955733] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.955777] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.955787] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:35.955822] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3292 [D 20:42:35.955835] element 0: offset: 0x661d80, size: 24 [D 20:42:35.955848] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 56/70. [D 20:42:35.955871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:35.955884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.955893] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:35.955908] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3296 [D 20:42:35.955919] element 0: offset: 0x62a410, size: 24 [D 20:42:35.955929] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 57/70. [D 20:42:35.989190] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3290 [D 20:42:35.989208] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 58/70. [D 20:42:35.989272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 9371. [D 20:42:35.989381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 9372. [D 20:42:35.989394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 9373. [D 20:42:35.989404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 9374. [D 20:42:35.989419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 9375. [D 20:42:35.989429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 9376. [D 20:42:35.989439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 9377. [D 20:42:35.989453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 9378. [D 20:42:35.989463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 9379. [D 20:42:35.989473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 9380. [D 20:42:35.989488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 9381. [D 20:42:35.989498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 9382. [D 20:42:35.989508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 9383. [D 20:42:35.989539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 9384. [D 20:42:35.989551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 9385. [D 20:42:35.989561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 9386. [D 20:42:35.989571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 9387. [D 20:42:35.989581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 9388. [D 20:42:35.989606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 9389. [D 20:42:35.989616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 9390. [D 20:42:35.989627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 9391. [D 20:42:35.989637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 9392. [D 20:42:35.989647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 9393. [D 20:42:35.989670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 9394. [D 20:42:35.989680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 9395. [D 20:42:35.989693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 9396. [D 20:42:35.989703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 9397. [D 20:42:35.989713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 9398. [D 20:42:35.989734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 9399. [D 20:42:35.989744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 9400. [D 20:42:35.989755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 9401. [D 20:42:35.989765] openib_post_sr_rdmaw: ibv_post_send wr_id 6570e0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 9402. [D 20:42:35.995279] openib_check_cq: completed rdma wr_id 6570e0, nic_wr_credit 9402. [D 20:42:35.995295] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 59/70. [D 20:42:35.996219] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:35.996234] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:35.996245] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.004310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.004325] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.004336] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.004368] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3299 [D 20:42:36.004379] element 0: offset: 0x61ee50, size: 24 [D 20:42:36.004391] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 60/70. [D 20:42:36.101893] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3296 [D 20:42:36.101912] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 0/70. [D 20:42:36.102018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 9402. [D 20:42:36.102094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 9403. [D 20:42:36.102105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 9404. [D 20:42:36.102115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 9405. [D 20:42:36.102126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 9406. [D 20:42:36.102136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 9407. [D 20:42:36.102146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 9408. [D 20:42:36.102156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 9409. [D 20:42:36.102166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 9410. [D 20:42:36.102175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 9411. [D 20:42:36.102185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 9412. [D 20:42:36.102241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 9413. [D 20:42:36.102252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 9414. [D 20:42:36.102262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 9415. [D 20:42:36.102284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 9416. [D 20:42:36.102294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 9417. [D 20:42:36.102304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 9418. [D 20:42:36.102314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 9419. [D 20:42:36.102324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 9420. [D 20:42:36.102340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 9421. [D 20:42:36.102350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 9422. [D 20:42:36.102360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 9423. [D 20:42:36.102370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 9424. [D 20:42:36.102404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 9425. [D 20:42:36.102414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 9426. [D 20:42:36.102428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 9427. [D 20:42:36.102438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 9428. [D 20:42:36.102461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 9429. [D 20:42:36.102471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 9430. [D 20:42:36.102481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 9431. [D 20:42:36.102495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 9432. [D 20:42:36.102504] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 9433. [D 20:42:36.108027] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 9433. [D 20:42:36.108044] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 1/70. [D 20:42:36.110349] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.110364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.110374] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.115733] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.115748] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.115758] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.115794] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3302 [D 20:42:36.115805] element 0: offset: 0x61f310, size: 24 [D 20:42:36.115819] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 2/70. [D 20:42:36.158277] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3302 [D 20:42:36.158296] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 3/70. [D 20:42:36.158359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 9433. [D 20:42:36.158434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 9434. [D 20:42:36.158446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 9435. [D 20:42:36.158456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 9436. [D 20:42:36.158467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 9437. [D 20:42:36.158477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 9438. [D 20:42:36.158493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 9439. [D 20:42:36.158503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 9440. [D 20:42:36.158512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 9441. [D 20:42:36.158528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 9442. [D 20:42:36.158578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 9443. [D 20:42:36.158591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 9444. [D 20:42:36.158601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 9445. [D 20:42:36.158626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 9446. [D 20:42:36.158636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 9447. [D 20:42:36.158652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 9448. [D 20:42:36.158662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 9449. [D 20:42:36.158672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 9450. [D 20:42:36.158699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 9451. [D 20:42:36.158710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 9452. [D 20:42:36.158720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 9453. [D 20:42:36.158731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 9454. [D 20:42:36.158741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 9455. [D 20:42:36.158751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 9456. [D 20:42:36.158761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 9457. [D 20:42:36.158782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 9458. [D 20:42:36.158792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 9459. [D 20:42:36.158802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 9460. [D 20:42:36.158812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 9461. [D 20:42:36.158835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 9462. [D 20:42:36.158845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 9463. [D 20:42:36.158855] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 9464. [D 20:42:36.164397] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 9464. [D 20:42:36.164415] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 4/70. [D 20:42:36.166623] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.166638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.166648] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.172088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.172103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.172113] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.172145] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3305 [D 20:42:36.172156] element 0: offset: 0x5b0030, size: 24 [D 20:42:36.172168] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 5/70. [D 20:42:36.212779] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3292 [D 20:42:36.212797] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 6/70. [D 20:42:36.212859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 9464. [D 20:42:36.212929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9465. [D 20:42:36.212949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9466. [D 20:42:36.212959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9467. [D 20:42:36.212970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9468. [D 20:42:36.212980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9469. [D 20:42:36.212994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9470. [D 20:42:36.213004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9471. [D 20:42:36.213014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9472. [D 20:42:36.213029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 9473. [D 20:42:36.213039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 9474. [D 20:42:36.213049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 9475. [D 20:42:36.213058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 9476. [D 20:42:36.213069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 9477. [D 20:42:36.213079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 9478. [D 20:42:36.213089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 9479. [D 20:42:36.213098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 9480. [D 20:42:36.213151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 9481. [D 20:42:36.213162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 9482. [D 20:42:36.213172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 9483. [D 20:42:36.213195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 9484. [D 20:42:36.213206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 9485. [D 20:42:36.213217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 9486. [D 20:42:36.213228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 9487. [D 20:42:36.213237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 9488. [D 20:42:36.213248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 9489. [D 20:42:36.213271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 9490. [D 20:42:36.213283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 9491. [D 20:42:36.213298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 9492. [D 20:42:36.213308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 9493. [D 20:42:36.213333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 9494. [D 20:42:36.213348] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 9495. [D 20:42:36.218782] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 9495. [D 20:42:36.218799] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 7/70. [D 20:42:36.221139] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.221154] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.221166] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.226225] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.226255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.226265] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.226301] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3307 [D 20:42:36.226314] element 0: offset: 0x657210, size: 24 [D 20:42:36.226327] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 8/70. [D 20:42:36.270068] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3299 [D 20:42:36.270086] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 9/70. [D 20:42:36.270147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 9495. [D 20:42:36.270224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 9496. [D 20:42:36.270235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 9497. [D 20:42:36.270246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 9498. [D 20:42:36.270257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 9499. [D 20:42:36.270267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 9500. [D 20:42:36.270283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 9501. [D 20:42:36.270292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 9502. [D 20:42:36.270302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 9503. [D 20:42:36.270318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 9504. [D 20:42:36.270369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 9505. [D 20:42:36.270380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 9506. [D 20:42:36.270390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 9507. [D 20:42:36.270400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 9508. [D 20:42:36.270410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 9509. [D 20:42:36.270425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 9510. [D 20:42:36.270435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 9511. [D 20:42:36.270444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 9512. [D 20:42:36.270454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 9513. [D 20:42:36.270472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 9514. [D 20:42:36.270482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 9515. [D 20:42:36.270491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 9516. [D 20:42:36.270501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 9517. [D 20:42:36.270512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 9518. [D 20:42:36.270522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 9519. [D 20:42:36.270532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 9520. [D 20:42:36.270558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 9521. [D 20:42:36.270568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 9522. [D 20:42:36.270578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 9523. [D 20:42:36.270587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 9524. [D 20:42:36.270598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 9525. [D 20:42:36.270623] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 9526. [D 20:42:36.276122] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 9526. [D 20:42:36.276139] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 10/70. [D 20:42:36.278456] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.278471] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.278481] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.285041] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.285067] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.285078] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.285110] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3311 [D 20:42:36.285121] element 0: offset: 0x64b790, size: 24 [D 20:42:36.285133] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 11/70. [D 20:42:36.307805] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3287 [D 20:42:36.307824] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 12/70. [D 20:42:36.307887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 9526. [D 20:42:36.307967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 9527. [D 20:42:36.307979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 9528. [D 20:42:36.307990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 9529. [D 20:42:36.308000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 9530. [D 20:42:36.308010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 9531. [D 20:42:36.308024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 9532. [D 20:42:36.308034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 9533. [D 20:42:36.308044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 9534. [D 20:42:36.308059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 9535. [D 20:42:36.308110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 9536. [D 20:42:36.308122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 9537. [D 20:42:36.308146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 9538. [D 20:42:36.308158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 9539. [D 20:42:36.308168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 9540. [D 20:42:36.308177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 9541. [D 20:42:36.308211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 9542. [D 20:42:36.308221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 9543. [D 20:42:36.308235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 9544. [D 20:42:36.308245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 9545. [D 20:42:36.308255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 9546. [D 20:42:36.308283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 9547. [D 20:42:36.308299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 9548. [D 20:42:36.308310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 9549. [D 20:42:36.308319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 9550. [D 20:42:36.308349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 9551. [D 20:42:36.308359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 9552. [D 20:42:36.308371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 9553. [D 20:42:36.308381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 9554. [D 20:42:36.308391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 9555. [D 20:42:36.308414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 9556. [D 20:42:36.308424] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 9557. [D 20:42:36.313820] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 9557. [D 20:42:36.313837] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 13/70. [D 20:42:36.315985] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.316000] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.316010] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.321846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.321865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.321876] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.321910] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3314 [D 20:42:36.321921] element 0: offset: 0x61f310, size: 24 [D 20:42:36.321933] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 14/70. [D 20:42:36.368786] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3305 [D 20:42:36.368805] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 15/70. [D 20:42:36.368866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 9557. [D 20:42:36.368949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 9558. [D 20:42:36.368961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 9559. [D 20:42:36.368973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 9560. [D 20:42:36.368983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 9561. [D 20:42:36.368994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 9562. [D 20:42:36.369005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 9563. [D 20:42:36.369015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 9564. [D 20:42:36.369025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 9565. [D 20:42:36.369035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 9566. [D 20:42:36.369045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 9567. [D 20:42:36.369055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 9568. [D 20:42:36.369065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 9569. [D 20:42:36.369090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 9570. [D 20:42:36.369099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 9571. [D 20:42:36.369123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 9572. [D 20:42:36.369134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 9573. [D 20:42:36.369144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 9574. [D 20:42:36.369165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 9575. [D 20:42:36.369176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 9576. [D 20:42:36.369186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 9577. [D 20:42:36.369196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 9578. [D 20:42:36.369206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 9579. [D 20:42:36.369216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 9580. [D 20:42:36.369232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 9581. [D 20:42:36.369242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 9582. [D 20:42:36.369268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 9583. [D 20:42:36.369279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 9584. [D 20:42:36.369289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 9585. [D 20:42:36.369300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 9586. [D 20:42:36.369319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 9587. [D 20:42:36.369329] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 9588. [D 20:42:36.374800] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 9588. [D 20:42:36.374817] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 16/70. [D 20:42:36.377145] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.377161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.377171] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.382668] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.382682] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.382693] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.382727] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3317 [D 20:42:36.382737] element 0: offset: 0x661d80, size: 24 [D 20:42:36.382750] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 17/70. [D 20:42:36.410782] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3307 [D 20:42:36.410801] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 18/70. [D 20:42:36.410860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 9588. [D 20:42:36.410931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9589. [D 20:42:36.410988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9590. [D 20:42:36.410999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9591. [D 20:42:36.411010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9592. [D 20:42:36.411020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9593. [D 20:42:36.411030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9594. [D 20:42:36.411053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9595. [D 20:42:36.411068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9596. [D 20:42:36.411077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 9597. [D 20:42:36.411087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 9598. [D 20:42:36.411117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 9599. [D 20:42:36.411132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 9600. [D 20:42:36.411156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 9601. [D 20:42:36.411170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 9602. [D 20:42:36.411189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 9603. [D 20:42:36.411200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 9604. [D 20:42:36.411209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 9605. [D 20:42:36.411220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 9606. [D 20:42:36.411243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 9607. [D 20:42:36.411253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 9608. [D 20:42:36.411278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 9609. [D 20:42:36.411289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 9610. [D 20:42:36.411313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 9611. [D 20:42:36.411323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 9612. [D 20:42:36.411345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 9613. [D 20:42:36.411356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 9614. [D 20:42:36.411366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 9615. [D 20:42:36.411388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 9616. [D 20:42:36.411403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 9617. [D 20:42:36.411413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 9618. [D 20:42:36.411436] openib_post_sr_rdmaw: ibv_post_send wr_id 661f90 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 9619. [D 20:42:36.416789] openib_check_cq: completed rdma wr_id 661f90, nic_wr_credit 9619. [D 20:42:36.416806] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 19/70. [D 20:42:36.419120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.419135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.419144] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.424376] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.424390] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.424401] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.424433] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3319 [D 20:42:36.424445] element 0: offset: 0x61ee50, size: 24 [D 20:42:36.424459] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 20/70. [D 20:42:36.500952] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3314 [D 20:42:36.500971] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 21/70. [D 20:42:36.501120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 9619. [D 20:42:36.501190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 9620. [D 20:42:36.501201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 9621. [D 20:42:36.501211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 9622. [D 20:42:36.501225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 9623. [D 20:42:36.501235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 9624. [D 20:42:36.501245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 9625. [D 20:42:36.501259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 9626. [D 20:42:36.501269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 9627. [D 20:42:36.501278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 9628. [D 20:42:36.501336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 9629. [D 20:42:36.501348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 9630. [D 20:42:36.501358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 9631. [D 20:42:36.501368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 9632. [D 20:42:36.501378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 9633. [D 20:42:36.501393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 9634. [D 20:42:36.501402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 9635. [D 20:42:36.501412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 9636. [D 20:42:36.501423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 9637. [D 20:42:36.501433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 9638. [D 20:42:36.501443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 9639. [D 20:42:36.501468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 9640. [D 20:42:36.501479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 9641. [D 20:42:36.501488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 9642. [D 20:42:36.501505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 9643. [D 20:42:36.501514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 9644. [D 20:42:36.501524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 9645. [D 20:42:36.501558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 9646. [D 20:42:36.501569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 9647. [D 20:42:36.501579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 9648. [D 20:42:36.501589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 9649. [D 20:42:36.501618] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 9650. [D 20:42:36.507092] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 9650. [D 20:42:36.507109] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 22/70. [D 20:42:36.509425] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.509441] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.509452] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.515111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.515125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.515135] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.515168] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3323 [D 20:42:36.515179] element 0: offset: 0x63feb0, size: 24 [D 20:42:36.515191] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 23/70. [D 20:42:36.568624] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3311 [D 20:42:36.568643] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 24/70. [D 20:42:36.568701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 9650. [D 20:42:36.568767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 9651. [D 20:42:36.568787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 9652. [D 20:42:36.568804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 9653. [D 20:42:36.568815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 9654. [D 20:42:36.568825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 9655. [D 20:42:36.568841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 9656. [D 20:42:36.568851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 9657. [D 20:42:36.568860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 9658. [D 20:42:36.568917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 9659. [D 20:42:36.568928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 9660. [D 20:42:36.568938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 9661. [D 20:42:36.568949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 9662. [D 20:42:36.568958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 9663. [D 20:42:36.568968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 9664. [D 20:42:36.568992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 9665. [D 20:42:36.569002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 9666. [D 20:42:36.569012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 9667. [D 20:42:36.569028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 9668. [D 20:42:36.569038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 9669. [D 20:42:36.569063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 9670. [D 20:42:36.569073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 9671. [D 20:42:36.569083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 9672. [D 20:42:36.569110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 9673. [D 20:42:36.569120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 9674. [D 20:42:36.569130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 9675. [D 20:42:36.569145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 9676. [D 20:42:36.569155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 9677. [D 20:42:36.569174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 9678. [D 20:42:36.569184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 9679. [D 20:42:36.569194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 9680. [D 20:42:36.569204] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 9681. [D 20:42:36.574622] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 9681. [D 20:42:36.574639] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 25/70. [D 20:42:36.576280] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.576296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.576306] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.583457] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.583471] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.583482] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.583515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3326 [D 20:42:36.583526] element 0: offset: 0x5b0030, size: 24 [D 20:42:36.583540] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 26/70. [D 20:42:36.677100] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3319 [D 20:42:36.677118] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 27/70. [D 20:42:36.677233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 9681. [D 20:42:36.677312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9682. [D 20:42:36.677322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9683. [D 20:42:36.677333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9684. [D 20:42:36.677347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9685. [D 20:42:36.677357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9686. [D 20:42:36.677367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9687. [D 20:42:36.677382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9688. [D 20:42:36.677391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9689. [D 20:42:36.677401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 9690. [D 20:42:36.677460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 9691. [D 20:42:36.677470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 9692. [D 20:42:36.677495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 9693. [D 20:42:36.677508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 9694. [D 20:42:36.677518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 9695. [D 20:42:36.677528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 9696. [D 20:42:36.677542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 9697. [D 20:42:36.677552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 9698. [D 20:42:36.677562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 9699. [D 20:42:36.677590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 9700. [D 20:42:36.677600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 9701. [D 20:42:36.677612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 9702. [D 20:42:36.677622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 9703. [D 20:42:36.677633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 9704. [D 20:42:36.677660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 9705. [D 20:42:36.677670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 9706. [D 20:42:36.677683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 9707. [D 20:42:36.677693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 9708. [D 20:42:36.677703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 9709. [D 20:42:36.677726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 9710. [D 20:42:36.677736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 9711. [D 20:42:36.677750] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 9712. [D 20:42:36.683210] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 9712. [D 20:42:36.683227] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 28/70. [D 20:42:36.685529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.685545] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.685556] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.690868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.690882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.690892] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.690925] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3328 [D 20:42:36.690936] element 0: offset: 0x691fe0, size: 24 [D 20:42:36.690948] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 29/70. [D 20:42:36.767113] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3323 [D 20:42:36.767133] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 30/70. [D 20:42:36.767217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 9712. [D 20:42:36.767295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 9713. [D 20:42:36.767306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 9714. [D 20:42:36.767316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 9715. [D 20:42:36.767331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 9716. [D 20:42:36.767341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 9717. [D 20:42:36.767353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 9718. [D 20:42:36.767368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 9719. [D 20:42:36.767378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 9720. [D 20:42:36.767387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 9721. [D 20:42:36.767444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 9722. [D 20:42:36.767454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 9723. [D 20:42:36.767464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 9724. [D 20:42:36.767489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 9725. [D 20:42:36.767499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 9726. [D 20:42:36.767514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 9727. [D 20:42:36.767525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 9728. [D 20:42:36.767535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 9729. [D 20:42:36.767545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 9730. [D 20:42:36.767555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 9731. [D 20:42:36.767565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 9732. [D 20:42:36.767592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 9733. [D 20:42:36.767603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 9734. [D 20:42:36.767612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 9735. [D 20:42:36.767628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 9736. [D 20:42:36.767648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 9737. [D 20:42:36.767658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 9738. [D 20:42:36.767668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 9739. [D 20:42:36.767678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 9740. [D 20:42:36.767692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 9741. [D 20:42:36.767713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 9742. [D 20:42:36.767723] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 9743. [D 20:42:36.773151] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 9743. [D 20:42:36.773169] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 31/70. [D 20:42:36.775454] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.775469] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.775478] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.781081] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.781097] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.781107] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.781140] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3332 [D 20:42:36.781151] element 0: offset: 0x61f800, size: 24 [D 20:42:36.781164] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 32/70. [D 20:42:36.826004] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3326 [D 20:42:36.826023] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 33/70. [D 20:42:36.826086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 9743. [D 20:42:36.826163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 9744. [D 20:42:36.826174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 9745. [D 20:42:36.826187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 9746. [D 20:42:36.826201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 9747. [D 20:42:36.826211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 9748. [D 20:42:36.826220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 9749. [D 20:42:36.826235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 9750. [D 20:42:36.826245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 9751. [D 20:42:36.826255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 9752. [D 20:42:36.826307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 9753. [D 20:42:36.826318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 9754. [D 20:42:36.826328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 9755. [D 20:42:36.826356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 9756. [D 20:42:36.826366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 9757. [D 20:42:36.826380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 9758. [D 20:42:36.826389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 9759. [D 20:42:36.826399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 9760. [D 20:42:36.826414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 9761. [D 20:42:36.826435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 9762. [D 20:42:36.826445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 9763. [D 20:42:36.826456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 9764. [D 20:42:36.826466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 9765. [D 20:42:36.826476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 9766. [D 20:42:36.826486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 9767. [D 20:42:36.826496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 9768. [D 20:42:36.826506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 9769. [D 20:42:36.826515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 9770. [D 20:42:36.826526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 9771. [D 20:42:36.826536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 9772. [D 20:42:36.826559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 9773. [D 20:42:36.826571] openib_post_sr_rdmaw: ibv_post_send wr_id 6256c0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 9774. [D 20:42:36.832019] openib_check_cq: completed rdma wr_id 6256c0, nic_wr_credit 9774. [D 20:42:36.832035] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 34/70. [D 20:42:36.834206] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.834222] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.834231] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:36.870418] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3317 [D 20:42:36.870437] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 35/70. [D 20:42:36.870500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 9774. [D 20:42:36.870576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 9775. [D 20:42:36.870587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 9776. [D 20:42:36.870597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 9777. [D 20:42:36.870609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 9778. [D 20:42:36.870618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 9779. [D 20:42:36.870635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 9780. [D 20:42:36.870644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 9781. [D 20:42:36.870654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 9782. [D 20:42:36.870669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 9783. [D 20:42:36.870717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 9784. [D 20:42:36.870730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 9785. [D 20:42:36.870740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 9786. [D 20:42:36.870750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 9787. [D 20:42:36.870760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 9788. [D 20:42:36.870775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 9789. [D 20:42:36.870785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 9790. [D 20:42:36.870795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 9791. [D 20:42:36.870805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 9792. [D 20:42:36.870816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 9793. [D 20:42:36.870837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 9794. [D 20:42:36.870852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 9795. [D 20:42:36.870862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 9796. [D 20:42:36.870872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 9797. [D 20:42:36.870888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 9798. [D 20:42:36.870898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 9799. [D 20:42:36.870907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 9800. [D 20:42:36.870932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 9801. [D 20:42:36.870942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 9802. [D 20:42:36.870954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 9803. [D 20:42:36.870969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 9804. [D 20:42:36.870979] openib_post_sr_rdmaw: ibv_post_send wr_id 6256c0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 9805. [D 20:42:36.876437] openib_check_cq: completed rdma wr_id 6256c0, nic_wr_credit 9805. [D 20:42:36.876454] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 36/70. [D 20:42:36.878765] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.878780] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.878790] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:36.884732] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.884778] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.884788] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:36.884826] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3335 [D 20:42:36.884839] element 0: offset: 0x61ee50, size: 24 [D 20:42:36.884852] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 37/70. [D 20:42:36.921824] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3328 [D 20:42:36.921842] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 38/70. [D 20:42:36.921906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 9805. [D 20:42:36.921977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9806. [D 20:42:36.921996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9807. [D 20:42:36.922007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9808. [D 20:42:36.922018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9809. [D 20:42:36.922028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9810. [D 20:42:36.922042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9811. [D 20:42:36.922052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9812. [D 20:42:36.922062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9813. [D 20:42:36.922077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 9814. [D 20:42:36.922137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 9815. [D 20:42:36.922148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 9816. [D 20:42:36.922178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 9817. [D 20:42:36.922189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 9818. [D 20:42:36.922198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 9819. [D 20:42:36.922215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 9820. [D 20:42:36.922225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 9821. [D 20:42:36.922253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 9822. [D 20:42:36.922263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 9823. [D 20:42:36.922273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 9824. [D 20:42:36.922289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 9825. [D 20:42:36.922299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 9826. [D 20:42:36.922308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 9827. [D 20:42:36.922318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 9828. [D 20:42:36.922336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 9829. [D 20:42:36.922346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 9830. [D 20:42:36.922368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 9831. [D 20:42:36.922383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 9832. [D 20:42:36.922393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 9833. [D 20:42:36.922403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 9834. [D 20:42:36.922419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 9835. [D 20:42:36.922429] openib_post_sr_rdmaw: ibv_post_send wr_id 6256c0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 9836. [D 20:42:36.927834] openib_check_cq: completed rdma wr_id 6256c0, nic_wr_credit 9836. [D 20:42:36.927851] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 39/70. [D 20:42:36.930018] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.930033] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.930044] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:36.935776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.935791] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.935801] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:36.935833] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3337 [D 20:42:36.935845] element 0: offset: 0x61f310, size: 24 [D 20:42:36.935859] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 40/70. [D 20:42:36.964696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:36.964759] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.964769] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:36.964807] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3341 [D 20:42:36.964821] element 0: offset: 0x661750, size: 24 [D 20:42:36.964834] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 41/70. [D 20:42:36.984426] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3332 [D 20:42:36.984444] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 42/70. [D 20:42:36.984509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 9836. [D 20:42:36.984588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 9837. [D 20:42:36.984600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 9838. [D 20:42:36.984610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 9839. [D 20:42:36.984622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 9840. [D 20:42:36.984632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 9841. [D 20:42:36.984648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 9842. [D 20:42:36.984658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 9843. [D 20:42:36.984667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 9844. [D 20:42:36.984722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 9845. [D 20:42:36.984734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 9846. [D 20:42:36.984746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 9847. [D 20:42:36.984756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 9848. [D 20:42:36.984766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 9849. [D 20:42:36.984776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 9850. [D 20:42:36.984791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 9851. [D 20:42:36.984801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 9852. [D 20:42:36.984811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 9853. [D 20:42:36.984827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 9854. [D 20:42:36.984837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 9855. [D 20:42:36.984847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 9856. [D 20:42:36.984857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 9857. [D 20:42:36.984875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 9858. [D 20:42:36.984885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 9859. [D 20:42:36.984895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 9860. [D 20:42:36.984922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 9861. [D 20:42:36.984932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 9862. [D 20:42:36.984946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 9863. [D 20:42:36.984956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 9864. [D 20:42:36.984966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 9865. [D 20:42:36.984995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 9866. [D 20:42:36.985006] openib_post_sr_rdmaw: ibv_post_send wr_id 62b000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 9867. [D 20:42:36.990441] openib_check_cq: completed rdma wr_id 62b000, nic_wr_credit 9867. [D 20:42:36.990457] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 43/70. [D 20:42:36.992605] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:36.992620] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:36.992630] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.050920] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3335 [D 20:42:37.050940] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 44/70. [D 20:42:37.051009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 9867. [D 20:42:37.051108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 9868. [D 20:42:37.051121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 9869. [D 20:42:37.051131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 9870. [D 20:42:37.051142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 9871. [D 20:42:37.051152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 9872. [D 20:42:37.051162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 9873. [D 20:42:37.051172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 9874. [D 20:42:37.051182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 9875. [D 20:42:37.051192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 9876. [D 20:42:37.051202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 9877. [D 20:42:37.051233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 9878. [D 20:42:37.051243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 9879. [D 20:42:37.051267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 9880. [D 20:42:37.051283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 9881. [D 20:42:37.051306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 9882. [D 20:42:37.051320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 9883. [D 20:42:37.051330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 9884. [D 20:42:37.051356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 9885. [D 20:42:37.051366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 9886. [D 20:42:37.051376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 9887. [D 20:42:37.051404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 9888. [D 20:42:37.051417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 9889. [D 20:42:37.051430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 9890. [D 20:42:37.051452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 9891. [D 20:42:37.051463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 9892. [D 20:42:37.051482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 9893. [D 20:42:37.051493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 9894. [D 20:42:37.051503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 9895. [D 20:42:37.051522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 9896. [D 20:42:37.051538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 9897. [D 20:42:37.051562] openib_post_sr_rdmaw: ibv_post_send wr_id 63e740 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 9898. [D 20:42:37.056974] openib_check_cq: completed rdma wr_id 63e740, nic_wr_credit 9898. [D 20:42:37.056992] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 45/70. [D 20:42:37.059309] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.059324] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.059334] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:37.064266] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.064291] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.064301] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:37.064335] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3344 [D 20:42:37.064347] element 0: offset: 0x64b790, size: 24 [D 20:42:37.064360] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 46/70. [D 20:42:37.101760] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3341 [D 20:42:37.101779] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 47/70. [D 20:42:37.101840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 9898. [D 20:42:37.101906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 9899. [D 20:42:37.101957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 9900. [D 20:42:37.101968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 9901. [D 20:42:37.101979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 9902. [D 20:42:37.101989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 9903. [D 20:42:37.101999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 9904. [D 20:42:37.102009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 9905. [D 20:42:37.102033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 9906. [D 20:42:37.102043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 9907. [D 20:42:37.102053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 9908. [D 20:42:37.102081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 9909. [D 20:42:37.102091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 9910. [D 20:42:37.102104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 9911. [D 20:42:37.102131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 9912. [D 20:42:37.102141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 9913. [D 20:42:37.102166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 9914. [D 20:42:37.102176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 9915. [D 20:42:37.102199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 9916. [D 20:42:37.102210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 9917. [D 20:42:37.102219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 9918. [D 20:42:37.102247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 9919. [D 20:42:37.102258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 9920. [D 20:42:37.102272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 9921. [D 20:42:37.102294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 9922. [D 20:42:37.102305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 9923. [D 20:42:37.102316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 9924. [D 20:42:37.102326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 9925. [D 20:42:37.102336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 9926. [D 20:42:37.102346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 9927. [D 20:42:37.102358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 9928. [D 20:42:37.102381] openib_post_sr_rdmaw: ibv_post_send wr_id 62b000 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 9929. [D 20:42:37.107765] openib_check_cq: completed rdma wr_id 62b000, nic_wr_credit 9929. [D 20:42:37.107783] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 48/70. [D 20:42:37.110106] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.110121] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.110132] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:37.116024] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.116039] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.116049] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:37.116082] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3347 [D 20:42:37.116093] element 0: offset: 0x662480, size: 24 [D 20:42:37.116107] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 49/70. [D 20:42:37.122467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.122483] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.122494] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.122511] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3350 [D 20:42:37.122524] element 0: offset: 0x63e1a0, size: 24 [D 20:42:37.122533] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 50/70. [D 20:42:37.137702] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3337 [D 20:42:37.137721] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 51/70. [D 20:42:37.137779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 9929. [D 20:42:37.137877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9930. [D 20:42:37.137890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9931. [D 20:42:37.137901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9932. [D 20:42:37.137912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9933. [D 20:42:37.137922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9934. [D 20:42:37.137936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9935. [D 20:42:37.137945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9936. [D 20:42:37.137983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9937. [D 20:42:37.137993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 9938. [D 20:42:37.138003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 9939. [D 20:42:37.138012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 9940. [D 20:42:37.138029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 9941. [D 20:42:37.138039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 9942. [D 20:42:37.138062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 9943. [D 20:42:37.138072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 9944. [D 20:42:37.138082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 9945. [D 20:42:37.138103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 9946. [D 20:42:37.138114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 9947. [D 20:42:37.138124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 9948. [D 20:42:37.138137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 9949. [D 20:42:37.138161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 9950. [D 20:42:37.138175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 9951. [D 20:42:37.138185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 9952. [D 20:42:37.138195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 9953. [D 20:42:37.138205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 9954. [D 20:42:37.138220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 9955. [D 20:42:37.138229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 9956. [D 20:42:37.138239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 9957. [D 20:42:37.138249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 9958. [D 20:42:37.138266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 9959. [D 20:42:37.138276] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 9960. [D 20:42:37.143731] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 9960. [D 20:42:37.143748] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 52/70. [D 20:42:37.145998] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.146013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.146023] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.151472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.151486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.151497] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.151529] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3352 [D 20:42:37.151540] element 0: offset: 0x61ee50, size: 24 [D 20:42:37.151553] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 53/70. [D 20:42:37.223473] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3352 [D 20:42:37.223492] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 54/70. [D 20:42:37.223667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 9960. [D 20:42:37.223737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9961. [D 20:42:37.223748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9962. [D 20:42:37.223759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9963. [D 20:42:37.223769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9964. [D 20:42:37.223779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9965. [D 20:42:37.223789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9966. [D 20:42:37.223800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9967. [D 20:42:37.223810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9968. [D 20:42:37.223819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 9969. [D 20:42:37.223829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 9970. [D 20:42:37.223862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 9971. [D 20:42:37.223879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 9972. [D 20:42:37.223889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 9973. [D 20:42:37.223899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 9974. [D 20:42:37.223909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 9975. [D 20:42:37.223937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 9976. [D 20:42:37.223947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 9977. [D 20:42:37.223957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 9978. [D 20:42:37.223968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 9979. [D 20:42:37.223982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 9980. [D 20:42:37.224007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 9981. [D 20:42:37.224017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 9982. [D 20:42:37.224028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 9983. [D 20:42:37.224038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 9984. [D 20:42:37.224048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 9985. [D 20:42:37.224059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 9986. [D 20:42:37.224084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 9987. [D 20:42:37.224093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 9988. [D 20:42:37.224107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 9989. [D 20:42:37.224117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 9990. [D 20:42:37.224143] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 9991. [D 20:42:37.229666] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 9991. [D 20:42:37.229684] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 55/70. [D 20:42:37.231948] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.231964] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.231974] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.236270] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.236286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.236297] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.236330] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3355 [D 20:42:37.236341] element 0: offset: 0x5b0030, size: 24 [D 20:42:37.236355] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 56/70. [D 20:42:37.291650] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3355 [D 20:42:37.291669] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 57/70. [D 20:42:37.291730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 9991. [D 20:42:37.291810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 9992. [D 20:42:37.291821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 9993. [D 20:42:37.291832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 9994. [D 20:42:37.291843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 9995. [D 20:42:37.291853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 9996. [D 20:42:37.291869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 9997. [D 20:42:37.291879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 9998. [D 20:42:37.291888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 9999. [D 20:42:37.291943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 10000. [D 20:42:37.291955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 10001. [D 20:42:37.291966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 10002. [D 20:42:37.291996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 10003. [D 20:42:37.292006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 10004. [D 20:42:37.292015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 10005. [D 20:42:37.292047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 10006. [D 20:42:37.292058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 10007. [D 20:42:37.292067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 10008. [D 20:42:37.292083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 10009. [D 20:42:37.292093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 10010. [D 20:42:37.292103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 10011. [D 20:42:37.292127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 10012. [D 20:42:37.292137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 10013. [D 20:42:37.292147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 10014. [D 20:42:37.292158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 10015. [D 20:42:37.292168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 10016. [D 20:42:37.292178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 10017. [D 20:42:37.292203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 10018. [D 20:42:37.292219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 10019. [D 20:42:37.292230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 10020. [D 20:42:37.292240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 10021. [D 20:42:37.292270] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 10022. [D 20:42:37.297714] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 10022. [D 20:42:37.297732] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 58/70. [D 20:42:37.299934] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.299950] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.299959] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.305720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.305734] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.305745] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.305778] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3358 [D 20:42:37.305789] element 0: offset: 0x64dc00, size: 24 [D 20:42:37.305801] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 59/70. [D 20:42:37.335352] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3350 [D 20:42:37.335370] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 60/70. [D 20:42:37.335431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 10022. [D 20:42:37.335502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 10023. [D 20:42:37.335522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 10024. [D 20:42:37.335532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 10025. [D 20:42:37.335543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 10026. [D 20:42:37.335553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 10027. [D 20:42:37.335569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 10028. [D 20:42:37.335579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 10029. [D 20:42:37.335588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 10030. [D 20:42:37.335604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 10031. [D 20:42:37.335654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 10032. [D 20:42:37.335666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 10033. [D 20:42:37.335687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 10034. [D 20:42:37.335700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 10035. [D 20:42:37.335710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 10036. [D 20:42:37.335720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 10037. [D 20:42:37.335749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 10038. [D 20:42:37.335759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 10039. [D 20:42:37.335770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 10040. [D 20:42:37.335779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 10041. [D 20:42:37.335790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 10042. [D 20:42:37.335801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 10043. [D 20:42:37.335825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 10044. [D 20:42:37.335836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 10045. [D 20:42:37.335846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 10046. [D 20:42:37.335870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 10047. [D 20:42:37.335880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 10048. [D 20:42:37.335896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 10049. [D 20:42:37.335906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 10050. [D 20:42:37.335916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 10051. [D 20:42:37.335940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 10052. [D 20:42:37.335950] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 10053. [D 20:42:37.341357] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 10053. [D 20:42:37.341374] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 0/70. [D 20:42:37.343667] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.343682] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.343692] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.348274] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.348289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.348299] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.348333] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3362 [D 20:42:37.348344] element 0: offset: 0x61f310, size: 24 [D 20:42:37.348358] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 1/70. [D 20:42:37.400322] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3362 [D 20:42:37.400340] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 2/70. [D 20:42:37.400400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 10053. [D 20:42:37.400471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 10054. [D 20:42:37.400522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 10055. [D 20:42:37.400532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 10056. [D 20:42:37.400543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 10057. [D 20:42:37.400553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 10058. [D 20:42:37.400563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 10059. [D 20:42:37.400573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 10060. [D 20:42:37.400597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 10061. [D 20:42:37.400607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 10062. [D 20:42:37.400617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 10063. [D 20:42:37.400645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 10064. [D 20:42:37.400655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 10065. [D 20:42:37.400667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 10066. [D 20:42:37.400694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 10067. [D 20:42:37.400705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 10068. [D 20:42:37.400731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 10069. [D 20:42:37.400741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 10070. [D 20:42:37.400763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 10071. [D 20:42:37.400773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 10072. [D 20:42:37.400783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 10073. [D 20:42:37.400797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 10074. [D 20:42:37.400824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 10075. [D 20:42:37.400837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 10076. [D 20:42:37.400856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 10077. [D 20:42:37.400867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 10078. [D 20:42:37.400877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 10079. [D 20:42:37.400904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 10080. [D 20:42:37.400915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 10081. [D 20:42:37.400937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 10082. [D 20:42:37.400948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 10083. [D 20:42:37.400969] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 10084. [D 20:42:37.406410] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 10084. [D 20:42:37.406427] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 3/70. [D 20:42:37.408755] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.408771] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.408781] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.413388] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.413404] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.413414] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.413448] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3365 [D 20:42:37.413459] element 0: offset: 0x61f800, size: 24 [D 20:42:37.413473] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 4/70. [D 20:42:37.460364] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3358 [D 20:42:37.460383] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 5/70. [D 20:42:37.460441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 10084. [D 20:42:37.460541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 10085. [D 20:42:37.460554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 10086. [D 20:42:37.460566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 10087. [D 20:42:37.460576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 10088. [D 20:42:37.460587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 10089. [D 20:42:37.460597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 10090. [D 20:42:37.460607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 10091. [D 20:42:37.460616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 10092. [D 20:42:37.460627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 10093. [D 20:42:37.460639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 10094. [D 20:42:37.460649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 10095. [D 20:42:37.460658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 10096. [D 20:42:37.460693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 10097. [D 20:42:37.460714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 10098. [D 20:42:37.460724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 10099. [D 20:42:37.460734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 10100. [D 20:42:37.460750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 10101. [D 20:42:37.460760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 10102. [D 20:42:37.460770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 10103. [D 20:42:37.460785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 10104. [D 20:42:37.460810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 10105. [D 20:42:37.460824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 10106. [D 20:42:37.460834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 10107. [D 20:42:37.460846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 10108. [D 20:42:37.460871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 10109. [D 20:42:37.460881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 10110. [D 20:42:37.460895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 10111. [D 20:42:37.460905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 10112. [D 20:42:37.460929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 10113. [D 20:42:37.460939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 10114. [D 20:42:37.460959] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 10115. [D 20:42:37.466437] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 10115. [D 20:42:37.466454] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 6/70. [D 20:42:37.468760] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.468775] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.468786] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.513236] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3347 [D 20:42:37.513256] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 7/70. [D 20:42:37.513323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 10115. [D 20:42:37.513425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 10116. [D 20:42:37.513437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 10117. [D 20:42:37.513448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 10118. [D 20:42:37.513463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 10119. [D 20:42:37.513472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 10120. [D 20:42:37.513482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 10121. [D 20:42:37.513496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 10122. [D 20:42:37.513506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 10123. [D 20:42:37.513516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 10124. [D 20:42:37.513527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 10125. [D 20:42:37.513552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 10126. [D 20:42:37.513563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 10127. [D 20:42:37.513586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 10128. [D 20:42:37.513600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 10129. [D 20:42:37.513623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 10130. [D 20:42:37.513633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 10131. [D 20:42:37.513643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 10132. [D 20:42:37.513662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 10133. [D 20:42:37.513676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 10134. [D 20:42:37.513686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 10135. [D 20:42:37.513706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 10136. [D 20:42:37.513717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 10137. [D 20:42:37.513743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 10138. [D 20:42:37.513753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 10139. [D 20:42:37.513775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 10140. [D 20:42:37.513785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 10141. [D 20:42:37.513795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 10142. [D 20:42:37.513818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 10143. [D 20:42:37.513828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 10144. [D 20:42:37.513844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 10145. [D 20:42:37.513861] openib_post_sr_rdmaw: ibv_post_send wr_id 661f90 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 10146. [D 20:42:37.519284] openib_check_cq: completed rdma wr_id 661f90, nic_wr_credit 10146. [D 20:42:37.519301] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 8/70. [D 20:42:37.520329] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.520345] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.520355] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:37.528124] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.528139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.528150] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:37.528182] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3368 [D 20:42:37.528193] element 0: offset: 0x661750, size: 24 [D 20:42:37.528205] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 9/70. [D 20:42:37.567588] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3365 [D 20:42:37.567607] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 10/70. [D 20:42:37.567668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 10146. [D 20:42:37.567790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 10147. [D 20:42:37.567804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 10148. [D 20:42:37.567815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 10149. [D 20:42:37.567826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 10150. [D 20:42:37.567836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 10151. [D 20:42:37.567859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 10152. [D 20:42:37.567869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 10153. [D 20:42:37.567879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 10154. [D 20:42:37.567890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 10155. [D 20:42:37.567900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 10156. [D 20:42:37.567910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 10157. [D 20:42:37.567930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 10158. [D 20:42:37.567940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 10159. [D 20:42:37.567963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 10160. [D 20:42:37.567973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 10161. [D 20:42:37.567997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 10162. [D 20:42:37.568008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 10163. [D 20:42:37.568023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 10164. [D 20:42:37.568049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 10165. [D 20:42:37.568059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 10166. [D 20:42:37.568081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 10167. [D 20:42:37.568091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 10168. [D 20:42:37.568101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 10169. [D 20:42:37.568123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 10170. [D 20:42:37.568133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 10171. [D 20:42:37.568144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 10172. [D 20:42:37.568168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 10173. [D 20:42:37.568179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 10174. [D 20:42:37.568189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 10175. [D 20:42:37.568199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 10176. [D 20:42:37.568209] openib_post_sr_rdmaw: ibv_post_send wr_id 62b000 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 10177. [D 20:42:37.573651] openib_check_cq: completed rdma wr_id 62b000, nic_wr_credit 10177. [D 20:42:37.573669] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 11/70. [D 20:42:37.575831] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.575846] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.575857] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:37.581421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.581435] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.581446] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:37.581479] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3371 [D 20:42:37.581490] element 0: offset: 0x691fe0, size: 24 [D 20:42:37.581502] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 12/70. [D 20:42:37.596313] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.596376] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.596386] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.596424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3373 [D 20:42:37.596438] element 0: offset: 0x61ee50, size: 24 [D 20:42:37.596452] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 13/70. [D 20:42:37.617286] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3344 [D 20:42:37.617305] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 14/70. [D 20:42:37.617364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 10177. [D 20:42:37.617433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 10178. [D 20:42:37.617452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 10179. [D 20:42:37.617463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 10180. [D 20:42:37.617474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 10181. [D 20:42:37.617484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 10182. [D 20:42:37.617498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 10183. [D 20:42:37.617508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 10184. [D 20:42:37.617518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 10185. [D 20:42:37.617534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 10186. [D 20:42:37.617579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 10187. [D 20:42:37.617590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 10188. [D 20:42:37.617614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 10189. [D 20:42:37.617628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 10190. [D 20:42:37.617638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 10191. [D 20:42:37.617648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 10192. [D 20:42:37.617677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 10193. [D 20:42:37.617687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 10194. [D 20:42:37.617701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 10195. [D 20:42:37.617711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 10196. [D 20:42:37.617721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 10197. [D 20:42:37.617735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 10198. [D 20:42:37.617762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 10199. [D 20:42:37.617775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 10200. [D 20:42:37.617785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 10201. [D 20:42:37.617794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 10202. [D 20:42:37.617817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 10203. [D 20:42:37.617827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 10204. [D 20:42:37.617837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 10205. [D 20:42:37.617848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 10206. [D 20:42:37.617857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 10207. [D 20:42:37.617882] openib_post_sr_rdmaw: ibv_post_send wr_id 650730 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 10208. [D 20:42:37.623288] openib_check_cq: completed rdma wr_id 650730, nic_wr_credit 10208. [D 20:42:37.623305] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 15/70. [D 20:42:37.625450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.625465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.625476] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.631691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.631746] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.631756] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.631794] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3377 [D 20:42:37.631805] element 0: offset: 0x662480, size: 24 [D 20:42:37.631819] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 16/70. [D 20:42:37.663344] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3368 [D 20:42:37.663362] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 17/70. [D 20:42:37.663423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 10208. [D 20:42:37.663499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 10209. [D 20:42:37.663510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 10210. [D 20:42:37.663523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 10211. [D 20:42:37.663536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 10212. [D 20:42:37.663546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 10213. [D 20:42:37.663556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 10214. [D 20:42:37.663570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 10215. [D 20:42:37.663580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 10216. [D 20:42:37.663590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 10217. [D 20:42:37.663641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 10218. [D 20:42:37.663652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 10219. [D 20:42:37.663662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 10220. [D 20:42:37.663685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 10221. [D 20:42:37.663696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 10222. [D 20:42:37.663706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 10223. [D 20:42:37.663716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 10224. [D 20:42:37.663726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 10225. [D 20:42:37.663758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 10226. [D 20:42:37.663769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 10227. [D 20:42:37.663780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 10228. [D 20:42:37.663791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 10229. [D 20:42:37.663800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 10230. [D 20:42:37.663824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 10231. [D 20:42:37.663834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 10232. [D 20:42:37.663848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 10233. [D 20:42:37.663859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 10234. [D 20:42:37.663869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 10235. [D 20:42:37.663893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 10236. [D 20:42:37.663903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 10237. [D 20:42:37.663916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 10238. [D 20:42:37.663931] openib_post_sr_rdmaw: ibv_post_send wr_id 650730 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 10239. [D 20:42:37.669355] openib_check_cq: completed rdma wr_id 650730, nic_wr_credit 10239. [D 20:42:37.669373] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 18/70. [D 20:42:37.671575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.671590] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.671600] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.676302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.676320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.676330] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.676363] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3380 [D 20:42:37.676374] element 0: offset: 0x5b0030, size: 24 [D 20:42:37.676386] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 19/70. [D 20:42:37.751326] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3377 [D 20:42:37.751345] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 20/70. [D 20:42:37.751518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 10239. [D 20:42:37.751584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 10240. [D 20:42:37.751595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 10241. [D 20:42:37.751605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 10242. [D 20:42:37.751620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 10243. [D 20:42:37.751630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 10244. [D 20:42:37.751640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 10245. [D 20:42:37.751655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 10246. [D 20:42:37.751665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 10247. [D 20:42:37.751674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 10248. [D 20:42:37.751704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 10249. [D 20:42:37.751715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 10250. [D 20:42:37.751737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 10251. [D 20:42:37.751748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 10252. [D 20:42:37.751758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 10253. [D 20:42:37.751777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 10254. [D 20:42:37.751791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 10255. [D 20:42:37.751801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 10256. [D 20:42:37.751826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 10257. [D 20:42:37.751836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 10258. [D 20:42:37.751846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 10259. [D 20:42:37.751873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 10260. [D 20:42:37.751883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 10261. [D 20:42:37.751895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 10262. [D 20:42:37.751914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 10263. [D 20:42:37.751925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 10264. [D 20:42:37.751935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 10265. [D 20:42:37.751954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 10266. [D 20:42:37.751970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 10267. [D 20:42:37.751991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 10268. [D 20:42:37.752002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 10269. [D 20:42:37.752012] openib_post_sr_rdmaw: ibv_post_send wr_id 64b710 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 10270. [D 20:42:37.757486] openib_check_cq: completed rdma wr_id 64b710, nic_wr_credit 10270. [D 20:42:37.757504] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 21/70. [D 20:42:37.759792] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.759807] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.759817] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.807148] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3373 [D 20:42:37.807168] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 22/70. [D 20:42:37.807229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 10270. [D 20:42:37.807299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 10271. [D 20:42:37.807354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 10272. [D 20:42:37.807366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 10273. [D 20:42:37.807376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 10274. [D 20:42:37.807387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 10275. [D 20:42:37.807397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 10276. [D 20:42:37.807418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 10277. [D 20:42:37.807434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 10278. [D 20:42:37.807444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 10279. [D 20:42:37.807454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 10280. [D 20:42:37.807483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 10281. [D 20:42:37.807493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 10282. [D 20:42:37.807514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 10283. [D 20:42:37.807524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 10284. [D 20:42:37.807534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 10285. [D 20:42:37.807561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 10286. [D 20:42:37.807571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 10287. [D 20:42:37.807585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 10288. [D 20:42:37.807607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 10289. [D 20:42:37.807620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 10290. [D 20:42:37.807640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 10291. [D 20:42:37.807654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 10292. [D 20:42:37.807673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 10293. [D 20:42:37.807684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 10294. [D 20:42:37.807694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 10295. [D 20:42:37.807716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 10296. [D 20:42:37.807727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 10297. [D 20:42:37.807736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 10298. [D 20:42:37.807746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 10299. [D 20:42:37.807757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 10300. [D 20:42:37.807768] openib_post_sr_rdmaw: ibv_post_send wr_id 64b710 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 10301. [D 20:42:37.813160] openib_check_cq: completed rdma wr_id 64b710, nic_wr_credit 10301. [D 20:42:37.813178] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 23/70. [D 20:42:37.815502] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.815517] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.815526] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:37.821180] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.821195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.821206] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:37.821238] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3382 [D 20:42:37.821249] element 0: offset: 0x61f800, size: 24 [D 20:42:37.821261] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 24/70. [D 20:42:37.845959] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3371 [D 20:42:37.845977] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 25/70. [D 20:42:37.846039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 10301. [D 20:42:37.846150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 10302. [D 20:42:37.846163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 10303. [D 20:42:37.846175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 10304. [D 20:42:37.846186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 10305. [D 20:42:37.846196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 10306. [D 20:42:37.846207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 10307. [D 20:42:37.846229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 10308. [D 20:42:37.846239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 10309. [D 20:42:37.846249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 10310. [D 20:42:37.846259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 10311. [D 20:42:37.846269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 10312. [D 20:42:37.846292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 10313. [D 20:42:37.846302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 10314. [D 20:42:37.846326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 10315. [D 20:42:37.846336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 10316. [D 20:42:37.846347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 10317. [D 20:42:37.846357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 10318. [D 20:42:37.846381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 10319. [D 20:42:37.846391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 10320. [D 20:42:37.846401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 10321. [D 20:42:37.846416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 10322. [D 20:42:37.846440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 10323. [D 20:42:37.846451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 10324. [D 20:42:37.846461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 10325. [D 20:42:37.846471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 10326. [D 20:42:37.846493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 10327. [D 20:42:37.846503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 10328. [D 20:42:37.846513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 10329. [D 20:42:37.846523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 10330. [D 20:42:37.846533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 10331. [D 20:42:37.846543] openib_post_sr_rdmaw: ibv_post_send wr_id 62b000 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 10332. [D 20:42:37.852004] openib_check_cq: completed rdma wr_id 62b000, nic_wr_credit 10332. [D 20:42:37.852021] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 26/70. [D 20:42:37.854141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.854157] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.854168] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:37.859866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.859880] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.859890] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:37.859922] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3386 [D 20:42:37.859933] element 0: offset: 0x64dc00, size: 24 [D 20:42:37.859948] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 27/70. [D 20:42:37.891499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.891563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.891573] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.891611] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3389 [D 20:42:37.891625] element 0: offset: 0x62a8b0, size: 24 [D 20:42:37.891639] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 28/70. [D 20:42:37.916173] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3380 [D 20:42:37.916192] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 29/70. [D 20:42:37.916257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 10332. [D 20:42:37.916368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 10333. [D 20:42:37.916380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 10334. [D 20:42:37.916391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 10335. [D 20:42:37.916401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 10336. [D 20:42:37.916412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 10337. [D 20:42:37.916422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 10338. [D 20:42:37.916433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 10339. [D 20:42:37.916442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 10340. [D 20:42:37.916452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 10341. [D 20:42:37.916462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 10342. [D 20:42:37.916493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 10343. [D 20:42:37.916504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 10344. [D 20:42:37.916516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 10345. [D 20:42:37.916526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 10346. [D 20:42:37.916536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 10347. [D 20:42:37.916546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 10348. [D 20:42:37.916576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 10349. [D 20:42:37.916586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 10350. [D 20:42:37.916600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 10351. [D 20:42:37.916610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 10352. [D 20:42:37.916620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 10353. [D 20:42:37.916646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 10354. [D 20:42:37.916655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 10355. [D 20:42:37.916666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 10356. [D 20:42:37.916676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 10357. [D 20:42:37.916686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 10358. [D 20:42:37.916710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 10359. [D 20:42:37.916721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 10360. [D 20:42:37.916737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 10361. [D 20:42:37.916748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 10362. [D 20:42:37.916775] openib_post_sr_rdmaw: ibv_post_send wr_id 650690 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 10363. [D 20:42:37.922227] openib_check_cq: completed rdma wr_id 650690, nic_wr_credit 10363. [D 20:42:37.922245] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 30/70. [D 20:42:37.924394] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.924410] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.924421] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.930893] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.930925] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.930934] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.930969] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3392 [D 20:42:37.930980] element 0: offset: 0x63e1a0, size: 24 [D 20:42:37.930993] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 31/70. [D 20:42:37.967489] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3382 [D 20:42:37.967507] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 32/70. [D 20:42:37.967573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 10363. [D 20:42:37.967653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 10364. [D 20:42:37.967664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 10365. [D 20:42:37.967675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 10366. [D 20:42:37.967685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 10367. [D 20:42:37.967695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 10368. [D 20:42:37.967710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 10369. [D 20:42:37.967720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 10370. [D 20:42:37.967730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 10371. [D 20:42:37.967745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 10372. [D 20:42:37.967796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 10373. [D 20:42:37.967808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 10374. [D 20:42:37.967833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 10375. [D 20:42:37.967845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 10376. [D 20:42:37.967855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 10377. [D 20:42:37.967864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 10378. [D 20:42:37.967890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 10379. [D 20:42:37.967900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 10380. [D 20:42:37.967909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 10381. [D 20:42:37.967925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 10382. [D 20:42:37.967935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 10383. [D 20:42:37.967945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 10384. [D 20:42:37.967957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 10385. [D 20:42:37.967968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 10386. [D 20:42:37.967978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 10387. [D 20:42:37.967988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 10388. [D 20:42:37.968006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 10389. [D 20:42:37.968016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 10390. [D 20:42:37.968041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 10391. [D 20:42:37.968051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 10392. [D 20:42:37.968061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 10393. [D 20:42:37.968076] openib_post_sr_rdmaw: ibv_post_send wr_id 632990 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 10394. [D 20:42:37.973510] openib_check_cq: completed rdma wr_id 632990, nic_wr_credit 10394. [D 20:42:37.973528] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 33/70. [D 20:42:37.975733] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:37.975747] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.975757] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:37.981316] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:37.981331] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:37.981342] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:37.981374] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3394 [D 20:42:37.981385] element 0: offset: 0x61ee50, size: 24 [D 20:42:37.981397] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 34/70. [D 20:42:38.029156] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3392 [D 20:42:38.029175] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 35/70. [D 20:42:38.029233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 10394. [D 20:42:38.029318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 10395. [D 20:42:38.029332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 10396. [D 20:42:38.029344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 10397. [D 20:42:38.029355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 10398. [D 20:42:38.029365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 10399. [D 20:42:38.029376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 10400. [D 20:42:38.029386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 10401. [D 20:42:38.029396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 10402. [D 20:42:38.029420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 10403. [D 20:42:38.029431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 10404. [D 20:42:38.029441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 10405. [D 20:42:38.029464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 10406. [D 20:42:38.029474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 10407. [D 20:42:38.029495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 10408. [D 20:42:38.029511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 10409. [D 20:42:38.029532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 10410. [D 20:42:38.029547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 10411. [D 20:42:38.029557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 10412. [D 20:42:38.029580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 10413. [D 20:42:38.029590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 10414. [D 20:42:38.029600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 10415. [D 20:42:38.029610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 10416. [D 20:42:38.029625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 10417. [D 20:42:38.029648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 10418. [D 20:42:38.029662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 10419. [D 20:42:38.029672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 10420. [D 20:42:38.029698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 10421. [D 20:42:38.029717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 10422. [D 20:42:38.029731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 10423. [D 20:42:38.029741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 10424. [D 20:42:38.029751] openib_post_sr_rdmaw: ibv_post_send wr_id 655ce0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 10425. [D 20:42:38.035224] openib_check_cq: completed rdma wr_id 655ce0, nic_wr_credit 10425. [D 20:42:38.035242] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 36/70. [D 20:42:38.036401] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.036417] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.036428] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.043769] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.043806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.043816] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.043852] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3398 [D 20:42:38.043863] element 0: offset: 0x661750, size: 24 [D 20:42:38.043877] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 37/70. [D 20:42:38.110980] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3394 [D 20:42:38.110999] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 38/70. [D 20:42:38.111059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 10425. [D 20:42:38.111131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 10426. [D 20:42:38.111187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 10427. [D 20:42:38.111197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 10428. [D 20:42:38.111208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 10429. [D 20:42:38.111219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 10430. [D 20:42:38.111229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 10431. [D 20:42:38.111251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 10432. [D 20:42:38.111266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 10433. [D 20:42:38.111276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 10434. [D 20:42:38.111286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 10435. [D 20:42:38.111322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 10436. [D 20:42:38.111347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 10437. [D 20:42:38.111358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 10438. [D 20:42:38.111368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 10439. [D 20:42:38.111390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 10440. [D 20:42:38.111401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 10441. [D 20:42:38.111410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 10442. [D 20:42:38.111432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 10443. [D 20:42:38.111442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 10444. [D 20:42:38.111455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 10445. [D 20:42:38.111484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 10446. [D 20:42:38.111493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 10447. [D 20:42:38.111503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 10448. [D 20:42:38.111524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 10449. [D 20:42:38.111534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 10450. [D 20:42:38.111560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 10451. [D 20:42:38.111570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 10452. [D 20:42:38.111581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 10453. [D 20:42:38.111591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 10454. [D 20:42:38.111601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 10455. [D 20:42:38.111611] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 10456. [D 20:42:38.117061] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 10456. [D 20:42:38.117079] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 39/70. [D 20:42:38.119369] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.119384] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.119394] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.124914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.124928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.124939] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.124971] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3400 [D 20:42:38.124982] element 0: offset: 0x5b0030, size: 24 [D 20:42:38.124994] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 40/70. [D 20:42:38.169798] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3386 [D 20:42:38.169817] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 41/70. [D 20:42:38.169879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 10456. [D 20:42:38.169991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 10457. [D 20:42:38.170005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 10458. [D 20:42:38.170016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 10459. [D 20:42:38.170027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 10460. [D 20:42:38.170038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 10461. [D 20:42:38.170048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 10462. [D 20:42:38.170069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 10463. [D 20:42:38.170084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 10464. [D 20:42:38.170093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 10465. [D 20:42:38.170103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 10466. [D 20:42:38.170134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 10467. [D 20:42:38.170145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 10468. [D 20:42:38.170154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 10469. [D 20:42:38.170164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 10470. [D 20:42:38.170182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 10471. [D 20:42:38.170191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 10472. [D 20:42:38.170201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 10473. [D 20:42:38.170211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 10474. [D 20:42:38.170229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 10475. [D 20:42:38.170238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 10476. [D 20:42:38.170260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 10477. [D 20:42:38.170269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 10478. [D 20:42:38.170279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 10479. [D 20:42:38.170294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 10480. [D 20:42:38.170317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 10481. [D 20:42:38.170333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 10482. [D 20:42:38.170343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 10483. [D 20:42:38.170353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 10484. [D 20:42:38.170376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 10485. [D 20:42:38.170386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 10486. [D 20:42:38.170396] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 10487. [D 20:42:38.175806] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 10487. [D 20:42:38.175823] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 42/70. [D 20:42:38.177940] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.177955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.177965] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.183450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.183465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.183475] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.183508] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3404 [D 20:42:38.183519] element 0: offset: 0x62a510, size: 24 [D 20:42:38.183531] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 43/70. [D 20:42:38.229598] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3398 [D 20:42:38.229616] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 44/70. [D 20:42:38.229680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 10487. [D 20:42:38.229786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 10488. [D 20:42:38.229799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 10489. [D 20:42:38.229810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 10490. [D 20:42:38.229821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 10491. [D 20:42:38.229831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 10492. [D 20:42:38.229841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 10493. [D 20:42:38.229862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 10494. [D 20:42:38.229878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 10495. [D 20:42:38.229888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 10496. [D 20:42:38.229898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 10497. [D 20:42:38.229913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 10498. [D 20:42:38.229923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 10499. [D 20:42:38.229933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 10500. [D 20:42:38.229943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 10501. [D 20:42:38.229966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 10502. [D 20:42:38.229976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 10503. [D 20:42:38.229997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 10504. [D 20:42:38.230009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 10505. [D 20:42:38.230019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 10506. [D 20:42:38.230029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 10507. [D 20:42:38.230051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 10508. [D 20:42:38.230061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 10509. [D 20:42:38.230071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 10510. [D 20:42:38.230081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 10511. [D 20:42:38.230091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 10512. [D 20:42:38.230107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 10513. [D 20:42:38.230131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 10514. [D 20:42:38.230142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 10515. [D 20:42:38.230153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 10516. [D 20:42:38.230172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 10517. [D 20:42:38.230188] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 10518. [D 20:42:38.235638] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 10518. [D 20:42:38.235654] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 45/70. [D 20:42:38.236386] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.236401] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.236412] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.244242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.244257] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.244267] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.244299] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3407 [D 20:42:38.244310] element 0: offset: 0x655ed0, size: 24 [D 20:42:38.244325] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 46/70. [D 20:42:38.270987] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3389 [D 20:42:38.271006] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 47/70. [D 20:42:38.271063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 10518. [D 20:42:38.271157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 10519. [D 20:42:38.271171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 10520. [D 20:42:38.271182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 10521. [D 20:42:38.271193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 10522. [D 20:42:38.271204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 10523. [D 20:42:38.271215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 10524. [D 20:42:38.271224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 10525. [D 20:42:38.271235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 10526. [D 20:42:38.271275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 10527. [D 20:42:38.271297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 10528. [D 20:42:38.271312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 10529. [D 20:42:38.271333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 10530. [D 20:42:38.271347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 10531. [D 20:42:38.271357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 10532. [D 20:42:38.271380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 10533. [D 20:42:38.271390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 10534. [D 20:42:38.271412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 10535. [D 20:42:38.271423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 10536. [D 20:42:38.271444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 10537. [D 20:42:38.271455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 10538. [D 20:42:38.271465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 10539. [D 20:42:38.271475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 10540. [D 20:42:38.271485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 10541. [D 20:42:38.271495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 10542. [D 20:42:38.271505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 10543. [D 20:42:38.271534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 10544. [D 20:42:38.271559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 10545. [D 20:42:38.271571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 10546. [D 20:42:38.271593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 10547. [D 20:42:38.271604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 10548. [D 20:42:38.271614] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 10549. [D 20:42:38.277017] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 10549. [D 20:42:38.277034] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 48/70. [D 20:42:38.279239] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.279254] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.279264] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.284706] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.284720] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.284731] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.284764] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3410 [D 20:42:38.284775] element 0: offset: 0x61ee50, size: 24 [D 20:42:38.284787] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 49/70. [D 20:42:38.343547] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3404 [D 20:42:38.343567] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 50/70. [D 20:42:38.343629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 10549. [D 20:42:38.343699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 10550. [D 20:42:38.343719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 10551. [D 20:42:38.343732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 10552. [D 20:42:38.343742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 10553. [D 20:42:38.343753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 10554. [D 20:42:38.343763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 10555. [D 20:42:38.343772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 10556. [D 20:42:38.343784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 10557. [D 20:42:38.343801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 10558. [D 20:42:38.343852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 10559. [D 20:42:38.343865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 10560. [D 20:42:38.343875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 10561. [D 20:42:38.343885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 10562. [D 20:42:38.343895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 10563. [D 20:42:38.343905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 10564. [D 20:42:38.343915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 10565. [D 20:42:38.343925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 10566. [D 20:42:38.343955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 10567. [D 20:42:38.343965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 10568. [D 20:42:38.343975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 10569. [D 20:42:38.343990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 10570. [D 20:42:38.344000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 10571. [D 20:42:38.344010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 10572. [D 20:42:38.344046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 10573. [D 20:42:38.344059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 10574. [D 20:42:38.344069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 10575. [D 20:42:38.344079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 10576. [D 20:42:38.344103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 10577. [D 20:42:38.344114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 10578. [D 20:42:38.344125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 10579. [D 20:42:38.344134] openib_post_sr_rdmaw: ibv_post_send wr_id 62b000 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 10580. [D 20:42:38.349554] openib_check_cq: completed rdma wr_id 62b000, nic_wr_credit 10580. [D 20:42:38.349571] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 51/70. [D 20:42:38.351733] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.351748] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.351758] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.356353] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.356383] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.356393] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.356428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3413 [D 20:42:38.356439] element 0: offset: 0x64dc00, size: 24 [D 20:42:38.356453] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 52/70. [D 20:42:38.411144] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3407 [D 20:42:38.411163] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 53/70. [D 20:42:38.411224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 10580. [D 20:42:38.411300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 10581. [D 20:42:38.411311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 10582. [D 20:42:38.411322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 10583. [D 20:42:38.411333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 10584. [D 20:42:38.411343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 10585. [D 20:42:38.411359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 10586. [D 20:42:38.411369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 10587. [D 20:42:38.411379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 10588. [D 20:42:38.411395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 10589. [D 20:42:38.411444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 10590. [D 20:42:38.411457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 10591. [D 20:42:38.411482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 10592. [D 20:42:38.411492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 10593. [D 20:42:38.411502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 10594. [D 20:42:38.411532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 10595. [D 20:42:38.411543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 10596. [D 20:42:38.411554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 10597. [D 20:42:38.411564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 10598. [D 20:42:38.411575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 10599. [D 20:42:38.411588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 10600. [D 20:42:38.411611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 10601. [D 20:42:38.411626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 10602. [D 20:42:38.411636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 10603. [D 20:42:38.411646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 10604. [D 20:42:38.411675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 10605. [D 20:42:38.411685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 10606. [D 20:42:38.411696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 10607. [D 20:42:38.411706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 10608. [D 20:42:38.411716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 10609. [D 20:42:38.411741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 10610. [D 20:42:38.411751] openib_post_sr_rdmaw: ibv_post_send wr_id 62b000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 10611. [D 20:42:38.417157] openib_check_cq: completed rdma wr_id 62b000, nic_wr_credit 10611. [D 20:42:38.417175] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 54/70. [D 20:42:38.419431] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.419446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.419456] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.425770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.425786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.425796] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.425829] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3416 [D 20:42:38.425840] element 0: offset: 0x61f310, size: 24 [D 20:42:38.425854] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 55/70. [D 20:42:38.491065] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3410 [D 20:42:38.491083] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 56/70. [D 20:42:38.491138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 10611. [D 20:42:38.491207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 10612. [D 20:42:38.491247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 10613. [D 20:42:38.491258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 10614. [D 20:42:38.491269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 10615. [D 20:42:38.491279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 10616. [D 20:42:38.491289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 10617. [D 20:42:38.491299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 10618. [D 20:42:38.491309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 10619. [D 20:42:38.491335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 10620. [D 20:42:38.491351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 10621. [D 20:42:38.491375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 10622. [D 20:42:38.491385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 10623. [D 20:42:38.491406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 10624. [D 20:42:38.491417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 10625. [D 20:42:38.491428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 10626. [D 20:42:38.491454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 10627. [D 20:42:38.491465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 10628. [D 20:42:38.491486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 10629. [D 20:42:38.491496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 10630. [D 20:42:38.491506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 10631. [D 20:42:38.491529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 10632. [D 20:42:38.491539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 10633. [D 20:42:38.491549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 10634. [D 20:42:38.491571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 10635. [D 20:42:38.491582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 10636. [D 20:42:38.491604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 10637. [D 20:42:38.491614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 10638. [D 20:42:38.491625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 10639. [D 20:42:38.491634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 10640. [D 20:42:38.491644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 10641. [D 20:42:38.491654] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 10642. [D 20:42:38.497143] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 10642. [D 20:42:38.497161] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 57/70. [D 20:42:38.499481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.499496] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.499506] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.504358] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.504372] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.504382] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.504415] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3419 [D 20:42:38.504426] element 0: offset: 0x655b90, size: 24 [D 20:42:38.504438] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 58/70. [D 20:42:38.568534] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3413 [D 20:42:38.568553] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 59/70. [D 20:42:38.568616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 10642. [D 20:42:38.568728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 10643. [D 20:42:38.568742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 10644. [D 20:42:38.568753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 10645. [D 20:42:38.568764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 10646. [D 20:42:38.568774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 10647. [D 20:42:38.568784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 10648. [D 20:42:38.568806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 10649. [D 20:42:38.568821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 10650. [D 20:42:38.568831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 10651. [D 20:42:38.568841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 10652. [D 20:42:38.568869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 10653. [D 20:42:38.568879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 10654. [D 20:42:38.568905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 10655. [D 20:42:38.568915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 10656. [D 20:42:38.568927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 10657. [D 20:42:38.568947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 10658. [D 20:42:38.568961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 10659. [D 20:42:38.568971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 10660. [D 20:42:38.568995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 10661. [D 20:42:38.569005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 10662. [D 20:42:38.569027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 10663. [D 20:42:38.569037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 10664. [D 20:42:38.569047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 10665. [D 20:42:38.569069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 10666. [D 20:42:38.569079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 10667. [D 20:42:38.569089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 10668. [D 20:42:38.569111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 10669. [D 20:42:38.569133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 10670. [D 20:42:38.569144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 10671. [D 20:42:38.569155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 10672. [D 20:42:38.569165] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 10673. [D 20:42:38.574583] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 10673. [D 20:42:38.574600] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 60/70. [D 20:42:38.576953] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.576969] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.576979] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.582378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.582410] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.582420] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.582455] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3422 [D 20:42:38.582467] element 0: offset: 0x655ed0, size: 24 [D 20:42:38.582480] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 0/70. [D 20:42:38.594483] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3400 [D 20:42:38.594502] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 1/70. [D 20:42:38.594562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 10673. [D 20:42:38.594625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 10674. [D 20:42:38.594677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 10675. [D 20:42:38.594689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 10676. [D 20:42:38.594699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 10677. [D 20:42:38.594710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 10678. [D 20:42:38.594720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 10679. [D 20:42:38.594740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 10680. [D 20:42:38.594755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 10681. [D 20:42:38.594765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 10682. [D 20:42:38.594775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 10683. [D 20:42:38.594804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 10684. [D 20:42:38.594814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 10685. [D 20:42:38.594839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 10686. [D 20:42:38.594855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 10687. [D 20:42:38.594865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 10688. [D 20:42:38.594875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 10689. [D 20:42:38.594885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 10690. [D 20:42:38.594903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 10691. [D 20:42:38.594925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 10692. [D 20:42:38.594936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 10693. [D 20:42:38.594945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 10694. [D 20:42:38.594970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 10695. [D 20:42:38.594981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 10696. [D 20:42:38.595000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 10697. [D 20:42:38.595015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 10698. [D 20:42:38.595025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 10699. [D 20:42:38.595034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 10700. [D 20:42:38.595044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 10701. [D 20:42:38.595062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 10702. [D 20:42:38.595071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 10703. [D 20:42:38.595081] openib_post_sr_rdmaw: ibv_post_send wr_id 650690 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 10704. [D 20:42:38.600484] openib_check_cq: completed rdma wr_id 650690, nic_wr_credit 10704. [D 20:42:38.600501] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 2/70. [D 20:42:38.602646] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.602661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.602670] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.608369] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.608383] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.608394] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.608424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3424 [D 20:42:38.608435] element 0: offset: 0x662010, size: 24 [D 20:42:38.608447] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 3/70. [D 20:42:38.647240] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3419 [D 20:42:38.647260] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 4/70. [D 20:42:38.647320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 10704. [D 20:42:38.647415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 10705. [D 20:42:38.647429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 10706. [D 20:42:38.647440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 10707. [D 20:42:38.647451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 10708. [D 20:42:38.647461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 10709. [D 20:42:38.647471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 10710. [D 20:42:38.647481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 10711. [D 20:42:38.647520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 10712. [D 20:42:38.647534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 10713. [D 20:42:38.647557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 10714. [D 20:42:38.647567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 10715. [D 20:42:38.647592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 10716. [D 20:42:38.647602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 10717. [D 20:42:38.647628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 10718. [D 20:42:38.647639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 10719. [D 20:42:38.647649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 10720. [D 20:42:38.647670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 10721. [D 20:42:38.647682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 10722. [D 20:42:38.647692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 10723. [D 20:42:38.647712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 10724. [D 20:42:38.647728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 10725. [D 20:42:38.647755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 10726. [D 20:42:38.647765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 10727. [D 20:42:38.647788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 10728. [D 20:42:38.647798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 10729. [D 20:42:38.647821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 10730. [D 20:42:38.647832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 10731. [D 20:42:38.647842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 10732. [D 20:42:38.647861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 10733. [D 20:42:38.647875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 10734. [D 20:42:38.647884] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 10735. [D 20:42:38.653274] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 10735. [D 20:42:38.653291] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 5/70. [D 20:42:38.655552] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.655568] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.655577] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.660889] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.660904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.660915] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.660947] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3428 [D 20:42:38.660958] element 0: offset: 0x691fe0, size: 24 [D 20:42:38.660970] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 6/70. [D 20:42:38.765703] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3428 [D 20:42:38.765724] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 7/70. [D 20:42:38.765871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 10735. [D 20:42:38.765939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 10736. [D 20:42:38.765950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 10737. [D 20:42:38.765961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 10738. [D 20:42:38.765971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 10739. [D 20:42:38.765982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 10740. [D 20:42:38.765992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 10741. [D 20:42:38.766002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 10742. [D 20:42:38.766012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 10743. [D 20:42:38.766021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 10744. [D 20:42:38.766031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 10745. [D 20:42:38.766074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 10746. [D 20:42:38.766085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 10747. [D 20:42:38.766095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 10748. [D 20:42:38.766105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 10749. [D 20:42:38.766141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 10750. [D 20:42:38.766151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 10751. [D 20:42:38.766161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 10752. [D 20:42:38.766171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 10753. [D 20:42:38.766200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 10754. [D 20:42:38.766211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 10755. [D 20:42:38.766223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 10756. [D 20:42:38.766233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 10757. [D 20:42:38.766243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 10758. [D 20:42:38.766271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 10759. [D 20:42:38.766287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 10760. [D 20:42:38.766297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 10761. [D 20:42:38.766307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 10762. [D 20:42:38.766338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 10763. [D 20:42:38.766350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 10764. [D 20:42:38.766363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 10765. [D 20:42:38.766373] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 10766. [D 20:42:38.771874] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 10766. [D 20:42:38.771892] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 8/70. [D 20:42:38.772420] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.772435] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.772446] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.779861] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.779876] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.779885] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.779918] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3431 [D 20:42:38.779929] element 0: offset: 0x6507a0, size: 24 [D 20:42:38.779943] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 9/70. [D 20:42:38.788008] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3416 [D 20:42:38.788027] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 10/70. [D 20:42:38.788089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 10766. [D 20:42:38.788163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 10767. [D 20:42:38.788174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 10768. [D 20:42:38.788185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 10769. [D 20:42:38.788196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 10770. [D 20:42:38.788206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 10771. [D 20:42:38.788221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 10772. [D 20:42:38.788231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 10773. [D 20:42:38.788241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 10774. [D 20:42:38.788264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 10775. [D 20:42:38.788274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 10776. [D 20:42:38.788285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 10777. [D 20:42:38.788294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 10778. [D 20:42:38.788304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 10779. [D 20:42:38.788320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 10780. [D 20:42:38.788342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 10781. [D 20:42:38.788351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 10782. [D 20:42:38.788361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 10783. [D 20:42:38.788423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 10784. [D 20:42:38.788434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 10785. [D 20:42:38.788444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 10786. [D 20:42:38.788455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 10787. [D 20:42:38.788469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 10788. [D 20:42:38.788479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 10789. [D 20:42:38.788489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 10790. [D 20:42:38.788504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 10791. [D 20:42:38.788514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 10792. [D 20:42:38.788524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 10793. [D 20:42:38.788549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 10794. [D 20:42:38.788559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 10795. [D 20:42:38.788586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 10796. [D 20:42:38.788596] openib_post_sr_rdmaw: ibv_post_send wr_id 63d810 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 10797. [D 20:42:38.794016] openib_check_cq: completed rdma wr_id 63d810, nic_wr_credit 10797. [D 20:42:38.794033] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 11/70. [D 20:42:38.796237] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.796255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.796265] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:38.828009] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3422 [D 20:42:38.828030] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 12/70. [D 20:42:38.828095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 10797. [D 20:42:38.828194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 10798. [D 20:42:38.828208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 10799. [D 20:42:38.828219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 10800. [D 20:42:38.828229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 10801. [D 20:42:38.828240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 10802. [D 20:42:38.828250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 10803. [D 20:42:38.828263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 10804. [D 20:42:38.828273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 10805. [D 20:42:38.828283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 10806. [D 20:42:38.828294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 10807. [D 20:42:38.828303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 10808. [D 20:42:38.828347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 10809. [D 20:42:38.828359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 10810. [D 20:42:38.828373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 10811. [D 20:42:38.828396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 10812. [D 20:42:38.828407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 10813. [D 20:42:38.828417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 10814. [D 20:42:38.828427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 10815. [D 20:42:38.828437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 10816. [D 20:42:38.828447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 10817. [D 20:42:38.828471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 10818. [D 20:42:38.828482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 10819. [D 20:42:38.828496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 10820. [D 20:42:38.828506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 10821. [D 20:42:38.828516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 10822. [D 20:42:38.828526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 10823. [D 20:42:38.828536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 10824. [D 20:42:38.828546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 10825. [D 20:42:38.828556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 10826. [D 20:42:38.828585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 10827. [D 20:42:38.828595] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 10828. [D 20:42:38.834052] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 10828. [D 20:42:38.834069] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 13/70. [D 20:42:38.836206] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.836221] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.836230] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:38.885708] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3424 [D 20:42:38.885729] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 14/70. [D 20:42:38.885787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 10828. [D 20:42:38.885856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 10829. [D 20:42:38.885911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 10830. [D 20:42:38.885922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 10831. [D 20:42:38.885933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 10832. [D 20:42:38.885944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 10833. [D 20:42:38.885954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 10834. [D 20:42:38.885977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 10835. [D 20:42:38.885991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 10836. [D 20:42:38.886000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 10837. [D 20:42:38.886010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 10838. [D 20:42:38.886038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 10839. [D 20:42:38.886048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 10840. [D 20:42:38.886061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 10841. [D 20:42:38.886071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 10842. [D 20:42:38.886081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 10843. [D 20:42:38.886091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 10844. [D 20:42:38.886118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 10845. [D 20:42:38.886129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 10846. [D 20:42:38.886139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 10847. [D 20:42:38.886160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 10848. [D 20:42:38.886173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 10849. [D 20:42:38.886201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 10850. [D 20:42:38.886211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 10851. [D 20:42:38.886223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 10852. [D 20:42:38.886238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 10853. [D 20:42:38.886262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 10854. [D 20:42:38.886274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 10855. [D 20:42:38.886283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 10856. [D 20:42:38.886296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 10857. [D 20:42:38.886310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 10858. [D 20:42:38.886321] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 10859. [D 20:42:38.891726] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 10859. [D 20:42:38.891743] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 15/70. [D 20:42:38.893952] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:38.893967] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.893978] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:38.900146] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.900161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.900171] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:38.900204] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3433 [D 20:42:38.900215] element 0: offset: 0x5b0030, size: 24 [D 20:42:38.900229] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 16/70. [D 20:42:38.932399] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.932456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.932467] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:38.932502] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3437 [D 20:42:38.932513] element 0: offset: 0x661750, size: 24 [D 20:42:38.932527] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 17/70. [D 20:42:38.968037] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:38.968054] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:38.968065] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:38.968082] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3440 [D 20:42:38.968095] element 0: offset: 0x655b90, size: 24 [D 20:42:38.968105] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 18/70. [D 20:42:39.026694] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3431 [D 20:42:39.026713] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 19/70. [D 20:42:39.026781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 10859. [D 20:42:39.026890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 10860. [D 20:42:39.026903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 10861. [D 20:42:39.026913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 10862. [D 20:42:39.026928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 10863. [D 20:42:39.026938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 10864. [D 20:42:39.026948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 10865. [D 20:42:39.026962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 10866. [D 20:42:39.026972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 10867. [D 20:42:39.026981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 10868. [D 20:42:39.027012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 10869. [D 20:42:39.027025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 10870. [D 20:42:39.027049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 10871. [D 20:42:39.027059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 10872. [D 20:42:39.027071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 10873. [D 20:42:39.027081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 10874. [D 20:42:39.027090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 10875. [D 20:42:39.027100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 10876. [D 20:42:39.027131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 10877. [D 20:42:39.027141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 10878. [D 20:42:39.027167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 10879. [D 20:42:39.027177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 10880. [D 20:42:39.027199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 10881. [D 20:42:39.027210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 10882. [D 20:42:39.027222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 10883. [D 20:42:39.027232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 10884. [D 20:42:39.027242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 10885. [D 20:42:39.027269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 10886. [D 20:42:39.027285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 10887. [D 20:42:39.027295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 10888. [D 20:42:39.027305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 10889. [D 20:42:39.027315] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 10890. [D 20:42:39.032743] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 10890. [D 20:42:39.032760] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 20/70. [D 20:42:39.034912] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.034927] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.034937] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.040706] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.040722] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.040733] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.040766] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3443 [D 20:42:39.040777] element 0: offset: 0x691fe0, size: 24 [D 20:42:39.040789] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 21/70. [D 20:42:39.071194] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3437 [D 20:42:39.071213] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 22/70. [D 20:42:39.071276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 10890. [D 20:42:39.071388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 10891. [D 20:42:39.071402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 10892. [D 20:42:39.071413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 10893. [D 20:42:39.071424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 10894. [D 20:42:39.071435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 10895. [D 20:42:39.071444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 10896. [D 20:42:39.071465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 10897. [D 20:42:39.071481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 10898. [D 20:42:39.071491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 10899. [D 20:42:39.071501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 10900. [D 20:42:39.071531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 10901. [D 20:42:39.071540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 10902. [D 20:42:39.071560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 10903. [D 20:42:39.071570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 10904. [D 20:42:39.071580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 10905. [D 20:42:39.071608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 10906. [D 20:42:39.071619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 10907. [D 20:42:39.071631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 10908. [D 20:42:39.071641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 10909. [D 20:42:39.071650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 10910. [D 20:42:39.071660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 10911. [D 20:42:39.071676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 10912. [D 20:42:39.071686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 10913. [D 20:42:39.071695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 10914. [D 20:42:39.071705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 10915. [D 20:42:39.071732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 10916. [D 20:42:39.071742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 10917. [D 20:42:39.071764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 10918. [D 20:42:39.071775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 10919. [D 20:42:39.071785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 10920. [D 20:42:39.071795] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 10921. [D 20:42:39.077247] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 10921. [D 20:42:39.077265] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 23/70. [D 20:42:39.079468] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.079483] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.079493] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.085669] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.085684] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.085695] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.085728] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3446 [D 20:42:39.085739] element 0: offset: 0x655ed0, size: 24 [D 20:42:39.085751] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 24/70. [D 20:42:39.123841] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3433 [D 20:42:39.123860] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 25/70. [D 20:42:39.123919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 10921. [D 20:42:39.123989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 10922. [D 20:42:39.124009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 10923. [D 20:42:39.124022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 10924. [D 20:42:39.124032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 10925. [D 20:42:39.124043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 10926. [D 20:42:39.124053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 10927. [D 20:42:39.124063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 10928. [D 20:42:39.124072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 10929. [D 20:42:39.124087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 10930. [D 20:42:39.124138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 10931. [D 20:42:39.124148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 10932. [D 20:42:39.124158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 10933. [D 20:42:39.124168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 10934. [D 20:42:39.124178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 10935. [D 20:42:39.124189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 10936. [D 20:42:39.124198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 10937. [D 20:42:39.124208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 10938. [D 20:42:39.124233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 10939. [D 20:42:39.124243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 10940. [D 20:42:39.124253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 10941. [D 20:42:39.124263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 10942. [D 20:42:39.124273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 10943. [D 20:42:39.124283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 10944. [D 20:42:39.124293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 10945. [D 20:42:39.124329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 10946. [D 20:42:39.124339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 10947. [D 20:42:39.124350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 10948. [D 20:42:39.124360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 10949. [D 20:42:39.124370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 10950. [D 20:42:39.124394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 10951. [D 20:42:39.124415] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 10952. [D 20:42:39.129848] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 10952. [D 20:42:39.129864] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 26/70. [D 20:42:39.132176] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.132191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.132200] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.137961] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.137975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.137986] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.138019] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3448 [D 20:42:39.138029] element 0: offset: 0x61ee50, size: 24 [D 20:42:39.138042] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 27/70. [D 20:42:39.227359] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3440 [D 20:42:39.227378] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 28/70. [D 20:42:39.227557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 10952. [D 20:42:39.227625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 10953. [D 20:42:39.227636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 10954. [D 20:42:39.227647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 10955. [D 20:42:39.227657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 10956. [D 20:42:39.227667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 10957. [D 20:42:39.227677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 10958. [D 20:42:39.227687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 10959. [D 20:42:39.227697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 10960. [D 20:42:39.227707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 10961. [D 20:42:39.227717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 10962. [D 20:42:39.227749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 10963. [D 20:42:39.227762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 10964. [D 20:42:39.227788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 10965. [D 20:42:39.227798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 10966. [D 20:42:39.227821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 10967. [D 20:42:39.227836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 10968. [D 20:42:39.227846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 10969. [D 20:42:39.227855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 10970. [D 20:42:39.227869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 10971. [D 20:42:39.227893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 10972. [D 20:42:39.227905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 10973. [D 20:42:39.227915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 10974. [D 20:42:39.227936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 10975. [D 20:42:39.227947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 10976. [D 20:42:39.227971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 10977. [D 20:42:39.227982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 10978. [D 20:42:39.227992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 10979. [D 20:42:39.228016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 10980. [D 20:42:39.228026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 10981. [D 20:42:39.228050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 10982. [D 20:42:39.228061] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 10983. [D 20:42:39.233481] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 10983. [D 20:42:39.233499] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 29/70. [D 20:42:39.235817] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.235832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.235842] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.241125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.241140] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.241150] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.241184] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3452 [D 20:42:39.241195] element 0: offset: 0x6507d0, size: 24 [D 20:42:39.241208] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 30/70. [D 20:42:39.297350] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3443 [D 20:42:39.297369] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 31/70. [D 20:42:39.297433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 10983. [D 20:42:39.297545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 10984. [D 20:42:39.297559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 10985. [D 20:42:39.297570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 10986. [D 20:42:39.297581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 10987. [D 20:42:39.297591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 10988. [D 20:42:39.297602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 10989. [D 20:42:39.297612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 10990. [D 20:42:39.297623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 10991. [D 20:42:39.297648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 10992. [D 20:42:39.297664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 10993. [D 20:42:39.297687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 10994. [D 20:42:39.297698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 10995. [D 20:42:39.297719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 10996. [D 20:42:39.297730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 10997. [D 20:42:39.297740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 10998. [D 20:42:39.297759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 10999. [D 20:42:39.297774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 11000. [D 20:42:39.297795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 11001. [D 20:42:39.297806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 11002. [D 20:42:39.297816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 11003. [D 20:42:39.297835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 11004. [D 20:42:39.297852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 11005. [D 20:42:39.297874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 11006. [D 20:42:39.297888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 11007. [D 20:42:39.297911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 11008. [D 20:42:39.297925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 11009. [D 20:42:39.297935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 11010. [D 20:42:39.297944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 11011. [D 20:42:39.297954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 11012. [D 20:42:39.297982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 11013. [D 20:42:39.297993] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 11014. [D 20:42:39.303399] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 11014. [D 20:42:39.303416] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 32/70. [D 20:42:39.304464] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.304480] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.304490] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.311078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.311113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.311122] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.311158] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3455 [D 20:42:39.311169] element 0: offset: 0x62a8b0, size: 24 [D 20:42:39.311183] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 33/70. [D 20:42:39.361695] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3452 [D 20:42:39.361714] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 34/70. [D 20:42:39.361771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 11014. [D 20:42:39.361840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 11015. [D 20:42:39.361851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 11016. [D 20:42:39.361861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 11017. [D 20:42:39.361871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 11018. [D 20:42:39.361888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 11019. [D 20:42:39.361897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 11020. [D 20:42:39.361907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 11021. [D 20:42:39.361923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 11022. [D 20:42:39.361933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 11023. [D 20:42:39.361942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 11024. [D 20:42:39.361984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 11025. [D 20:42:39.361995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 11026. [D 20:42:39.362028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 11027. [D 20:42:39.362038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 11028. [D 20:42:39.362062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 11029. [D 20:42:39.362072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 11030. [D 20:42:39.362082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 11031. [D 20:42:39.362105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 11032. [D 20:42:39.362115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 11033. [D 20:42:39.362125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 11034. [D 20:42:39.362150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 11035. [D 20:42:39.362161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 11036. [D 20:42:39.362171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 11037. [D 20:42:39.362190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 11038. [D 20:42:39.362205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 11039. [D 20:42:39.362215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 11040. [D 20:42:39.362235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 11041. [D 20:42:39.362246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 11042. [D 20:42:39.362256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 11043. [D 20:42:39.362279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 11044. [D 20:42:39.362290] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 11045. [D 20:42:39.367741] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 11045. [D 20:42:39.367758] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 35/70. [D 20:42:39.370026] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.370042] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.370052] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.375332] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.375346] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.375357] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.375389] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3458 [D 20:42:39.375400] element 0: offset: 0x5b0030, size: 24 [D 20:42:39.375412] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 36/70. [D 20:42:39.380600] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3448 [D 20:42:39.380619] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 37/70. [D 20:42:39.380789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 11045. [D 20:42:39.380854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 11046. [D 20:42:39.380866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 11047. [D 20:42:39.380876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 11048. [D 20:42:39.380890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 11049. [D 20:42:39.380900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 11050. [D 20:42:39.380910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 11051. [D 20:42:39.380924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 11052. [D 20:42:39.380934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 11053. [D 20:42:39.380944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 11054. [D 20:42:39.380973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 11055. [D 20:42:39.380989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 11056. [D 20:42:39.381011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 11057. [D 20:42:39.381026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 11058. [D 20:42:39.381035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 11059. [D 20:42:39.381057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 11060. [D 20:42:39.381067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 11061. [D 20:42:39.381094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 11062. [D 20:42:39.381105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 11063. [D 20:42:39.381115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 11064. [D 20:42:39.381139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 11065. [D 20:42:39.381156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 11066. [D 20:42:39.381166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 11067. [D 20:42:39.381177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 11068. [D 20:42:39.381195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 11069. [D 20:42:39.381211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 11070. [D 20:42:39.381232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 11071. [D 20:42:39.381246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 11072. [D 20:42:39.381267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 11073. [D 20:42:39.381281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 11074. [D 20:42:39.381292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 11075. [D 20:42:39.381317] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 11076. [D 20:42:39.388641] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 11076. [D 20:42:39.388658] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 38/70. [D 20:42:39.390996] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.391011] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.391021] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.396435] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.396451] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.396461] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.396494] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3460 [D 20:42:39.396505] element 0: offset: 0x655b90, size: 24 [D 20:42:39.396563] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 39/70. [D 20:42:39.435273] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3446 [D 20:42:39.435292] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 40/70. [D 20:42:39.435354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11076. [D 20:42:39.435465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 11077. [D 20:42:39.435479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 11078. [D 20:42:39.435490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 11079. [D 20:42:39.435501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 11080. [D 20:42:39.435511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 11081. [D 20:42:39.435521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11082. [D 20:42:39.435542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11083. [D 20:42:39.435558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11084. [D 20:42:39.435568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 11085. [D 20:42:39.435578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 11086. [D 20:42:39.435607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 11087. [D 20:42:39.435617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 11088. [D 20:42:39.435627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 11089. [D 20:42:39.435638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11090. [D 20:42:39.435649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11091. [D 20:42:39.435659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11092. [D 20:42:39.435687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 11093. [D 20:42:39.435697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 11094. [D 20:42:39.435706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 11095. [D 20:42:39.435732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 11096. [D 20:42:39.435742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 11097. [D 20:42:39.435757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11098. [D 20:42:39.435780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11099. [D 20:42:39.435790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11100. [D 20:42:39.435811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 11101. [D 20:42:39.435822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 11102. [D 20:42:39.435832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 11103. [D 20:42:39.435851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 11104. [D 20:42:39.435867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 11105. [D 20:42:39.435877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11106. [D 20:42:39.435903] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11107. [D 20:42:39.441280] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 11107. [D 20:42:39.441298] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 41/70. [D 20:42:39.443613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.443628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.443638] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.449900] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.449915] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.449925] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.449958] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3464 [D 20:42:39.449969] element 0: offset: 0x64dd40, size: 24 [D 20:42:39.449981] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 42/70. [D 20:42:39.524193] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3455 [D 20:42:39.524212] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 43/70. [D 20:42:39.524314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 11107. [D 20:42:39.524393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 11108. [D 20:42:39.524405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 11109. [D 20:42:39.524415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 11110. [D 20:42:39.524426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 11111. [D 20:42:39.524443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 11112. [D 20:42:39.524452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 11113. [D 20:42:39.524463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 11114. [D 20:42:39.524473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 11115. [D 20:42:39.524482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 11116. [D 20:42:39.524492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 11117. [D 20:42:39.524541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 11118. [D 20:42:39.524552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 11119. [D 20:42:39.524562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 11120. [D 20:42:39.524587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 11121. [D 20:42:39.524597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 11122. [D 20:42:39.524608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 11123. [D 20:42:39.524618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 11124. [D 20:42:39.524628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 11125. [D 20:42:39.524638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 11126. [D 20:42:39.524663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 11127. [D 20:42:39.524673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 11128. [D 20:42:39.524684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 11129. [D 20:42:39.524694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 11130. [D 20:42:39.524704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 11131. [D 20:42:39.524727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 11132. [D 20:42:39.524740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 11133. [D 20:42:39.524754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 11134. [D 20:42:39.524764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 11135. [D 20:42:39.524786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 11136. [D 20:42:39.524797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 11137. [D 20:42:39.524808] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 11138. [D 20:42:39.530251] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 11138. [D 20:42:39.530269] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 44/70. [D 20:42:39.532490] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.532506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.532517] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.538057] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.538081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.538091] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.538126] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3467 [D 20:42:39.538137] element 0: offset: 0x61ee50, size: 24 [D 20:42:39.538150] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 45/70. [D 20:42:39.589260] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3458 [D 20:42:39.589279] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 46/70. [D 20:42:39.589337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 11138. [D 20:42:39.589405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 11139. [D 20:42:39.589431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 11140. [D 20:42:39.589444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 11141. [D 20:42:39.589455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 11142. [D 20:42:39.589465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 11143. [D 20:42:39.589476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 11144. [D 20:42:39.589486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 11145. [D 20:42:39.589496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 11146. [D 20:42:39.589506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 11147. [D 20:42:39.589529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 11148. [D 20:42:39.589545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 11149. [D 20:42:39.589569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 11150. [D 20:42:39.589592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 11151. [D 20:42:39.589609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 11152. [D 20:42:39.589619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 11153. [D 20:42:39.589629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 11154. [D 20:42:39.589640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 11155. [D 20:42:39.589650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 11156. [D 20:42:39.589660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 11157. [D 20:42:39.589686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 11158. [D 20:42:39.589700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 11159. [D 20:42:39.589722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 11160. [D 20:42:39.589735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 11161. [D 20:42:39.589757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 11162. [D 20:42:39.589770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 11163. [D 20:42:39.589780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 11164. [D 20:42:39.589795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 11165. [D 20:42:39.589818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 11166. [D 20:42:39.589829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 11167. [D 20:42:39.589839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 11168. [D 20:42:39.589849] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 11169. [D 20:42:39.595259] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 11169. [D 20:42:39.595276] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 47/70. [D 20:42:39.597624] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.597640] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.597651] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.602936] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.602975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.602985] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.603021] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3470 [D 20:42:39.603035] element 0: offset: 0x661e80, size: 24 [D 20:42:39.603047] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 48/70. [D 20:42:39.636560] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3460 [D 20:42:39.636580] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 49/70. [D 20:42:39.636638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 11169. [D 20:42:39.636708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 11170. [D 20:42:39.636762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 11171. [D 20:42:39.636773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 11172. [D 20:42:39.636784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 11173. [D 20:42:39.636794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 11174. [D 20:42:39.636804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 11175. [D 20:42:39.636824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 11176. [D 20:42:39.636835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 11177. [D 20:42:39.636852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 11178. [D 20:42:39.636862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 11179. [D 20:42:39.636885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 11180. [D 20:42:39.636895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 11181. [D 20:42:39.636905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 11182. [D 20:42:39.636926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 11183. [D 20:42:39.636936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 11184. [D 20:42:39.636946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 11185. [D 20:42:39.636961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 11186. [D 20:42:39.636971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 11187. [D 20:42:39.636981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 11188. [D 20:42:39.636999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 11189. [D 20:42:39.637009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 11190. [D 20:42:39.637019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 11191. [D 20:42:39.637029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 11192. [D 20:42:39.637040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 11193. [D 20:42:39.637063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 11194. [D 20:42:39.637074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 11195. [D 20:42:39.637104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 11196. [D 20:42:39.637116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 11197. [D 20:42:39.637125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 11198. [D 20:42:39.637145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 11199. [D 20:42:39.637155] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 11200. [D 20:42:39.642649] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 11200. [D 20:42:39.642669] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 50/70. [D 20:42:39.644856] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.644872] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.644883] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.705286] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3464 [D 20:42:39.705306] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 51/70. [D 20:42:39.705365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11200. [D 20:42:39.705432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 11201. [D 20:42:39.705484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 11202. [D 20:42:39.705495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 11203. [D 20:42:39.705506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 11204. [D 20:42:39.705516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 11205. [D 20:42:39.705526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11206. [D 20:42:39.705549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11207. [D 20:42:39.705560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11208. [D 20:42:39.705570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 11209. [D 20:42:39.705586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 11210. [D 20:42:39.705608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 11211. [D 20:42:39.705618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 11212. [D 20:42:39.705632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 11213. [D 20:42:39.705642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11214. [D 20:42:39.705652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11215. [D 20:42:39.705662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11216. [D 20:42:39.705685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 11217. [D 20:42:39.705695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 11218. [D 20:42:39.705705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 11219. [D 20:42:39.705732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 11220. [D 20:42:39.705742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 11221. [D 20:42:39.705769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11222. [D 20:42:39.705779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11223. [D 20:42:39.705789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11224. [D 20:42:39.705799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 11225. [D 20:42:39.705809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 11226. [D 20:42:39.705836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 11227. [D 20:42:39.705847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 11228. [D 20:42:39.705856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 11229. [D 20:42:39.705871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11230. [D 20:42:39.705890] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11231. [D 20:42:39.711293] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 11231. [D 20:42:39.711309] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 52/70. [D 20:42:39.713636] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.713652] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.713662] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:39.719880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.719896] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.719906] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:39.719940] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3473 [D 20:42:39.719951] element 0: offset: 0x64dc00, size: 24 [D 20:42:39.719965] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 53/70. [D 20:42:39.772795] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3470 [D 20:42:39.772814] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 54/70. [D 20:42:39.772873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 11231. [D 20:42:39.772940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 11232. [D 20:42:39.772952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 11233. [D 20:42:39.772962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 11234. [D 20:42:39.772972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 11235. [D 20:42:39.772988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 11236. [D 20:42:39.772997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 11237. [D 20:42:39.773007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 11238. [D 20:42:39.773023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 11239. [D 20:42:39.773032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 11240. [D 20:42:39.773042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 11241. [D 20:42:39.773058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 11242. [D 20:42:39.773067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 11243. [D 20:42:39.773077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 11244. [D 20:42:39.773087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 11245. [D 20:42:39.773161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 11246. [D 20:42:39.773172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 11247. [D 20:42:39.773181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 11248. [D 20:42:39.773204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 11249. [D 20:42:39.773214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 11250. [D 20:42:39.773225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 11251. [D 20:42:39.773238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 11252. [D 20:42:39.773248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 11253. [D 20:42:39.773257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 11254. [D 20:42:39.773281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 11255. [D 20:42:39.773291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 11256. [D 20:42:39.773302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 11257. [D 20:42:39.773324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 11258. [D 20:42:39.773335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 11259. [D 20:42:39.773345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 11260. [D 20:42:39.773366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 11261. [D 20:42:39.773380] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 11262. [D 20:42:39.776480] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.776497] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.776507] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.776543] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3475 [D 20:42:39.776557] element 0: offset: 0x691fe0, size: 24 [D 20:42:39.777922] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 55/70. [D 20:42:39.778811] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 11262. [D 20:42:39.778825] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 56/70. [D 20:42:39.781073] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.781087] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.781098] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.783165] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3475 [D 20:42:39.783185] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 57/70. [D 20:42:39.784101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11262. [D 20:42:39.784153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11263. [D 20:42:39.784165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 11264. [D 20:42:39.784176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 11265. [D 20:42:39.784190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 11266. [D 20:42:39.784200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 11267. [D 20:42:39.784210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 11268. [D 20:42:39.784224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11269. [D 20:42:39.784233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11270. [D 20:42:39.784243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11271. [D 20:42:39.784259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 11272. [D 20:42:39.784281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 11273. [D 20:42:39.784295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 11274. [D 20:42:39.784318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 11275. [D 20:42:39.784332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 11276. [D 20:42:39.784353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11277. [D 20:42:39.784365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11278. [D 20:42:39.784384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11279. [D 20:42:39.784399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 11280. [D 20:42:39.784418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 11281. [D 20:42:39.784436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 11282. [D 20:42:39.784446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 11283. [D 20:42:39.784466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 11284. [D 20:42:39.784476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11285. [D 20:42:39.784505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11286. [D 20:42:39.784516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11287. [D 20:42:39.784536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 11288. [D 20:42:39.784552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 11289. [D 20:42:39.784574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 11290. [D 20:42:39.784584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 11291. [D 20:42:39.784605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 11292. [D 20:42:39.784616] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11293. [D 20:42:39.786980] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.786994] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.787005] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.787040] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3479 [D 20:42:39.787054] element 0: offset: 0x62a8b0, size: 24 [D 20:42:39.787068] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 58/70. [D 20:42:39.795853] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 11293. [D 20:42:39.795913] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 59/70. [D 20:42:39.798137] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.798152] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.798163] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.803512] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.803558] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.803568] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.803616] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3481 [D 20:42:39.803630] element 0: offset: 0x662460, size: 24 [D 20:42:39.803644] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 60/70. [D 20:42:39.807997] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3481 [D 20:42:39.808016] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 0/70. [D 20:42:39.808082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11293. [D 20:42:39.808146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11294. [D 20:42:39.808167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 11295. [D 20:42:39.808177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 11296. [D 20:42:39.808188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 11297. [D 20:42:39.808198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 11298. [D 20:42:39.808213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 11299. [D 20:42:39.808223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11300. [D 20:42:39.808232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11301. [D 20:42:39.808248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11302. [D 20:42:39.808258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 11303. [D 20:42:39.808268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 11304. [D 20:42:39.808278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 11305. [D 20:42:39.808289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 11306. [D 20:42:39.808298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 11307. [D 20:42:39.808308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11308. [D 20:42:39.808360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11309. [D 20:42:39.808371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11310. [D 20:42:39.808381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 11311. [D 20:42:39.808413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 11312. [D 20:42:39.808423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 11313. [D 20:42:39.808441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 11314. [D 20:42:39.808561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 11315. [D 20:42:39.808575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11316. [D 20:42:39.808586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11317. [D 20:42:39.808596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11318. [D 20:42:39.808608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 11319. [D 20:42:39.808622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 11320. [D 20:42:39.808632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 11321. [D 20:42:39.808642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 11322. [D 20:42:39.808657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 11323. [D 20:42:39.808668] openib_post_sr_rdmaw: ibv_post_send wr_id 63e830 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11324. [D 20:42:39.817025] openib_check_cq: completed rdma wr_id 63e830, nic_wr_credit 11324. [D 20:42:39.817082] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 1/70. [D 20:42:39.819291] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.819306] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.819316] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.827291] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.827309] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.827320] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.827354] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3484 [D 20:42:39.827365] element 0: offset: 0x5b0030, size: 24 [D 20:42:39.827554] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 2/70. [D 20:42:39.832165] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3484 [D 20:42:39.832185] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 3/70. [D 20:42:39.832330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11324. [D 20:42:39.832401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11325. [D 20:42:39.832412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 11326. [D 20:42:39.832422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 11327. [D 20:42:39.832443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 11328. [D 20:42:39.832465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 11329. [D 20:42:39.832475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 11330. [D 20:42:39.832484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11331. [D 20:42:39.832500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11332. [D 20:42:39.832557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11333. [D 20:42:39.832568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 11334. [D 20:42:39.832587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 11335. [D 20:42:39.832601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 11336. [D 20:42:39.832611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 11337. [D 20:42:39.832621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 11338. [D 20:42:39.832645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11339. [D 20:42:39.832655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11340. [D 20:42:39.832666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11341. [D 20:42:39.832676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 11342. [D 20:42:39.832685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 11343. [D 20:42:39.832695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 11344. [D 20:42:39.832705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 11345. [D 20:42:39.832732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 11346. [D 20:42:39.832746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11347. [D 20:42:39.832756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11348. [D 20:42:39.832779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11349. [D 20:42:39.832789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 11350. [D 20:42:39.832799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 11351. [D 20:42:39.832814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 11352. [D 20:42:39.832824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 11353. [D 20:42:39.832833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 11354. [D 20:42:39.832844] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11355. [D 20:42:39.840754] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 11355. [D 20:42:39.840788] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 4/70. [D 20:42:39.842966] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.842981] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.842993] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.848115] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.848149] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.848159] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.848193] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3487 [D 20:42:39.848205] element 0: offset: 0x64dd40, size: 24 [D 20:42:39.848216] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 5/70. [D 20:42:39.850740] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3479 [D 20:42:39.850777] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 6/70. [D 20:42:39.850913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 11355. [D 20:42:39.850955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 11356. [D 20:42:39.850966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 11357. [D 20:42:39.850976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 11358. [D 20:42:39.850987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 11359. [D 20:42:39.850997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 11360. [D 20:42:39.851007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 11361. [D 20:42:39.851017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 11362. [D 20:42:39.851027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 11363. [D 20:42:39.851037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 11364. [D 20:42:39.851047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 11365. [D 20:42:39.851064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 11366. [D 20:42:39.851074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 11367. [D 20:42:39.851083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 11368. [D 20:42:39.851094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 11369. [D 20:42:39.851124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 11370. [D 20:42:39.851138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 11371. [D 20:42:39.851148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 11372. [D 20:42:39.851158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 11373. [D 20:42:39.851171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 11374. [D 20:42:39.851195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 11375. [D 20:42:39.851209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 11376. [D 20:42:39.851219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 11377. [D 20:42:39.851229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 11378. [D 20:42:39.851254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 11379. [D 20:42:39.851264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 11380. [D 20:42:39.851278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 11381. [D 20:42:39.851287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 11382. [D 20:42:39.851297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 11383. [D 20:42:39.851325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 11384. [D 20:42:39.851337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 11385. [D 20:42:39.851350] openib_post_sr_rdmaw: ibv_post_send wr_id 655a80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 11386. [D 20:42:39.855515] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3487 [D 20:42:39.855534] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 7/70. [D 20:42:39.861735] openib_check_cq: completed rdma wr_id 655a80, nic_wr_credit 11386. [D 20:42:39.861789] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 8/70. [D 20:42:39.861804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11386. [D 20:42:39.861818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11387. [D 20:42:39.861830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 11388. [D 20:42:39.861840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 11389. [D 20:42:39.861856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 11390. [D 20:42:39.861867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 11391. [D 20:42:39.861877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 11392. [D 20:42:39.861887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11393. [D 20:42:39.861897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11394. [D 20:42:39.861907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11395. [D 20:42:39.861917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 11396. [D 20:42:39.861934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 11397. [D 20:42:39.861975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 11398. [D 20:42:39.861985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 11399. [D 20:42:39.861995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 11400. [D 20:42:39.862005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11401. [D 20:42:39.862015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11402. [D 20:42:39.862025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11403. [D 20:42:39.862038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 11404. [D 20:42:39.862048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 11405. [D 20:42:39.862057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 11406. [D 20:42:39.862086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 11407. [D 20:42:39.862097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 11408. [D 20:42:39.862107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11409. [D 20:42:39.862122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11410. [D 20:42:39.862132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11411. [D 20:42:39.862142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 11412. [D 20:42:39.862157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 11413. [D 20:42:39.862167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 11414. [D 20:42:39.862177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 11415. [D 20:42:39.862208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 11416. [D 20:42:39.862219] openib_post_sr_rdmaw: ibv_post_send wr_id 63e0b0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11417. [D 20:42:39.862283] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.862298] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.862308] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.867794] openib_check_cq: completed rdma wr_id 63e0b0, nic_wr_credit 11417. [D 20:42:39.867808] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 9/70. [D 20:42:39.869973] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.869987] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.869998] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.870031] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3491 [D 20:42:39.870041] element 0: offset: 0x66e830, size: 24 [D 20:42:39.870053] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 10/70. [D 20:42:39.870074] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.870087] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.870095] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.875645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.875683] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.875692] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.875725] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3493 [D 20:42:39.875736] element 0: offset: 0x62b090, size: 24 [D 20:42:39.875748] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 11/70. [D 20:42:39.878445] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3493 [D 20:42:39.878500] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 12/70. [D 20:42:39.878633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11417. [D 20:42:39.878653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11418. [D 20:42:39.878666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 11419. [D 20:42:39.878675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 11420. [D 20:42:39.878690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 11421. [D 20:42:39.878700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 11422. [D 20:42:39.878710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 11423. [D 20:42:39.878720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11424. [D 20:42:39.878736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11425. [D 20:42:39.878746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11426. [D 20:42:39.878756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 11427. [D 20:42:39.878789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 11428. [D 20:42:39.878800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 11429. [D 20:42:39.878811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 11430. [D 20:42:39.878820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 11431. [D 20:42:39.878831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11432. [D 20:42:39.878855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11433. [D 20:42:39.878866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11434. [D 20:42:39.878875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 11435. [D 20:42:39.878885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 11436. [D 20:42:39.878895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 11437. [D 20:42:39.878925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 11438. [D 20:42:39.878935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 11439. [D 20:42:39.878949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11440. [D 20:42:39.878958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11441. [D 20:42:39.878968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11442. [D 20:42:39.878994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 11443. [D 20:42:39.879004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 11444. [D 20:42:39.879018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 11445. [D 20:42:39.879028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 11446. [D 20:42:39.879037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 11447. [D 20:42:39.879065] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11448. [D 20:42:39.886516] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 11448. [D 20:42:39.886563] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 13/70. [D 20:42:39.888495] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.888510] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.888522] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.898144] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.898160] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.898170] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.898204] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3496 [D 20:42:39.898215] element 0: offset: 0x661e80, size: 24 [D 20:42:39.898230] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 14/70. [D 20:42:39.902915] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3496 [D 20:42:39.902970] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 15/70. [D 20:42:39.903103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11448. [D 20:42:39.903124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11449. [D 20:42:39.903136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 11450. [D 20:42:39.903146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 11451. [D 20:42:39.903158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 11452. [D 20:42:39.903174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 11453. [D 20:42:39.903184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 11454. [D 20:42:39.903194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11455. [D 20:42:39.903209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11456. [D 20:42:39.903219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11457. [D 20:42:39.903229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 11458. [D 20:42:39.903245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 11459. [D 20:42:39.903255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 11460. [D 20:42:39.903265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 11461. [D 20:42:39.903298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 11462. [D 20:42:39.903308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11463. [D 20:42:39.903319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11464. [D 20:42:39.903329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11465. [D 20:42:39.903339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 11466. [D 20:42:39.903362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 11467. [D 20:42:39.903372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 11468. [D 20:42:39.903383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 11469. [D 20:42:39.903394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 11470. [D 20:42:39.903403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11471. [D 20:42:39.903413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11472. [D 20:42:39.903431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11473. [D 20:42:39.903441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 11474. [D 20:42:39.903465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 11475. [D 20:42:39.903476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 11476. [D 20:42:39.903486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 11477. [D 20:42:39.903502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 11478. [D 20:42:39.903511] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11479. [D 20:42:39.911766] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 11479. [D 20:42:39.911826] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 16/70. [D 20:42:39.914022] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.914038] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.914049] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.919298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.919324] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.919335] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.919371] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3499 [D 20:42:39.919382] element 0: offset: 0x6507d0, size: 24 [D 20:42:39.919397] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 17/70. [D 20:42:39.923054] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3499 [D 20:42:39.923109] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 18/70. [D 20:42:39.923248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11479. [D 20:42:39.923274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11480. [D 20:42:39.923286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 11481. [D 20:42:39.923301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 11482. [D 20:42:39.923311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 11483. [D 20:42:39.923322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 11484. [D 20:42:39.923332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 11485. [D 20:42:39.923342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11486. [D 20:42:39.923352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11487. [D 20:42:39.923361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11488. [D 20:42:39.923371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 11489. [D 20:42:39.923381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 11490. [D 20:42:39.923399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 11491. [D 20:42:39.923409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 11492. [D 20:42:39.923444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 11493. [D 20:42:39.923476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11494. [D 20:42:39.923486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11495. [D 20:42:39.923500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11496. [D 20:42:39.923510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 11497. [D 20:42:39.923534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 11498. [D 20:42:39.923544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 11499. [D 20:42:39.923556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 11500. [D 20:42:39.923571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 11501. [D 20:42:39.923581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11502. [D 20:42:39.923591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11503. [D 20:42:39.923607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11504. [D 20:42:39.923616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 11505. [D 20:42:39.923641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 11506. [D 20:42:39.923652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 11507. [D 20:42:39.923661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 11508. [D 20:42:39.923677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 11509. [D 20:42:39.923686] openib_post_sr_rdmaw: ibv_post_send wr_id 643300 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11510. [D 20:42:39.928022] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3491 [D 20:42:39.928042] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 19/70. [D 20:42:39.932779] openib_check_cq: completed rdma wr_id 643300, nic_wr_credit 11510. [D 20:42:39.932824] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 20/70. [D 20:42:39.932840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 11510. [D 20:42:39.932851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 11511. [D 20:42:39.932864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 11512. [D 20:42:39.932873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 11513. [D 20:42:39.932884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 11514. [D 20:42:39.932899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 11515. [D 20:42:39.932909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 11516. [D 20:42:39.932918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 11517. [D 20:42:39.932934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 11518. [D 20:42:39.932943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 11519. [D 20:42:39.932953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 11520. [D 20:42:39.932968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 11521. [D 20:42:39.932978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 11522. [D 20:42:39.932988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 11523. [D 20:42:39.933022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 11524. [D 20:42:39.933032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 11525. [D 20:42:39.933042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 11526. [D 20:42:39.933052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 11527. [D 20:42:39.933081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 11528. [D 20:42:39.933091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 11529. [D 20:42:39.933103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 11530. [D 20:42:39.933113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 11531. [D 20:42:39.933123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 11532. [D 20:42:39.933137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 11533. [D 20:42:39.933146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 11534. [D 20:42:39.933156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 11535. [D 20:42:39.933186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 11536. [D 20:42:39.933197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 11537. [D 20:42:39.933207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 11538. [D 20:42:39.933217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 11539. [D 20:42:39.933227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 11540. [D 20:42:39.933252] openib_post_sr_rdmaw: ibv_post_send wr_id 655a50 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 11541. [D 20:42:39.935435] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.935450] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.935460] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.938784] openib_check_cq: completed rdma wr_id 655a50, nic_wr_credit 11541. [D 20:42:39.938801] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 21/70. [D 20:42:39.940987] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.941001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.941012] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.941044] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3502 [D 20:42:39.941055] element 0: offset: 0x655ed0, size: 24 [D 20:42:39.941069] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 22/70. [D 20:42:39.941091] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.941104] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.941113] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.943522] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3467 [D 20:42:39.943544] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 23/70. [D 20:42:39.944128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 11541. [D 20:42:39.944147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 11542. [D 20:42:39.944158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 11543. [D 20:42:39.944167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 11544. [D 20:42:39.944177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 11545. [D 20:42:39.944187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 11546. [D 20:42:39.944197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 11547. [D 20:42:39.944207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 11548. [D 20:42:39.944216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 11549. [D 20:42:39.944226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 11550. [D 20:42:39.944236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 11551. [D 20:42:39.944246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 11552. [D 20:42:39.944255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 11553. [D 20:42:39.944265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 11554. [D 20:42:39.944275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 11555. [D 20:42:39.944284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 11556. [D 20:42:39.944294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 11557. [D 20:42:39.944304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 11558. [D 20:42:39.944313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 11559. [D 20:42:39.944323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 11560. [D 20:42:39.944333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 11561. [D 20:42:39.944343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 11562. [D 20:42:39.944352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 11563. [D 20:42:39.944362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 11564. [D 20:42:39.944372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 11565. [D 20:42:39.944381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 11566. [D 20:42:39.944391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 11567. [D 20:42:39.944401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 11568. [D 20:42:39.944410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 11569. [D 20:42:39.944421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 11570. [D 20:42:39.944431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 11571. [D 20:42:39.944441] openib_post_sr_rdmaw: ibv_post_send wr_id 64b6e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 11572. [D 20:42:39.944772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:39.944783] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.944791] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:39.944808] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3506 [D 20:42:39.944817] element 0: offset: 0x64dd40, size: 24 [D 20:42:39.944827] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 24/70. [D 20:42:39.947282] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3502 [D 20:42:39.947321] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 25/70. [D 20:42:39.955847] openib_check_cq: completed rdma wr_id 64b6e0, nic_wr_credit 11572. [D 20:42:39.955865] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 26/70. [D 20:42:39.955878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 11572. [D 20:42:39.955889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 11573. [D 20:42:39.955899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 11574. [D 20:42:39.955909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 11575. [D 20:42:39.955919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 11576. [D 20:42:39.955929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 11577. [D 20:42:39.955939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 11578. [D 20:42:39.955949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 11579. [D 20:42:39.955959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 11580. [D 20:42:39.955976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 11581. [D 20:42:39.955986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 11582. [D 20:42:39.955996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 11583. [D 20:42:39.956006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 11584. [D 20:42:39.956015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 11585. [D 20:42:39.956025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 11586. [D 20:42:39.956035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 11587. [D 20:42:39.956045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 11588. [D 20:42:39.956055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 11589. [D 20:42:39.956065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 11590. [D 20:42:39.956074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 11591. [D 20:42:39.956109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 11592. [D 20:42:39.956130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 11593. [D 20:42:39.956140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 11594. [D 20:42:39.956150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 11595. [D 20:42:39.956159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 11596. [D 20:42:39.956169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 11597. [D 20:42:39.956179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 11598. [D 20:42:39.956188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 11599. [D 20:42:39.956198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 11600. [D 20:42:39.956208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 11601. [D 20:42:39.956217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 11602. [D 20:42:39.956228] openib_post_sr_rdmaw: ibv_post_send wr_id 62a510 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 11603. [D 20:42:39.956473] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.956486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.956497] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:39.961840] openib_check_cq: completed rdma wr_id 62a510, nic_wr_credit 11603. [D 20:42:39.961858] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 27/70. [D 20:42:39.964017] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.964030] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.964039] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:39.988901] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3473 [D 20:42:39.988945] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 28/70. [D 20:42:39.989006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 11603. [D 20:42:39.989071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 11604. [D 20:42:39.989082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 11605. [D 20:42:39.989093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 11606. [D 20:42:39.989113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 11607. [D 20:42:39.989122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 11608. [D 20:42:39.989132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 11609. [D 20:42:39.989148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 11610. [D 20:42:39.989158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 11611. [D 20:42:39.989167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 11612. [D 20:42:39.989223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 11613. [D 20:42:39.989235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 11614. [D 20:42:39.989245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 11615. [D 20:42:39.989255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 11616. [D 20:42:39.989279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 11617. [D 20:42:39.989289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 11618. [D 20:42:39.989300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 11619. [D 20:42:39.989310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 11620. [D 20:42:39.989320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 11621. [D 20:42:39.989329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 11622. [D 20:42:39.989339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 11623. [D 20:42:39.989368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 11624. [D 20:42:39.989377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 11625. [D 20:42:39.989387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 11626. [D 20:42:39.989403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 11627. [D 20:42:39.989426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 11628. [D 20:42:39.989440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 11629. [D 20:42:39.989450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 11630. [D 20:42:39.989460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 11631. [D 20:42:39.989473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 11632. [D 20:42:39.989492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 11633. [D 20:42:39.989502] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 11634. [D 20:42:39.994935] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 11634. [D 20:42:39.994951] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 29/70. [D 20:42:39.997274] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:39.997289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:39.997300] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:40.004697] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.004712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.004723] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:40.004756] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3509 [D 20:42:40.004767] element 0: offset: 0x662460, size: 24 [D 20:42:40.004779] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 30/70. [D 20:42:40.051375] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3506 [D 20:42:40.051394] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 31/70. [D 20:42:40.051460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 11634. [D 20:42:40.051538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 11635. [D 20:42:40.051550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 11636. [D 20:42:40.051562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 11637. [D 20:42:40.051576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 11638. [D 20:42:40.051586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 11639. [D 20:42:40.051596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 11640. [D 20:42:40.051610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 11641. [D 20:42:40.051619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 11642. [D 20:42:40.051629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 11643. [D 20:42:40.051686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 11644. [D 20:42:40.051697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 11645. [D 20:42:40.051707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 11646. [D 20:42:40.051718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 11647. [D 20:42:40.051727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 11648. [D 20:42:40.051737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 11649. [D 20:42:40.051750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 11650. [D 20:42:40.051782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 11651. [D 20:42:40.051792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 11652. [D 20:42:40.051804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 11653. [D 20:42:40.051814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 11654. [D 20:42:40.051823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 11655. [D 20:42:40.051850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 11656. [D 20:42:40.051861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 11657. [D 20:42:40.051875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 11658. [D 20:42:40.051885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 11659. [D 20:42:40.051894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 11660. [D 20:42:40.051908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 11661. [D 20:42:40.051918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 11662. [D 20:42:40.051928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 11663. [D 20:42:40.051937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 11664. [D 20:42:40.051948] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 11665. [D 20:42:40.057400] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 11665. [D 20:42:40.057417] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 32/70. [D 20:42:40.059564] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.059579] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.059590] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:40.064499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.064513] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.064524] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:40.064558] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3512 [D 20:42:40.064569] element 0: offset: 0x5b0030, size: 24 [D 20:42:40.064584] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 33/70. [D 20:42:40.094069] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.094132] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.094143] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:40.094180] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3515 [D 20:42:40.094192] element 0: offset: 0x661780, size: 24 [D 20:42:40.094206] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 34/70. [D 20:42:40.100491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.100511] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.100520] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.100549] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3517 [D 20:42:40.100559] element 0: offset: 0x62a8b0, size: 24 [D 20:42:40.100571] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 35/70. [D 20:42:40.128631] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3509 [D 20:42:40.128681] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 36/70. [D 20:42:40.128742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 11665. [D 20:42:40.128816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 11666. [D 20:42:40.128828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 11667. [D 20:42:40.128839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 11668. [D 20:42:40.128853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 11669. [D 20:42:40.128863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 11670. [D 20:42:40.128873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 11671. [D 20:42:40.128939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 11672. [D 20:42:40.128951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 11673. [D 20:42:40.128974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 11674. [D 20:42:40.128989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 11675. [D 20:42:40.128999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 11676. [D 20:42:40.129012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 11677. [D 20:42:40.129027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 11678. [D 20:42:40.129037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 11679. [D 20:42:40.129046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 11680. [D 20:42:40.129076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 11681. [D 20:42:40.129086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 11682. [D 20:42:40.129099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 11683. [D 20:42:40.129109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 11684. [D 20:42:40.129119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 11685. [D 20:42:40.129133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 11686. [D 20:42:40.129156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 11687. [D 20:42:40.129169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 11688. [D 20:42:40.129178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 11689. [D 20:42:40.129188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 11690. [D 20:42:40.129202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 11691. [D 20:42:40.129212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 11692. [D 20:42:40.129238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 11693. [D 20:42:40.129247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 11694. [D 20:42:40.129257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 11695. [D 20:42:40.129272] openib_post_sr_rdmaw: ibv_post_send wr_id 643590 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 11696. [D 20:42:40.134671] openib_check_cq: completed rdma wr_id 643590, nic_wr_credit 11696. [D 20:42:40.134687] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 37/70. [D 20:42:40.134764] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.134780] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.134788] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:40.141517] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.141531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.141539] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.141565] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3521 [D 20:42:40.141575] element 0: offset: 0x61ee50, size: 24 [D 20:42:40.141586] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 38/70. [D 20:42:40.215356] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3521 [D 20:42:40.215373] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 39/70. [D 20:42:40.215519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 11696. [D 20:42:40.215589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 11697. [D 20:42:40.215601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 11698. [D 20:42:40.215611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 11699. [D 20:42:40.215622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 11700. [D 20:42:40.215632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 11701. [D 20:42:40.215642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 11702. [D 20:42:40.215652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 11703. [D 20:42:40.215662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 11704. [D 20:42:40.215672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 11705. [D 20:42:40.215681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 11706. [D 20:42:40.215726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 11707. [D 20:42:40.215737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 11708. [D 20:42:40.215748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 11709. [D 20:42:40.215758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 11710. [D 20:42:40.215768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 11711. [D 20:42:40.215778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 11712. [D 20:42:40.215787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 11713. [D 20:42:40.215797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 11714. [D 20:42:40.215839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 11715. [D 20:42:40.215863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 11716. [D 20:42:40.215874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 11717. [D 20:42:40.215884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 11718. [D 20:42:40.215894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 11719. [D 20:42:40.215909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 11720. [D 20:42:40.215919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 11721. [D 20:42:40.215929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 11722. [D 20:42:40.215944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 11723. [D 20:42:40.215954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 11724. [D 20:42:40.215963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 11725. [D 20:42:40.215974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 11726. [D 20:42:40.216005] openib_post_sr_rdmaw: ibv_post_send wr_id 643590 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 11727. [D 20:42:40.221505] openib_check_cq: completed rdma wr_id 643590, nic_wr_credit 11727. [D 20:42:40.221522] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 40/70. [D 20:42:40.221586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.221600] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.221609] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:40.228370] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.228383] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.228392] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.228408] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3524 [D 20:42:40.228417] element 0: offset: 0x62b090, size: 24 [D 20:42:40.228427] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 41/70. [D 20:42:40.240117] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3512 [D 20:42:40.240133] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 42/70. [D 20:42:40.240194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11727. [D 20:42:40.240282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 11728. [D 20:42:40.240293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 11729. [D 20:42:40.240304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 11730. [D 20:42:40.240318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 11731. [D 20:42:40.240328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 11732. [D 20:42:40.240338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11733. [D 20:42:40.240348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11734. [D 20:42:40.240358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11735. [D 20:42:40.240368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 11736. [D 20:42:40.240388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 11737. [D 20:42:40.240398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 11738. [D 20:42:40.240408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 11739. [D 20:42:40.240424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 11740. [D 20:42:40.240433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11741. [D 20:42:40.240443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11742. [D 20:42:40.240453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11743. [D 20:42:40.240470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 11744. [D 20:42:40.240484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 11745. [D 20:42:40.240494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 11746. [D 20:42:40.240549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 11747. [D 20:42:40.240563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 11748. [D 20:42:40.240574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11749. [D 20:42:40.240584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11750. [D 20:42:40.240594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11751. [D 20:42:40.240604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 11752. [D 20:42:40.240614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 11753. [D 20:42:40.240634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 11754. [D 20:42:40.240663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 11755. [D 20:42:40.240675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 11756. [D 20:42:40.240685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11757. [D 20:42:40.240717] openib_post_sr_rdmaw: ibv_post_send wr_id 643590 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11758. [D 20:42:40.246159] openib_check_cq: completed rdma wr_id 643590, nic_wr_credit 11758. [D 20:42:40.246216] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 43/70. [D 20:42:40.246280] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.246295] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.246303] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:40.274536] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3524 [D 20:42:40.274552] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 44/70. [D 20:42:40.274608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 11758. [D 20:42:40.274719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 11759. [D 20:42:40.274733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 11760. [D 20:42:40.274744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 11761. [D 20:42:40.274755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 11762. [D 20:42:40.274765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 11763. [D 20:42:40.274775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 11764. [D 20:42:40.274785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 11765. [D 20:42:40.274797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 11766. [D 20:42:40.274813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 11767. [D 20:42:40.274823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 11768. [D 20:42:40.274833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 11769. [D 20:42:40.274861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 11770. [D 20:42:40.274871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 11771. [D 20:42:40.274881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 11772. [D 20:42:40.274891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 11773. [D 20:42:40.274901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 11774. [D 20:42:40.274911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 11775. [D 20:42:40.274937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 11776. [D 20:42:40.274953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 11777. [D 20:42:40.274964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 11778. [D 20:42:40.274973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 11779. [D 20:42:40.274997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 11780. [D 20:42:40.275008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 11781. [D 20:42:40.275023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 11782. [D 20:42:40.275033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 11783. [D 20:42:40.275043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 11784. [D 20:42:40.275064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 11785. [D 20:42:40.275075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 11786. [D 20:42:40.275085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 11787. [D 20:42:40.275101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 11788. [D 20:42:40.275111] openib_post_sr_rdmaw: ibv_post_send wr_id 643590 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 11789. [D 20:42:40.280542] openib_check_cq: completed rdma wr_id 643590, nic_wr_credit 11789. [D 20:42:40.280558] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 45/70. [D 20:42:40.280624] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.280639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.280647] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:40.287350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.287363] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.287371] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:40.287387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3527 [D 20:42:40.287397] element 0: offset: 0x64dd40, size: 24 [D 20:42:40.287407] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 46/70. [D 20:42:40.318464] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3515 [D 20:42:40.318480] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 47/70. [D 20:42:40.318541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 11789. [D 20:42:40.318610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 11790. [D 20:42:40.318668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 11791. [D 20:42:40.318679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 11792. [D 20:42:40.318689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 11793. [D 20:42:40.318700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 11794. [D 20:42:40.318709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 11795. [D 20:42:40.318719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 11796. [D 20:42:40.318729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 11797. [D 20:42:40.318744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 11798. [D 20:42:40.318754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 11799. [D 20:42:40.318763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 11800. [D 20:42:40.318773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 11801. [D 20:42:40.318804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 11802. [D 20:42:40.318817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 11803. [D 20:42:40.318827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 11804. [D 20:42:40.318837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 11805. [D 20:42:40.318864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 11806. [D 20:42:40.318880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 11807. [D 20:42:40.318891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 11808. [D 20:42:40.318900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 11809. [D 20:42:40.318929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 11810. [D 20:42:40.318939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 11811. [D 20:42:40.318952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 11812. [D 20:42:40.318962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 11813. [D 20:42:40.318972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 11814. [D 20:42:40.318996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 11815. [D 20:42:40.319006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 11816. [D 20:42:40.319020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 11817. [D 20:42:40.319029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 11818. [D 20:42:40.319039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 11819. [D 20:42:40.319065] openib_post_sr_rdmaw: ibv_post_send wr_id 643590 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 11820. [D 20:42:40.324473] openib_check_cq: completed rdma wr_id 643590, nic_wr_credit 11820. [D 20:42:40.324493] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 48/70. [D 20:42:40.324561] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.324575] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.324584] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:40.330346] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.330360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.330368] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:40.330385] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3530 [D 20:42:40.330394] element 0: offset: 0x650720, size: 24 [D 20:42:40.330404] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 49/70. [D 20:42:40.362489] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3517 [D 20:42:40.362505] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 50/70. [D 20:42:40.362562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 11820. [D 20:42:40.362629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 11821. [D 20:42:40.362649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 11822. [D 20:42:40.362659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 11823. [D 20:42:40.362670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 11824. [D 20:42:40.362680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 11825. [D 20:42:40.362696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 11826. [D 20:42:40.362706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 11827. [D 20:42:40.362715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 11828. [D 20:42:40.362731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 11829. [D 20:42:40.362782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 11830. [D 20:42:40.362794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 11831. [D 20:42:40.362818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 11832. [D 20:42:40.362829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 11833. [D 20:42:40.362839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 11834. [D 20:42:40.362849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 11835. [D 20:42:40.362873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 11836. [D 20:42:40.362884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 11837. [D 20:42:40.362893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 11838. [D 20:42:40.362903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 11839. [D 20:42:40.362919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 11840. [D 20:42:40.362929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 11841. [D 20:42:40.362957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 11842. [D 20:42:40.362973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 11843. [D 20:42:40.362983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 11844. [D 20:42:40.362992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 11845. [D 20:42:40.363002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 11846. [D 20:42:40.363012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 11847. [D 20:42:40.363029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 11848. [D 20:42:40.363039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 11849. [D 20:42:40.363048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 11850. [D 20:42:40.363059] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 11851. [D 20:42:40.368491] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 11851. [D 20:42:40.368508] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 51/70. [D 20:42:40.368574] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.368588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.368597] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:40.374227] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.374241] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.374249] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:40.374265] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3532 [D 20:42:40.374275] element 0: offset: 0x655b90, size: 24 [D 20:42:40.374286] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 52/70. [D 20:42:40.375310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.375324] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.375333] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.375348] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3536 [D 20:42:40.375357] element 0: offset: 0x61ee50, size: 24 [D 20:42:40.375367] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 53/70. [D 20:42:40.408845] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3530 [D 20:42:40.408861] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 54/70. [D 20:42:40.408921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11851. [D 20:42:40.409016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 11852. [D 20:42:40.409030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 11853. [D 20:42:40.409041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 11854. [D 20:42:40.409052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 11855. [D 20:42:40.409062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 11856. [D 20:42:40.409072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11857. [D 20:42:40.409082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11858. [D 20:42:40.409092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11859. [D 20:42:40.409109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 11860. [D 20:42:40.409118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 11861. [D 20:42:40.409128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 11862. [D 20:42:40.409164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 11863. [D 20:42:40.409175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 11864. [D 20:42:40.409185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11865. [D 20:42:40.409195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11866. [D 20:42:40.409211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11867. [D 20:42:40.409235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 11868. [D 20:42:40.409247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 11869. [D 20:42:40.409257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 11870. [D 20:42:40.409267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 11871. [D 20:42:40.409280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 11872. [D 20:42:40.409290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11873. [D 20:42:40.409300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11874. [D 20:42:40.409324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11875. [D 20:42:40.409334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 11876. [D 20:42:40.409344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 11877. [D 20:42:40.409361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 11878. [D 20:42:40.409371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 11879. [D 20:42:40.409380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 11880. [D 20:42:40.409398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11881. [D 20:42:40.409408] openib_post_sr_rdmaw: ibv_post_send wr_id 62a510 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11882. [D 20:42:40.414873] openib_check_cq: completed rdma wr_id 62a510, nic_wr_credit 11882. [D 20:42:40.414890] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 55/70. [D 20:42:40.414954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.414968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.414977] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:40.420848] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.420861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.420870] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.420886] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3539 [D 20:42:40.420895] element 0: offset: 0x62b090, size: 24 [D 20:42:40.420906] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 56/70. [D 20:42:40.462790] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3539 [D 20:42:40.462808] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 57/70. [D 20:42:40.462868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11882. [D 20:42:40.462947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 11883. [D 20:42:40.462959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 11884. [D 20:42:40.462969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 11885. [D 20:42:40.462984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 11886. [D 20:42:40.462994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 11887. [D 20:42:40.463003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11888. [D 20:42:40.463018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11889. [D 20:42:40.463028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11890. [D 20:42:40.463038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 11891. [D 20:42:40.463103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 11892. [D 20:42:40.463115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 11893. [D 20:42:40.463124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 11894. [D 20:42:40.463134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 11895. [D 20:42:40.463144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11896. [D 20:42:40.463161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11897. [D 20:42:40.463170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11898. [D 20:42:40.463180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 11899. [D 20:42:40.463190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 11900. [D 20:42:40.463201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 11901. [D 20:42:40.463210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 11902. [D 20:42:40.463220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 11903. [D 20:42:40.463246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11904. [D 20:42:40.463256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11905. [D 20:42:40.463266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11906. [D 20:42:40.463276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 11907. [D 20:42:40.463286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 11908. [D 20:42:40.463310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 11909. [D 20:42:40.463321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 11910. [D 20:42:40.463331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 11911. [D 20:42:40.463347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11912. [D 20:42:40.463357] openib_post_sr_rdmaw: ibv_post_send wr_id 62a510 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11913. [D 20:42:40.468871] openib_check_cq: completed rdma wr_id 62a510, nic_wr_credit 11913. [D 20:42:40.468889] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 58/70. [D 20:42:40.468954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.468968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.468977] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:40.474772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.474786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.474794] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.474810] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3542 [D 20:42:40.474820] element 0: offset: 0x691fe0, size: 24 [D 20:42:40.474830] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 59/70. [D 20:42:40.532114] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3542 [D 20:42:40.532131] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 60/70. [D 20:42:40.532191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11913. [D 20:42:40.532287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 11914. [D 20:42:40.532301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 11915. [D 20:42:40.532312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 11916. [D 20:42:40.532323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 11917. [D 20:42:40.532333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 11918. [D 20:42:40.532343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11919. [D 20:42:40.532353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11920. [D 20:42:40.532388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11921. [D 20:42:40.532399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 11922. [D 20:42:40.532409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 11923. [D 20:42:40.532432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 11924. [D 20:42:40.532445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 11925. [D 20:42:40.532454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 11926. [D 20:42:40.532464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11927. [D 20:42:40.532474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11928. [D 20:42:40.532504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11929. [D 20:42:40.532514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 11930. [D 20:42:40.532524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 11931. [D 20:42:40.532533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 11932. [D 20:42:40.532544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 11933. [D 20:42:40.532558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 11934. [D 20:42:40.532569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11935. [D 20:42:40.532578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11936. [D 20:42:40.532589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11937. [D 20:42:40.532602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 11938. [D 20:42:40.532612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 11939. [D 20:42:40.532621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 11940. [D 20:42:40.532648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 11941. [D 20:42:40.532657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 11942. [D 20:42:40.532668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11943. [D 20:42:40.532681] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11944. [D 20:42:40.538204] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 11944. [D 20:42:40.538222] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 0/70. [D 20:42:40.538290] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.538304] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.538313] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:40.544104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.544118] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.544126] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.544141] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3545 [D 20:42:40.544151] element 0: offset: 0x61f310, size: 24 [D 20:42:40.544161] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 1/70. [D 20:42:40.627176] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3545 [D 20:42:40.627193] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 2/70. [D 20:42:40.627369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 11944. [D 20:42:40.627439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 11945. [D 20:42:40.627451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 11946. [D 20:42:40.627461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 11947. [D 20:42:40.627472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 11948. [D 20:42:40.627482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 11949. [D 20:42:40.627491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 11950. [D 20:42:40.627502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 11951. [D 20:42:40.627511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 11952. [D 20:42:40.627521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 11953. [D 20:42:40.627531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 11954. [D 20:42:40.627541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 11955. [D 20:42:40.627566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 11956. [D 20:42:40.627576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 11957. [D 20:42:40.627603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 11958. [D 20:42:40.627613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 11959. [D 20:42:40.627638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 11960. [D 20:42:40.627648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 11961. [D 20:42:40.627660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 11962. [D 20:42:40.627669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 11963. [D 20:42:40.627679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 11964. [D 20:42:40.627707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 11965. [D 20:42:40.627724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 11966. [D 20:42:40.627734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 11967. [D 20:42:40.627743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 11968. [D 20:42:40.627772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 11969. [D 20:42:40.627782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 11970. [D 20:42:40.627807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 11971. [D 20:42:40.627833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 11972. [D 20:42:40.627844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 11973. [D 20:42:40.627859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 11974. [D 20:42:40.627868] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 11975. [D 20:42:40.633346] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 11975. [D 20:42:40.633363] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 3/70. [D 20:42:40.633429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.633443] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.633452] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:40.639169] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.639183] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.639191] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.639207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3548 [D 20:42:40.639216] element 0: offset: 0x662460, size: 24 [D 20:42:40.639226] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 4/70. [D 20:42:40.644893] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3527 [D 20:42:40.644910] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 5/70. [D 20:42:40.645058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 11975. [D 20:42:40.645125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 11976. [D 20:42:40.645135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 11977. [D 20:42:40.645146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 11978. [D 20:42:40.645160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 11979. [D 20:42:40.645169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 11980. [D 20:42:40.645179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 11981. [D 20:42:40.645194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 11982. [D 20:42:40.645203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 11983. [D 20:42:40.645213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 11984. [D 20:42:40.645228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 11985. [D 20:42:40.645238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 11986. [D 20:42:40.645247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 11987. [D 20:42:40.645293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 11988. [D 20:42:40.645304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 11989. [D 20:42:40.645314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 11990. [D 20:42:40.645324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 11991. [D 20:42:40.645348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 11992. [D 20:42:40.645358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 11993. [D 20:42:40.645369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 11994. [D 20:42:40.645379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 11995. [D 20:42:40.645389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 11996. [D 20:42:40.645417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 11997. [D 20:42:40.645427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 11998. [D 20:42:40.645437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 11999. [D 20:42:40.645453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 12000. [D 20:42:40.645477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 12001. [D 20:42:40.645487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 12002. [D 20:42:40.645498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 12003. [D 20:42:40.645507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 12004. [D 20:42:40.645517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 12005. [D 20:42:40.645527] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 12006. [D 20:42:40.654699] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 12006. [D 20:42:40.654722] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 6/70. [D 20:42:40.654789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.654804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.654812] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:40.674230] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3536 [D 20:42:40.674246] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 7/70. [D 20:42:40.674308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 12006. [D 20:42:40.674396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 12007. [D 20:42:40.674410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 12008. [D 20:42:40.674421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 12009. [D 20:42:40.674432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 12010. [D 20:42:40.674442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 12011. [D 20:42:40.674452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 12012. [D 20:42:40.674462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 12013. [D 20:42:40.674478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 12014. [D 20:42:40.674498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 12015. [D 20:42:40.674509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 12016. [D 20:42:40.674538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 12017. [D 20:42:40.674549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 12018. [D 20:42:40.674572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 12019. [D 20:42:40.674582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 12020. [D 20:42:40.674591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 12021. [D 20:42:40.674605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 12022. [D 20:42:40.674615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 12023. [D 20:42:40.674625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 12024. [D 20:42:40.674634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 12025. [D 20:42:40.674652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 12026. [D 20:42:40.674661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 12027. [D 20:42:40.674693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 12028. [D 20:42:40.674703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 12029. [D 20:42:40.674712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 12030. [D 20:42:40.674728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 12031. [D 20:42:40.674750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 12032. [D 20:42:40.674762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 12033. [D 20:42:40.674772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 12034. [D 20:42:40.674782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 12035. [D 20:42:40.674807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 12036. [D 20:42:40.674817] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 12037. [D 20:42:40.680253] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 12037. [D 20:42:40.680270] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 8/70. [D 20:42:40.680335] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.680349] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.680357] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:40.685868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.685882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.685890] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:40.685907] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3551 [D 20:42:40.685916] element 0: offset: 0x650720, size: 24 [D 20:42:40.685927] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 9/70. [D 20:42:40.735820] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3548 [D 20:42:40.735837] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 10/70. [D 20:42:40.735901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 12037. [D 20:42:40.735980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 12038. [D 20:42:40.735992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 12039. [D 20:42:40.736003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 12040. [D 20:42:40.736017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 12041. [D 20:42:40.736027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 12042. [D 20:42:40.736037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 12043. [D 20:42:40.736052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 12044. [D 20:42:40.736062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 12045. [D 20:42:40.736071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 12046. [D 20:42:40.736129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 12047. [D 20:42:40.736140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 12048. [D 20:42:40.736166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 12049. [D 20:42:40.736177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 12050. [D 20:42:40.736187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 12051. [D 20:42:40.736196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 12052. [D 20:42:40.736226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 12053. [D 20:42:40.736239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 12054. [D 20:42:40.736252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 12055. [D 20:42:40.736262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 12056. [D 20:42:40.736271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 12057. [D 20:42:40.736285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 12058. [D 20:42:40.736315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 12059. [D 20:42:40.736326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 12060. [D 20:42:40.736335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 12061. [D 20:42:40.736365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 12062. [D 20:42:40.736374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 12063. [D 20:42:40.736388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 12064. [D 20:42:40.736397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 12065. [D 20:42:40.736407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 12066. [D 20:42:40.736429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 12067. [D 20:42:40.736439] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 12068. [D 20:42:40.741921] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 12068. [D 20:42:40.741938] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 11/70. [D 20:42:40.742002] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.742016] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.742024] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:40.748209] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.748223] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.748231] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:40.748247] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3554 [D 20:42:40.748257] element 0: offset: 0x691fe0, size: 24 [D 20:42:40.748267] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 12/70. [D 20:42:40.766381] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3532 [D 20:42:40.766398] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 13/70. [D 20:42:40.766463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 12068. [D 20:42:40.766572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 12069. [D 20:42:40.766586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 12070. [D 20:42:40.766597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 12071. [D 20:42:40.766608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 12072. [D 20:42:40.766620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 12073. [D 20:42:40.766635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 12074. [D 20:42:40.766645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 12075. [D 20:42:40.766654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 12076. [D 20:42:40.766671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 12077. [D 20:42:40.766680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 12078. [D 20:42:40.766690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 12079. [D 20:42:40.766716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 12080. [D 20:42:40.766726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 12081. [D 20:42:40.766737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 12082. [D 20:42:40.766747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 12083. [D 20:42:40.766756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 12084. [D 20:42:40.766767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 12085. [D 20:42:40.766793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 12086. [D 20:42:40.766803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 12087. [D 20:42:40.766814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 12088. [D 20:42:40.766823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 12089. [D 20:42:40.766834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 12090. [D 20:42:40.766856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 12091. [D 20:42:40.766866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 12092. [D 20:42:40.766876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 12093. [D 20:42:40.766894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 12094. [D 20:42:40.766918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 12095. [D 20:42:40.766929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 12096. [D 20:42:40.766939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 12097. [D 20:42:40.766949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 12098. [D 20:42:40.766961] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 12099. [D 20:42:40.772388] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 12099. [D 20:42:40.772405] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 14/70. [D 20:42:40.772471] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.772485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.772496] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:40.778225] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.778238] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.778247] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:40.778263] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3556 [D 20:42:40.778272] element 0: offset: 0x61f310, size: 24 [D 20:42:40.778283] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 15/70. [D 20:42:40.787448] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.787462] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.787471] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.787486] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3560 [D 20:42:40.787496] element 0: offset: 0x61f800, size: 24 [D 20:42:40.787506] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 16/70. [D 20:42:40.837872] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3556 [D 20:42:40.837895] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 17/70. [D 20:42:40.837959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 12099. [D 20:42:40.838029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 12100. [D 20:42:40.838045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 12101. [D 20:42:40.838055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 12102. [D 20:42:40.838066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 12103. [D 20:42:40.838077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 12104. [D 20:42:40.838086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 12105. [D 20:42:40.838097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 12106. [D 20:42:40.838107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 12107. [D 20:42:40.838116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 12108. [D 20:42:40.838126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 12109. [D 20:42:40.838191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 12110. [D 20:42:40.838202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 12111. [D 20:42:40.838228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 12112. [D 20:42:40.838241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 12113. [D 20:42:40.838251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 12114. [D 20:42:40.838260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 12115. [D 20:42:40.838271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 12116. [D 20:42:40.838282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 12117. [D 20:42:40.838291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 12118. [D 20:42:40.838328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 12119. [D 20:42:40.838338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 12120. [D 20:42:40.838348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 12121. [D 20:42:40.838364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 12122. [D 20:42:40.838374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 12123. [D 20:42:40.838401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 12124. [D 20:42:40.838411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 12125. [D 20:42:40.838420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 12126. [D 20:42:40.838435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 12127. [D 20:42:40.838445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 12128. [D 20:42:40.838455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 12129. [D 20:42:40.838485] openib_post_sr_rdmaw: ibv_post_send wr_id 63e700 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 12130. [D 20:42:40.843955] openib_check_cq: completed rdma wr_id 63e700, nic_wr_credit 12130. [D 20:42:40.843972] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 18/70. [D 20:42:40.844044] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.844059] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.844068] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:40.849512] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.849526] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.849534] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.849553] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3562 [D 20:42:40.849563] element 0: offset: 0x62a8b0, size: 24 [D 20:42:40.849574] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 19/70. [D 20:42:40.909409] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3562 [D 20:42:40.909426] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 20/70. [D 20:42:40.909489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 12130. [D 20:42:40.909567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 12131. [D 20:42:40.909578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 12132. [D 20:42:40.909589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 12133. [D 20:42:40.909600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 12134. [D 20:42:40.909610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 12135. [D 20:42:40.909620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 12136. [D 20:42:40.909631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 12137. [D 20:42:40.909641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 12138. [D 20:42:40.909651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 12139. [D 20:42:40.909694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 12140. [D 20:42:40.909705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 12141. [D 20:42:40.909716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 12142. [D 20:42:40.909726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 12143. [D 20:42:40.909764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 12144. [D 20:42:40.909777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 12145. [D 20:42:40.909787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 12146. [D 20:42:40.909817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 12147. [D 20:42:40.909828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 12148. [D 20:42:40.909842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 12149. [D 20:42:40.909852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 12150. [D 20:42:40.909862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 12151. [D 20:42:40.909892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 12152. [D 20:42:40.909902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 12153. [D 20:42:40.909913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 12154. [D 20:42:40.909923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 12155. [D 20:42:40.909933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 12156. [D 20:42:40.909957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 12157. [D 20:42:40.909967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 12158. [D 20:42:40.909977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 12159. [D 20:42:40.909987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 12160. [D 20:42:40.909997] openib_post_sr_rdmaw: ibv_post_send wr_id 63e700 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 12161. [D 20:42:40.915498] openib_check_cq: completed rdma wr_id 63e700, nic_wr_credit 12161. [D 20:42:40.915515] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 21/70. [D 20:42:40.915583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.915598] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.915606] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:40.921032] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:40.921045] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.921054] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:40.921070] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3565 [D 20:42:40.921080] element 0: offset: 0x5b0030, size: 24 [D 20:42:40.921090] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 22/70. [D 20:42:40.990304] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3560 [D 20:42:40.990321] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 23/70. [D 20:42:40.990383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 12161. [D 20:42:40.990463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 12162. [D 20:42:40.990475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 12163. [D 20:42:40.990488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 12164. [D 20:42:40.990498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 12165. [D 20:42:40.990509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 12166. [D 20:42:40.990519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 12167. [D 20:42:40.990529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 12168. [D 20:42:40.990544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 12169. [D 20:42:40.990554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 12170. [D 20:42:40.990615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 12171. [D 20:42:40.990639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 12172. [D 20:42:40.990650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 12173. [D 20:42:40.990660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 12174. [D 20:42:40.990670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 12175. [D 20:42:40.990699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 12176. [D 20:42:40.990715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 12177. [D 20:42:40.990725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 12178. [D 20:42:40.990735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 12179. [D 20:42:40.990765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 12180. [D 20:42:40.990775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 12181. [D 20:42:40.990788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 12182. [D 20:42:40.990798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 12183. [D 20:42:40.990807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 12184. [D 20:42:40.990831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 12185. [D 20:42:40.990841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 12186. [D 20:42:40.990852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 12187. [D 20:42:40.990862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 12188. [D 20:42:40.990872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 12189. [D 20:42:40.990882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 12190. [D 20:42:40.990904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 12191. [D 20:42:40.990914] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 12192. [D 20:42:40.996317] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 12192. [D 20:42:40.996333] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 24/70. [D 20:42:40.996398] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:40.996412] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:40.996421] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.002046] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.002060] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.002068] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.002084] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3569 [D 20:42:41.002094] element 0: offset: 0x62d8e0, size: 24 [D 20:42:41.002104] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 25/70. [D 20:42:41.045647] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3569 [D 20:42:41.045664] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 26/70. [D 20:42:41.045725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 12192. [D 20:42:41.045796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 12193. [D 20:42:41.045816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 12194. [D 20:42:41.045827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 12195. [D 20:42:41.045838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 12196. [D 20:42:41.045848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 12197. [D 20:42:41.045862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 12198. [D 20:42:41.045872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 12199. [D 20:42:41.045882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 12200. [D 20:42:41.045898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 12201. [D 20:42:41.045952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 12202. [D 20:42:41.045978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 12203. [D 20:42:41.045992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 12204. [D 20:42:41.046001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 12205. [D 20:42:41.046012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 12206. [D 20:42:41.046036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 12207. [D 20:42:41.046052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 12208. [D 20:42:41.046063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 12209. [D 20:42:41.046073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 12210. [D 20:42:41.046083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 12211. [D 20:42:41.046093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 12212. [D 20:42:41.046115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 12213. [D 20:42:41.046126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 12214. [D 20:42:41.046137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 12215. [D 20:42:41.046146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 12216. [D 20:42:41.046176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 12217. [D 20:42:41.046186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 12218. [D 20:42:41.046196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 12219. [D 20:42:41.046206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 12220. [D 20:42:41.046216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 12221. [D 20:42:41.046225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 12222. [D 20:42:41.046254] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 12223. [D 20:42:41.051711] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 12223. [D 20:42:41.051728] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 27/70. [D 20:42:41.051794] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.051809] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.051817] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.057495] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.057509] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.057518] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.057533] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3572 [D 20:42:41.057542] element 0: offset: 0x61f310, size: 24 [D 20:42:41.057552] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 28/70. [D 20:42:41.077748] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3551 [D 20:42:41.077764] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 29/70. [D 20:42:41.077826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 12223. [D 20:42:41.077892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 12224. [D 20:42:41.077911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 12225. [D 20:42:41.077922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 12226. [D 20:42:41.077932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 12227. [D 20:42:41.077942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 12228. [D 20:42:41.077958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 12229. [D 20:42:41.077967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 12230. [D 20:42:41.077977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 12231. [D 20:42:41.077987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 12232. [D 20:42:41.078033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 12233. [D 20:42:41.078045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 12234. [D 20:42:41.078056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 12235. [D 20:42:41.078080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 12236. [D 20:42:41.078094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 12237. [D 20:42:41.078104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 12238. [D 20:42:41.078114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 12239. [D 20:42:41.078128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 12240. [D 20:42:41.078138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 12241. [D 20:42:41.078147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 12242. [D 20:42:41.078157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 12243. [D 20:42:41.078167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 12244. [D 20:42:41.078177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 12245. [D 20:42:41.078187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 12246. [D 20:42:41.078197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 12247. [D 20:42:41.078223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 12248. [D 20:42:41.078233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 12249. [D 20:42:41.078242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 12250. [D 20:42:41.078257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 12251. [D 20:42:41.078267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 12252. [D 20:42:41.078277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 12253. [D 20:42:41.078306] openib_post_sr_rdmaw: ibv_post_send wr_id 6621e0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 12254. [D 20:42:41.083746] openib_check_cq: completed rdma wr_id 6621e0, nic_wr_credit 12254. [D 20:42:41.083763] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 30/70. [D 20:42:41.083830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.083845] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.083854] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.089761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.089774] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.089783] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.089798] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3575 [D 20:42:41.089808] element 0: offset: 0x62a8b0, size: 24 [D 20:42:41.089818] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 31/70. [D 20:42:41.118806] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3565 [D 20:42:41.118823] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 32/70. [D 20:42:41.118882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 12254. [D 20:42:41.118959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 12255. [D 20:42:41.118971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 12256. [D 20:42:41.118981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 12257. [D 20:42:41.118992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 12258. [D 20:42:41.119002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 12259. [D 20:42:41.119017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 12260. [D 20:42:41.119027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 12261. [D 20:42:41.119037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 12262. [D 20:42:41.119047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 12263. [D 20:42:41.119097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 12264. [D 20:42:41.119108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 12265. [D 20:42:41.119120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 12266. [D 20:42:41.119135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 12267. [D 20:42:41.119145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 12268. [D 20:42:41.119155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 12269. [D 20:42:41.119164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 12270. [D 20:42:41.119174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 12271. [D 20:42:41.119202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 12272. [D 20:42:41.119211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 12273. [D 20:42:41.119221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 12274. [D 20:42:41.119237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 12275. [D 20:42:41.119247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 12276. [D 20:42:41.119256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 12277. [D 20:42:41.119285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 12278. [D 20:42:41.119295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 12279. [D 20:42:41.119305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 12280. [D 20:42:41.119315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 12281. [D 20:42:41.119325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 12282. [D 20:42:41.119349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 12283. [D 20:42:41.119360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 12284. [D 20:42:41.119371] openib_post_sr_rdmaw: ibv_post_send wr_id 62d8e0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 12285. [D 20:42:41.124889] openib_check_cq: completed rdma wr_id 62d8e0, nic_wr_credit 12285. [D 20:42:41.124908] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 33/70. [D 20:42:41.124973] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.124988] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.124996] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.130456] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.130469] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.130478] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.130494] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3577 [D 20:42:41.130504] element 0: offset: 0x662460, size: 24 [D 20:42:41.130514] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 34/70. [D 20:42:41.181682] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3575 [D 20:42:41.181699] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 35/70. [D 20:42:41.181755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 12285. [D 20:42:41.181823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 12286. [D 20:42:41.181846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 12287. [D 20:42:41.181857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 12288. [D 20:42:41.181867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 12289. [D 20:42:41.181877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 12290. [D 20:42:41.181893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 12291. [D 20:42:41.181902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 12292. [D 20:42:41.181912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 12293. [D 20:42:41.181945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 12294. [D 20:42:41.181956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 12295. [D 20:42:41.181985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 12296. [D 20:42:41.181999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 12297. [D 20:42:41.182021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 12298. [D 20:42:41.182034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 12299. [D 20:42:41.182044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 12300. [D 20:42:41.182070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 12301. [D 20:42:41.182080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 12302. [D 20:42:41.182102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 12303. [D 20:42:41.182112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 12304. [D 20:42:41.182134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 12305. [D 20:42:41.182144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 12306. [D 20:42:41.182154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 12307. [D 20:42:41.182174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 12308. [D 20:42:41.182185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 12309. [D 20:42:41.182194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 12310. [D 20:42:41.182218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 12311. [D 20:42:41.182228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 12312. [D 20:42:41.182248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 12313. [D 20:42:41.182264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 12314. [D 20:42:41.182274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 12315. [D 20:42:41.182284] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 12316. [D 20:42:41.187731] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 12316. [D 20:42:41.187749] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 36/70. [D 20:42:41.187814] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.187828] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.187837] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.193861] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.193875] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.193883] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.193899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3581 [D 20:42:41.193908] element 0: offset: 0x61f800, size: 24 [D 20:42:41.193918] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 37/70. [D 20:42:41.265910] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3577 [D 20:42:41.265927] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 38/70. [D 20:42:41.266095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 12316. [D 20:42:41.266161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 12317. [D 20:42:41.266172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 12318. [D 20:42:41.266183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 12319. [D 20:42:41.266193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 12320. [D 20:42:41.266204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 12321. [D 20:42:41.266214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 12322. [D 20:42:41.266226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 12323. [D 20:42:41.266243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 12324. [D 20:42:41.266253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 12325. [D 20:42:41.266262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 12326. [D 20:42:41.266288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 12327. [D 20:42:41.266298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 12328. [D 20:42:41.266321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 12329. [D 20:42:41.266331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 12330. [D 20:42:41.266341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 12331. [D 20:42:41.266352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 12332. [D 20:42:41.266361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 12333. [D 20:42:41.266372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 12334. [D 20:42:41.266382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 12335. [D 20:42:41.266413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 12336. [D 20:42:41.266424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 12337. [D 20:42:41.266434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 12338. [D 20:42:41.266460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 12339. [D 20:42:41.266470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 12340. [D 20:42:41.266480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 12341. [D 20:42:41.266490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 12342. [D 20:42:41.266510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 12343. [D 20:42:41.266526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 12344. [D 20:42:41.266536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 12345. [D 20:42:41.266556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 12346. [D 20:42:41.266567] openib_post_sr_rdmaw: ibv_post_send wr_id 6618e0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 12347. [D 20:42:41.272088] openib_check_cq: completed rdma wr_id 6618e0, nic_wr_credit 12347. [D 20:42:41.272105] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 39/70. [D 20:42:41.272168] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.272182] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.272191] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.277938] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.277951] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.277960] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.277976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3583 [D 20:42:41.277985] element 0: offset: 0x63e8c0, size: 24 [D 20:42:41.277996] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 40/70. [D 20:42:41.326445] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3572 [D 20:42:41.326462] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 41/70. [D 20:42:41.326523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 12347. [D 20:42:41.326592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 12348. [D 20:42:41.326647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 12349. [D 20:42:41.326658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 12350. [D 20:42:41.326669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 12351. [D 20:42:41.326679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 12352. [D 20:42:41.326689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 12353. [D 20:42:41.326709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 12354. [D 20:42:41.326725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 12355. [D 20:42:41.326735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 12356. [D 20:42:41.326745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 12357. [D 20:42:41.326776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 12358. [D 20:42:41.326802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 12359. [D 20:42:41.326814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 12360. [D 20:42:41.326828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 12361. [D 20:42:41.326850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 12362. [D 20:42:41.326862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 12363. [D 20:42:41.326872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 12364. [D 20:42:41.326895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 12365. [D 20:42:41.326904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 12366. [D 20:42:41.326925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 12367. [D 20:42:41.326937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 12368. [D 20:42:41.326957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 12369. [D 20:42:41.326968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 12370. [D 20:42:41.326978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 12371. [D 20:42:41.326988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 12372. [D 20:42:41.327015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 12373. [D 20:42:41.327035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 12374. [D 20:42:41.327047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 12375. [D 20:42:41.327065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 12376. [D 20:42:41.327080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 12377. [D 20:42:41.327091] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 12378. [D 20:42:41.332449] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 12378. [D 20:42:41.332464] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 42/70. [D 20:42:41.332530] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.332545] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.332553] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.338315] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.338329] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.338337] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.338353] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3587 [D 20:42:41.338363] element 0: offset: 0x5b0030, size: 24 [D 20:42:41.338373] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 43/70. [D 20:42:41.409531] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3554 [D 20:42:41.409548] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 44/70. [D 20:42:41.409609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 12378. [D 20:42:41.409706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 12379. [D 20:42:41.409719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 12380. [D 20:42:41.409731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 12381. [D 20:42:41.409741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 12382. [D 20:42:41.409751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 12383. [D 20:42:41.409761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 12384. [D 20:42:41.409771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 12385. [D 20:42:41.409807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 12386. [D 20:42:41.409818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 12387. [D 20:42:41.409840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 12388. [D 20:42:41.409857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 12389. [D 20:42:41.409868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 12390. [D 20:42:41.409877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 12391. [D 20:42:41.409887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 12392. [D 20:42:41.409898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 12393. [D 20:42:41.409921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 12394. [D 20:42:41.409931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 12395. [D 20:42:41.409941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 12396. [D 20:42:41.409951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 12397. [D 20:42:41.409963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 12398. [D 20:42:41.409972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 12399. [D 20:42:41.409983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 12400. [D 20:42:41.410005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 12401. [D 20:42:41.410015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 12402. [D 20:42:41.410025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 12403. [D 20:42:41.410040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 12404. [D 20:42:41.410050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 12405. [D 20:42:41.410075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 12406. [D 20:42:41.410085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 12407. [D 20:42:41.410100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 12408. [D 20:42:41.410111] openib_post_sr_rdmaw: ibv_post_send wr_id 62a410 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 12409. [D 20:42:41.415564] openib_check_cq: completed rdma wr_id 62a410, nic_wr_credit 12409. [D 20:42:41.415580] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 45/70. [D 20:42:41.415647] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.415661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.415670] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.421813] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.421827] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.421835] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.421852] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3590 [D 20:42:41.421861] element 0: offset: 0x662460, size: 24 [D 20:42:41.421871] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 46/70. [D 20:42:41.472556] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3590 [D 20:42:41.472574] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 47/70. [D 20:42:41.472631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 12409. [D 20:42:41.472708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 12410. [D 20:42:41.472722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 12411. [D 20:42:41.472733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 12412. [D 20:42:41.472743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 12413. [D 20:42:41.472753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 12414. [D 20:42:41.472763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 12415. [D 20:42:41.472774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 12416. [D 20:42:41.472784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 12417. [D 20:42:41.472793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 12418. [D 20:42:41.472835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 12419. [D 20:42:41.472848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 12420. [D 20:42:41.472858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 12421. [D 20:42:41.472871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 12422. [D 20:42:41.472885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 12423. [D 20:42:41.472895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 12424. [D 20:42:41.472929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 12425. [D 20:42:41.472953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 12426. [D 20:42:41.472963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 12427. [D 20:42:41.472973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 12428. [D 20:42:41.472984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 12429. [D 20:42:41.472993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 12430. [D 20:42:41.473004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 12431. [D 20:42:41.473027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 12432. [D 20:42:41.473038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 12433. [D 20:42:41.473052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 12434. [D 20:42:41.473061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 12435. [D 20:42:41.473071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 12436. [D 20:42:41.473086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 12437. [D 20:42:41.473096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 12438. [D 20:42:41.473106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 12439. [D 20:42:41.473116] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 12440. [D 20:42:41.478617] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12440. [D 20:42:41.478633] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 48/70. [D 20:42:41.478696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.478710] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.478719] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.545948] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3581 [D 20:42:41.545964] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 49/70. [D 20:42:41.546028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 12440. [D 20:42:41.546093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 12441. [D 20:42:41.546112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 12442. [D 20:42:41.546122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 12443. [D 20:42:41.546133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 12444. [D 20:42:41.546143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 12445. [D 20:42:41.546159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 12446. [D 20:42:41.546169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 12447. [D 20:42:41.546179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 12448. [D 20:42:41.546194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 12449. [D 20:42:41.546245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 12450. [D 20:42:41.546257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 12451. [D 20:42:41.546267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 12452. [D 20:42:41.546291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 12453. [D 20:42:41.546301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 12454. [D 20:42:41.546312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 12455. [D 20:42:41.546322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 12456. [D 20:42:41.546331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 12457. [D 20:42:41.546342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 12458. [D 20:42:41.546368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 12459. [D 20:42:41.546378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 12460. [D 20:42:41.546388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 12461. [D 20:42:41.546398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 12462. [D 20:42:41.546408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 12463. [D 20:42:41.546419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 12464. [D 20:42:41.546429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 12465. [D 20:42:41.546457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 12466. [D 20:42:41.546466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 12467. [D 20:42:41.546476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 12468. [D 20:42:41.546486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 12469. [D 20:42:41.546497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 12470. [D 20:42:41.546508] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 12471. [D 20:42:41.551950] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12471. [D 20:42:41.551968] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 50/70. [D 20:42:41.552033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.552047] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.552055] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:41.558311] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.558325] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.558334] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:41.558350] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3593 [D 20:42:41.558359] element 0: offset: 0x655b90, size: 24 [D 20:42:41.558369] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 51/70. [D 20:42:41.597401] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3587 [D 20:42:41.597419] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 52/70. [D 20:42:41.597482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 12471. [D 20:42:41.597558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 12472. [D 20:42:41.597570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 12473. [D 20:42:41.597582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 12474. [D 20:42:41.597593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 12475. [D 20:42:41.597608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 12476. [D 20:42:41.597619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 12477. [D 20:42:41.597629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 12478. [D 20:42:41.597639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 12479. [D 20:42:41.597648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 12480. [D 20:42:41.597698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 12481. [D 20:42:41.597708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 12482. [D 20:42:41.597729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 12483. [D 20:42:41.597745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 12484. [D 20:42:41.597755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 12485. [D 20:42:41.597765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 12486. [D 20:42:41.597775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 12487. [D 20:42:41.597800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 12488. [D 20:42:41.597810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 12489. [D 20:42:41.597826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 12490. [D 20:42:41.597836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 12491. [D 20:42:41.597845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 12492. [D 20:42:41.597861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 12493. [D 20:42:41.597891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 12494. [D 20:42:41.597901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 12495. [D 20:42:41.597911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 12496. [D 20:42:41.597921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 12497. [D 20:42:41.597945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 12498. [D 20:42:41.597955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 12499. [D 20:42:41.597965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 12500. [D 20:42:41.597980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 12501. [D 20:42:41.597990] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 12502. [D 20:42:41.603415] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12502. [D 20:42:41.603431] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 53/70. [D 20:42:41.603496] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.603510] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.603519] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:41.609942] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.609955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.609964] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:41.609980] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3597 [D 20:42:41.609989] element 0: offset: 0x691fe0, size: 24 [D 20:42:41.609999] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 54/70. [D 20:42:41.610034] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.610044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.610052] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.610066] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3599 [D 20:42:41.610075] element 0: offset: 0x62a8b0, size: 24 [D 20:42:41.610085] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 55/70. [D 20:42:41.634887] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3583 [D 20:42:41.634903] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 56/70. [D 20:42:41.634962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 12502. [D 20:42:41.635054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 12503. [D 20:42:41.635068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 12504. [D 20:42:41.635079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 12505. [D 20:42:41.635090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 12506. [D 20:42:41.635100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 12507. [D 20:42:41.635113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 12508. [D 20:42:41.635123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 12509. [D 20:42:41.635133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 12510. [D 20:42:41.635149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 12511. [D 20:42:41.635158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 12512. [D 20:42:41.635168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 12513. [D 20:42:41.635207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 12514. [D 20:42:41.635219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 12515. [D 20:42:41.635229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 12516. [D 20:42:41.635239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 12517. [D 20:42:41.635249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 12518. [D 20:42:41.635259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 12519. [D 20:42:41.635284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 12520. [D 20:42:41.635294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 12521. [D 20:42:41.635303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 12522. [D 20:42:41.635318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 12523. [D 20:42:41.635328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 12524. [D 20:42:41.635338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 12525. [D 20:42:41.635366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 12526. [D 20:42:41.635376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 12527. [D 20:42:41.635389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 12528. [D 20:42:41.635399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 12529. [D 20:42:41.635425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 12530. [D 20:42:41.635434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 12531. [D 20:42:41.635445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 12532. [D 20:42:41.635455] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 12533. [D 20:42:41.640908] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12533. [D 20:42:41.640925] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 57/70. [D 20:42:41.640992] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.641006] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.641015] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.646615] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.646629] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.646637] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.646653] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3601 [D 20:42:41.646662] element 0: offset: 0x661780, size: 24 [D 20:42:41.646672] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 58/70. [D 20:42:41.684856] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3601 [D 20:42:41.684876] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 59/70. [D 20:42:41.684941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 12533. [D 20:42:41.685018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 12534. [D 20:42:41.685030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 12535. [D 20:42:41.685040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 12536. [D 20:42:41.685051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 12537. [D 20:42:41.685061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 12538. [D 20:42:41.685077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 12539. [D 20:42:41.685087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 12540. [D 20:42:41.685097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 12541. [D 20:42:41.685107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 12542. [D 20:42:41.685157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 12543. [D 20:42:41.685174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 12544. [D 20:42:41.685194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 12545. [D 20:42:41.685209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 12546. [D 20:42:41.685221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 12547. [D 20:42:41.685230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 12548. [D 20:42:41.685240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 12549. [D 20:42:41.685250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 12550. [D 20:42:41.685260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 12551. [D 20:42:41.685293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 12552. [D 20:42:41.685303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 12553. [D 20:42:41.685313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 12554. [D 20:42:41.685323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 12555. [D 20:42:41.685343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 12556. [D 20:42:41.685359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 12557. [D 20:42:41.685369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 12558. [D 20:42:41.685379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 12559. [D 20:42:41.685389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 12560. [D 20:42:41.685399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 12561. [D 20:42:41.685424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 12562. [D 20:42:41.685438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 12563. [D 20:42:41.685448] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 12564. [D 20:42:41.690910] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12564. [D 20:42:41.690927] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 60/70. [D 20:42:41.690996] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.691011] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.691020] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.721241] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3593 [D 20:42:41.721258] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 0/70. [D 20:42:41.721319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 12564. [D 20:42:41.721395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 12565. [D 20:42:41.721406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 12566. [D 20:42:41.721416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 12567. [D 20:42:41.721427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 12568. [D 20:42:41.721437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 12569. [D 20:42:41.721453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 12570. [D 20:42:41.721463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 12571. [D 20:42:41.721473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 12572. [D 20:42:41.721489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 12573. [D 20:42:41.721536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 12574. [D 20:42:41.721547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 12575. [D 20:42:41.721556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 12576. [D 20:42:41.721566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 12577. [D 20:42:41.721576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 12578. [D 20:42:41.721586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 12579. [D 20:42:41.721604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 12580. [D 20:42:41.721614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 12581. [D 20:42:41.721624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 12582. [D 20:42:41.721633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 12583. [D 20:42:41.721666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 12584. [D 20:42:41.721677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 12585. [D 20:42:41.721688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 12586. [D 20:42:41.721698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 12587. [D 20:42:41.721708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 12588. [D 20:42:41.721718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 12589. [D 20:42:41.721728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 12590. [D 20:42:41.721738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 12591. [D 20:42:41.721754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 12592. [D 20:42:41.721764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 12593. [D 20:42:41.721788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 12594. [D 20:42:41.721800] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 12595. [D 20:42:41.727259] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12595. [D 20:42:41.727277] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 1/70. [D 20:42:41.727344] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.727358] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.727367] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:41.733553] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.733566] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.733575] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:41.733597] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3605 [D 20:42:41.733606] element 0: offset: 0x61f310, size: 24 [D 20:42:41.733617] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 2/70. [D 20:42:41.778049] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3597 [D 20:42:41.778066] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 3/70. [D 20:42:41.778133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 12595. [D 20:42:41.778213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 12596. [D 20:42:41.778224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 12597. [D 20:42:41.778237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 12598. [D 20:42:41.778247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 12599. [D 20:42:41.778263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 12600. [D 20:42:41.778274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 12601. [D 20:42:41.778284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 12602. [D 20:42:41.778294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 12603. [D 20:42:41.778350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 12604. [D 20:42:41.778360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 12605. [D 20:42:41.778370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 12606. [D 20:42:41.778395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 12607. [D 20:42:41.778405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 12608. [D 20:42:41.778415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 12609. [D 20:42:41.778426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 12610. [D 20:42:41.778436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 12611. [D 20:42:41.778446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 12612. [D 20:42:41.778456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 12613. [D 20:42:41.778482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 12614. [D 20:42:41.778496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 12615. [D 20:42:41.778506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 12616. [D 20:42:41.778516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 12617. [D 20:42:41.778544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 12618. [D 20:42:41.778554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 12619. [D 20:42:41.778567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 12620. [D 20:42:41.778576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 12621. [D 20:42:41.778586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 12622. [D 20:42:41.778600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 12623. [D 20:42:41.778610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 12624. [D 20:42:41.778620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 12625. [D 20:42:41.778630] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 12626. [D 20:42:41.784076] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12626. [D 20:42:41.784093] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 4/70. [D 20:42:41.784160] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.784174] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.784183] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:41.790748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.790761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.790770] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:41.790787] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3608 [D 20:42:41.790796] element 0: offset: 0x632940, size: 24 [D 20:42:41.790806] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 5/70. [D 20:42:41.819058] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3599 [D 20:42:41.819074] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 6/70. [D 20:42:41.819135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 12626. [D 20:42:41.819204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 12627. [D 20:42:41.819264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 12628. [D 20:42:41.819276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 12629. [D 20:42:41.819286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 12630. [D 20:42:41.819301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 12631. [D 20:42:41.819312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 12632. [D 20:42:41.819322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 12633. [D 20:42:41.819332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 12634. [D 20:42:41.819342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 12635. [D 20:42:41.819352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 12636. [D 20:42:41.819362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 12637. [D 20:42:41.819395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 12638. [D 20:42:41.819405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 12639. [D 20:42:41.819417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 12640. [D 20:42:41.819427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 12641. [D 20:42:41.819436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 12642. [D 20:42:41.819463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 12643. [D 20:42:41.819478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 12644. [D 20:42:41.819489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 12645. [D 20:42:41.819499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 12646. [D 20:42:41.819509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 12647. [D 20:42:41.819520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 12648. [D 20:42:41.819530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 12649. [D 20:42:41.819555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 12650. [D 20:42:41.819565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 12651. [D 20:42:41.819575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 12652. [D 20:42:41.819599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 12653. [D 20:42:41.819609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 12654. [D 20:42:41.819619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 12655. [D 20:42:41.819630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 12656. [D 20:42:41.819640] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 12657. [D 20:42:41.825067] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 12657. [D 20:42:41.825085] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 7/70. [D 20:42:41.825152] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.825167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.825175] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:41.830741] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.830755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.830763] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:41.830780] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3611 [D 20:42:41.830789] element 0: offset: 0x61f800, size: 24 [D 20:42:41.830799] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 8/70. [D 20:42:41.830877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.830890] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.830898] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.830913] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3614 [D 20:42:41.830922] element 0: offset: 0x661780, size: 24 [D 20:42:41.830932] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 9/70. [D 20:42:41.913674] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3614 [D 20:42:41.913691] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 10/70. [D 20:42:41.913800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 12657. [D 20:42:41.913908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 12658. [D 20:42:41.913920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 12659. [D 20:42:41.913930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 12660. [D 20:42:41.913945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 12661. [D 20:42:41.913954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 12662. [D 20:42:41.913964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 12663. [D 20:42:41.913980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 12664. [D 20:42:41.913990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 12665. [D 20:42:41.914000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 12666. [D 20:42:41.914029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 12667. [D 20:42:41.914045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 12668. [D 20:42:41.914067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 12669. [D 20:42:41.914082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 12670. [D 20:42:41.914103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 12671. [D 20:42:41.914118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 12672. [D 20:42:41.914128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 12673. [D 20:42:41.914137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 12674. [D 20:42:41.914152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 12675. [D 20:42:41.914162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 12676. [D 20:42:41.914187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 12677. [D 20:42:41.914197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 12678. [D 20:42:41.914207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 12679. [D 20:42:41.914221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 12680. [D 20:42:41.914244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 12681. [D 20:42:41.914256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 12682. [D 20:42:41.914275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 12683. [D 20:42:41.914286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 12684. [D 20:42:41.914309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 12685. [D 20:42:41.914319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 12686. [D 20:42:41.914329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 12687. [D 20:42:41.914339] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 12688. [D 20:42:41.919820] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 12688. [D 20:42:41.919836] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 11/70. [D 20:42:41.919903] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.919918] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.919926] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.925500] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.925514] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.925522] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.925539] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3617 [D 20:42:41.925548] element 0: offset: 0x5b0030, size: 24 [D 20:42:41.925558] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 12/70. [D 20:42:41.973611] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3605 [D 20:42:41.973628] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 13/70. [D 20:42:41.973685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 12688. [D 20:42:41.973750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 12689. [D 20:42:41.973800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 12690. [D 20:42:41.973811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 12691. [D 20:42:41.973822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 12692. [D 20:42:41.973833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 12693. [D 20:42:41.973843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 12694. [D 20:42:41.973852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 12695. [D 20:42:41.973876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 12696. [D 20:42:41.973887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 12697. [D 20:42:41.973897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 12698. [D 20:42:41.973912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 12699. [D 20:42:41.973932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 12700. [D 20:42:41.973943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 12701. [D 20:42:41.973954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 12702. [D 20:42:41.973977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 12703. [D 20:42:41.973999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 12704. [D 20:42:41.974010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 12705. [D 20:42:41.974034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 12706. [D 20:42:41.974045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 12707. [D 20:42:41.974066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 12708. [D 20:42:41.974078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 12709. [D 20:42:41.974100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 12710. [D 20:42:41.974111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 12711. [D 20:42:41.974122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 12712. [D 20:42:41.974132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 12713. [D 20:42:41.974142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 12714. [D 20:42:41.974152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 12715. [D 20:42:41.974162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 12716. [D 20:42:41.974185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 12717. [D 20:42:41.974196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 12718. [D 20:42:41.974205] openib_post_sr_rdmaw: ibv_post_send wr_id 6434b0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 12719. [D 20:42:41.979607] openib_check_cq: completed rdma wr_id 6434b0, nic_wr_credit 12719. [D 20:42:41.979625] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 14/70. [D 20:42:41.979688] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:41.979702] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.979711] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:41.985693] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:41.985707] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:41.985715] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:41.985731] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3620 [D 20:42:41.985740] element 0: offset: 0x655b90, size: 24 [D 20:42:41.985750] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 15/70. [D 20:42:42.045308] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3617 [D 20:42:42.045325] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 16/70. [D 20:42:42.045390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 12719. [D 20:42:42.045458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 12720. [D 20:42:42.045511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 12721. [D 20:42:42.045522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 12722. [D 20:42:42.045533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 12723. [D 20:42:42.045543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 12724. [D 20:42:42.045553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 12725. [D 20:42:42.045563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 12726. [D 20:42:42.045588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 12727. [D 20:42:42.045598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 12728. [D 20:42:42.045608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 12729. [D 20:42:42.045624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 12730. [D 20:42:42.045648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 12731. [D 20:42:42.045671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 12732. [D 20:42:42.045683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 12733. [D 20:42:42.045694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 12734. [D 20:42:42.045721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 12735. [D 20:42:42.045732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 12736. [D 20:42:42.045742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 12737. [D 20:42:42.045758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 12738. [D 20:42:42.045768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 12739. [D 20:42:42.045778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 12740. [D 20:42:42.045803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 12741. [D 20:42:42.045812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 12742. [D 20:42:42.045823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 12743. [D 20:42:42.045849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 12744. [D 20:42:42.045860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 12745. [D 20:42:42.045871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 12746. [D 20:42:42.045895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 12747. [D 20:42:42.045918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 12748. [D 20:42:42.045928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 12749. [D 20:42:42.045938] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 12750. [D 20:42:42.051381] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 12750. [D 20:42:42.051398] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 17/70. [D 20:42:42.051462] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.051476] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.051485] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.057001] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.057014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.057023] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.057039] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3623 [D 20:42:42.057048] element 0: offset: 0x661780, size: 24 [D 20:42:42.057060] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 18/70. [D 20:42:42.082274] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3620 [D 20:42:42.082291] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 19/70. [D 20:42:42.082354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 12750. [D 20:42:42.082456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 12751. [D 20:42:42.082470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 12752. [D 20:42:42.082481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 12753. [D 20:42:42.082492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 12754. [D 20:42:42.082502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 12755. [D 20:42:42.082513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 12756. [D 20:42:42.082523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 12757. [D 20:42:42.082532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 12758. [D 20:42:42.082548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 12759. [D 20:42:42.082559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 12760. [D 20:42:42.082568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 12761. [D 20:42:42.082578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 12762. [D 20:42:42.082588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 12763. [D 20:42:42.082599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 12764. [D 20:42:42.082611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 12765. [D 20:42:42.082620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 12766. [D 20:42:42.082642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 12767. [D 20:42:42.082660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 12768. [D 20:42:42.082670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 12769. [D 20:42:42.082699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 12770. [D 20:42:42.082709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 12771. [D 20:42:42.082719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 12772. [D 20:42:42.082745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 12773. [D 20:42:42.082756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 12774. [D 20:42:42.082768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 12775. [D 20:42:42.082778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 12776. [D 20:42:42.082805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 12777. [D 20:42:42.082815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 12778. [D 20:42:42.082825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 12779. [D 20:42:42.082847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 12780. [D 20:42:42.082856] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 12781. [D 20:42:42.088389] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12781. [D 20:42:42.088407] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 20/70. [D 20:42:42.088471] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.088486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.088494] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.094472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.094485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.094494] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.094510] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3626 [D 20:42:42.094519] element 0: offset: 0x6a8400, size: 24 [D 20:42:42.094529] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 21/70. [D 20:42:42.172829] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3611 [D 20:42:42.172846] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 22/70. [D 20:42:42.172998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 12781. [D 20:42:42.173069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 12782. [D 20:42:42.173080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 12783. [D 20:42:42.173090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 12784. [D 20:42:42.173104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 12785. [D 20:42:42.173114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 12786. [D 20:42:42.173124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 12787. [D 20:42:42.173138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 12788. [D 20:42:42.173147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 12789. [D 20:42:42.173157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 12790. [D 20:42:42.173213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 12791. [D 20:42:42.173224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 12792. [D 20:42:42.173235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 12793. [D 20:42:42.173245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 12794. [D 20:42:42.173271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 12795. [D 20:42:42.173281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 12796. [D 20:42:42.173291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 12797. [D 20:42:42.173301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 12798. [D 20:42:42.173311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 12799. [D 20:42:42.173321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 12800. [D 20:42:42.173351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 12801. [D 20:42:42.173363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 12802. [D 20:42:42.173373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 12803. [D 20:42:42.173383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 12804. [D 20:42:42.173393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 12805. [D 20:42:42.173403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 12806. [D 20:42:42.173426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 12807. [D 20:42:42.173439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 12808. [D 20:42:42.173449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 12809. [D 20:42:42.173459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 12810. [D 20:42:42.173475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 12811. [D 20:42:42.173497] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 12812. [D 20:42:42.178926] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12812. [D 20:42:42.178942] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 23/70. [D 20:42:42.179006] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.179020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.179028] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.184487] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.184501] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.184510] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.184526] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3628 [D 20:42:42.184536] element 0: offset: 0x691fe0, size: 24 [D 20:42:42.184551] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 24/70. [D 20:42:42.221029] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3608 [D 20:42:42.221046] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 25/70. [D 20:42:42.221104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 12812. [D 20:42:42.221203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 12813. [D 20:42:42.221217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 12814. [D 20:42:42.221228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 12815. [D 20:42:42.221238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 12816. [D 20:42:42.221249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 12817. [D 20:42:42.221259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 12818. [D 20:42:42.221269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 12819. [D 20:42:42.221279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 12820. [D 20:42:42.221290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 12821. [D 20:42:42.221300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 12822. [D 20:42:42.221309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 12823. [D 20:42:42.221354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 12824. [D 20:42:42.221366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 12825. [D 20:42:42.221376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 12826. [D 20:42:42.221385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 12827. [D 20:42:42.221401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 12828. [D 20:42:42.221410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 12829. [D 20:42:42.221420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 12830. [D 20:42:42.221451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 12831. [D 20:42:42.221462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 12832. [D 20:42:42.221473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 12833. [D 20:42:42.221498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 12834. [D 20:42:42.221509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 12835. [D 20:42:42.221519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 12836. [D 20:42:42.221529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 12837. [D 20:42:42.221544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 12838. [D 20:42:42.221569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 12839. [D 20:42:42.221583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 12840. [D 20:42:42.221593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 12841. [D 20:42:42.221603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 12842. [D 20:42:42.221617] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 12843. [D 20:42:42.227061] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 12843. [D 20:42:42.227079] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 26/70. [D 20:42:42.229402] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.229417] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.229428] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.235862] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.235876] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.235886] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.235919] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3632 [D 20:42:42.235929] element 0: offset: 0x64dc30, size: 24 [D 20:42:42.235942] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 27/70. [D 20:42:42.278150] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3623 [D 20:42:42.278168] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 28/70. [D 20:42:42.278224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 12843. [D 20:42:42.278291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 12844. [D 20:42:42.278312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 12845. [D 20:42:42.278322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 12846. [D 20:42:42.278333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 12847. [D 20:42:42.278343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 12848. [D 20:42:42.278358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 12849. [D 20:42:42.278368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 12850. [D 20:42:42.278378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 12851. [D 20:42:42.278394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 12852. [D 20:42:42.278404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 12853. [D 20:42:42.278413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 12854. [D 20:42:42.278423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 12855. [D 20:42:42.278433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 12856. [D 20:42:42.278443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 12857. [D 20:42:42.278453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 12858. [D 20:42:42.278463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 12859. [D 20:42:42.278511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 12860. [D 20:42:42.278524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 12861. [D 20:42:42.278533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 12862. [D 20:42:42.278544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 12863. [D 20:42:42.278554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 12864. [D 20:42:42.278564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 12865. [D 20:42:42.278574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 12866. [D 20:42:42.278586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 12867. [D 20:42:42.278604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 12868. [D 20:42:42.278628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 12869. [D 20:42:42.278640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 12870. [D 20:42:42.278651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 12871. [D 20:42:42.278660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 12872. [D 20:42:42.278671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 12873. [D 20:42:42.278680] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 12874. [D 20:42:42.284147] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12874. [D 20:42:42.284164] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 29/70. [D 20:42:42.286433] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.286448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.286460] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.291856] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.291870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.291881] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.291915] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3635 [D 20:42:42.291926] element 0: offset: 0x64dd40, size: 24 [D 20:42:42.291940] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 30/70. [D 20:42:42.349879] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3628 [D 20:42:42.349897] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 31/70. [D 20:42:42.349958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 12874. [D 20:42:42.350027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 12875. [D 20:42:42.350048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 12876. [D 20:42:42.350061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 12877. [D 20:42:42.350072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 12878. [D 20:42:42.350082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 12879. [D 20:42:42.350092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 12880. [D 20:42:42.350101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 12881. [D 20:42:42.350111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 12882. [D 20:42:42.350126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 12883. [D 20:42:42.350176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 12884. [D 20:42:42.350189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 12885. [D 20:42:42.350214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 12886. [D 20:42:42.350224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 12887. [D 20:42:42.350234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 12888. [D 20:42:42.350250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 12889. [D 20:42:42.350277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 12890. [D 20:42:42.350289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 12891. [D 20:42:42.350299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 12892. [D 20:42:42.350309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 12893. [D 20:42:42.350322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 12894. [D 20:42:42.350346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 12895. [D 20:42:42.350358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 12896. [D 20:42:42.350367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 12897. [D 20:42:42.350380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 12898. [D 20:42:42.350410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 12899. [D 20:42:42.350421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 12900. [D 20:42:42.350431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 12901. [D 20:42:42.350441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 12902. [D 20:42:42.350466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 12903. [D 20:42:42.350476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 12904. [D 20:42:42.350486] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 12905. [D 20:42:42.355886] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 12905. [D 20:42:42.355903] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 32/70. [D 20:42:42.358222] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.358238] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.358248] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.363419] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.363433] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.363443] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.363475] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3637 [D 20:42:42.363487] element 0: offset: 0x5b0030, size: 24 [D 20:42:42.363501] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 33/70. [D 20:42:42.371121] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3626 [D 20:42:42.371138] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 34/70. [D 20:42:42.371202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 12905. [D 20:42:42.371278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 12906. [D 20:42:42.371289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 12907. [D 20:42:42.371299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 12908. [D 20:42:42.371311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 12909. [D 20:42:42.371321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 12910. [D 20:42:42.371337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 12911. [D 20:42:42.371347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 12912. [D 20:42:42.371356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 12913. [D 20:42:42.371372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 12914. [D 20:42:42.371382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 12915. [D 20:42:42.371392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 12916. [D 20:42:42.371407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 12917. [D 20:42:42.371417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 12918. [D 20:42:42.371426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 12919. [D 20:42:42.371470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 12920. [D 20:42:42.371482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 12921. [D 20:42:42.371492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 12922. [D 20:42:42.371502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 12923. [D 20:42:42.371535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 12924. [D 20:42:42.371548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 12925. [D 20:42:42.371558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 12926. [D 20:42:42.371571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 12927. [D 20:42:42.371585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 12928. [D 20:42:42.371595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 12929. [D 20:42:42.371605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 12930. [D 20:42:42.371631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 12931. [D 20:42:42.371641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 12932. [D 20:42:42.371651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 12933. [D 20:42:42.371661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 12934. [D 20:42:42.371671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 12935. [D 20:42:42.371681] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 12936. [D 20:42:42.377133] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12936. [D 20:42:42.377149] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 35/70. [D 20:42:42.379291] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.379306] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.379316] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.433637] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3632 [D 20:42:42.433655] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 36/70. [D 20:42:42.433720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 12936. [D 20:42:42.433798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 12937. [D 20:42:42.433810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 12938. [D 20:42:42.433821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 12939. [D 20:42:42.433835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 12940. [D 20:42:42.433845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 12941. [D 20:42:42.433855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 12942. [D 20:42:42.433869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 12943. [D 20:42:42.433879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 12944. [D 20:42:42.433888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 12945. [D 20:42:42.433946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 12946. [D 20:42:42.433958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 12947. [D 20:42:42.433981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 12948. [D 20:42:42.433993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 12949. [D 20:42:42.434003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 12950. [D 20:42:42.434014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 12951. [D 20:42:42.434024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 12952. [D 20:42:42.434034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 12953. [D 20:42:42.434047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 12954. [D 20:42:42.434063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 12955. [D 20:42:42.434072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 12956. [D 20:42:42.434082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 12957. [D 20:42:42.434092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 12958. [D 20:42:42.434102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 12959. [D 20:42:42.434114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 12960. [D 20:42:42.434124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 12961. [D 20:42:42.434153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 12962. [D 20:42:42.434163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 12963. [D 20:42:42.434173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 12964. [D 20:42:42.434188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 12965. [D 20:42:42.434198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 12966. [D 20:42:42.434208] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 12967. [D 20:42:42.439663] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12967. [D 20:42:42.439679] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 37/70. [D 20:42:42.440592] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.440607] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.440617] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:42.448649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.448664] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.448675] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:42.448709] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3641 [D 20:42:42.448720] element 0: offset: 0x61f310, size: 24 [D 20:42:42.448732] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 38/70. [D 20:42:42.495505] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3635 [D 20:42:42.495523] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 39/70. [D 20:42:42.495585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 12967. [D 20:42:42.495654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 12968. [D 20:42:42.495674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 12969. [D 20:42:42.495685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 12970. [D 20:42:42.495695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 12971. [D 20:42:42.495705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 12972. [D 20:42:42.495719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 12973. [D 20:42:42.495729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 12974. [D 20:42:42.495739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 12975. [D 20:42:42.495749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 12976. [D 20:42:42.495798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 12977. [D 20:42:42.495809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 12978. [D 20:42:42.495822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 12979. [D 20:42:42.495832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 12980. [D 20:42:42.495841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 12981. [D 20:42:42.495851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 12982. [D 20:42:42.495868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 12983. [D 20:42:42.495894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 12984. [D 20:42:42.495905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 12985. [D 20:42:42.495915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 12986. [D 20:42:42.495925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 12987. [D 20:42:42.495936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 12988. [D 20:42:42.495945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 12989. [D 20:42:42.495955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 12990. [D 20:42:42.495965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 12991. [D 20:42:42.495997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 12992. [D 20:42:42.496010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 12993. [D 20:42:42.496023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 12994. [D 20:42:42.496033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 12995. [D 20:42:42.496042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 12996. [D 20:42:42.496071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 12997. [D 20:42:42.496087] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 12998. [D 20:42:42.501515] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 12998. [D 20:42:42.501532] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 40/70. [D 20:42:42.503696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.503711] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.503721] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:42.510989] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.511004] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.511014] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:42.511047] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3644 [D 20:42:42.511058] element 0: offset: 0x691fe0, size: 24 [D 20:42:42.511070] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 41/70. [D 20:42:42.511090] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.511103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.511112] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.511126] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3647 [D 20:42:42.511136] element 0: offset: 0x632940, size: 24 [D 20:42:42.511145] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 42/70. [D 20:42:42.551949] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3637 [D 20:42:42.551967] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 43/70. [D 20:42:42.552034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 12998. [D 20:42:42.552135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 12999. [D 20:42:42.552148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 13000. [D 20:42:42.552160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 13001. [D 20:42:42.552170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 13002. [D 20:42:42.552181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 13003. [D 20:42:42.552192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 13004. [D 20:42:42.552202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13005. [D 20:42:42.552212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13006. [D 20:42:42.552222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13007. [D 20:42:42.552232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 13008. [D 20:42:42.552242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 13009. [D 20:42:42.552286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 13010. [D 20:42:42.552299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 13011. [D 20:42:42.552309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 13012. [D 20:42:42.552320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 13013. [D 20:42:42.552346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 13014. [D 20:42:42.552360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 13015. [D 20:42:42.552370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 13016. [D 20:42:42.552380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 13017. [D 20:42:42.552408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 13018. [D 20:42:42.552419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 13019. [D 20:42:42.552432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 13020. [D 20:42:42.552442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 13021. [D 20:42:42.552452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 13022. [D 20:42:42.552476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 13023. [D 20:42:42.552486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 13024. [D 20:42:42.552501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 13025. [D 20:42:42.552511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 13026. [D 20:42:42.552520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 13027. [D 20:42:42.552544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 13028. [D 20:42:42.552554] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 13029. [D 20:42:42.557991] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 13029. [D 20:42:42.558007] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 44/70. [D 20:42:42.560152] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.560167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.560178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.565652] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.565668] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.565679] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.565712] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3649 [D 20:42:42.565723] element 0: offset: 0x61f800, size: 24 [D 20:42:42.565738] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 45/70. [D 20:42:42.621228] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3644 [D 20:42:42.621246] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 46/70. [D 20:42:42.621307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 13029. [D 20:42:42.621378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 13030. [D 20:42:42.621398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 13031. [D 20:42:42.621409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 13032. [D 20:42:42.621420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 13033. [D 20:42:42.621429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 13034. [D 20:42:42.621444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 13035. [D 20:42:42.621454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 13036. [D 20:42:42.621463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 13037. [D 20:42:42.621479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 13038. [D 20:42:42.621529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 13039. [D 20:42:42.621540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 13040. [D 20:42:42.621567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 13041. [D 20:42:42.621580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 13042. [D 20:42:42.621589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 13043. [D 20:42:42.621599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 13044. [D 20:42:42.621625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 13045. [D 20:42:42.621635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 13046. [D 20:42:42.621648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 13047. [D 20:42:42.621658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 13048. [D 20:42:42.621668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 13049. [D 20:42:42.621681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 13050. [D 20:42:42.621705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 13051. [D 20:42:42.621717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 13052. [D 20:42:42.621726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 13053. [D 20:42:42.621736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 13054. [D 20:42:42.621763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 13055. [D 20:42:42.621773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 13056. [D 20:42:42.621785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 13057. [D 20:42:42.621795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 13058. [D 20:42:42.621807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 13059. [D 20:42:42.621832] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 13060. [D 20:42:42.627235] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 13060. [D 20:42:42.627252] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 47/70. [D 20:42:42.629334] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.629349] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.629359] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.635492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.635506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.635516] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.635550] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3653 [D 20:42:42.635561] element 0: offset: 0x64dd40, size: 24 [D 20:42:42.635573] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 48/70. [D 20:42:42.726792] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3653 [D 20:42:42.726812] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 49/70. [D 20:42:42.726942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 13060. [D 20:42:42.727018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 13061. [D 20:42:42.727029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 13062. [D 20:42:42.727039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 13063. [D 20:42:42.727054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 13064. [D 20:42:42.727064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 13065. [D 20:42:42.727074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 13066. [D 20:42:42.727087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 13067. [D 20:42:42.727097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 13068. [D 20:42:42.727107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 13069. [D 20:42:42.727162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 13070. [D 20:42:42.727173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 13071. [D 20:42:42.727183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 13072. [D 20:42:42.727207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 13073. [D 20:42:42.727217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 13074. [D 20:42:42.727233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 13075. [D 20:42:42.727244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 13076. [D 20:42:42.727254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 13077. [D 20:42:42.727278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 13078. [D 20:42:42.727289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 13079. [D 20:42:42.727299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 13080. [D 20:42:42.727309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 13081. [D 20:42:42.727319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 13082. [D 20:42:42.727348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 13083. [D 20:42:42.727359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 13084. [D 20:42:42.727374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 13085. [D 20:42:42.727385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 13086. [D 20:42:42.727395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 13087. [D 20:42:42.727418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 13088. [D 20:42:42.727429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 13089. [D 20:42:42.727438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 13090. [D 20:42:42.727452] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 13091. [D 20:42:42.732953] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 13091. [D 20:42:42.732971] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 50/70. [D 20:42:42.735282] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.735297] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.735307] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.741504] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.741518] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.741529] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.741562] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3656 [D 20:42:42.741573] element 0: offset: 0x63e8c0, size: 24 [D 20:42:42.741585] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 51/70. [D 20:42:42.755555] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3649 [D 20:42:42.755574] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 52/70. [D 20:42:42.755641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 13091. [D 20:42:42.755753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 13092. [D 20:42:42.755767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 13093. [D 20:42:42.755778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 13094. [D 20:42:42.755789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 13095. [D 20:42:42.755799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 13096. [D 20:42:42.755809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 13097. [D 20:42:42.755819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13098. [D 20:42:42.755829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13099. [D 20:42:42.755844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13100. [D 20:42:42.755854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 13101. [D 20:42:42.755864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 13102. [D 20:42:42.755874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 13103. [D 20:42:42.755884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 13104. [D 20:42:42.755894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 13105. [D 20:42:42.755904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 13106. [D 20:42:42.755914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 13107. [D 20:42:42.755924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 13108. [D 20:42:42.755934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 13109. [D 20:42:42.755984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 13110. [D 20:42:42.755997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 13111. [D 20:42:42.756010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 13112. [D 20:42:42.756020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 13113. [D 20:42:42.756030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 13114. [D 20:42:42.756061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 13115. [D 20:42:42.756073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 13116. [D 20:42:42.756083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 13117. [D 20:42:42.756093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 13118. [D 20:42:42.756103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 13119. [D 20:42:42.756113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 13120. [D 20:42:42.756123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 13121. [D 20:42:42.756147] openib_post_sr_rdmaw: ibv_post_send wr_id 62afd0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 13122. [D 20:42:42.761608] openib_check_cq: completed rdma wr_id 62afd0, nic_wr_credit 13122. [D 20:42:42.761626] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 53/70. [D 20:42:42.763761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.763776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.763786] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.769488] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.769502] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.769513] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:42.769546] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3658 [D 20:42:42.769557] element 0: offset: 0x63e390, size: 24 [D 20:42:42.769570] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 54/70. [D 20:42:42.825456] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3656 [D 20:42:42.825478] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 55/70. [D 20:42:42.825540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 13122. [D 20:42:42.825609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 13123. [D 20:42:42.825629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 13124. [D 20:42:42.825642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 13125. [D 20:42:42.825653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 13126. [D 20:42:42.825669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 13127. [D 20:42:42.825680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 13128. [D 20:42:42.825689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 13129. [D 20:42:42.825700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 13130. [D 20:42:42.825710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 13131. [D 20:42:42.825765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 13132. [D 20:42:42.825776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 13133. [D 20:42:42.825802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 13134. [D 20:42:42.825812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 13135. [D 20:42:42.825822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 13136. [D 20:42:42.825836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 13137. [D 20:42:42.825846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 13138. [D 20:42:42.825855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 13139. [D 20:42:42.825881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 13140. [D 20:42:42.825892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 13141. [D 20:42:42.825902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 13142. [D 20:42:42.825912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 13143. [D 20:42:42.825922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 13144. [D 20:42:42.825932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 13145. [D 20:42:42.825957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 13146. [D 20:42:42.825967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 13147. [D 20:42:42.825977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 13148. [D 20:42:42.825987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 13149. [D 20:42:42.825999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 13150. [D 20:42:42.826029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 13151. [D 20:42:42.826038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 13152. [D 20:42:42.826053] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 13153. [D 20:42:42.831466] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 13153. [D 20:42:42.831483] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 56/70. [D 20:42:42.832608] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.832624] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.832633] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:42.865575] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3641 [D 20:42:42.865594] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 57/70. [D 20:42:42.865661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 13153. [D 20:42:42.865738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 13154. [D 20:42:42.865749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 13155. [D 20:42:42.865759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 13156. [D 20:42:42.865770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 13157. [D 20:42:42.865780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 13158. [D 20:42:42.865789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 13159. [D 20:42:42.865800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 13160. [D 20:42:42.865811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 13161. [D 20:42:42.865821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 13162. [D 20:42:42.865831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 13163. [D 20:42:42.865864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 13164. [D 20:42:42.865873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 13165. [D 20:42:42.865883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 13166. [D 20:42:42.865893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 13167. [D 20:42:42.865903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 13168. [D 20:42:42.865950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 13169. [D 20:42:42.865966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 13170. [D 20:42:42.865977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 13171. [D 20:42:42.865986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 13172. [D 20:42:42.866016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 13173. [D 20:42:42.866032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 13174. [D 20:42:42.866042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 13175. [D 20:42:42.866052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 13176. [D 20:42:42.866062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 13177. [D 20:42:42.866088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 13178. [D 20:42:42.866098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 13179. [D 20:42:42.866109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 13180. [D 20:42:42.866119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 13181. [D 20:42:42.866129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 13182. [D 20:42:42.866139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 13183. [D 20:42:42.866149] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 13184. [D 20:42:42.871597] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 13184. [D 20:42:42.871614] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 58/70. [D 20:42:42.873908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.873923] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.873933] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:42.933128] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3658 [D 20:42:42.933148] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 59/70. [D 20:42:42.933217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 13184. [D 20:42:42.933320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 13185. [D 20:42:42.933334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 13186. [D 20:42:42.933345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 13187. [D 20:42:42.933356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 13188. [D 20:42:42.933367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 13189. [D 20:42:42.933377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 13190. [D 20:42:42.933407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13191. [D 20:42:42.933416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13192. [D 20:42:42.933426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13193. [D 20:42:42.933441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 13194. [D 20:42:42.933464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 13195. [D 20:42:42.933476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 13196. [D 20:42:42.933504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 13197. [D 20:42:42.933523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 13198. [D 20:42:42.933538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 13199. [D 20:42:42.933549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 13200. [D 20:42:42.933559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 13201. [D 20:42:42.933569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 13202. [D 20:42:42.933579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 13203. [D 20:42:42.933590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 13204. [D 20:42:42.933600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 13205. [D 20:42:42.933625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 13206. [D 20:42:42.933635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 13207. [D 20:42:42.933645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 13208. [D 20:42:42.933655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 13209. [D 20:42:42.933680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 13210. [D 20:42:42.933690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 13211. [D 20:42:42.933705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 13212. [D 20:42:42.933727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 13213. [D 20:42:42.933737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 13214. [D 20:42:42.933747] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 13215. [D 20:42:42.939178] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 13215. [D 20:42:42.939194] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 60/70. [D 20:42:42.941539] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.941554] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.941566] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:42.947429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.947449] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.947460] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:42.947494] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3661 [D 20:42:42.947505] element 0: offset: 0x63c4f0, size: 24 [D 20:42:42.947519] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 0/70. [D 20:42:42.967178] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.967244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.967254] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:42.967292] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3665 [D 20:42:42.967306] element 0: offset: 0x61f800, size: 24 [D 20:42:42.967320] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 1/70. [D 20:42:42.972052] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3647 [D 20:42:42.972072] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 2/70. [D 20:42:42.972210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 13215. [D 20:42:42.972262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 13216. [D 20:42:42.972272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 13217. [D 20:42:42.972283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 13218. [D 20:42:42.972294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 13219. [D 20:42:42.972305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 13220. [D 20:42:42.972314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 13221. [D 20:42:42.972325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 13222. [D 20:42:42.972334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 13223. [D 20:42:42.972344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 13224. [D 20:42:42.972354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 13225. [D 20:42:42.972371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 13226. [D 20:42:42.972381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 13227. [D 20:42:42.972391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 13228. [D 20:42:42.972401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 13229. [D 20:42:42.972412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 13230. [D 20:42:42.972422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 13231. [D 20:42:42.972431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 13232. [D 20:42:42.972476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 13233. [D 20:42:42.972486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 13234. [D 20:42:42.972496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 13235. [D 20:42:42.972523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 13236. [D 20:42:42.972533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 13237. [D 20:42:42.972547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 13238. [D 20:42:42.972557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 13239. [D 20:42:42.972567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 13240. [D 20:42:42.972603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 13241. [D 20:42:42.972613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 13242. [D 20:42:42.972629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 13243. [D 20:42:42.972640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 13244. [D 20:42:42.972650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 13245. [D 20:42:42.972664] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 13246. [D 20:42:42.980574] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 13246. [D 20:42:42.980592] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 3/70. [D 20:42:42.982850] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:42.982865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.982875] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:42.988985] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:42.989002] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:42.989013] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:42.989045] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3668 [D 20:42:42.989056] element 0: offset: 0x61f310, size: 24 [D 20:42:42.989068] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 4/70. [D 20:42:43.012621] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.012687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.012697] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.012735] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3671 [D 20:42:43.012749] element 0: offset: 0x64dd40, size: 24 [D 20:42:43.012763] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 5/70. [D 20:42:43.052851] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3665 [D 20:42:43.052870] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 6/70. [D 20:42:43.052927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 13246. [D 20:42:43.053001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 13247. [D 20:42:43.053022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 13248. [D 20:42:43.053035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 13249. [D 20:42:43.053045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 13250. [D 20:42:43.053055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 13251. [D 20:42:43.053068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 13252. [D 20:42:43.053084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 13253. [D 20:42:43.053094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 13254. [D 20:42:43.053104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 13255. [D 20:42:43.053158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 13256. [D 20:42:43.053168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 13257. [D 20:42:43.053178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 13258. [D 20:42:43.053189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 13259. [D 20:42:43.053199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 13260. [D 20:42:43.053223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 13261. [D 20:42:43.053234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 13262. [D 20:42:43.053243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 13263. [D 20:42:43.053266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 13264. [D 20:42:43.053276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 13265. [D 20:42:43.053286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 13266. [D 20:42:43.053315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 13267. [D 20:42:43.053326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 13268. [D 20:42:43.053350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 13269. [D 20:42:43.053361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 13270. [D 20:42:43.053372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 13271. [D 20:42:43.053382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 13272. [D 20:42:43.053409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 13273. [D 20:42:43.053419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 13274. [D 20:42:43.053433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 13275. [D 20:42:43.053458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 13276. [D 20:42:43.053470] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 13277. [D 20:42:43.058858] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 13277. [D 20:42:43.058874] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 7/70. [D 20:42:43.061197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.061212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.061223] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.066942] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.066957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.066968] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.067002] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3674 [D 20:42:43.067013] element 0: offset: 0x5b0030, size: 24 [D 20:42:43.067025] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 8/70. [D 20:42:43.111038] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3668 [D 20:42:43.111056] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 9/70. [D 20:42:43.111115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13277. [D 20:42:43.111183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 13278. [D 20:42:43.111194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 13279. [D 20:42:43.111205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 13280. [D 20:42:43.111215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 13281. [D 20:42:43.111231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 13282. [D 20:42:43.111241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 13283. [D 20:42:43.111250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 13284. [D 20:42:43.111266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 13285. [D 20:42:43.111276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 13286. [D 20:42:43.111286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 13287. [D 20:42:43.111326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 13288. [D 20:42:43.111339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 13289. [D 20:42:43.111377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 13290. [D 20:42:43.111399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 13291. [D 20:42:43.111414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 13292. [D 20:42:43.111424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 13293. [D 20:42:43.111451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 13294. [D 20:42:43.111461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 13295. [D 20:42:43.111485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 13296. [D 20:42:43.111496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 13297. [D 20:42:43.111505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 13298. [D 20:42:43.111516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 13299. [D 20:42:43.111526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 13300. [D 20:42:43.111546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 13301. [D 20:42:43.111556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 13302. [D 20:42:43.111567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 13303. [D 20:42:43.111577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 13304. [D 20:42:43.111603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 13305. [D 20:42:43.111613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 13306. [D 20:42:43.111623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 13307. [D 20:42:43.111639] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 13308. [D 20:42:43.117037] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 13308. [D 20:42:43.117053] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 10/70. [D 20:42:43.119343] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.119357] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.119367] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.124403] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.124417] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.124427] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.124460] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3677 [D 20:42:43.124471] element 0: offset: 0x632940, size: 24 [D 20:42:43.124482] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 11/70. [D 20:42:43.189161] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3674 [D 20:42:43.189180] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 12/70. [D 20:42:43.189239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 13308. [D 20:42:43.189310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 13309. [D 20:42:43.189365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 13310. [D 20:42:43.189377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 13311. [D 20:42:43.189387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 13312. [D 20:42:43.189398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 13313. [D 20:42:43.189408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 13314. [D 20:42:43.189428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 13315. [D 20:42:43.189445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 13316. [D 20:42:43.189454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 13317. [D 20:42:43.189464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 13318. [D 20:42:43.189493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 13319. [D 20:42:43.189504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 13320. [D 20:42:43.189518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 13321. [D 20:42:43.189544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 13322. [D 20:42:43.189569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 13323. [D 20:42:43.189580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 13324. [D 20:42:43.189591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 13325. [D 20:42:43.189601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 13326. [D 20:42:43.189611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 13327. [D 20:42:43.189622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 13328. [D 20:42:43.189631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 13329. [D 20:42:43.189654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 13330. [D 20:42:43.189670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 13331. [D 20:42:43.189693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 13332. [D 20:42:43.189706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 13333. [D 20:42:43.189728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 13334. [D 20:42:43.189742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 13335. [D 20:42:43.189763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 13336. [D 20:42:43.189777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 13337. [D 20:42:43.189787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 13338. [D 20:42:43.189797] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 13339. [D 20:42:43.195220] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 13339. [D 20:42:43.195238] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 13/70. [D 20:42:43.197534] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.197550] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.197561] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.203379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.203393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.203403] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.203436] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3680 [D 20:42:43.203446] element 0: offset: 0x61f800, size: 24 [D 20:42:43.203458] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 14/70. [D 20:42:43.285038] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3677 [D 20:42:43.285057] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 15/70. [D 20:42:43.285168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13339. [D 20:42:43.285246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 13340. [D 20:42:43.285257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 13341. [D 20:42:43.285267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 13342. [D 20:42:43.285281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 13343. [D 20:42:43.285291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 13344. [D 20:42:43.285301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 13345. [D 20:42:43.285315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 13346. [D 20:42:43.285325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 13347. [D 20:42:43.285335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 13348. [D 20:42:43.285350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 13349. [D 20:42:43.285360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 13350. [D 20:42:43.285370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 13351. [D 20:42:43.285386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 13352. [D 20:42:43.285395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 13353. [D 20:42:43.285405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 13354. [D 20:42:43.285421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 13355. [D 20:42:43.285431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 13356. [D 20:42:43.285441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 13357. [D 20:42:43.285450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 13358. [D 20:42:43.285461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 13359. [D 20:42:43.285471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 13360. [D 20:42:43.285481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 13361. [D 20:42:43.285536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 13362. [D 20:42:43.285547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 13363. [D 20:42:43.285557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 13364. [D 20:42:43.285567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 13365. [D 20:42:43.285578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 13366. [D 20:42:43.285599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 13367. [D 20:42:43.285613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 13368. [D 20:42:43.285623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 13369. [D 20:42:43.285633] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 13370. [D 20:42:43.291189] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 13370. [D 20:42:43.291207] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 16/70. [D 20:42:43.293554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.293569] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.293581] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.296632] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.296649] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.296658] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.296686] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3683 [D 20:42:43.296697] element 0: offset: 0x61f310, size: 24 [D 20:42:43.296707] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 17/70. [D 20:42:43.324800] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3661 [D 20:42:43.324817] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 18/70. [D 20:42:43.324877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 13370. [D 20:42:43.324946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 13371. [D 20:42:43.325004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 13372. [D 20:42:43.325015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 13373. [D 20:42:43.325026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 13374. [D 20:42:43.325045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 13375. [D 20:42:43.325055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 13376. [D 20:42:43.325065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 13377. [D 20:42:43.325082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 13378. [D 20:42:43.325092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 13379. [D 20:42:43.325102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 13380. [D 20:42:43.325118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 13381. [D 20:42:43.325128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 13382. [D 20:42:43.325138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 13383. [D 20:42:43.325148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 13384. [D 20:42:43.325158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 13385. [D 20:42:43.325169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 13386. [D 20:42:43.325179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 13387. [D 20:42:43.325201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 13388. [D 20:42:43.325210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 13389. [D 20:42:43.325220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 13390. [D 20:42:43.325230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 13391. [D 20:42:43.325247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 13392. [D 20:42:43.325257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 13393. [D 20:42:43.325267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 13394. [D 20:42:43.325286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 13395. [D 20:42:43.325298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 13396. [D 20:42:43.325307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 13397. [D 20:42:43.325317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 13398. [D 20:42:43.325335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 13399. [D 20:42:43.325345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 13400. [D 20:42:43.325370] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 13401. [D 20:42:43.330802] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 13401. [D 20:42:43.330818] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 19/70. [D 20:42:43.330889] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.330904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.330913] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.336710] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.336724] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.336732] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.336749] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3685 [D 20:42:43.336758] element 0: offset: 0x5b0030, size: 24 [D 20:42:43.336768] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 20/70. [D 20:42:43.358927] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3680 [D 20:42:43.358943] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 21/70. [D 20:42:43.359002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 13401. [D 20:42:43.359070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 13402. [D 20:42:43.359089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 13403. [D 20:42:43.359100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 13404. [D 20:42:43.359110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 13405. [D 20:42:43.359120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 13406. [D 20:42:43.359135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 13407. [D 20:42:43.359145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 13408. [D 20:42:43.359154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 13409. [D 20:42:43.359170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 13410. [D 20:42:43.359215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 13411. [D 20:42:43.359225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 13412. [D 20:42:43.359237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 13413. [D 20:42:43.359266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 13414. [D 20:42:43.359276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 13415. [D 20:42:43.359286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 13416. [D 20:42:43.359300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 13417. [D 20:42:43.359310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 13418. [D 20:42:43.359319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 13419. [D 20:42:43.359349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 13420. [D 20:42:43.359359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 13421. [D 20:42:43.359382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 13422. [D 20:42:43.359394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 13423. [D 20:42:43.359404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 13424. [D 20:42:43.359414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 13425. [D 20:42:43.359425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 13426. [D 20:42:43.359436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 13427. [D 20:42:43.359461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 13428. [D 20:42:43.359472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 13429. [D 20:42:43.359482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 13430. [D 20:42:43.359492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 13431. [D 20:42:43.359502] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 13432. [D 20:42:43.364926] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 13432. [D 20:42:43.364944] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 22/70. [D 20:42:43.365010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.365024] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.365033] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.370841] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.370855] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.370863] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.370879] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3689 [D 20:42:43.370889] element 0: offset: 0x632940, size: 24 [D 20:42:43.370899] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 23/70. [D 20:42:43.420343] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3683 [D 20:42:43.420360] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 24/70. [D 20:42:43.420423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13432. [D 20:42:43.420500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 13433. [D 20:42:43.420511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 13434. [D 20:42:43.420522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 13435. [D 20:42:43.420533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 13436. [D 20:42:43.420543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 13437. [D 20:42:43.420557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 13438. [D 20:42:43.420567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 13439. [D 20:42:43.420577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 13440. [D 20:42:43.420593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 13441. [D 20:42:43.420647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 13442. [D 20:42:43.420658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 13443. [D 20:42:43.420668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 13444. [D 20:42:43.420692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 13445. [D 20:42:43.420702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 13446. [D 20:42:43.420712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 13447. [D 20:42:43.420722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 13448. [D 20:42:43.420732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 13449. [D 20:42:43.420742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 13450. [D 20:42:43.420763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 13451. [D 20:42:43.420774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 13452. [D 20:42:43.420783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 13453. [D 20:42:43.420793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 13454. [D 20:42:43.420803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 13455. [D 20:42:43.420833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 13456. [D 20:42:43.420844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 13457. [D 20:42:43.420857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 13458. [D 20:42:43.420867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 13459. [D 20:42:43.420880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 13460. [D 20:42:43.420906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 13461. [D 20:42:43.420916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 13462. [D 20:42:43.420927] openib_post_sr_rdmaw: ibv_post_send wr_id 62a880 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 13463. [D 20:42:43.426439] openib_check_cq: completed rdma wr_id 62a880, nic_wr_credit 13463. [D 20:42:43.426457] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 25/70. [D 20:42:43.426522] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.426536] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.426545] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.431708] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.431722] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.431731] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.431746] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3692 [D 20:42:43.431756] element 0: offset: 0x63c4f0, size: 24 [D 20:42:43.431766] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 26/70. [D 20:42:43.502811] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3685 [D 20:42:43.502827] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 27/70. [D 20:42:43.502929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 13463. [D 20:42:43.503033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 13464. [D 20:42:43.503044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 13465. [D 20:42:43.503055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 13466. [D 20:42:43.503069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 13467. [D 20:42:43.503079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 13468. [D 20:42:43.503089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 13469. [D 20:42:43.503103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 13470. [D 20:42:43.503113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 13471. [D 20:42:43.503123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 13472. [D 20:42:43.503154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 13473. [D 20:42:43.503169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 13474. [D 20:42:43.503193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 13475. [D 20:42:43.503207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 13476. [D 20:42:43.503228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 13477. [D 20:42:43.503239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 13478. [D 20:42:43.503249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 13479. [D 20:42:43.503271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 13480. [D 20:42:43.503286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 13481. [D 20:42:43.503296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 13482. [D 20:42:43.503306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 13483. [D 20:42:43.503328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 13484. [D 20:42:43.503338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 13485. [D 20:42:43.503348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 13486. [D 20:42:43.503377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 13487. [D 20:42:43.503388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 13488. [D 20:42:43.503412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 13489. [D 20:42:43.503427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 13490. [D 20:42:43.503437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 13491. [D 20:42:43.503460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 13492. [D 20:42:43.503470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 13493. [D 20:42:43.503480] openib_post_sr_rdmaw: ibv_post_send wr_id 66e7c0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 13494. [D 20:42:43.508892] openib_check_cq: completed rdma wr_id 66e7c0, nic_wr_credit 13494. [D 20:42:43.508909] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 28/70. [D 20:42:43.508976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.508991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.508999] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.514758] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.514772] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.514781] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.514797] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3694 [D 20:42:43.514806] element 0: offset: 0x61f800, size: 24 [D 20:42:43.514816] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 29/70. [D 20:42:43.601531] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3692 [D 20:42:43.601548] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 30/70. [D 20:42:43.601673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13494. [D 20:42:43.601777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 13495. [D 20:42:43.601788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 13496. [D 20:42:43.601799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 13497. [D 20:42:43.601813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 13498. [D 20:42:43.601823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 13499. [D 20:42:43.601833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 13500. [D 20:42:43.601847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 13501. [D 20:42:43.601857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 13502. [D 20:42:43.601867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 13503. [D 20:42:43.601901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 13504. [D 20:42:43.601912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 13505. [D 20:42:43.601937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 13506. [D 20:42:43.601951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 13507. [D 20:42:43.601971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 13508. [D 20:42:43.601981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 13509. [D 20:42:43.601992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 13510. [D 20:42:43.602001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 13511. [D 20:42:43.602025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 13512. [D 20:42:43.602034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 13513. [D 20:42:43.602044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 13514. [D 20:42:43.602069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 13515. [D 20:42:43.602091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 13516. [D 20:42:43.602102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 13517. [D 20:42:43.602113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 13518. [D 20:42:43.602134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 13519. [D 20:42:43.602144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 13520. [D 20:42:43.602163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 13521. [D 20:42:43.602179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 13522. [D 20:42:43.602189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 13523. [D 20:42:43.602209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 13524. [D 20:42:43.602219] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 13525. [D 20:42:43.607707] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 13525. [D 20:42:43.607725] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 31/70. [D 20:42:43.607791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.607805] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.607814] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.613073] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.613087] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.613095] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.613112] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3698 [D 20:42:43.613121] element 0: offset: 0x61f310, size: 24 [D 20:42:43.613133] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 32/70. [D 20:42:43.661717] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3671 [D 20:42:43.661734] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 33/70. [D 20:42:43.661791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 13525. [D 20:42:43.661857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 13526. [D 20:42:43.661876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 13527. [D 20:42:43.661886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 13528. [D 20:42:43.661898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 13529. [D 20:42:43.661908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 13530. [D 20:42:43.661924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 13531. [D 20:42:43.661934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 13532. [D 20:42:43.661943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 13533. [D 20:42:43.661959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 13534. [D 20:42:43.662008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 13535. [D 20:42:43.662021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 13536. [D 20:42:43.662031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 13537. [D 20:42:43.662041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 13538. [D 20:42:43.662057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 13539. [D 20:42:43.662067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 13540. [D 20:42:43.662077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 13541. [D 20:42:43.662086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 13542. [D 20:42:43.662103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 13543. [D 20:42:43.662125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 13544. [D 20:42:43.662136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 13545. [D 20:42:43.662146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 13546. [D 20:42:43.662155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 13547. [D 20:42:43.662170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 13548. [D 20:42:43.662180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 13549. [D 20:42:43.662190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 13550. [D 20:42:43.662200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 13551. [D 20:42:43.662216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 13552. [D 20:42:43.662226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 13553. [D 20:42:43.662236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 13554. [D 20:42:43.662272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 13555. [D 20:42:43.662296] openib_post_sr_rdmaw: ibv_post_send wr_id 66e7c0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 13556. [D 20:42:43.667716] openib_check_cq: completed rdma wr_id 66e7c0, nic_wr_credit 13556. [D 20:42:43.667734] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 34/70. [D 20:42:43.667800] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.667815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.667823] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.673757] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.673771] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.673780] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.673795] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3701 [D 20:42:43.673805] element 0: offset: 0x63e490, size: 24 [D 20:42:43.673816] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 35/70. [D 20:42:43.799304] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3689 [D 20:42:43.799323] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 36/70. [D 20:42:43.799427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 13556. [D 20:42:43.799505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 13557. [D 20:42:43.799515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 13558. [D 20:42:43.799526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 13559. [D 20:42:43.799540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 13560. [D 20:42:43.799550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 13561. [D 20:42:43.799560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 13562. [D 20:42:43.799575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 13563. [D 20:42:43.799584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 13564. [D 20:42:43.799594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 13565. [D 20:42:43.799609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 13566. [D 20:42:43.799619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 13567. [D 20:42:43.799629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 13568. [D 20:42:43.799638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 13569. [D 20:42:43.799648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 13570. [D 20:42:43.799660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 13571. [D 20:42:43.799670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 13572. [D 20:42:43.799680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 13573. [D 20:42:43.799690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 13574. [D 20:42:43.799709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 13575. [D 20:42:43.799719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 13576. [D 20:42:43.799728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 13577. [D 20:42:43.799738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 13578. [D 20:42:43.799756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 13579. [D 20:42:43.799765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 13580. [D 20:42:43.799818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 13581. [D 20:42:43.799830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 13582. [D 20:42:43.799840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 13583. [D 20:42:43.799850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 13584. [D 20:42:43.799859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 13585. [D 20:42:43.799884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 13586. [D 20:42:43.799894] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 13587. [D 20:42:43.805365] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 13587. [D 20:42:43.805383] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 37/70. [D 20:42:43.805452] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.805467] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.805475] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.811208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.811221] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.811230] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.811247] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3704 [D 20:42:43.811257] element 0: offset: 0x63c4f0, size: 24 [D 20:42:43.811267] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 38/70. [D 20:42:43.862259] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3698 [D 20:42:43.862275] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 39/70. [D 20:42:43.862339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13587. [D 20:42:43.862405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 13588. [D 20:42:43.862454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 13589. [D 20:42:43.862465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 13590. [D 20:42:43.862475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 13591. [D 20:42:43.862486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 13592. [D 20:42:43.862496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 13593. [D 20:42:43.862505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 13594. [D 20:42:43.862529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 13595. [D 20:42:43.862540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 13596. [D 20:42:43.862550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 13597. [D 20:42:43.862560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 13598. [D 20:42:43.862583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 13599. [D 20:42:43.862592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 13600. [D 20:42:43.862602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 13601. [D 20:42:43.862612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 13602. [D 20:42:43.862629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 13603. [D 20:42:43.862639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 13604. [D 20:42:43.862663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 13605. [D 20:42:43.862673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 13606. [D 20:42:43.862683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 13607. [D 20:42:43.862693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 13608. [D 20:42:43.862716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 13609. [D 20:42:43.862732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 13610. [D 20:42:43.862743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 13611. [D 20:42:43.862752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 13612. [D 20:42:43.862762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 13613. [D 20:42:43.862781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 13614. [D 20:42:43.862791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 13615. [D 20:42:43.862800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 13616. [D 20:42:43.862811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 13617. [D 20:42:43.862834] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 13618. [D 20:42:43.868260] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 13618. [D 20:42:43.868278] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 40/70. [D 20:42:43.868343] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.868357] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.868366] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.873758] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.873772] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.873781] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:43.873797] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3707 [D 20:42:43.873806] element 0: offset: 0x691fe0, size: 24 [D 20:42:43.873816] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 41/70. [D 20:42:43.890874] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3694 [D 20:42:43.890891] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 42/70. [D 20:42:43.890948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 13618. [D 20:42:43.891015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 13619. [D 20:42:43.891062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 13620. [D 20:42:43.891073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 13621. [D 20:42:43.891084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 13622. [D 20:42:43.891094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 13623. [D 20:42:43.891104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 13624. [D 20:42:43.891114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 13625. [D 20:42:43.891138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 13626. [D 20:42:43.891147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 13627. [D 20:42:43.891157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 13628. [D 20:42:43.891185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 13629. [D 20:42:43.891196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 13630. [D 20:42:43.891209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 13631. [D 20:42:43.891236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 13632. [D 20:42:43.891247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 13633. [D 20:42:43.891256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 13634. [D 20:42:43.891266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 13635. [D 20:42:43.891283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 13636. [D 20:42:43.891307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 13637. [D 20:42:43.891318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 13638. [D 20:42:43.891329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 13639. [D 20:42:43.891348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 13640. [D 20:42:43.891361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 13641. [D 20:42:43.891382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 13642. [D 20:42:43.891397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 13643. [D 20:42:43.891407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 13644. [D 20:42:43.891416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 13645. [D 20:42:43.891439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 13646. [D 20:42:43.891449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 13647. [D 20:42:43.891463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 13648. [D 20:42:43.891474] openib_post_sr_rdmaw: ibv_post_send wr_id 66e7c0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 13649. [D 20:42:43.896870] openib_check_cq: completed rdma wr_id 66e7c0, nic_wr_credit 13649. [D 20:42:43.896886] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 43/70. [D 20:42:43.896951] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.896965] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.896974] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:43.906955] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3701 [D 20:42:43.906972] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 44/70. [D 20:42:43.907032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 13649. [D 20:42:43.907094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 13650. [D 20:42:43.907144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 13651. [D 20:42:43.907156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 13652. [D 20:42:43.907166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 13653. [D 20:42:43.907177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 13654. [D 20:42:43.907186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 13655. [D 20:42:43.907196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 13656. [D 20:42:43.907220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 13657. [D 20:42:43.907230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 13658. [D 20:42:43.907240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 13659. [D 20:42:43.907267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 13660. [D 20:42:43.907278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 13661. [D 20:42:43.907291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 13662. [D 20:42:43.907313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 13663. [D 20:42:43.907324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 13664. [D 20:42:43.907344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 13665. [D 20:42:43.907354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 13666. [D 20:42:43.907365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 13667. [D 20:42:43.907388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 13668. [D 20:42:43.907403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 13669. [D 20:42:43.907413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 13670. [D 20:42:43.907423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 13671. [D 20:42:43.907432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 13672. [D 20:42:43.907443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 13673. [D 20:42:43.907452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 13674. [D 20:42:43.907474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 13675. [D 20:42:43.907485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 13676. [D 20:42:43.907506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 13677. [D 20:42:43.907515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 13678. [D 20:42:43.907542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 13679. [D 20:42:43.907553] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 13680. [D 20:42:43.912960] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 13680. [D 20:42:43.912977] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 45/70. [D 20:42:43.913040] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.913055] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.913064] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:43.919185] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.919199] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.919207] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:43.919223] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3710 [D 20:42:43.919232] element 0: offset: 0x64dd40, size: 24 [D 20:42:43.919242] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 46/70. [D 20:42:43.965638] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3704 [D 20:42:43.965654] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 47/70. [D 20:42:43.965713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 13680. [D 20:42:43.965784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 13681. [D 20:42:43.965842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 13682. [D 20:42:43.965853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 13683. [D 20:42:43.965863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 13684. [D 20:42:43.965878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 13685. [D 20:42:43.965900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 13686. [D 20:42:43.965911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 13687. [D 20:42:43.965922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 13688. [D 20:42:43.965932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 13689. [D 20:42:43.965942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 13690. [D 20:42:43.965952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 13691. [D 20:42:43.965974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 13692. [D 20:42:43.965989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 13693. [D 20:42:43.966010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 13694. [D 20:42:43.966020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 13695. [D 20:42:43.966042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 13696. [D 20:42:43.966053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 13697. [D 20:42:43.966063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 13698. [D 20:42:43.966083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 13699. [D 20:42:43.966097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 13700. [D 20:42:43.966107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 13701. [D 20:42:43.966133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 13702. [D 20:42:43.966143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 13703. [D 20:42:43.966152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 13704. [D 20:42:43.966177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 13705. [D 20:42:43.966197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 13706. [D 20:42:43.966208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 13707. [D 20:42:43.966218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 13708. [D 20:42:43.966242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 13709. [D 20:42:43.966252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 13710. [D 20:42:43.966262] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 13711. [D 20:42:43.971647] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 13711. [D 20:42:43.971663] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 48/70. [D 20:42:43.971727] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:43.971742] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.971750] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:43.977918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:43.977932] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:43.977940] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:43.977956] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3713 [D 20:42:43.977965] element 0: offset: 0x61f310, size: 24 [D 20:42:43.977975] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 49/70. [D 20:42:44.031028] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.031043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.031051] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.031067] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3715 [D 20:42:44.031077] element 0: offset: 0x655b90, size: 24 [D 20:42:44.031087] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 50/70. [D 20:42:44.035217] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3707 [D 20:42:44.035234] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 51/70. [D 20:42:44.035361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13711. [D 20:42:44.035472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 13712. [D 20:42:44.035483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 13713. [D 20:42:44.035494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 13714. [D 20:42:44.035508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 13715. [D 20:42:44.035518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 13716. [D 20:42:44.035527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 13717. [D 20:42:44.035542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 13718. [D 20:42:44.035551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 13719. [D 20:42:44.035561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 13720. [D 20:42:44.035577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 13721. [D 20:42:44.035586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 13722. [D 20:42:44.035596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 13723. [D 20:42:44.035612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 13724. [D 20:42:44.035635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 13725. [D 20:42:44.035645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 13726. [D 20:42:44.035655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 13727. [D 20:42:44.035665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 13728. [D 20:42:44.035675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 13729. [D 20:42:44.035700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 13730. [D 20:42:44.035710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 13731. [D 20:42:44.035720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 13732. [D 20:42:44.035730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 13733. [D 20:42:44.035745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 13734. [D 20:42:44.035772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 13735. [D 20:42:44.035782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 13736. [D 20:42:44.035792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 13737. [D 20:42:44.035807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 13738. [D 20:42:44.035829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 13739. [D 20:42:44.035839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 13740. [D 20:42:44.035849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 13741. [D 20:42:44.035859] openib_post_sr_rdmaw: ibv_post_send wr_id 653910 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 13742. [D 20:42:44.046546] openib_check_cq: completed rdma wr_id 653910, nic_wr_credit 13742. [D 20:42:44.046574] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 52/70. [D 20:42:44.046640] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.046654] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.046663] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.052243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.052257] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.052266] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.052282] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3719 [D 20:42:44.052291] element 0: offset: 0x5b0030, size: 24 [D 20:42:44.052301] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 53/70. [D 20:42:44.065580] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3715 [D 20:42:44.065596] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 54/70. [D 20:42:44.065659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 13742. [D 20:42:44.065770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 13743. [D 20:42:44.065784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 13744. [D 20:42:44.065795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 13745. [D 20:42:44.065805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 13746. [D 20:42:44.065816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 13747. [D 20:42:44.065827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 13748. [D 20:42:44.065837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 13749. [D 20:42:44.065846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 13750. [D 20:42:44.065862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 13751. [D 20:42:44.065872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 13752. [D 20:42:44.065882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 13753. [D 20:42:44.065892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 13754. [D 20:42:44.065912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 13755. [D 20:42:44.065922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 13756. [D 20:42:44.065932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 13757. [D 20:42:44.065942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 13758. [D 20:42:44.065952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 13759. [D 20:42:44.065962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 13760. [D 20:42:44.065988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 13761. [D 20:42:44.065998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 13762. [D 20:42:44.066008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 13763. [D 20:42:44.066018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 13764. [D 20:42:44.066029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 13765. [D 20:42:44.066039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 13766. [D 20:42:44.066049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 13767. [D 20:42:44.066075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 13768. [D 20:42:44.066085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 13769. [D 20:42:44.066096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 13770. [D 20:42:44.066106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 13771. [D 20:42:44.066115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 13772. [D 20:42:44.066125] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 13773. [D 20:42:44.071652] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 13773. [D 20:42:44.071715] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 55/70. [D 20:42:44.071774] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.071789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.071797] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.076755] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.076769] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.076777] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.076793] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3721 [D 20:42:44.076803] element 0: offset: 0x632940, size: 24 [D 20:42:44.076813] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 56/70. [D 20:42:44.118164] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3710 [D 20:42:44.118180] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 57/70. [D 20:42:44.118239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 13773. [D 20:42:44.118307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 13774. [D 20:42:44.118327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 13775. [D 20:42:44.118337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 13776. [D 20:42:44.118348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 13777. [D 20:42:44.118357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 13778. [D 20:42:44.118373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 13779. [D 20:42:44.118382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 13780. [D 20:42:44.118392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 13781. [D 20:42:44.118407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 13782. [D 20:42:44.118417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 13783. [D 20:42:44.118426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 13784. [D 20:42:44.118436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 13785. [D 20:42:44.118452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 13786. [D 20:42:44.118463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 13787. [D 20:42:44.118509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 13788. [D 20:42:44.118520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 13789. [D 20:42:44.118530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 13790. [D 20:42:44.118540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 13791. [D 20:42:44.118549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 13792. [D 20:42:44.118565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 13793. [D 20:42:44.118593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 13794. [D 20:42:44.118606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 13795. [D 20:42:44.118616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 13796. [D 20:42:44.118638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 13797. [D 20:42:44.118649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 13798. [D 20:42:44.118659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 13799. [D 20:42:44.118673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 13800. [D 20:42:44.118683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 13801. [D 20:42:44.118692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 13802. [D 20:42:44.118722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 13803. [D 20:42:44.118737] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 13804. [D 20:42:44.124163] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 13804. [D 20:42:44.124180] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 58/70. [D 20:42:44.124244] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.124258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.124267] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.130968] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.130982] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.130990] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.131007] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3725 [D 20:42:44.131016] element 0: offset: 0x61ee50, size: 24 [D 20:42:44.131028] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 59/70. [D 20:42:44.227995] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3713 [D 20:42:44.228011] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 60/70. [D 20:42:44.228135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 13804. [D 20:42:44.228240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 13805. [D 20:42:44.228252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 13806. [D 20:42:44.228262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 13807. [D 20:42:44.228273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 13808. [D 20:42:44.228283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 13809. [D 20:42:44.228292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 13810. [D 20:42:44.228303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 13811. [D 20:42:44.228312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 13812. [D 20:42:44.228322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 13813. [D 20:42:44.228332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 13814. [D 20:42:44.228363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 13815. [D 20:42:44.228373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 13816. [D 20:42:44.228386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 13817. [D 20:42:44.228396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 13818. [D 20:42:44.228406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 13819. [D 20:42:44.228415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 13820. [D 20:42:44.228445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 13821. [D 20:42:44.228455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 13822. [D 20:42:44.228470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 13823. [D 20:42:44.228480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 13824. [D 20:42:44.228489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 13825. [D 20:42:44.228513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 13826. [D 20:42:44.228523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 13827. [D 20:42:44.228533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 13828. [D 20:42:44.228548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 13829. [D 20:42:44.228558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 13830. [D 20:42:44.228583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 13831. [D 20:42:44.228593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 13832. [D 20:42:44.228603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 13833. [D 20:42:44.228614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 13834. [D 20:42:44.228624] openib_post_sr_rdmaw: ibv_post_send wr_id 63e850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 13835. [D 20:42:44.234093] openib_check_cq: completed rdma wr_id 63e850, nic_wr_credit 13835. [D 20:42:44.234109] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 0/70. [D 20:42:44.234175] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.234189] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.234198] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.240201] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.240214] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.240223] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.240240] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3728 [D 20:42:44.240249] element 0: offset: 0x61f800, size: 24 [D 20:42:44.240259] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 1/70. [D 20:42:44.343968] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3719 [D 20:42:44.343985] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 2/70. [D 20:42:44.344083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 13835. [D 20:42:44.344187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 13836. [D 20:42:44.344198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 13837. [D 20:42:44.344209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 13838. [D 20:42:44.344223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 13839. [D 20:42:44.344233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 13840. [D 20:42:44.344243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 13841. [D 20:42:44.344257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 13842. [D 20:42:44.344267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 13843. [D 20:42:44.344277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 13844. [D 20:42:44.344307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 13845. [D 20:42:44.344323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 13846. [D 20:42:44.344347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 13847. [D 20:42:44.344361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 13848. [D 20:42:44.344379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 13849. [D 20:42:44.344390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 13850. [D 20:42:44.344400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 13851. [D 20:42:44.344410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 13852. [D 20:42:44.344433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 13853. [D 20:42:44.344443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 13854. [D 20:42:44.344453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 13855. [D 20:42:44.344476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 13856. [D 20:42:44.344499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 13857. [D 20:42:44.344510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 13858. [D 20:42:44.344520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 13859. [D 20:42:44.344543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 13860. [D 20:42:44.344553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 13861. [D 20:42:44.344576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 13862. [D 20:42:44.344586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 13863. [D 20:42:44.344596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 13864. [D 20:42:44.344625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 13865. [D 20:42:44.344635] openib_post_sr_rdmaw: ibv_post_send wr_id 653910 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 13866. [D 20:42:44.350058] openib_check_cq: completed rdma wr_id 653910, nic_wr_credit 13866. [D 20:42:44.350116] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 3/70. [D 20:42:44.350179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.350194] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.350203] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.352454] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3725 [D 20:42:44.352471] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 4/70. [D 20:42:44.355340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 13866. [D 20:42:44.355359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 13867. [D 20:42:44.355371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 13868. [D 20:42:44.355396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 13869. [D 20:42:44.355407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 13870. [D 20:42:44.355417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 13871. [D 20:42:44.355431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 13872. [D 20:42:44.355441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 13873. [D 20:42:44.355450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 13874. [D 20:42:44.355466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 13875. [D 20:42:44.355490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 13876. [D 20:42:44.355502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 13877. [D 20:42:44.355511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 13878. [D 20:42:44.355521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 13879. [D 20:42:44.355531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 13880. [D 20:42:44.355541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 13881. [D 20:42:44.355565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 13882. [D 20:42:44.355575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 13883. [D 20:42:44.355602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 13884. [D 20:42:44.355612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 13885. [D 20:42:44.355635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 13886. [D 20:42:44.355646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 13887. [D 20:42:44.355658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 13888. [D 20:42:44.355668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 13889. [D 20:42:44.355677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 13890. [D 20:42:44.355691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 13891. [D 20:42:44.355713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 13892. [D 20:42:44.355726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 13893. [D 20:42:44.355735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 13894. [D 20:42:44.355745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 13895. [D 20:42:44.355770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 13896. [D 20:42:44.355780] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 13897. [D 20:42:44.361229] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 13897. [D 20:42:44.361247] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 5/70. [D 20:42:44.361294] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.361309] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.361318] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:44.370722] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.370736] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.370744] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:44.370761] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3731 [D 20:42:44.370770] element 0: offset: 0x63c4f0, size: 24 [D 20:42:44.370780] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 6/70. [D 20:42:44.432637] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3721 [D 20:42:44.432653] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 7/70. [D 20:42:44.432724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 13897. [D 20:42:44.432802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 13898. [D 20:42:44.432813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 13899. [D 20:42:44.432824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 13900. [D 20:42:44.432834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 13901. [D 20:42:44.432844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 13902. [D 20:42:44.432859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 13903. [D 20:42:44.432869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 13904. [D 20:42:44.432879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 13905. [D 20:42:44.432895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 13906. [D 20:42:44.432944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 13907. [D 20:42:44.432954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 13908. [D 20:42:44.432969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 13909. [D 20:42:44.432978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 13910. [D 20:42:44.432988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 13911. [D 20:42:44.433003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 13912. [D 20:42:44.433013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 13913. [D 20:42:44.433023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 13914. [D 20:42:44.433049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 13915. [D 20:42:44.433059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 13916. [D 20:42:44.433073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 13917. [D 20:42:44.433083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 13918. [D 20:42:44.433092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 13919. [D 20:42:44.433122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 13920. [D 20:42:44.433133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 13921. [D 20:42:44.433144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 13922. [D 20:42:44.433154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 13923. [D 20:42:44.433164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 13924. [D 20:42:44.433190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 13925. [D 20:42:44.433201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 13926. [D 20:42:44.433211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 13927. [D 20:42:44.433221] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 13928. [D 20:42:44.438667] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 13928. [D 20:42:44.438683] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 8/70. [D 20:42:44.438748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.438763] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.438772] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:44.444548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.444562] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.444570] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:44.444587] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3733 [D 20:42:44.444596] element 0: offset: 0x61f310, size: 24 [D 20:42:44.444607] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 9/70. [D 20:42:44.458614] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3728 [D 20:42:44.458630] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 10/70. [D 20:42:44.458692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 13928. [D 20:42:44.458768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 13929. [D 20:42:44.458779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 13930. [D 20:42:44.458789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 13931. [D 20:42:44.458801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 13932. [D 20:42:44.458811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 13933. [D 20:42:44.458827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 13934. [D 20:42:44.458836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 13935. [D 20:42:44.458846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 13936. [D 20:42:44.458862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 13937. [D 20:42:44.458902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 13938. [D 20:42:44.458912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 13939. [D 20:42:44.458926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 13940. [D 20:42:44.458954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 13941. [D 20:42:44.458967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 13942. [D 20:42:44.458977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 13943. [D 20:42:44.459000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 13944. [D 20:42:44.459015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 13945. [D 20:42:44.459024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 13946. [D 20:42:44.459034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 13947. [D 20:42:44.459050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 13948. [D 20:42:44.459060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 13949. [D 20:42:44.459082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 13950. [D 20:42:44.459095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 13951. [D 20:42:44.459105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 13952. [D 20:42:44.459115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 13953. [D 20:42:44.459130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 13954. [D 20:42:44.459140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 13955. [D 20:42:44.459150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 13956. [D 20:42:44.459174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 13957. [D 20:42:44.459184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 13958. [D 20:42:44.459194] openib_post_sr_rdmaw: ibv_post_send wr_id 62a880 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 13959. [D 20:42:44.464628] openib_check_cq: completed rdma wr_id 62a880, nic_wr_credit 13959. [D 20:42:44.464645] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 11/70. [D 20:42:44.466816] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.466832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.466842] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:44.472938] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.472953] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.472963] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:44.472997] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3737 [D 20:42:44.473008] element 0: offset: 0x5b0030, size: 24 [D 20:42:44.473022] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 12/70. [D 20:42:44.482112] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.482148] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.482158] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.482182] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3740 [D 20:42:44.482193] element 0: offset: 0x63e490, size: 24 [D 20:42:44.482204] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 13/70. [D 20:42:44.548721] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3731 [D 20:42:44.548741] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 14/70. [D 20:42:44.548797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 13959. [D 20:42:44.548866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 13960. [D 20:42:44.548913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 13961. [D 20:42:44.548924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 13962. [D 20:42:44.548935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 13963. [D 20:42:44.548945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 13964. [D 20:42:44.548955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 13965. [D 20:42:44.548965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 13966. [D 20:42:44.548988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 13967. [D 20:42:44.548998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 13968. [D 20:42:44.549008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 13969. [D 20:42:44.549018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 13970. [D 20:42:44.549028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 13971. [D 20:42:44.549038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 13972. [D 20:42:44.549048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 13973. [D 20:42:44.549057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 13974. [D 20:42:44.549080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 13975. [D 20:42:44.549090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 13976. [D 20:42:44.549100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 13977. [D 20:42:44.549122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 13978. [D 20:42:44.549132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 13979. [D 20:42:44.549142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 13980. [D 20:42:44.549167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 13981. [D 20:42:44.549177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 13982. [D 20:42:44.549187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 13983. [D 20:42:44.549197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 13984. [D 20:42:44.549207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 13985. [D 20:42:44.549217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 13986. [D 20:42:44.549241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 13987. [D 20:42:44.549251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 13988. [D 20:42:44.549265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 13989. [D 20:42:44.549275] openib_post_sr_rdmaw: ibv_post_send wr_id 62a880 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 13990. [D 20:42:44.554721] openib_check_cq: completed rdma wr_id 62a880, nic_wr_credit 13990. [D 20:42:44.554738] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 15/70. [D 20:42:44.556720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.556735] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.556746] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.563593] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.563607] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.563617] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.563650] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3743 [D 20:42:44.563661] element 0: offset: 0x655b90, size: 24 [D 20:42:44.563675] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 16/70. [D 20:42:44.657235] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3733 [D 20:42:44.657253] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 17/70. [D 20:42:44.657424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 13990. [D 20:42:44.657491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 13991. [D 20:42:44.657503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 13992. [D 20:42:44.657514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 13993. [D 20:42:44.657528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 13994. [D 20:42:44.657538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 13995. [D 20:42:44.657548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 13996. [D 20:42:44.657562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 13997. [D 20:42:44.657572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 13998. [D 20:42:44.657581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 13999. [D 20:42:44.657612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 14000. [D 20:42:44.657628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 14001. [D 20:42:44.657650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 14002. [D 20:42:44.657664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 14003. [D 20:42:44.657673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 14004. [D 20:42:44.657697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 14005. [D 20:42:44.657707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 14006. [D 20:42:44.657728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 14007. [D 20:42:44.657738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 14008. [D 20:42:44.657748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 14009. [D 20:42:44.657775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 14010. [D 20:42:44.657785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 14011. [D 20:42:44.657812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 14012. [D 20:42:44.657823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 14013. [D 20:42:44.657833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 14014. [D 20:42:44.657843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 14015. [D 20:42:44.657866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 14016. [D 20:42:44.657875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 14017. [D 20:42:44.657895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 14018. [D 20:42:44.657906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 14019. [D 20:42:44.657916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 14020. [D 20:42:44.657926] openib_post_sr_rdmaw: ibv_post_send wr_id 62a880 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 14021. [D 20:42:44.660690] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3740 [D 20:42:44.660712] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 18/70. [D 20:42:44.663351] openib_check_cq: completed rdma wr_id 62a880, nic_wr_credit 14021. [D 20:42:44.663371] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 19/70. [D 20:42:44.663383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 14021. [D 20:42:44.663393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 14022. [D 20:42:44.663404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 14023. [D 20:42:44.663414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 14024. [D 20:42:44.663424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 14025. [D 20:42:44.663434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 14026. [D 20:42:44.663444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 14027. [D 20:42:44.663454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 14028. [D 20:42:44.663463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 14029. [D 20:42:44.663493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 14030. [D 20:42:44.663503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 14031. [D 20:42:44.663526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 14032. [D 20:42:44.663537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 14033. [D 20:42:44.663550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 14034. [D 20:42:44.663571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 14035. [D 20:42:44.663583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 14036. [D 20:42:44.663593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 14037. [D 20:42:44.663602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 14038. [D 20:42:44.663617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 14039. [D 20:42:44.663627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 14040. [D 20:42:44.663637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 14041. [D 20:42:44.663647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 14042. [D 20:42:44.663669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 14043. [D 20:42:44.663679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 14044. [D 20:42:44.663702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 14045. [D 20:42:44.663713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 14046. [D 20:42:44.663723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 14047. [D 20:42:44.663733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 14048. [D 20:42:44.663743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 14049. [D 20:42:44.663753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 14050. [D 20:42:44.663763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 14051. [D 20:42:44.663777] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 14052. [D 20:42:44.663866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.663890] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.663900] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.669300] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 14052. [D 20:42:44.669337] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 20/70. [D 20:42:44.671532] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.671547] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.671556] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.671590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3745 [D 20:42:44.671601] element 0: offset: 0x691fe0, size: 24 [D 20:42:44.671614] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 21/70. [D 20:42:44.671645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.671656] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.671665] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.676713] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.676753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.676763] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.676793] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3749 [D 20:42:44.676804] element 0: offset: 0x62a4d0, size: 24 [D 20:42:44.676826] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 22/70. [D 20:42:44.710271] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3743 [D 20:42:44.710288] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 23/70. [D 20:42:44.710347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 14052. [D 20:42:44.710414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 14053. [D 20:42:44.710464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 14054. [D 20:42:44.710475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 14055. [D 20:42:44.710486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 14056. [D 20:42:44.710496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 14057. [D 20:42:44.710506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 14058. [D 20:42:44.710516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 14059. [D 20:42:44.710526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 14060. [D 20:42:44.710535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 14061. [D 20:42:44.710552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 14062. [D 20:42:44.710562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 14063. [D 20:42:44.710572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 14064. [D 20:42:44.710597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 14065. [D 20:42:44.710607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 14066. [D 20:42:44.710633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 14067. [D 20:42:44.710644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 14068. [D 20:42:44.710653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 14069. [D 20:42:44.710667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 14070. [D 20:42:44.710677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 14071. [D 20:42:44.710687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 14072. [D 20:42:44.710720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 14073. [D 20:42:44.710731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 14074. [D 20:42:44.710741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 14075. [D 20:42:44.710751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 14076. [D 20:42:44.710779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 14077. [D 20:42:44.710789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 14078. [D 20:42:44.710812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 14079. [D 20:42:44.710823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 14080. [D 20:42:44.710833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 14081. [D 20:42:44.710843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 14082. [D 20:42:44.710868] openib_post_sr_rdmaw: ibv_post_send wr_id 62a880 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 14083. [D 20:42:44.716267] openib_check_cq: completed rdma wr_id 62a880, nic_wr_credit 14083. [D 20:42:44.716284] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 24/70. [D 20:42:44.716352] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.716367] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.716376] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.723016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.723029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.723038] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.723057] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3752 [D 20:42:44.723066] element 0: offset: 0x655ed0, size: 24 [D 20:42:44.723076] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 25/70. [D 20:42:44.752813] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3737 [D 20:42:44.752829] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 26/70. [D 20:42:44.752890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 14083. [D 20:42:44.752959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 14084. [D 20:42:44.753018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 14085. [D 20:42:44.753028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 14086. [D 20:42:44.753039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 14087. [D 20:42:44.753055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 14088. [D 20:42:44.753066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 14089. [D 20:42:44.753075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 14090. [D 20:42:44.753086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 14091. [D 20:42:44.753095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 14092. [D 20:42:44.753105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 14093. [D 20:42:44.753115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 14094. [D 20:42:44.753149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 14095. [D 20:42:44.753159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 14096. [D 20:42:44.753170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 14097. [D 20:42:44.753180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 14098. [D 20:42:44.753190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 14099. [D 20:42:44.753215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 14100. [D 20:42:44.753226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 14101. [D 20:42:44.753240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 14102. [D 20:42:44.753250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 14103. [D 20:42:44.753259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 14104. [D 20:42:44.753284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 14105. [D 20:42:44.753301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 14106. [D 20:42:44.753314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 14107. [D 20:42:44.753323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 14108. [D 20:42:44.753333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 14109. [D 20:42:44.753357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 14110. [D 20:42:44.753367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 14111. [D 20:42:44.753377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 14112. [D 20:42:44.753387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 14113. [D 20:42:44.753396] openib_post_sr_rdmaw: ibv_post_send wr_id 62a880 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 14114. [D 20:42:44.758812] openib_check_cq: completed rdma wr_id 62a880, nic_wr_credit 14114. [D 20:42:44.758828] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 27/70. [D 20:42:44.758894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.758909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.758917] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.898467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.898481] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.898490] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.898506] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3755 [D 20:42:44.898516] element 0: offset: 0x61f800, size: 24 [D 20:42:44.898526] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 28/70. [D 20:42:44.917389] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3752 [D 20:42:44.917406] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 29/70. [D 20:42:44.917469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 14114. [D 20:42:44.917579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 14115. [D 20:42:44.917592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 14116. [D 20:42:44.917603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 14117. [D 20:42:44.917614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 14118. [D 20:42:44.917625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 14119. [D 20:42:44.917635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 14120. [D 20:42:44.917645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 14121. [D 20:42:44.917657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 14122. [D 20:42:44.917673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 14123. [D 20:42:44.917683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 14124. [D 20:42:44.917693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 14125. [D 20:42:44.917719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 14126. [D 20:42:44.917730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 14127. [D 20:42:44.917740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 14128. [D 20:42:44.917751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 14129. [D 20:42:44.917760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 14130. [D 20:42:44.917771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 14131. [D 20:42:44.917795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 14132. [D 20:42:44.917805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 14133. [D 20:42:44.917820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 14134. [D 20:42:44.917830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 14135. [D 20:42:44.917851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 14136. [D 20:42:44.917862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 14137. [D 20:42:44.917872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 14138. [D 20:42:44.917883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 14139. [D 20:42:44.917893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 14140. [D 20:42:44.917903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 14141. [D 20:42:44.917913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 14142. [D 20:42:44.917938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 14143. [D 20:42:44.917951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 14144. [D 20:42:44.917965] openib_post_sr_rdmaw: ibv_post_send wr_id 62a880 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 14145. [D 20:42:44.923492] openib_check_cq: completed rdma wr_id 62a880, nic_wr_credit 14145. [D 20:42:44.923509] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 30/70. [D 20:42:44.923573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:44.923587] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.923595] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:44.930193] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:44.930207] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:44.930215] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:44.930231] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3758 [D 20:42:44.930241] element 0: offset: 0x64dd40, size: 24 [D 20:42:44.930252] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 31/70. [D 20:42:45.012751] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3745 [D 20:42:45.012767] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 32/70. [D 20:42:45.012852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 14145. [D 20:42:45.012957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 14146. [D 20:42:45.012968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 14147. [D 20:42:45.012979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 14148. [D 20:42:45.012993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 14149. [D 20:42:45.013003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 14150. [D 20:42:45.013013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 14151. [D 20:42:45.013026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 14152. [D 20:42:45.013036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 14153. [D 20:42:45.013046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 14154. [D 20:42:45.013056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 14155. [D 20:42:45.013082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 14156. [D 20:42:45.013092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 14157. [D 20:42:45.013114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 14158. [D 20:42:45.013125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 14159. [D 20:42:45.013135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 14160. [D 20:42:45.013158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 14161. [D 20:42:45.013169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 14162. [D 20:42:45.013178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 14163. [D 20:42:45.013202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 14164. [D 20:42:45.013212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 14165. [D 20:42:45.013232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 14166. [D 20:42:45.013243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 14167. [D 20:42:45.013253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 14168. [D 20:42:45.013263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 14169. [D 20:42:45.013273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 14170. [D 20:42:45.013283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 14171. [D 20:42:45.013293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 14172. [D 20:42:45.013303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 14173. [D 20:42:45.013339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 14174. [D 20:42:45.013350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 14175. [D 20:42:45.013360] openib_post_sr_rdmaw: ibv_post_send wr_id 62a880 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 14176. [D 20:42:45.018814] openib_check_cq: completed rdma wr_id 62a880, nic_wr_credit 14176. [D 20:42:45.018833] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 33/70. [D 20:42:45.018899] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.018913] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.018922] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.024604] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.024617] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.024626] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.024642] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3760 [D 20:42:45.024651] element 0: offset: 0x655b90, size: 24 [D 20:42:45.024661] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 34/70. [D 20:42:45.081749] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3749 [D 20:42:45.081765] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 35/70. [D 20:42:45.081824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 14176. [D 20:42:45.081920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 14177. [D 20:42:45.081933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 14178. [D 20:42:45.081945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 14179. [D 20:42:45.081955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 14180. [D 20:42:45.081966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 14181. [D 20:42:45.081976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 14182. [D 20:42:45.081985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 14183. [D 20:42:45.081996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 14184. [D 20:42:45.082016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 14185. [D 20:42:45.082025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 14186. [D 20:42:45.082035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 14187. [D 20:42:45.082066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 14188. [D 20:42:45.082077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 14189. [D 20:42:45.082098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 14190. [D 20:42:45.082108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 14191. [D 20:42:45.082118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 14192. [D 20:42:45.082140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 14193. [D 20:42:45.082151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 14194. [D 20:42:45.082162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 14195. [D 20:42:45.082171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 14196. [D 20:42:45.082196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 14197. [D 20:42:45.082206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 14198. [D 20:42:45.082222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 14199. [D 20:42:45.082232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 14200. [D 20:42:45.082243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 14201. [D 20:42:45.082253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 14202. [D 20:42:45.082263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 14203. [D 20:42:45.082274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 14204. [D 20:42:45.082297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 14205. [D 20:42:45.082307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 14206. [D 20:42:45.082328] openib_post_sr_rdmaw: ibv_post_send wr_id 64b530 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 14207. [D 20:42:45.087778] openib_check_cq: completed rdma wr_id 64b530, nic_wr_credit 14207. [D 20:42:45.087795] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 36/70. [D 20:42:45.087863] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.087878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.087887] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.092826] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.092840] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.092849] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.092865] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3764 [D 20:42:45.092875] element 0: offset: 0x632940, size: 24 [D 20:42:45.092886] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 37/70. [D 20:42:45.119464] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3758 [D 20:42:45.119480] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 38/70. [D 20:42:45.119540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 14207. [D 20:42:45.119608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 14208. [D 20:42:45.119619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 14209. [D 20:42:45.119629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 14210. [D 20:42:45.119639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 14211. [D 20:42:45.119655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 14212. [D 20:42:45.119664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 14213. [D 20:42:45.119674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 14214. [D 20:42:45.119690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 14215. [D 20:42:45.119700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 14216. [D 20:42:45.119709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 14217. [D 20:42:45.119780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 14218. [D 20:42:45.119792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 14219. [D 20:42:45.119802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 14220. [D 20:42:45.119824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 14221. [D 20:42:45.119838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 14222. [D 20:42:45.119858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 14223. [D 20:42:45.119868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 14224. [D 20:42:45.119878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 14225. [D 20:42:45.119899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 14226. [D 20:42:45.119912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 14227. [D 20:42:45.119930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 14228. [D 20:42:45.119941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 14229. [D 20:42:45.119952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 14230. [D 20:42:45.119975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 14231. [D 20:42:45.119985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 14232. [D 20:42:45.120004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 14233. [D 20:42:45.120015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 14234. [D 20:42:45.120025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 14235. [D 20:42:45.120035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 14236. [D 20:42:45.120045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 14237. [D 20:42:45.120060] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 14238. [D 20:42:45.125463] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 14238. [D 20:42:45.125481] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 39/70. [D 20:42:45.125547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.125561] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.125570] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.162567] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3760 [D 20:42:45.162583] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 40/70. [D 20:42:45.162646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 14238. [D 20:42:45.162711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 14239. [D 20:42:45.162762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 14240. [D 20:42:45.162773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 14241. [D 20:42:45.162784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 14242. [D 20:42:45.162794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 14243. [D 20:42:45.162804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 14244. [D 20:42:45.162814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 14245. [D 20:42:45.162839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 14246. [D 20:42:45.162848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 14247. [D 20:42:45.162858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 14248. [D 20:42:45.162885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 14249. [D 20:42:45.162895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 14250. [D 20:42:45.162906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 14251. [D 20:42:45.162926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 14252. [D 20:42:45.162937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 14253. [D 20:42:45.162947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 14254. [D 20:42:45.162967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 14255. [D 20:42:45.162982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 14256. [D 20:42:45.163000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 14257. [D 20:42:45.163010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 14258. [D 20:42:45.163025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 14259. [D 20:42:45.163046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 14260. [D 20:42:45.163061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 14261. [D 20:42:45.163081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 14262. [D 20:42:45.163096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 14263. [D 20:42:45.163115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 14264. [D 20:42:45.163126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 14265. [D 20:42:45.163135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 14266. [D 20:42:45.163157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 14267. [D 20:42:45.163168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 14268. [D 20:42:45.163178] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 14269. [D 20:42:45.168617] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 14269. [D 20:42:45.168635] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 41/70. [D 20:42:45.168700] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.168714] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.168723] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:45.174414] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.174428] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.174436] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:45.174453] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3766 [D 20:42:45.174462] element 0: offset: 0x61f310, size: 24 [D 20:42:45.174473] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 42/70. [D 20:42:45.257431] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.257445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.257454] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.257470] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3770 [D 20:42:45.257479] element 0: offset: 0x691fe0, size: 24 [D 20:42:45.257489] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 43/70. [D 20:42:45.274260] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3764 [D 20:42:45.274277] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 44/70. [D 20:42:45.274336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 14269. [D 20:42:45.274433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 14270. [D 20:42:45.274447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 14271. [D 20:42:45.274458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 14272. [D 20:42:45.274468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 14273. [D 20:42:45.274479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 14274. [D 20:42:45.274490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 14275. [D 20:42:45.274500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 14276. [D 20:42:45.274532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 14277. [D 20:42:45.274543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 14278. [D 20:42:45.274556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 14279. [D 20:42:45.274566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 14280. [D 20:42:45.274576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 14281. [D 20:42:45.274585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 14282. [D 20:42:45.274614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 14283. [D 20:42:45.274623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 14284. [D 20:42:45.274634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 14285. [D 20:42:45.274644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 14286. [D 20:42:45.274653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 14287. [D 20:42:45.274663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 14288. [D 20:42:45.274674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 14289. [D 20:42:45.274696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 14290. [D 20:42:45.274706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 14291. [D 20:42:45.274721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 14292. [D 20:42:45.274744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 14293. [D 20:42:45.274757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 14294. [D 20:42:45.274776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 14295. [D 20:42:45.274787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 14296. [D 20:42:45.274797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 14297. [D 20:42:45.274806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 14298. [D 20:42:45.274830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 14299. [D 20:42:45.274840] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 14300. [D 20:42:45.280285] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 14300. [D 20:42:45.280302] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 45/70. [D 20:42:45.280368] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.280383] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.280391] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.285715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.285728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.285737] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.285752] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3773 [D 20:42:45.285762] element 0: offset: 0x62a4d0, size: 24 [D 20:42:45.285772] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 46/70. [D 20:42:45.363771] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3773 [D 20:42:45.363788] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 47/70. [D 20:42:45.363884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 14300. [D 20:42:45.363995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 14301. [D 20:42:45.364007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 14302. [D 20:42:45.364017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 14303. [D 20:42:45.364028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 14304. [D 20:42:45.364038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 14305. [D 20:42:45.364048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 14306. [D 20:42:45.364058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 14307. [D 20:42:45.364068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 14308. [D 20:42:45.364077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 14309. [D 20:42:45.364087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 14310. [D 20:42:45.364120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 14311. [D 20:42:45.364130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 14312. [D 20:42:45.364155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 14313. [D 20:42:45.364168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 14314. [D 20:42:45.364181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 14315. [D 20:42:45.364203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 14316. [D 20:42:45.364217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 14317. [D 20:42:45.364239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 14318. [D 20:42:45.364250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 14319. [D 20:42:45.364260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 14320. [D 20:42:45.364282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 14321. [D 20:42:45.364294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 14322. [D 20:42:45.364303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 14323. [D 20:42:45.364334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 14324. [D 20:42:45.364345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 14325. [D 20:42:45.364355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 14326. [D 20:42:45.364364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 14327. [D 20:42:45.364386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 14328. [D 20:42:45.364396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 14329. [D 20:42:45.364417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 14330. [D 20:42:45.364427] openib_post_sr_rdmaw: ibv_post_send wr_id 661710 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 14331. [D 20:42:45.369910] openib_check_cq: completed rdma wr_id 661710, nic_wr_credit 14331. [D 20:42:45.369928] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 48/70. [D 20:42:45.369993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.370007] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.370016] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.375251] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.375265] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.375273] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.375289] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3776 [D 20:42:45.375298] element 0: offset: 0x655ed0, size: 24 [D 20:42:45.375310] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 49/70. [D 20:42:45.424984] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3755 [D 20:42:45.425000] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 50/70. [D 20:42:45.425065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 14331. [D 20:42:45.425164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 14332. [D 20:42:45.425178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 14333. [D 20:42:45.425189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 14334. [D 20:42:45.425200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 14335. [D 20:42:45.425210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 14336. [D 20:42:45.425219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 14337. [D 20:42:45.425229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 14338. [D 20:42:45.425239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 14339. [D 20:42:45.425277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 14340. [D 20:42:45.425287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 14341. [D 20:42:45.425310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 14342. [D 20:42:45.425324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 14343. [D 20:42:45.425350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 14344. [D 20:42:45.425361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 14345. [D 20:42:45.425371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 14346. [D 20:42:45.425387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 14347. [D 20:42:45.425397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 14348. [D 20:42:45.425410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 14349. [D 20:42:45.425420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 14350. [D 20:42:45.425438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 14351. [D 20:42:45.425447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 14352. [D 20:42:45.425457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 14353. [D 20:42:45.425485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 14354. [D 20:42:45.425495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 14355. [D 20:42:45.425505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 14356. [D 20:42:45.425526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 14357. [D 20:42:45.425537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 14358. [D 20:42:45.425547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 14359. [D 20:42:45.425569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 14360. [D 20:42:45.425580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 14361. [D 20:42:45.425590] openib_post_sr_rdmaw: ibv_post_send wr_id 661710 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 14362. [D 20:42:45.431017] openib_check_cq: completed rdma wr_id 661710, nic_wr_credit 14362. [D 20:42:45.431034] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 51/70. [D 20:42:45.431099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.431114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.431122] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.437151] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.437165] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.437173] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.437190] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3779 [D 20:42:45.437199] element 0: offset: 0x63e4c0, size: 24 [D 20:42:45.437210] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 52/70. [D 20:42:45.504505] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3776 [D 20:42:45.504521] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 53/70. [D 20:42:45.504580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 14362. [D 20:42:45.504676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 14363. [D 20:42:45.504689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 14364. [D 20:42:45.504701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 14365. [D 20:42:45.504711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 14366. [D 20:42:45.504721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 14367. [D 20:42:45.504731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 14368. [D 20:42:45.504741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 14369. [D 20:42:45.504784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 14370. [D 20:42:45.504796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 14371. [D 20:42:45.504806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 14372. [D 20:42:45.504815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 14373. [D 20:42:45.504829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 14374. [D 20:42:45.504854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 14375. [D 20:42:45.504869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 14376. [D 20:42:45.504879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 14377. [D 20:42:45.504889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 14378. [D 20:42:45.504903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 14379. [D 20:42:45.504927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 14380. [D 20:42:45.504940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 14381. [D 20:42:45.504949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 14382. [D 20:42:45.504973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 14383. [D 20:42:45.504983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 14384. [D 20:42:45.505002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 14385. [D 20:42:45.505014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 14386. [D 20:42:45.505024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 14387. [D 20:42:45.505079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 14388. [D 20:42:45.505092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 14389. [D 20:42:45.505117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 14390. [D 20:42:45.505127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 14391. [D 20:42:45.505148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 14392. [D 20:42:45.505159] openib_post_sr_rdmaw: ibv_post_send wr_id 64b530 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 14393. [D 20:42:45.510613] openib_check_cq: completed rdma wr_id 64b530, nic_wr_credit 14393. [D 20:42:45.510631] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 54/70. [D 20:42:45.510694] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.510708] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.510717] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.515914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.515928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.515937] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.515952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3782 [D 20:42:45.515962] element 0: offset: 0x5b0030, size: 24 [D 20:42:45.515972] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 55/70. [D 20:42:45.557598] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3766 [D 20:42:45.557615] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 56/70. [D 20:42:45.557674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 14393. [D 20:42:45.557740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 14394. [D 20:42:45.557752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 14395. [D 20:42:45.557762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 14396. [D 20:42:45.557772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 14397. [D 20:42:45.557788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 14398. [D 20:42:45.557797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 14399. [D 20:42:45.557807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 14400. [D 20:42:45.557822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 14401. [D 20:42:45.557832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 14402. [D 20:42:45.557842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 14403. [D 20:42:45.557881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 14404. [D 20:42:45.557892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 14405. [D 20:42:45.557923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 14406. [D 20:42:45.557936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 14407. [D 20:42:45.557957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 14408. [D 20:42:45.557971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 14409. [D 20:42:45.557981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 14410. [D 20:42:45.557990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 14411. [D 20:42:45.558000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 14412. [D 20:42:45.558018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 14413. [D 20:42:45.558041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 14414. [D 20:42:45.558067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 14415. [D 20:42:45.558083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 14416. [D 20:42:45.558093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 14417. [D 20:42:45.558103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 14418. [D 20:42:45.558119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 14419. [D 20:42:45.558143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 14420. [D 20:42:45.558156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 14421. [D 20:42:45.558183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 14422. [D 20:42:45.558194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 14423. [D 20:42:45.558203] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 14424. [D 20:42:45.563595] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 14424. [D 20:42:45.563612] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 57/70. [D 20:42:45.563675] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.563689] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.563698] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.569649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.569662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.569671] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.569687] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3784 [D 20:42:45.569696] element 0: offset: 0x655b90, size: 24 [D 20:42:45.569706] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 58/70. [D 20:42:45.675804] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3779 [D 20:42:45.675821] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 59/70. [D 20:42:45.675921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 14424. [D 20:42:45.676033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 14425. [D 20:42:45.676045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 14426. [D 20:42:45.676056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 14427. [D 20:42:45.676071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 14428. [D 20:42:45.676080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 14429. [D 20:42:45.676090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 14430. [D 20:42:45.676100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 14431. [D 20:42:45.676111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 14432. [D 20:42:45.676121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 14433. [D 20:42:45.676130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 14434. [D 20:42:45.676161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 14435. [D 20:42:45.676171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 14436. [D 20:42:45.676195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 14437. [D 20:42:45.676210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 14438. [D 20:42:45.676232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 14439. [D 20:42:45.676246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 14440. [D 20:42:45.676256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 14441. [D 20:42:45.676280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 14442. [D 20:42:45.676289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 14443. [D 20:42:45.676299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 14444. [D 20:42:45.676326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 14445. [D 20:42:45.676336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 14446. [D 20:42:45.676360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 14447. [D 20:42:45.676370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 14448. [D 20:42:45.676382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 14449. [D 20:42:45.676392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 14450. [D 20:42:45.676401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 14451. [D 20:42:45.676411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 14452. [D 20:42:45.676426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 14453. [D 20:42:45.676437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 14454. [D 20:42:45.676462] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 14455. [D 20:42:45.681890] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 14455. [D 20:42:45.681907] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 60/70. [D 20:42:45.681974] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.681989] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.681998] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.687878] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.687892] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.687901] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.687917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3788 [D 20:42:45.687926] element 0: offset: 0x62a4d0, size: 24 [D 20:42:45.687936] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 0/70. [D 20:42:45.731884] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3782 [D 20:42:45.731901] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 1/70. [D 20:42:45.731960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 14455. [D 20:42:45.732044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 14456. [D 20:42:45.732056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 14457. [D 20:42:45.732068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 14458. [D 20:42:45.732079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 14459. [D 20:42:45.732089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 14460. [D 20:42:45.732099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 14461. [D 20:42:45.732109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 14462. [D 20:42:45.732124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 14463. [D 20:42:45.732150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 14464. [D 20:42:45.732160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 14465. [D 20:42:45.732179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 14466. [D 20:42:45.732189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 14467. [D 20:42:45.732199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 14468. [D 20:42:45.732222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 14469. [D 20:42:45.732231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 14470. [D 20:42:45.732241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 14471. [D 20:42:45.732268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 14472. [D 20:42:45.732279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 14473. [D 20:42:45.732292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 14474. [D 20:42:45.732312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 14475. [D 20:42:45.732326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 14476. [D 20:42:45.732336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 14477. [D 20:42:45.732346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 14478. [D 20:42:45.732356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 14479. [D 20:42:45.732371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 14480. [D 20:42:45.732393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 14481. [D 20:42:45.732404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 14482. [D 20:42:45.732414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 14483. [D 20:42:45.732424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 14484. [D 20:42:45.732434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 14485. [D 20:42:45.732444] openib_post_sr_rdmaw: ibv_post_send wr_id 653910 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 14486. [D 20:42:45.737976] openib_check_cq: completed rdma wr_id 653910, nic_wr_credit 14486. [D 20:42:45.737993] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 2/70. [D 20:42:45.738060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.738075] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.738083] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.743283] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.743297] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.743305] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.743321] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3791 [D 20:42:45.743331] element 0: offset: 0x63c4f0, size: 24 [D 20:42:45.743341] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 3/70. [D 20:42:45.847098] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3784 [D 20:42:45.847115] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 4/70. [D 20:42:45.847232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 14486. [D 20:42:45.847337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 14487. [D 20:42:45.847348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 14488. [D 20:42:45.847358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 14489. [D 20:42:45.847373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 14490. [D 20:42:45.847382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 14491. [D 20:42:45.847392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 14492. [D 20:42:45.847408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 14493. [D 20:42:45.847418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 14494. [D 20:42:45.847427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 14495. [D 20:42:45.847459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 14496. [D 20:42:45.847470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 14497. [D 20:42:45.847494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 14498. [D 20:42:45.847505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 14499. [D 20:42:45.847539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 14500. [D 20:42:45.847550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 14501. [D 20:42:45.847559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 14502. [D 20:42:45.847569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 14503. [D 20:42:45.847580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 14504. [D 20:42:45.847589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 14505. [D 20:42:45.847612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 14506. [D 20:42:45.847623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 14507. [D 20:42:45.847633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 14508. [D 20:42:45.847652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 14509. [D 20:42:45.847663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 14510. [D 20:42:45.847673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 14511. [D 20:42:45.847683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 14512. [D 20:42:45.847693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 14513. [D 20:42:45.847722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 14514. [D 20:42:45.847733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 14515. [D 20:42:45.847747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 14516. [D 20:42:45.847768] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 14517. [D 20:42:45.853206] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 14517. [D 20:42:45.853247] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 5/70. [D 20:42:45.853310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.853325] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.853333] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.859124] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.859138] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.859146] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.859162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3793 [D 20:42:45.859172] element 0: offset: 0x61f310, size: 24 [D 20:42:45.859181] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 6/70. [D 20:42:45.909413] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3788 [D 20:42:45.909430] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 7/70. [D 20:42:45.909493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 14517. [D 20:42:45.909604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 14518. [D 20:42:45.909618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 14519. [D 20:42:45.909629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 14520. [D 20:42:45.909640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 14521. [D 20:42:45.909650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 14522. [D 20:42:45.909660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 14523. [D 20:42:45.909679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 14524. [D 20:42:45.909690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 14525. [D 20:42:45.909700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 14526. [D 20:42:45.909710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 14527. [D 20:42:45.909720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 14528. [D 20:42:45.909746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 14529. [D 20:42:45.909756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 14530. [D 20:42:45.909777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 14531. [D 20:42:45.909787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 14532. [D 20:42:45.909797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 14533. [D 20:42:45.909807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 14534. [D 20:42:45.909830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 14535. [D 20:42:45.909840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 14536. [D 20:42:45.909850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 14537. [D 20:42:45.909873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 14538. [D 20:42:45.909883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 14539. [D 20:42:45.909893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 14540. [D 20:42:45.909925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 14541. [D 20:42:45.909935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 14542. [D 20:42:45.909959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 14543. [D 20:42:45.909973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 14544. [D 20:42:45.909983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 14545. [D 20:42:45.910004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 14546. [D 20:42:45.910014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 14547. [D 20:42:45.910024] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 14548. [D 20:42:45.915460] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 14548. [D 20:42:45.915477] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 8/70. [D 20:42:45.915546] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.915560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.915569] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.921310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.921323] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.921331] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.921348] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3797 [D 20:42:45.921357] element 0: offset: 0x64dd40, size: 24 [D 20:42:45.921367] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 9/70. [D 20:42:45.946641] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3770 [D 20:42:45.946658] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 10/70. [D 20:42:45.946723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 14548. [D 20:42:45.946788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 14549. [D 20:42:45.946839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 14550. [D 20:42:45.946851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 14551. [D 20:42:45.946861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 14552. [D 20:42:45.946877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 14553. [D 20:42:45.946888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 14554. [D 20:42:45.946913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 14555. [D 20:42:45.946923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 14556. [D 20:42:45.946933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 14557. [D 20:42:45.946943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 14558. [D 20:42:45.946969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 14559. [D 20:42:45.946979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 14560. [D 20:42:45.946990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 14561. [D 20:42:45.947011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 14562. [D 20:42:45.947021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 14563. [D 20:42:45.947041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 14564. [D 20:42:45.947058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 14565. [D 20:42:45.947068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 14566. [D 20:42:45.947087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 14567. [D 20:42:45.947098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 14568. [D 20:42:45.947108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 14569. [D 20:42:45.947130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 14570. [D 20:42:45.947140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 14571. [D 20:42:45.947162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 14572. [D 20:42:45.947172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 14573. [D 20:42:45.947182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 14574. [D 20:42:45.947205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 14575. [D 20:42:45.947215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 14576. [D 20:42:45.947237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 14577. [D 20:42:45.947248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 14578. [D 20:42:45.947257] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 14579. [D 20:42:45.952644] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 14579. [D 20:42:45.952661] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 11/70. [D 20:42:45.952726] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:45.952741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.952749] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:45.959050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:45.959064] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:45.959072] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:45.959088] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3800 [D 20:42:45.959098] element 0: offset: 0x5b0030, size: 24 [D 20:42:45.959107] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 12/70. [D 20:42:46.082414] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3791 [D 20:42:46.082431] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 13/70. [D 20:42:46.082526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 14579. [D 20:42:46.082635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 14580. [D 20:42:46.082647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 14581. [D 20:42:46.082657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 14582. [D 20:42:46.082668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 14583. [D 20:42:46.082678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 14584. [D 20:42:46.082688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 14585. [D 20:42:46.082698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 14586. [D 20:42:46.082708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 14587. [D 20:42:46.082717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 14588. [D 20:42:46.082727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 14589. [D 20:42:46.082759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 14590. [D 20:42:46.082769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 14591. [D 20:42:46.082781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 14592. [D 20:42:46.082796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 14593. [D 20:42:46.082805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 14594. [D 20:42:46.082816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 14595. [D 20:42:46.082838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 14596. [D 20:42:46.082848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 14597. [D 20:42:46.082858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 14598. [D 20:42:46.082880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 14599. [D 20:42:46.082890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 14600. [D 20:42:46.082903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 14601. [D 20:42:46.082924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 14602. [D 20:42:46.082938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 14603. [D 20:42:46.082961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 14604. [D 20:42:46.082973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 14605. [D 20:42:46.082995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 14606. [D 20:42:46.083006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 14607. [D 20:42:46.083016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 14608. [D 20:42:46.083037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 14609. [D 20:42:46.083047] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 14610. [D 20:42:46.088493] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 14610. [D 20:42:46.088510] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 14/70. [D 20:42:46.088575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.088589] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.088598] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:46.093947] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.093961] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.093969] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:46.093985] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3803 [D 20:42:46.093994] element 0: offset: 0x63e8c0, size: 24 [D 20:42:46.094006] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 15/70. [D 20:42:46.168919] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3797 [D 20:42:46.168936] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 16/70. [D 20:42:46.169049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 14610. [D 20:42:46.169160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 14611. [D 20:42:46.169171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 14612. [D 20:42:46.169182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 14613. [D 20:42:46.169196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 14614. [D 20:42:46.169206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 14615. [D 20:42:46.169215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 14616. [D 20:42:46.169231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 14617. [D 20:42:46.169241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 14618. [D 20:42:46.169251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 14619. [D 20:42:46.169261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 14620. [D 20:42:46.169286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 14621. [D 20:42:46.169297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 14622. [D 20:42:46.169307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 14623. [D 20:42:46.169317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 14624. [D 20:42:46.169327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 14625. [D 20:42:46.169342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 14626. [D 20:42:46.169366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 14627. [D 20:42:46.169375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 14628. [D 20:42:46.169404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 14629. [D 20:42:46.169414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 14630. [D 20:42:46.169424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 14631. [D 20:42:46.169443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 14632. [D 20:42:46.169453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 14633. [D 20:42:46.169463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 14634. [D 20:42:46.169486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 14635. [D 20:42:46.169497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 14636. [D 20:42:46.169508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 14637. [D 20:42:46.169517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 14638. [D 20:42:46.169528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 14639. [D 20:42:46.169558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 14640. [D 20:42:46.169569] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 14641. [D 20:42:46.175093] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 14641. [D 20:42:46.175110] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 17/70. [D 20:42:46.175174] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.175188] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.175197] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:46.181156] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.181169] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.181178] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:46.181193] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3806 [D 20:42:46.181203] element 0: offset: 0x62a4d0, size: 24 [D 20:42:46.181215] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 18/70. [D 20:42:46.251837] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3793 [D 20:42:46.251855] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 19/70. [D 20:42:46.251914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 14641. [D 20:42:46.251981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 14642. [D 20:42:46.251992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 14643. [D 20:42:46.252003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 14644. [D 20:42:46.252013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 14645. [D 20:42:46.252023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 14646. [D 20:42:46.252032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 14647. [D 20:42:46.252048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 14648. [D 20:42:46.252058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 14649. [D 20:42:46.252068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 14650. [D 20:42:46.252078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 14651. [D 20:42:46.252127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 14652. [D 20:42:46.252138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 14653. [D 20:42:46.252148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 14654. [D 20:42:46.252183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 14655. [D 20:42:46.252194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 14656. [D 20:42:46.252204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 14657. [D 20:42:46.252214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 14658. [D 20:42:46.252245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 14659. [D 20:42:46.252255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 14660. [D 20:42:46.252266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 14661. [D 20:42:46.252276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 14662. [D 20:42:46.252286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 14663. [D 20:42:46.252297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 14664. [D 20:42:46.252307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 14665. [D 20:42:46.252331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 14666. [D 20:42:46.252342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 14667. [D 20:42:46.252351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 14668. [D 20:42:46.252362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 14669. [D 20:42:46.252372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 14670. [D 20:42:46.252392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 14671. [D 20:42:46.252408] openib_post_sr_rdmaw: ibv_post_send wr_id 653910 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 14672. [D 20:42:46.257837] openib_check_cq: completed rdma wr_id 653910, nic_wr_credit 14672. [D 20:42:46.257855] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 20/70. [D 20:42:46.257919] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.257934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.257942] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:46.348082] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3803 [D 20:42:46.348099] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 21/70. [D 20:42:46.348191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 14672. [D 20:42:46.348269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 14673. [D 20:42:46.348280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 14674. [D 20:42:46.348291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 14675. [D 20:42:46.348301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 14676. [D 20:42:46.348311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 14677. [D 20:42:46.348320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 14678. [D 20:42:46.348331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 14679. [D 20:42:46.348341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 14680. [D 20:42:46.348350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 14681. [D 20:42:46.348360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 14682. [D 20:42:46.348402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 14683. [D 20:42:46.348415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 14684. [D 20:42:46.348425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 14685. [D 20:42:46.348436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 14686. [D 20:42:46.348471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 14687. [D 20:42:46.348482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 14688. [D 20:42:46.348492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 14689. [D 20:42:46.348502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 14690. [D 20:42:46.348530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 14691. [D 20:42:46.348540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 14692. [D 20:42:46.348553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 14693. [D 20:42:46.348563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 14694. [D 20:42:46.348573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 14695. [D 20:42:46.348586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 14696. [D 20:42:46.348596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 14697. [D 20:42:46.348622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 14698. [D 20:42:46.348631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 14699. [D 20:42:46.348641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 14700. [D 20:42:46.348668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 14701. [D 20:42:46.348677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 14702. [D 20:42:46.348691] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 14703. [D 20:42:46.354201] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 14703. [D 20:42:46.354217] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 22/70. [D 20:42:46.354280] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.354294] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.354303] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:46.381703] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3800 [D 20:42:46.381720] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 23/70. [D 20:42:46.381781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 14703. [D 20:42:46.381845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 14704. [D 20:42:46.381855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 14705. [D 20:42:46.381866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 14706. [D 20:42:46.381876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 14707. [D 20:42:46.381886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 14708. [D 20:42:46.381896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 14709. [D 20:42:46.381907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 14710. [D 20:42:46.381916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 14711. [D 20:42:46.381926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 14712. [D 20:42:46.381936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 14713. [D 20:42:46.381953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 14714. [D 20:42:46.382006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 14715. [D 20:42:46.382035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 14716. [D 20:42:46.382048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 14717. [D 20:42:46.382058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 14718. [D 20:42:46.382074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 14719. [D 20:42:46.382085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 14720. [D 20:42:46.382095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 14721. [D 20:42:46.382104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 14722. [D 20:42:46.382114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 14723. [D 20:42:46.382131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 14724. [D 20:42:46.382141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 14725. [D 20:42:46.382151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 14726. [D 20:42:46.382175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 14727. [D 20:42:46.382186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 14728. [D 20:42:46.382197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 14729. [D 20:42:46.382206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 14730. [D 20:42:46.382216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 14731. [D 20:42:46.382226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 14732. [D 20:42:46.382256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 14733. [D 20:42:46.382267] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 14734. [D 20:42:46.387715] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 14734. [D 20:42:46.387732] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 24/70. [D 20:42:46.387794] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.387808] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.387816] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:46.394698] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.394712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.394720] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:46.394737] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3809 [D 20:42:46.394746] element 0: offset: 0x655b90, size: 24 [D 20:42:46.394756] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 25/70. [D 20:42:46.396298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.396312] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.396320] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:46.396336] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3811 [D 20:42:46.396345] element 0: offset: 0x655ed0, size: 24 [D 20:42:46.396355] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 26/70. [D 20:42:46.466286] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3806 [D 20:42:46.466302] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 27/70. [D 20:42:46.466361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 14734. [D 20:42:46.466430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 14735. [D 20:42:46.466450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 14736. [D 20:42:46.466461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 14737. [D 20:42:46.466472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 14738. [D 20:42:46.466481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 14739. [D 20:42:46.466497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 14740. [D 20:42:46.466506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 14741. [D 20:42:46.466516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 14742. [D 20:42:46.466532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 14743. [D 20:42:46.466583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 14744. [D 20:42:46.466593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 14745. [D 20:42:46.466604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 14746. [D 20:42:46.466628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 14747. [D 20:42:46.466638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 14748. [D 20:42:46.466649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 14749. [D 20:42:46.466659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 14750. [D 20:42:46.466669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 14751. [D 20:42:46.466679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 14752. [D 20:42:46.466706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 14753. [D 20:42:46.466716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 14754. [D 20:42:46.466727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 14755. [D 20:42:46.466737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 14756. [D 20:42:46.466747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 14757. [D 20:42:46.466757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 14758. [D 20:42:46.466767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 14759. [D 20:42:46.466793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 14760. [D 20:42:46.466802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 14761. [D 20:42:46.466813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 14762. [D 20:42:46.466837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 14763. [D 20:42:46.466847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 14764. [D 20:42:46.466858] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 14765. [D 20:42:46.472297] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 14765. [D 20:42:46.472315] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 28/70. [D 20:42:46.472378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.472392] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.472401] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:46.478312] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.478326] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.478334] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:46.478351] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3815 [D 20:42:46.478360] element 0: offset: 0x61f310, size: 24 [D 20:42:46.478370] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 29/70. [D 20:42:46.487753] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.487768] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.487776] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:46.487792] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3818 [D 20:42:46.487801] element 0: offset: 0x691fe0, size: 24 [D 20:42:46.487811] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 30/70. [D 20:42:46.546126] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3809 [D 20:42:46.546143] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 31/70. [D 20:42:46.546202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 14765. [D 20:42:46.546270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 14766. [D 20:42:46.546289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 14767. [D 20:42:46.546300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 14768. [D 20:42:46.546311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 14769. [D 20:42:46.546320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 14770. [D 20:42:46.546335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 14771. [D 20:42:46.546345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 14772. [D 20:42:46.546354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 14773. [D 20:42:46.546370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 14774. [D 20:42:46.546427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 14775. [D 20:42:46.546438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 14776. [D 20:42:46.546458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 14777. [D 20:42:46.546472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 14778. [D 20:42:46.546482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 14779. [D 20:42:46.546492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 14780. [D 20:42:46.546502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 14781. [D 20:42:46.546512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 14782. [D 20:42:46.546532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 14783. [D 20:42:46.546543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 14784. [D 20:42:46.546553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 14785. [D 20:42:46.546562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 14786. [D 20:42:46.546572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 14787. [D 20:42:46.546605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 14788. [D 20:42:46.546615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 14789. [D 20:42:46.546627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 14790. [D 20:42:46.546637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 14791. [D 20:42:46.546647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 14792. [D 20:42:46.546672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 14793. [D 20:42:46.546682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 14794. [D 20:42:46.546695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 14795. [D 20:42:46.546705] openib_post_sr_rdmaw: ibv_post_send wr_id 653910 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 14796. [D 20:42:46.552125] openib_check_cq: completed rdma wr_id 653910, nic_wr_credit 14796. [D 20:42:46.552143] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 32/70. [D 20:42:46.552208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.552222] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.552231] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:46.558813] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.558827] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.558835] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:46.558851] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3821 [D 20:42:46.558860] element 0: offset: 0x5b0030, size: 24 [D 20:42:46.558870] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 33/70. [D 20:42:46.583374] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3811 [D 20:42:46.583391] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 34/70. [D 20:42:46.583456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 14796. [D 20:42:46.583566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 14797. [D 20:42:46.583578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 14798. [D 20:42:46.583589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 14799. [D 20:42:46.583599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 14800. [D 20:42:46.583609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 14801. [D 20:42:46.583619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 14802. [D 20:42:46.583629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 14803. [D 20:42:46.583644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 14804. [D 20:42:46.583654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 14805. [D 20:42:46.583664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 14806. [D 20:42:46.583674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 14807. [D 20:42:46.583685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 14808. [D 20:42:46.583695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 14809. [D 20:42:46.583704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 14810. [D 20:42:46.583733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 14811. [D 20:42:46.583743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 14812. [D 20:42:46.583753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 14813. [D 20:42:46.583763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 14814. [D 20:42:46.583773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 14815. [D 20:42:46.583795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 14816. [D 20:42:46.583811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 14817. [D 20:42:46.583821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 14818. [D 20:42:46.583831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 14819. [D 20:42:46.583847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 14820. [D 20:42:46.583857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 14821. [D 20:42:46.583867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 14822. [D 20:42:46.583894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 14823. [D 20:42:46.583904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 14824. [D 20:42:46.583918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 14825. [D 20:42:46.583928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 14826. [D 20:42:46.583937] openib_post_sr_rdmaw: ibv_post_send wr_id 63ded0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 14827. [D 20:42:46.589423] openib_check_cq: completed rdma wr_id 63ded0, nic_wr_credit 14827. [D 20:42:46.589442] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 35/70. [D 20:42:46.589506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.589520] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.589529] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:46.595104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.595118] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.595126] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:46.595143] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3823 [D 20:42:46.595152] element 0: offset: 0x64dd40, size: 24 [D 20:42:46.595162] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 36/70. [D 20:42:46.637483] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3821 [D 20:42:46.637500] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 37/70. [D 20:42:46.637556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 14827. [D 20:42:46.637623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 14828. [D 20:42:46.637644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 14829. [D 20:42:46.637656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 14830. [D 20:42:46.637666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 14831. [D 20:42:46.637677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 14832. [D 20:42:46.637687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 14833. [D 20:42:46.637696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 14834. [D 20:42:46.637709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 14835. [D 20:42:46.637762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 14836. [D 20:42:46.637774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 14837. [D 20:42:46.637785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 14838. [D 20:42:46.637808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 14839. [D 20:42:46.637820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 14840. [D 20:42:46.637830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 14841. [D 20:42:46.637840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 14842. [D 20:42:46.637866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 14843. [D 20:42:46.637877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 14844. [D 20:42:46.637889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 14845. [D 20:42:46.637899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 14846. [D 20:42:46.637911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 14847. [D 20:42:46.637938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 14848. [D 20:42:46.637949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 14849. [D 20:42:46.637961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 14850. [D 20:42:46.637971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 14851. [D 20:42:46.637992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 14852. [D 20:42:46.638003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 14853. [D 20:42:46.638013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 14854. [D 20:42:46.638023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 14855. [D 20:42:46.638033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 14856. [D 20:42:46.638043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 14857. [D 20:42:46.638072] openib_post_sr_rdmaw: ibv_post_send wr_id 63ded0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 14858. [D 20:42:46.643539] openib_check_cq: completed rdma wr_id 63ded0, nic_wr_credit 14858. [D 20:42:46.643555] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 38/70. [D 20:42:46.643619] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.643634] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.643642] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:46.650461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.650475] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.650484] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:46.650499] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3827 [D 20:42:46.650509] element 0: offset: 0x63c4f0, size: 24 [D 20:42:46.650519] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 39/70. [D 20:42:46.761385] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3823 [D 20:42:46.761402] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 40/70. [D 20:42:46.761492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 14858. [D 20:42:46.761570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 14859. [D 20:42:46.761582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 14860. [D 20:42:46.761592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 14861. [D 20:42:46.761603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 14862. [D 20:42:46.761613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 14863. [D 20:42:46.761622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 14864. [D 20:42:46.761632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 14865. [D 20:42:46.761646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 14866. [D 20:42:46.761656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 14867. [D 20:42:46.761665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 14868. [D 20:42:46.761681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 14869. [D 20:42:46.761691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 14870. [D 20:42:46.761700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 14871. [D 20:42:46.761710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 14872. [D 20:42:46.761720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 14873. [D 20:42:46.761730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 14874. [D 20:42:46.761740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 14875. [D 20:42:46.761793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 14876. [D 20:42:46.761806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 14877. [D 20:42:46.761815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 14878. [D 20:42:46.761826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 14879. [D 20:42:46.761856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 14880. [D 20:42:46.761867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 14881. [D 20:42:46.761877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 14882. [D 20:42:46.761887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 14883. [D 20:42:46.761910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 14884. [D 20:42:46.761921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 14885. [D 20:42:46.761936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 14886. [D 20:42:46.761947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 14887. [D 20:42:46.761957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 14888. [D 20:42:46.761981] openib_post_sr_rdmaw: ibv_post_send wr_id 63ded0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 14889. [D 20:42:46.767425] openib_check_cq: completed rdma wr_id 63ded0, nic_wr_credit 14889. [D 20:42:46.767442] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 41/70. [D 20:42:46.767505] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.767519] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.767528] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:46.773180] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.773194] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.773202] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:46.773218] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3829 [D 20:42:46.773227] element 0: offset: 0x655ed0, size: 24 [D 20:42:46.773238] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 42/70. [D 20:42:46.815057] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3815 [D 20:42:46.815074] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 43/70. [D 20:42:46.815132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 14889. [D 20:42:46.815203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 14890. [D 20:42:46.815223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 14891. [D 20:42:46.815233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 14892. [D 20:42:46.815244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 14893. [D 20:42:46.815253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 14894. [D 20:42:46.815264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 14895. [D 20:42:46.815273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 14896. [D 20:42:46.815283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 14897. [D 20:42:46.815293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 14898. [D 20:42:46.815337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 14899. [D 20:42:46.815348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 14900. [D 20:42:46.815362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 14901. [D 20:42:46.815372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 14902. [D 20:42:46.815382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 14903. [D 20:42:46.815391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 14904. [D 20:42:46.815408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 14905. [D 20:42:46.815417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 14906. [D 20:42:46.815427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 14907. [D 20:42:46.815437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 14908. [D 20:42:46.815447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 14909. [D 20:42:46.815457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 14910. [D 20:42:46.815494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 14911. [D 20:42:46.815505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 14912. [D 20:42:46.815518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 14913. [D 20:42:46.815528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 14914. [D 20:42:46.815538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 14915. [D 20:42:46.815562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 14916. [D 20:42:46.815573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 14917. [D 20:42:46.815582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 14918. [D 20:42:46.815592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 14919. [D 20:42:46.815602] openib_post_sr_rdmaw: ibv_post_send wr_id 63ded0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 14920. [D 20:42:46.821063] openib_check_cq: completed rdma wr_id 63ded0, nic_wr_credit 14920. [D 20:42:46.821082] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 44/70. [D 20:42:46.821147] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.821161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.821170] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:46.827215] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.827229] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.827237] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:46.827253] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3833 [D 20:42:46.827262] element 0: offset: 0x5b0030, size: 24 [D 20:42:46.827272] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 45/70. [D 20:42:46.851968] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3818 [D 20:42:46.851985] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 46/70. [D 20:42:46.852052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 14920. [D 20:42:46.852128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 14921. [D 20:42:46.852139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 14922. [D 20:42:46.852149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 14923. [D 20:42:46.852160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 14924. [D 20:42:46.852170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 14925. [D 20:42:46.852185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 14926. [D 20:42:46.852195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 14927. [D 20:42:46.852205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 14928. [D 20:42:46.852220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 14929. [D 20:42:46.852271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 14930. [D 20:42:46.852283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 14931. [D 20:42:46.852308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 14932. [D 20:42:46.852319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 14933. [D 20:42:46.852329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 14934. [D 20:42:46.852339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 14935. [D 20:42:46.852364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 14936. [D 20:42:46.852374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 14937. [D 20:42:46.852384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 14938. [D 20:42:46.852398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 14939. [D 20:42:46.852408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 14940. [D 20:42:46.852418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 14941. [D 20:42:46.852446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 14942. [D 20:42:46.852457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 14943. [D 20:42:46.852467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 14944. [D 20:42:46.852478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 14945. [D 20:42:46.852487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 14946. [D 20:42:46.852497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 14947. [D 20:42:46.852522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 14948. [D 20:42:46.852538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 14949. [D 20:42:46.852549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 14950. [D 20:42:46.852559] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 14951. [D 20:42:46.857983] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 14951. [D 20:42:46.858001] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 47/70. [D 20:42:46.858066] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.858081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.858089] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:46.863280] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.863294] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.863302] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:46.863317] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3836 [D 20:42:46.863327] element 0: offset: 0x64dd40, size: 24 [D 20:42:46.863337] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 48/70. [D 20:42:46.936306] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3829 [D 20:42:46.936323] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 49/70. [D 20:42:46.936421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 14951. [D 20:42:46.936497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 14952. [D 20:42:46.936509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 14953. [D 20:42:46.936519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 14954. [D 20:42:46.936529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 14955. [D 20:42:46.936539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 14956. [D 20:42:46.936549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 14957. [D 20:42:46.936559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 14958. [D 20:42:46.936568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 14959. [D 20:42:46.936578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 14960. [D 20:42:46.936588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 14961. [D 20:42:46.936647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 14962. [D 20:42:46.936658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 14963. [D 20:42:46.936678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 14964. [D 20:42:46.936689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 14965. [D 20:42:46.936702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 14966. [D 20:42:46.936712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 14967. [D 20:42:46.936722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 14968. [D 20:42:46.936737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 14969. [D 20:42:46.936758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 14970. [D 20:42:46.936769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 14971. [D 20:42:46.936780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 14972. [D 20:42:46.936790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 14973. [D 20:42:46.936800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 14974. [D 20:42:46.936810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 14975. [D 20:42:46.936820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 14976. [D 20:42:46.936829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 14977. [D 20:42:46.936861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 14978. [D 20:42:46.936871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 14979. [D 20:42:46.936889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 14980. [D 20:42:46.936899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 14981. [D 20:42:46.936921] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 14982. [D 20:42:46.942358] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 14982. [D 20:42:46.942374] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 50/70. [D 20:42:46.942438] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:46.942453] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.942461] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:46.948133] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:46.948147] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:46.948155] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:46.948171] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3838 [D 20:42:46.948180] element 0: offset: 0x61f310, size: 24 [D 20:42:46.948190] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 51/70. [D 20:42:47.007801] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3833 [D 20:42:47.007818] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 52/70. [D 20:42:47.007876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 14982. [D 20:42:47.007946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 14983. [D 20:42:47.007967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 14984. [D 20:42:47.007978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 14985. [D 20:42:47.007989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 14986. [D 20:42:47.007998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 14987. [D 20:42:47.008009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 14988. [D 20:42:47.008019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 14989. [D 20:42:47.008029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 14990. [D 20:42:47.008039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 14991. [D 20:42:47.008080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 14992. [D 20:42:47.008093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 14993. [D 20:42:47.008103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 14994. [D 20:42:47.008113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 14995. [D 20:42:47.008153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 14996. [D 20:42:47.008164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 14997. [D 20:42:47.008174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 14998. [D 20:42:47.008196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 14999. [D 20:42:47.008206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 15000. [D 20:42:47.008217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 15001. [D 20:42:47.008226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 15002. [D 20:42:47.008236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 15003. [D 20:42:47.008252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15004. [D 20:42:47.008272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15005. [D 20:42:47.008282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15006. [D 20:42:47.008292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 15007. [D 20:42:47.008302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 15008. [D 20:42:47.008312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 15009. [D 20:42:47.008338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 15010. [D 20:42:47.008368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 15011. [D 20:42:47.008378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15012. [D 20:42:47.008388] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15013. [D 20:42:47.013801] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 15013. [D 20:42:47.013819] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 53/70. [D 20:42:47.013883] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.013898] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.013907] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.019948] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.019962] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.019970] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.019987] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3842 [D 20:42:47.019996] element 0: offset: 0x63e5c0, size: 24 [D 20:42:47.020006] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 54/70. [D 20:42:47.111002] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3836 [D 20:42:47.111018] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 55/70. [D 20:42:47.111161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 15013. [D 20:42:47.111225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 15014. [D 20:42:47.111237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 15015. [D 20:42:47.111247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 15016. [D 20:42:47.111262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 15017. [D 20:42:47.111271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 15018. [D 20:42:47.111281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 15019. [D 20:42:47.111295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 15020. [D 20:42:47.111305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 15021. [D 20:42:47.111315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 15022. [D 20:42:47.111331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 15023. [D 20:42:47.111340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 15024. [D 20:42:47.111350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 15025. [D 20:42:47.111359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 15026. [D 20:42:47.111369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 15027. [D 20:42:47.111379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 15028. [D 20:42:47.111389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 15029. [D 20:42:47.111398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 15030. [D 20:42:47.111408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 15031. [D 20:42:47.111427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 15032. [D 20:42:47.111437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 15033. [D 20:42:47.111446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 15034. [D 20:42:47.111456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 15035. [D 20:42:47.111467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 15036. [D 20:42:47.111477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 15037. [D 20:42:47.111486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 15038. [D 20:42:47.111537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 15039. [D 20:42:47.111548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 15040. [D 20:42:47.111558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 15041. [D 20:42:47.111583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 15042. [D 20:42:47.111593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 15043. [D 20:42:47.111603] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 15044. [D 20:42:47.117149] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 15044. [D 20:42:47.117167] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 56/70. [D 20:42:47.117229] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.117244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.117252] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.122625] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.122638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.122646] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.122662] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3845 [D 20:42:47.122671] element 0: offset: 0x657110, size: 24 [D 20:42:47.122681] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 57/70. [D 20:42:47.125750] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3827 [D 20:42:47.125767] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 58/70. [D 20:42:47.125817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 15044. [D 20:42:47.125854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 15045. [D 20:42:47.125865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 15046. [D 20:42:47.125875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 15047. [D 20:42:47.125886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 15048. [D 20:42:47.125896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 15049. [D 20:42:47.125906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 15050. [D 20:42:47.125946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 15051. [D 20:42:47.125956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 15052. [D 20:42:47.125965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 15053. [D 20:42:47.125975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 15054. [D 20:42:47.125991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 15055. [D 20:42:47.126001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 15056. [D 20:42:47.126010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 15057. [D 20:42:47.126020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 15058. [D 20:42:47.126030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 15059. [D 20:42:47.126040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 15060. [D 20:42:47.126049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 15061. [D 20:42:47.126059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 15062. [D 20:42:47.126069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 15063. [D 20:42:47.126089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 15064. [D 20:42:47.126099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 15065. [D 20:42:47.126109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 15066. [D 20:42:47.126119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 15067. [D 20:42:47.126130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 15068. [D 20:42:47.126140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 15069. [D 20:42:47.126168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 15070. [D 20:42:47.126178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 15071. [D 20:42:47.126188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 15072. [D 20:42:47.126198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 15073. [D 20:42:47.126208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 15074. [D 20:42:47.126217] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 15075. [D 20:42:47.136607] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 15075. [D 20:42:47.136624] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 59/70. [D 20:42:47.136724] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.136740] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.136748] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.143503] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.143516] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.143525] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.143541] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3848 [D 20:42:47.143550] element 0: offset: 0x62a4d0, size: 24 [D 20:42:47.143560] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 60/70. [D 20:42:47.222945] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3842 [D 20:42:47.222962] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 0/70. [D 20:42:47.223064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15075. [D 20:42:47.223172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 15076. [D 20:42:47.223183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 15077. [D 20:42:47.223193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 15078. [D 20:42:47.223204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 15079. [D 20:42:47.223213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 15080. [D 20:42:47.223223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15081. [D 20:42:47.223233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15082. [D 20:42:47.223248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15083. [D 20:42:47.223258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 15084. [D 20:42:47.223268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 15085. [D 20:42:47.223294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 15086. [D 20:42:47.223305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 15087. [D 20:42:47.223331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 15088. [D 20:42:47.223342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15089. [D 20:42:47.223354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15090. [D 20:42:47.223364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15091. [D 20:42:47.223374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 15092. [D 20:42:47.223387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 15093. [D 20:42:47.223397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 15094. [D 20:42:47.223406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 15095. [D 20:42:47.223416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 15096. [D 20:42:47.223426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15097. [D 20:42:47.223436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15098. [D 20:42:47.223446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15099. [D 20:42:47.223468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 15100. [D 20:42:47.223478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 15101. [D 20:42:47.223488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 15102. [D 20:42:47.223497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 15103. [D 20:42:47.223528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 15104. [D 20:42:47.223538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15105. [D 20:42:47.223547] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15106. [D 20:42:47.229030] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 15106. [D 20:42:47.229048] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 1/70. [D 20:42:47.229111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.229125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.229134] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.306788] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3838 [D 20:42:47.306805] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 2/70. [D 20:42:47.306916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 15106. [D 20:42:47.307026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 15107. [D 20:42:47.307038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 15108. [D 20:42:47.307049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 15109. [D 20:42:47.307059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 15110. [D 20:42:47.307069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 15111. [D 20:42:47.307079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 15112. [D 20:42:47.307090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 15113. [D 20:42:47.307100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 15114. [D 20:42:47.307109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 15115. [D 20:42:47.307119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 15116. [D 20:42:47.307151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 15117. [D 20:42:47.307161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 15118. [D 20:42:47.307185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 15119. [D 20:42:47.307196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 15120. [D 20:42:47.307207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 15121. [D 20:42:47.307231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 15122. [D 20:42:47.307241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 15123. [D 20:42:47.307251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 15124. [D 20:42:47.307262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 15125. [D 20:42:47.307286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 15126. [D 20:42:47.307296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 15127. [D 20:42:47.307307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 15128. [D 20:42:47.307317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 15129. [D 20:42:47.307327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 15130. [D 20:42:47.307348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 15131. [D 20:42:47.307359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 15132. [D 20:42:47.307373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 15133. [D 20:42:47.307383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 15134. [D 20:42:47.307410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 15135. [D 20:42:47.307420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 15136. [D 20:42:47.307445] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 15137. [D 20:42:47.312882] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 15137. [D 20:42:47.312901] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 3/70. [D 20:42:47.315153] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.315169] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.315178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:47.321160] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.321174] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.321185] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:47.321219] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3850 [D 20:42:47.321229] element 0: offset: 0x655ed0, size: 24 [D 20:42:47.321242] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 4/70. [D 20:42:47.363806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.363869] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.363879] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.363916] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3854 [D 20:42:47.363930] element 0: offset: 0x64dd40, size: 24 [D 20:42:47.363943] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 5/70. [D 20:42:47.389155] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3845 [D 20:42:47.389174] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 6/70. [D 20:42:47.389233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 15137. [D 20:42:47.389299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 15138. [D 20:42:47.389355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 15139. [D 20:42:47.389366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 15140. [D 20:42:47.389377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 15141. [D 20:42:47.389387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 15142. [D 20:42:47.389397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 15143. [D 20:42:47.389416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 15144. [D 20:42:47.389432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 15145. [D 20:42:47.389442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 15146. [D 20:42:47.389452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 15147. [D 20:42:47.389485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 15148. [D 20:42:47.389495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 15149. [D 20:42:47.389518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 15150. [D 20:42:47.389527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 15151. [D 20:42:47.389537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 15152. [D 20:42:47.389561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 15153. [D 20:42:47.389571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 15154. [D 20:42:47.389581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 15155. [D 20:42:47.389603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 15156. [D 20:42:47.389614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 15157. [D 20:42:47.389624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 15158. [D 20:42:47.389643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 15159. [D 20:42:47.389657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 15160. [D 20:42:47.389667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 15161. [D 20:42:47.389686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 15162. [D 20:42:47.389697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 15163. [D 20:42:47.389719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 15164. [D 20:42:47.389730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 15165. [D 20:42:47.389740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 15166. [D 20:42:47.389768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 15167. [D 20:42:47.389778] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 15168. [D 20:42:47.395158] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 15168. [D 20:42:47.395176] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 7/70. [D 20:42:47.397457] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.397472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.397483] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.402395] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.402410] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.402420] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.402453] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3857 [D 20:42:47.402463] element 0: offset: 0x63e5c0, size: 24 [D 20:42:47.402475] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 8/70. [D 20:42:47.481014] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3857 [D 20:42:47.481033] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 9/70. [D 20:42:47.481149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 15168. [D 20:42:47.481254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 15169. [D 20:42:47.481265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 15170. [D 20:42:47.481276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 15171. [D 20:42:47.481290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 15172. [D 20:42:47.481300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 15173. [D 20:42:47.481310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 15174. [D 20:42:47.481324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 15175. [D 20:42:47.481333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 15176. [D 20:42:47.481343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 15177. [D 20:42:47.481373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 15178. [D 20:42:47.481384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 15179. [D 20:42:47.481395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 15180. [D 20:42:47.481405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 15181. [D 20:42:47.481415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 15182. [D 20:42:47.481424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 15183. [D 20:42:47.481453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 15184. [D 20:42:47.481463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 15185. [D 20:42:47.481489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 15186. [D 20:42:47.481500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 15187. [D 20:42:47.481512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 15188. [D 20:42:47.481521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 15189. [D 20:42:47.481531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 15190. [D 20:42:47.481547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 15191. [D 20:42:47.481594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 15192. [D 20:42:47.481611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 15193. [D 20:42:47.481636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 15194. [D 20:42:47.481647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 15195. [D 20:42:47.481656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 15196. [D 20:42:47.481666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 15197. [D 20:42:47.481676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 15198. [D 20:42:47.481686] openib_post_sr_rdmaw: ibv_post_send wr_id 63ded0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 15199. [D 20:42:47.487183] openib_check_cq: completed rdma wr_id 63ded0, nic_wr_credit 15199. [D 20:42:47.487201] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 10/70. [D 20:42:47.489573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.489588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.489598] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.492949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.492964] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.492974] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.493006] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3860 [D 20:42:47.493017] element 0: offset: 0x5b0030, size: 24 [D 20:42:47.493029] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 11/70. [D 20:42:47.544667] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3848 [D 20:42:47.544686] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 12/70. [D 20:42:47.544749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 15199. [D 20:42:47.544812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 15200. [D 20:42:47.544855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 15201. [D 20:42:47.544866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 15202. [D 20:42:47.544877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 15203. [D 20:42:47.544893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 15204. [D 20:42:47.544904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 15205. [D 20:42:47.544913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 15206. [D 20:42:47.544996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 15207. [D 20:42:47.545008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 15208. [D 20:42:47.545031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 15209. [D 20:42:47.545041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 15210. [D 20:42:47.545051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 15211. [D 20:42:47.545074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 15212. [D 20:42:47.545083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 15213. [D 20:42:47.545094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 15214. [D 20:42:47.545104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 15215. [D 20:42:47.545126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 15216. [D 20:42:47.545139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 15217. [D 20:42:47.545160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 15218. [D 20:42:47.545174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 15219. [D 20:42:47.545195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 15220. [D 20:42:47.545209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 15221. [D 20:42:47.545227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 15222. [D 20:42:47.545238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 15223. [D 20:42:47.545248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 15224. [D 20:42:47.545266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 15225. [D 20:42:47.545277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 15226. [D 20:42:47.545287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 15227. [D 20:42:47.545296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 15228. [D 20:42:47.545320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 15229. [D 20:42:47.545330] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 15230. [D 20:42:47.550666] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 15230. [D 20:42:47.550682] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 13/70. [D 20:42:47.552869] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.552884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.552894] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.559613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.559628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.559639] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.559672] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3863 [D 20:42:47.559683] element 0: offset: 0x657110, size: 24 [D 20:42:47.559697] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 14/70. [D 20:42:47.611751] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3860 [D 20:42:47.611770] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 15/70. [D 20:42:47.611831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 15230. [D 20:42:47.611898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 15231. [D 20:42:47.611952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 15232. [D 20:42:47.611964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 15233. [D 20:42:47.611974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 15234. [D 20:42:47.611984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 15235. [D 20:42:47.611995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 15236. [D 20:42:47.612014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 15237. [D 20:42:47.612030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 15238. [D 20:42:47.612040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 15239. [D 20:42:47.612049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 15240. [D 20:42:47.612080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 15241. [D 20:42:47.612090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 15242. [D 20:42:47.612116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 15243. [D 20:42:47.612126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 15244. [D 20:42:47.612139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 15245. [D 20:42:47.612160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 15246. [D 20:42:47.612172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 15247. [D 20:42:47.612181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 15248. [D 20:42:47.612205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 15249. [D 20:42:47.612215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 15250. [D 20:42:47.612225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 15251. [D 20:42:47.612235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 15252. [D 20:42:47.612247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 15253. [D 20:42:47.612256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 15254. [D 20:42:47.612284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 15255. [D 20:42:47.612294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 15256. [D 20:42:47.612304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 15257. [D 20:42:47.612320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 15258. [D 20:42:47.612342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 15259. [D 20:42:47.612356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 15260. [D 20:42:47.612378] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 15261. [D 20:42:47.617758] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 15261. [D 20:42:47.617775] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 16/70. [D 20:42:47.619925] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.619940] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.619950] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.624949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.624964] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.624975] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.625008] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3866 [D 20:42:47.625019] element 0: offset: 0x62a4d0, size: 24 [D 20:42:47.625031] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 17/70. [D 20:42:47.712448] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3863 [D 20:42:47.712467] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 18/70. [D 20:42:47.712558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 15261. [D 20:42:47.712662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 15262. [D 20:42:47.712674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 15263. [D 20:42:47.712684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 15264. [D 20:42:47.712699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 15265. [D 20:42:47.712709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 15266. [D 20:42:47.712719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 15267. [D 20:42:47.712733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 15268. [D 20:42:47.712743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 15269. [D 20:42:47.712752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 15270. [D 20:42:47.712782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 15271. [D 20:42:47.712793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 15272. [D 20:42:47.712804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 15273. [D 20:42:47.712814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 15274. [D 20:42:47.712823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 15275. [D 20:42:47.712834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 15276. [D 20:42:47.712844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 15277. [D 20:42:47.712866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 15278. [D 20:42:47.712877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 15279. [D 20:42:47.712903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 15280. [D 20:42:47.712914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 15281. [D 20:42:47.712924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 15282. [D 20:42:47.712955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 15283. [D 20:42:47.712965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 15284. [D 20:42:47.712975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 15285. [D 20:42:47.713003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 15286. [D 20:42:47.713013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 15287. [D 20:42:47.713024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 15288. [D 20:42:47.713034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 15289. [D 20:42:47.713044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 15290. [D 20:42:47.713071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 15291. [D 20:42:47.713091] openib_post_sr_rdmaw: ibv_post_send wr_id 63ded0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 15292. [D 20:42:47.718521] openib_check_cq: completed rdma wr_id 63ded0, nic_wr_credit 15292. [D 20:42:47.718539] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 19/70. [D 20:42:47.720801] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.720816] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.720826] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.727475] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.727491] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.727501] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.727533] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3869 [D 20:42:47.727543] element 0: offset: 0x691fe0, size: 24 [D 20:42:47.727555] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 20/70. [D 20:42:47.751477] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3850 [D 20:42:47.751496] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 21/70. [D 20:42:47.751555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15292. [D 20:42:47.751624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15293. [D 20:42:47.751688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15294. [D 20:42:47.751699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15295. [D 20:42:47.751710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15296. [D 20:42:47.751721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15297. [D 20:42:47.751742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15298. [D 20:42:47.751752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15299. [D 20:42:47.751766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15300. [D 20:42:47.751776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15301. [D 20:42:47.751786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15302. [D 20:42:47.751815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15303. [D 20:42:47.751825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15304. [D 20:42:47.751849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15305. [D 20:42:47.751866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15306. [D 20:42:47.751876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15307. [D 20:42:47.751899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15308. [D 20:42:47.751909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15309. [D 20:42:47.751920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15310. [D 20:42:47.751930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15311. [D 20:42:47.751947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15312. [D 20:42:47.751957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15313. [D 20:42:47.751967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15314. [D 20:42:47.751992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15315. [D 20:42:47.752002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15316. [D 20:42:47.752012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15317. [D 20:42:47.752035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15318. [D 20:42:47.752045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15319. [D 20:42:47.752055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15320. [D 20:42:47.752071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15321. [D 20:42:47.752081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15322. [D 20:42:47.752108] openib_post_sr_rdmaw: ibv_post_send wr_id 63ded0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15323. [D 20:42:47.757484] openib_check_cq: completed rdma wr_id 63ded0, nic_wr_credit 15323. [D 20:42:47.757503] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 22/70. [D 20:42:47.759717] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.759732] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.759743] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.764953] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.764968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.764978] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.765011] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3871 [D 20:42:47.765022] element 0: offset: 0x5b0030, size: 24 [D 20:42:47.765622] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 23/70. [D 20:42:47.840445] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3866 [D 20:42:47.840463] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 24/70. [D 20:42:47.840578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 15323. [D 20:42:47.840685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 15324. [D 20:42:47.840696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 15325. [D 20:42:47.840707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 15326. [D 20:42:47.840722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 15327. [D 20:42:47.840731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 15328. [D 20:42:47.840742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 15329. [D 20:42:47.840755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 15330. [D 20:42:47.840765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 15331. [D 20:42:47.840775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 15332. [D 20:42:47.840806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 15333. [D 20:42:47.840817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 15334. [D 20:42:47.840828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 15335. [D 20:42:47.840838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 15336. [D 20:42:47.840848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 15337. [D 20:42:47.840858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 15338. [D 20:42:47.840885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 15339. [D 20:42:47.840895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 15340. [D 20:42:47.840905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 15341. [D 20:42:47.840926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 15342. [D 20:42:47.840936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 15343. [D 20:42:47.840964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 15344. [D 20:42:47.840975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 15345. [D 20:42:47.840985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 15346. [D 20:42:47.840996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 15347. [D 20:42:47.841006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 15348. [D 20:42:47.841016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 15349. [D 20:42:47.841027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 15350. [D 20:42:47.841050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 15351. [D 20:42:47.841067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 15352. [D 20:42:47.841078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 15353. [D 20:42:47.841088] openib_post_sr_rdmaw: ibv_post_send wr_id 63ded0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 15354. [D 20:42:47.846545] openib_check_cq: completed rdma wr_id 63ded0, nic_wr_credit 15354. [D 20:42:47.846563] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 25/70. [D 20:42:47.848887] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.848902] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.848912] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.854173] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.854187] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.854197] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.854230] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3875 [D 20:42:47.854240] element 0: offset: 0x657110, size: 24 [D 20:42:47.854255] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 26/70. [D 20:42:47.958143] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3871 [D 20:42:47.958162] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 27/70. [D 20:42:47.958246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15354. [D 20:42:47.958357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15355. [D 20:42:47.958370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15356. [D 20:42:47.958381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15357. [D 20:42:47.958396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15358. [D 20:42:47.958406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15359. [D 20:42:47.958422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15360. [D 20:42:47.958433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15361. [D 20:42:47.958443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15362. [D 20:42:47.958454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15363. [D 20:42:47.958478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15364. [D 20:42:47.958489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15365. [D 20:42:47.958511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15366. [D 20:42:47.958523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15367. [D 20:42:47.958533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15368. [D 20:42:47.958553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15369. [D 20:42:47.958567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15370. [D 20:42:47.958577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15371. [D 20:42:47.958597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15372. [D 20:42:47.958608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15373. [D 20:42:47.958618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15374. [D 20:42:47.958640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15375. [D 20:42:47.958651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15376. [D 20:42:47.958661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15377. [D 20:42:47.958690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15378. [D 20:42:47.958701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15379. [D 20:42:47.958711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15380. [D 20:42:47.958721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15381. [D 20:42:47.958732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15382. [D 20:42:47.958743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15383. [D 20:42:47.958770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15384. [D 20:42:47.958780] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15385. [D 20:42:47.964251] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 15385. [D 20:42:47.964270] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 28/70. [D 20:42:47.964980] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:47.964995] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.965005] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:47.972157] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:47.972172] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:47.972194] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:47.972228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3877 [D 20:42:47.972239] element 0: offset: 0x63e5c0, size: 24 [D 20:42:47.972251] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 29/70. [D 20:42:48.017595] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3869 [D 20:42:48.017614] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 30/70. [D 20:42:48.017674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 15385. [D 20:42:48.017742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 15386. [D 20:42:48.017768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 15387. [D 20:42:48.017780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 15388. [D 20:42:48.017791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 15389. [D 20:42:48.017802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 15390. [D 20:42:48.017812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 15391. [D 20:42:48.017822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 15392. [D 20:42:48.017832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 15393. [D 20:42:48.017842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 15394. [D 20:42:48.017872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 15395. [D 20:42:48.017883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 15396. [D 20:42:48.017892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 15397. [D 20:42:48.017902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 15398. [D 20:42:48.017913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 15399. [D 20:42:48.017930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 15400. [D 20:42:48.017940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 15401. [D 20:42:48.017950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 15402. [D 20:42:48.017972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 15403. [D 20:42:48.017983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 15404. [D 20:42:48.017993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 15405. [D 20:42:48.018003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 15406. [D 20:42:48.018020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 15407. [D 20:42:48.018030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 15408. [D 20:42:48.018040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 15409. [D 20:42:48.018050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 15410. [D 20:42:48.018061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 15411. [D 20:42:48.018071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 15412. [D 20:42:48.018096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 15413. [D 20:42:48.018107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 15414. [D 20:42:48.018117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 15415. [D 20:42:48.018132] openib_post_sr_rdmaw: ibv_post_send wr_id 63ded0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 15416. [D 20:42:48.023602] openib_check_cq: completed rdma wr_id 63ded0, nic_wr_credit 15416. [D 20:42:48.023621] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 31/70. [D 20:42:48.025946] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.025962] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.025972] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.067906] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3854 [D 20:42:48.067926] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 32/70. [D 20:42:48.067986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 15416. [D 20:42:48.068095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 15417. [D 20:42:48.068110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 15418. [D 20:42:48.068121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 15419. [D 20:42:48.068132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 15420. [D 20:42:48.068142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 15421. [D 20:42:48.068152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 15422. [D 20:42:48.068175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 15423. [D 20:42:48.068189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 15424. [D 20:42:48.068199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 15425. [D 20:42:48.068209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 15426. [D 20:42:48.068238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 15427. [D 20:42:48.068251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 15428. [D 20:42:48.068275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 15429. [D 20:42:48.068286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 15430. [D 20:42:48.068309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 15431. [D 20:42:48.068319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 15432. [D 20:42:48.068333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 15433. [D 20:42:48.068354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 15434. [D 20:42:48.068367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 15435. [D 20:42:48.068377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 15436. [D 20:42:48.068400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 15437. [D 20:42:48.068410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 15438. [D 20:42:48.068433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 15439. [D 20:42:48.068443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 15440. [D 20:42:48.068468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 15441. [D 20:42:48.068478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 15442. [D 20:42:48.068500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 15443. [D 20:42:48.068511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 15444. [D 20:42:48.068522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 15445. [D 20:42:48.068532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 15446. [D 20:42:48.068542] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 15447. [D 20:42:48.073956] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 15447. [D 20:42:48.073975] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 33/70. [D 20:42:48.076262] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.076277] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.076287] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.080976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.080995] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.081005] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.081040] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3881 [D 20:42:48.081051] element 0: offset: 0x62a4d0, size: 24 [D 20:42:48.082626] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 34/70. [D 20:42:48.163580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.163647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.163657] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.163695] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3884 [D 20:42:48.163707] element 0: offset: 0x655b90, size: 24 [D 20:42:48.163720] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 35/70. [D 20:42:48.172321] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3877 [D 20:42:48.172342] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 36/70. [D 20:42:48.172404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15447. [D 20:42:48.172474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15448. [D 20:42:48.172494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15449. [D 20:42:48.172505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15450. [D 20:42:48.172516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15451. [D 20:42:48.172526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15452. [D 20:42:48.172540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15453. [D 20:42:48.172550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15454. [D 20:42:48.172561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15455. [D 20:42:48.172576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15456. [D 20:42:48.172586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15457. [D 20:42:48.172596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15458. [D 20:42:48.172611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15459. [D 20:42:48.172621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15460. [D 20:42:48.172631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15461. [D 20:42:48.172674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15462. [D 20:42:48.172686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15463. [D 20:42:48.172696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15464. [D 20:42:48.172706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15465. [D 20:42:48.172716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15466. [D 20:42:48.172727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15467. [D 20:42:48.172736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15468. [D 20:42:48.172747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15469. [D 20:42:48.172764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15470. [D 20:42:48.172797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15471. [D 20:42:48.172808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15472. [D 20:42:48.172818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15473. [D 20:42:48.172828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15474. [D 20:42:48.172839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15475. [D 20:42:48.172848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15476. [D 20:42:48.172858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15477. [D 20:42:48.172868] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15478. [D 20:42:48.178333] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 15478. [D 20:42:48.178351] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 37/70. [D 20:42:48.180582] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.180597] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.180607] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.186159] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.186173] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.186184] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.186216] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3886 [D 20:42:48.186226] element 0: offset: 0x61f310, size: 24 [D 20:42:48.186238] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 38/70. [D 20:42:48.224346] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3875 [D 20:42:48.224365] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 39/70. [D 20:42:48.224423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 15478. [D 20:42:48.224492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 15479. [D 20:42:48.224550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 15480. [D 20:42:48.224561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 15481. [D 20:42:48.224572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 15482. [D 20:42:48.224589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 15483. [D 20:42:48.224612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 15484. [D 20:42:48.224622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 15485. [D 20:42:48.224633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 15486. [D 20:42:48.224643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 15487. [D 20:42:48.224653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 15488. [D 20:42:48.224676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 15489. [D 20:42:48.224686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 15490. [D 20:42:48.224712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 15491. [D 20:42:48.224723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 15492. [D 20:42:48.224737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 15493. [D 20:42:48.224766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 15494. [D 20:42:48.224779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 15495. [D 20:42:48.224800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 15496. [D 20:42:48.224812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 15497. [D 20:42:48.224831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 15498. [D 20:42:48.224846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 15499. [D 20:42:48.224856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 15500. [D 20:42:48.224878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 15501. [D 20:42:48.224888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 15502. [D 20:42:48.224898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 15503. [D 20:42:48.224909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 15504. [D 20:42:48.224919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 15505. [D 20:42:48.224930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 15506. [D 20:42:48.224940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 15507. [D 20:42:48.224962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 15508. [D 20:42:48.224990] openib_post_sr_rdmaw: ibv_post_send wr_id 63ded0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 15509. [D 20:42:48.230349] openib_check_cq: completed rdma wr_id 63ded0, nic_wr_credit 15509. [D 20:42:48.230367] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 40/70. [D 20:42:48.232580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.232596] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.232605] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.236982] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.236996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.237006] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.237038] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3890 [D 20:42:48.237049] element 0: offset: 0x6252d0, size: 24 [D 20:42:48.237061] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 41/70. [D 20:42:48.262835] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3886 [D 20:42:48.262854] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 42/70. [D 20:42:48.262917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15509. [D 20:42:48.263027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15510. [D 20:42:48.263041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15511. [D 20:42:48.263052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15512. [D 20:42:48.263063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15513. [D 20:42:48.263074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15514. [D 20:42:48.263084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15515. [D 20:42:48.263094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15516. [D 20:42:48.263104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15517. [D 20:42:48.263115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15518. [D 20:42:48.263128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15519. [D 20:42:48.263138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15520. [D 20:42:48.263148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15521. [D 20:42:48.263172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15522. [D 20:42:48.263182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15523. [D 20:42:48.263192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15524. [D 20:42:48.263214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15525. [D 20:42:48.263224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15526. [D 20:42:48.263241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15527. [D 20:42:48.263262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15528. [D 20:42:48.263277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15529. [D 20:42:48.263288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15530. [D 20:42:48.263298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15531. [D 20:42:48.263309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15532. [D 20:42:48.263318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15533. [D 20:42:48.263328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15534. [D 20:42:48.263338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15535. [D 20:42:48.263372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15536. [D 20:42:48.263383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15537. [D 20:42:48.263394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15538. [D 20:42:48.263404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15539. [D 20:42:48.263426] openib_post_sr_rdmaw: ibv_post_send wr_id 632880 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15540. [D 20:42:48.268958] openib_check_cq: completed rdma wr_id 632880, nic_wr_credit 15540. [D 20:42:48.268991] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 43/70. [D 20:42:48.271243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.271258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.271268] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.357241] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3890 [D 20:42:48.357260] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 44/70. [D 20:42:48.357361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 15540. [D 20:42:48.357465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 15541. [D 20:42:48.357477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 15542. [D 20:42:48.357487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 15543. [D 20:42:48.357502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 15544. [D 20:42:48.357512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 15545. [D 20:42:48.357522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 15546. [D 20:42:48.357538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 15547. [D 20:42:48.357548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 15548. [D 20:42:48.357557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 15549. [D 20:42:48.357590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 15550. [D 20:42:48.357601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 15551. [D 20:42:48.357624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 15552. [D 20:42:48.357634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 15553. [D 20:42:48.357645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 15554. [D 20:42:48.357667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 15555. [D 20:42:48.357682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 15556. [D 20:42:48.357700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 15557. [D 20:42:48.357717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 15558. [D 20:42:48.357727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 15559. [D 20:42:48.357750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 15560. [D 20:42:48.357762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 15561. [D 20:42:48.357783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 15562. [D 20:42:48.357795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 15563. [D 20:42:48.357805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 15564. [D 20:42:48.357827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 15565. [D 20:42:48.357837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 15566. [D 20:42:48.357847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 15567. [D 20:42:48.357860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 15568. [D 20:42:48.357887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 15569. [D 20:42:48.357910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 15570. [D 20:42:48.357925] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 15571. [D 20:42:48.363389] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 15571. [D 20:42:48.363406] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 45/70. [D 20:42:48.365728] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.365744] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.365753] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.404993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.405057] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.405068] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.405104] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3892 [D 20:42:48.405118] element 0: offset: 0x63e5c0, size: 24 [D 20:42:48.405131] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 46/70. [D 20:42:48.409546] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3892 [D 20:42:48.409564] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 47/70. [D 20:42:48.409711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15571. [D 20:42:48.409779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15572. [D 20:42:48.409790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15573. [D 20:42:48.409800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15574. [D 20:42:48.409815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15575. [D 20:42:48.409825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15576. [D 20:42:48.409837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15577. [D 20:42:48.409851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15578. [D 20:42:48.409861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15579. [D 20:42:48.409871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15580. [D 20:42:48.409887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15581. [D 20:42:48.409897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15582. [D 20:42:48.409906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15583. [D 20:42:48.409922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15584. [D 20:42:48.409939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15585. [D 20:42:48.409973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15586. [D 20:42:48.409984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15587. [D 20:42:48.409995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15588. [D 20:42:48.410005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15589. [D 20:42:48.410042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15590. [D 20:42:48.410056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15591. [D 20:42:48.410066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15592. [D 20:42:48.410076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15593. [D 20:42:48.410086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15594. [D 20:42:48.410096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15595. [D 20:42:48.410405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15596. [D 20:42:48.410419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15597. [D 20:42:48.410429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15598. [D 20:42:48.410440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15599. [D 20:42:48.410450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15600. [D 20:42:48.410460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15601. [D 20:42:48.410471] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15602. [D 20:42:48.418447] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 15602. [D 20:42:48.418466] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 48/70. [D 20:42:48.420670] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.420685] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.420694] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.426192] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.426207] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.426217] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.426250] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3895 [D 20:42:48.426261] element 0: offset: 0x64dd40, size: 24 [D 20:42:48.426273] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 49/70. [D 20:42:48.430856] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3895 [D 20:42:48.430875] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 50/70. [D 20:42:48.431022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15602. [D 20:42:48.431089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15603. [D 20:42:48.431100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15604. [D 20:42:48.431111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15605. [D 20:42:48.431125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15606. [D 20:42:48.431135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15607. [D 20:42:48.431147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15608. [D 20:42:48.431162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15609. [D 20:42:48.431171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15610. [D 20:42:48.431181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15611. [D 20:42:48.431197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15612. [D 20:42:48.431207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15613. [D 20:42:48.431216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15614. [D 20:42:48.431232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15615. [D 20:42:48.431242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15616. [D 20:42:48.431251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15617. [D 20:42:48.431305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15618. [D 20:42:48.431318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15619. [D 20:42:48.431340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15620. [D 20:42:48.431353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15621. [D 20:42:48.431363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15622. [D 20:42:48.431373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15623. [D 20:42:48.431384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15624. [D 20:42:48.431394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15625. [D 20:42:48.431404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15626. [D 20:42:48.431414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15627. [D 20:42:48.431425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15628. [D 20:42:48.431434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15629. [D 20:42:48.431471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15630. [D 20:42:48.431482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15631. [D 20:42:48.431491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15632. [D 20:42:48.431501] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15633. [D 20:42:48.439825] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 15633. [D 20:42:48.439844] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 51/70. [D 20:42:48.441987] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.442002] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.442012] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.447738] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.447754] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.447764] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.447796] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3898 [D 20:42:48.447807] element 0: offset: 0x657110, size: 24 [D 20:42:48.447819] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 52/70. [D 20:42:48.448019] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3881 [D 20:42:48.448038] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 53/70. [D 20:42:48.448136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 15633. [D 20:42:48.448155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 15634. [D 20:42:48.448165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 15635. [D 20:42:48.448196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 15636. [D 20:42:48.448207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 15637. [D 20:42:48.448219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 15638. [D 20:42:48.448234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 15639. [D 20:42:48.448244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 15640. [D 20:42:48.448254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 15641. [D 20:42:48.448269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 15642. [D 20:42:48.448279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 15643. [D 20:42:48.448289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 15644. [D 20:42:48.448305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 15645. [D 20:42:48.448315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 15646. [D 20:42:48.448325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 15647. [D 20:42:48.448356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 15648. [D 20:42:48.448367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 15649. [D 20:42:48.448377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 15650. [D 20:42:48.448387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 15651. [D 20:42:48.448398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 15652. [D 20:42:48.448419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 15653. [D 20:42:48.448428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 15654. [D 20:42:48.448439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 15655. [D 20:42:48.448453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 15656. [D 20:42:48.448463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 15657. [D 20:42:48.448473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 15658. [D 20:42:48.448489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 15659. [D 20:42:48.448499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 15660. [D 20:42:48.448509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 15661. [D 20:42:48.448535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 15662. [D 20:42:48.448545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 15663. [D 20:42:48.448555] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 15664. [D 20:42:48.452787] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3898 [D 20:42:48.452805] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 54/70. [D 20:42:48.458270] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 15664. [D 20:42:48.458323] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 55/70. [D 20:42:48.458339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15664. [D 20:42:48.458356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15665. [D 20:42:48.458367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15666. [D 20:42:48.458377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15667. [D 20:42:48.458391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15668. [D 20:42:48.458401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15669. [D 20:42:48.458411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15670. [D 20:42:48.458427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15671. [D 20:42:48.458437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15672. [D 20:42:48.458446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15673. [D 20:42:48.458481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15674. [D 20:42:48.458491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15675. [D 20:42:48.458502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15676. [D 20:42:48.458511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15677. [D 20:42:48.458527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15678. [D 20:42:48.458537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15679. [D 20:42:48.458546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15680. [D 20:42:48.458556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15681. [D 20:42:48.458574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15682. [D 20:42:48.458584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15683. [D 20:42:48.458616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15684. [D 20:42:48.458626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15685. [D 20:42:48.458636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15686. [D 20:42:48.458647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15687. [D 20:42:48.458657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15688. [D 20:42:48.458667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15689. [D 20:42:48.458677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15690. [D 20:42:48.458703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15691. [D 20:42:48.458716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15692. [D 20:42:48.458726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15693. [D 20:42:48.458736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15694. [D 20:42:48.458752] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15695. [D 20:42:48.458864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.458881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.458903] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.465732] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 15695. [D 20:42:48.465791] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 56/70. [D 20:42:48.467971] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.467985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.467995] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.468031] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3902 [D 20:42:48.468045] element 0: offset: 0x2aaaab234fa0, size: 24 [D 20:42:48.468058] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 57/70. [D 20:42:48.468092] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.468104] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.468114] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.474051] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.474080] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.474091] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.474113] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3904 [D 20:42:48.474123] element 0: offset: 0x2aaaab2091e0, size: 24 [D 20:42:48.474135] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 58/70. [D 20:42:48.478502] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3904 [D 20:42:48.478523] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 59/70. [D 20:42:48.478588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15695. [D 20:42:48.478663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15696. [D 20:42:48.478675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15697. [D 20:42:48.478685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15698. [D 20:42:48.478696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15699. [D 20:42:48.478706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15700. [D 20:42:48.478721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15701. [D 20:42:48.478731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15702. [D 20:42:48.478741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15703. [D 20:42:48.478756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15704. [D 20:42:48.478766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15705. [D 20:42:48.478776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15706. [D 20:42:48.478791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15707. [D 20:42:48.478801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15708. [D 20:42:48.478811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15709. [D 20:42:48.478821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15710. [D 20:42:48.478839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15711. [D 20:42:48.478849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15712. [D 20:42:48.478859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15713. [D 20:42:48.478877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15714. [D 20:42:48.478886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15715. [D 20:42:48.478896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15716. [D 20:42:48.478906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15717. [D 20:42:48.478924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15718. [D 20:42:48.478934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15719. [D 20:42:48.478943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15720. [D 20:42:48.478954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15721. [D 20:42:48.478964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15722. [D 20:42:48.478974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15723. [D 20:42:48.478983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15724. [D 20:42:48.479033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15725. [D 20:42:48.479044] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15726. [D 20:42:48.485346] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 15726. [D 20:42:48.485371] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 60/70. [D 20:42:48.487615] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.487631] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.487641] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.497006] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.497023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.497033] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.497067] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3907 [D 20:42:48.497078] element 0: offset: 0x2aaaab211200, size: 24 [D 20:42:48.497092] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 0/70. [D 20:42:48.499450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.499465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.499474] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.499489] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3911 [D 20:42:48.499503] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:48.499512] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 1/70. [D 20:42:48.504282] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3907 [D 20:42:48.504301] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 2/70. [D 20:42:48.504454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15726. [D 20:42:48.504524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15727. [D 20:42:48.504535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15728. [D 20:42:48.504545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15729. [D 20:42:48.504559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15730. [D 20:42:48.504568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15731. [D 20:42:48.504580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15732. [D 20:42:48.504595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15733. [D 20:42:48.504605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15734. [D 20:42:48.504615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15735. [D 20:42:48.504653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15736. [D 20:42:48.504666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15737. [D 20:42:48.504676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15738. [D 20:42:48.504698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15739. [D 20:42:48.504715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15740. [D 20:42:48.504725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15741. [D 20:42:48.504735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15742. [D 20:42:48.504744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15743. [D 20:42:48.504754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15744. [D 20:42:48.504764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15745. [D 20:42:48.504773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15746. [D 20:42:48.504782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15747. [D 20:42:48.504792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15748. [D 20:42:48.504823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15749. [D 20:42:48.504833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15750. [D 20:42:48.504842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15751. [D 20:42:48.504852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15752. [D 20:42:48.504861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15753. [D 20:42:48.504871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15754. [D 20:42:48.504880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15755. [D 20:42:48.504890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15756. [D 20:42:48.504899] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15757. [D 20:42:48.505072] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3884 [D 20:42:48.505098] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 3/70. [D 20:42:48.516198] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 15757. [D 20:42:48.516268] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 4/70. [D 20:42:48.516286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 15757. [D 20:42:48.516301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 15758. [D 20:42:48.516313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 15759. [D 20:42:48.516323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 15760. [D 20:42:48.516339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 15761. [D 20:42:48.516351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 15762. [D 20:42:48.516361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 15763. [D 20:42:48.516371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 15764. [D 20:42:48.516382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 15765. [D 20:42:48.516392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 15766. [D 20:42:48.516406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 15767. [D 20:42:48.516459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 15768. [D 20:42:48.516470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 15769. [D 20:42:48.516481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 15770. [D 20:42:48.516505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 15771. [D 20:42:48.516515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 15772. [D 20:42:48.516525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 15773. [D 20:42:48.516541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 15774. [D 20:42:48.516550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 15775. [D 20:42:48.516560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 15776. [D 20:42:48.516576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 15777. [D 20:42:48.516586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 15778. [D 20:42:48.516596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 15779. [D 20:42:48.516606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 15780. [D 20:42:48.516616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 15781. [D 20:42:48.516626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 15782. [D 20:42:48.516636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 15783. [D 20:42:48.516646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 15784. [D 20:42:48.516671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 15785. [D 20:42:48.516681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 15786. [D 20:42:48.516691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 15787. [D 20:42:48.516707] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 15788. [D 20:42:48.516796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.516824] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.516834] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.523985] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 15788. [D 20:42:48.524000] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 5/70. [D 20:42:48.526157] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.526171] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.526181] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.526214] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3913 [D 20:42:48.526224] element 0: offset: 0x2aaaab2418e0, size: 24 [D 20:42:48.526239] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 6/70. [D 20:42:48.526259] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.526272] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.526281] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.532719] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.532782] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.532793] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.532830] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3917 [D 20:42:48.532841] element 0: offset: 0x2aaaab2091e0, size: 24 [D 20:42:48.532855] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 7/70. [D 20:42:48.535903] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3913 [D 20:42:48.535962] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 8/70. [D 20:42:48.536081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15788. [D 20:42:48.536128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15789. [D 20:42:48.536139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15790. [D 20:42:48.536149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15791. [D 20:42:48.536160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15792. [D 20:42:48.536170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15793. [D 20:42:48.536180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15794. [D 20:42:48.536195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15795. [D 20:42:48.536206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15796. [D 20:42:48.536216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15797. [D 20:42:48.536226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15798. [D 20:42:48.536243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15799. [D 20:42:48.536253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15800. [D 20:42:48.536263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15801. [D 20:42:48.536273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15802. [D 20:42:48.536288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15803. [D 20:42:48.536317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15804. [D 20:42:48.536332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15805. [D 20:42:48.536342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15806. [D 20:42:48.536365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15807. [D 20:42:48.536375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15808. [D 20:42:48.536386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15809. [D 20:42:48.536399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15810. [D 20:42:48.536409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15811. [D 20:42:48.536419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15812. [D 20:42:48.536448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15813. [D 20:42:48.536459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15814. [D 20:42:48.536470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15815. [D 20:42:48.536480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15816. [D 20:42:48.536490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15817. [D 20:42:48.536517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15818. [D 20:42:48.536528] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15819. [D 20:42:48.543131] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 15819. [D 20:42:48.543148] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 9/70. [D 20:42:48.545459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.545474] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.545484] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.551111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.551127] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.551138] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.551170] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3919 [D 20:42:48.551181] element 0: offset: 0x2aaaab211200, size: 24 [D 20:42:48.551194] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 10/70. [D 20:42:48.555800] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3919 [D 20:42:48.555876] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 11/70. [D 20:42:48.556009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15819. [D 20:42:48.556026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15820. [D 20:42:48.556037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15821. [D 20:42:48.556047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15822. [D 20:42:48.556058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15823. [D 20:42:48.556069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15824. [D 20:42:48.556078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15825. [D 20:42:48.556089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15826. [D 20:42:48.556099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15827. [D 20:42:48.556109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15828. [D 20:42:48.556119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15829. [D 20:42:48.556136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15830. [D 20:42:48.556146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15831. [D 20:42:48.556156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15832. [D 20:42:48.556212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15833. [D 20:42:48.556223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15834. [D 20:42:48.556233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15835. [D 20:42:48.556257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15836. [D 20:42:48.556268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15837. [D 20:42:48.556278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15838. [D 20:42:48.556289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15839. [D 20:42:48.556299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15840. [D 20:42:48.556309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15841. [D 20:42:48.556336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15842. [D 20:42:48.556346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15843. [D 20:42:48.556356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15844. [D 20:42:48.556366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15845. [D 20:42:48.556391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15846. [D 20:42:48.556402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15847. [D 20:42:48.556413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15848. [D 20:42:48.556423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15849. [D 20:42:48.556438] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15850. [D 20:42:48.564819] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 15850. [D 20:42:48.564860] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 12/70. [D 20:42:48.567038] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.567054] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.567065] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.572477] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.572492] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.572501] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.572534] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3922 [D 20:42:48.572545] element 0: offset: 0x2aaaab208c70, size: 24 [D 20:42:48.572558] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 13/70. [D 20:42:48.576792] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3922 [D 20:42:48.576861] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 14/70. [D 20:42:48.577006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 15850. [D 20:42:48.577022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 15851. [D 20:42:48.577033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 15852. [D 20:42:48.577043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 15853. [D 20:42:48.577054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 15854. [D 20:42:48.577064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 15855. [D 20:42:48.577074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 15856. [D 20:42:48.577084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 15857. [D 20:42:48.577095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 15858. [D 20:42:48.577105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 15859. [D 20:42:48.577115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 15860. [D 20:42:48.577172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 15861. [D 20:42:48.577182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 15862. [D 20:42:48.577192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 15863. [D 20:42:48.577217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 15864. [D 20:42:48.577227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 15865. [D 20:42:48.577237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 15866. [D 20:42:48.577248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 15867. [D 20:42:48.577258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 15868. [D 20:42:48.577268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 15869. [D 20:42:48.577292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 15870. [D 20:42:48.577302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 15871. [D 20:42:48.577318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 15872. [D 20:42:48.577328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 15873. [D 20:42:48.577349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 15874. [D 20:42:48.577360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 15875. [D 20:42:48.577370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 15876. [D 20:42:48.577385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 15877. [D 20:42:48.577395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 15878. [D 20:42:48.577405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 15879. [D 20:42:48.577420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 15880. [D 20:42:48.577446] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 15881. [D 20:42:48.582177] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3902 [D 20:42:48.582204] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 15/70. [D 20:42:48.586227] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 15881. [D 20:42:48.586244] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 16/70. [D 20:42:48.586256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 15881. [D 20:42:48.586266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 15882. [D 20:42:48.586277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 15883. [D 20:42:48.586287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 15884. [D 20:42:48.586297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 15885. [D 20:42:48.586313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 15886. [D 20:42:48.586323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 15887. [D 20:42:48.586333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 15888. [D 20:42:48.586349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 15889. [D 20:42:48.586359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 15890. [D 20:42:48.586369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 15891. [D 20:42:48.586385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 15892. [D 20:42:48.586395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 15893. [D 20:42:48.586405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 15894. [D 20:42:48.586438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 15895. [D 20:42:48.586449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 15896. [D 20:42:48.586460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 15897. [D 20:42:48.586470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 15898. [D 20:42:48.586480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 15899. [D 20:42:48.586505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 15900. [D 20:42:48.586515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 15901. [D 20:42:48.586526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 15902. [D 20:42:48.586536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 15903. [D 20:42:48.586557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 15904. [D 20:42:48.586567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 15905. [D 20:42:48.586577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 15906. [D 20:42:48.586593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 15907. [D 20:42:48.586603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 15908. [D 20:42:48.586613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 15909. [D 20:42:48.586637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 15910. [D 20:42:48.586646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 15911. [D 20:42:48.586657] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 15912. [D 20:42:48.588852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.588867] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.588877] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.592158] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 15912. [D 20:42:48.592173] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 17/70. [D 20:42:48.593036] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.593050] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.593059] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.601250] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.601265] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.601276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.601308] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3926 [D 20:42:48.601319] element 0: offset: 0x2aaaab208c70, size: 24 [D 20:42:48.601329] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 18/70. [D 20:42:48.617589] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3911 [D 20:42:48.617663] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 19/70. [D 20:42:48.617715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 15912. [D 20:42:48.617730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 15913. [D 20:42:48.617741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 15914. [D 20:42:48.617752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 15915. [D 20:42:48.617763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 15916. [D 20:42:48.617820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 15917. [D 20:42:48.617830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 15918. [D 20:42:48.617840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 15919. [D 20:42:48.617851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 15920. [D 20:42:48.617861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 15921. [D 20:42:48.617890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 15922. [D 20:42:48.617901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 15923. [D 20:42:48.617910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 15924. [D 20:42:48.617921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 15925. [D 20:42:48.617937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 15926. [D 20:42:48.617947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 15927. [D 20:42:48.617957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 15928. [D 20:42:48.617989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 15929. [D 20:42:48.618000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 15930. [D 20:42:48.618010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 15931. [D 20:42:48.618019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 15932. [D 20:42:48.618030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 15933. [D 20:42:48.618040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 15934. [D 20:42:48.618050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 15935. [D 20:42:48.618067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 15936. [D 20:42:48.618076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 15937. [D 20:42:48.618086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 15938. [D 20:42:48.618112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 15939. [D 20:42:48.618123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 15940. [D 20:42:48.618133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 15941. [D 20:42:48.618149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 15942. [D 20:42:48.618158] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 15943. [D 20:42:48.623593] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 15943. [D 20:42:48.623610] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 20/70. [D 20:42:48.625913] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.625928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.625938] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.631060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.631079] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.631091] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.631125] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3929 [D 20:42:48.631136] element 0: offset: 0x2aaaab208df0, size: 24 [D 20:42:48.631147] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 21/70. [D 20:42:48.672210] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3929 [D 20:42:48.672286] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 22/70. [D 20:42:48.672348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 15943. [D 20:42:48.672362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 15944. [D 20:42:48.672372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 15945. [D 20:42:48.672382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 15946. [D 20:42:48.672393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 15947. [D 20:42:48.672403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 15948. [D 20:42:48.672413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 15949. [D 20:42:48.672423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 15950. [D 20:42:48.672433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 15951. [D 20:42:48.672444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 15952. [D 20:42:48.672453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 15953. [D 20:42:48.672463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 15954. [D 20:42:48.672474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 15955. [D 20:42:48.672484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 15956. [D 20:42:48.672494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 15957. [D 20:42:48.672504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 15958. [D 20:42:48.672514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 15959. [D 20:42:48.672524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 15960. [D 20:42:48.672596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 15961. [D 20:42:48.672608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 15962. [D 20:42:48.672618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 15963. [D 20:42:48.672633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 15964. [D 20:42:48.672645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 15965. [D 20:42:48.672655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 15966. [D 20:42:48.672683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 15967. [D 20:42:48.672693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 15968. [D 20:42:48.672703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 15969. [D 20:42:48.672719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 15970. [D 20:42:48.672729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 15971. [D 20:42:48.672739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 15972. [D 20:42:48.672769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 15973. [D 20:42:48.672781] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 15974. [D 20:42:48.678229] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 15974. [D 20:42:48.678245] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 23/70. [D 20:42:48.680557] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.680572] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.680582] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.686109] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.686124] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.686134] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.686167] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3932 [D 20:42:48.686178] element 0: offset: 0x2aaaab2418e0, size: 24 [D 20:42:48.686191] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 24/70. [D 20:42:48.721914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.721982] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.721993] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.722029] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3934 [D 20:42:48.722043] element 0: offset: 0x2aaaab234fa0, size: 24 [D 20:42:48.722057] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 25/70. [D 20:42:48.726470] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3934 [D 20:42:48.726525] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 26/70. [D 20:42:48.726721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 15974. [D 20:42:48.726789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 15975. [D 20:42:48.726800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 15976. [D 20:42:48.726811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 15977. [D 20:42:48.726825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 15978. [D 20:42:48.726835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 15979. [D 20:42:48.726844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 15980. [D 20:42:48.726859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 15981. [D 20:42:48.726869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 15982. [D 20:42:48.726879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 15983. [D 20:42:48.726889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 15984. [D 20:42:48.726900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 15985. [D 20:42:48.726910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 15986. [D 20:42:48.726958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 15987. [D 20:42:48.726971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 15988. [D 20:42:48.726982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 15989. [D 20:42:48.726992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 15990. [D 20:42:48.727017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 15991. [D 20:42:48.727027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 15992. [D 20:42:48.727037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 15993. [D 20:42:48.727047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 15994. [D 20:42:48.727057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 15995. [D 20:42:48.727068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 15996. [D 20:42:48.727102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 15997. [D 20:42:48.727112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 15998. [D 20:42:48.727122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 15999. [D 20:42:48.727132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 16000. [D 20:42:48.727156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 16001. [D 20:42:48.727166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 16002. [D 20:42:48.727180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 16003. [D 20:42:48.727190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 16004. [D 20:42:48.727200] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 16005. [D 20:42:48.735329] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 16005. [D 20:42:48.735348] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 27/70. [D 20:42:48.737482] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.737496] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.737507] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.742632] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.742647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.742657] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.742689] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3937 [D 20:42:48.742700] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:48.742724] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 28/70. [D 20:42:48.746770] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3937 [D 20:42:48.746787] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 29/70. [D 20:42:48.746930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 16005. [D 20:42:48.746990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 16006. [D 20:42:48.747001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 16007. [D 20:42:48.747012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 16008. [D 20:42:48.747026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 16009. [D 20:42:48.747036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 16010. [D 20:42:48.747054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 16011. [D 20:42:48.747064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 16012. [D 20:42:48.747074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 16013. [D 20:42:48.747084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 16014. [D 20:42:48.747095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 16015. [D 20:42:48.747105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 16016. [D 20:42:48.747116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 16017. [D 20:42:48.747288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 16018. [D 20:42:48.747301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 16019. [D 20:42:48.747312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 16020. [D 20:42:48.747322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 16021. [D 20:42:48.747333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 16022. [D 20:42:48.747343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 16023. [D 20:42:48.747353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 16024. [D 20:42:48.747364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 16025. [D 20:42:48.747374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 16026. [D 20:42:48.747383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 16027. [D 20:42:48.747399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 16028. [D 20:42:48.747410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 16029. [D 20:42:48.747419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 16030. [D 20:42:48.747435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 16031. [D 20:42:48.747445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 16032. [D 20:42:48.747455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 16033. [D 20:42:48.747491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 16034. [D 20:42:48.747502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 16035. [D 20:42:48.747512] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 16036. [D 20:42:48.756172] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16036. [D 20:42:48.756192] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 30/70. [D 20:42:48.756266] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.756281] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.756291] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.761342] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.761356] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.761364] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.761389] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3940 [D 20:42:48.761399] element 0: offset: 0x2aaaab211240, size: 24 [D 20:42:48.761409] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 31/70. [D 20:42:48.765519] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3940 [D 20:42:48.765537] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 32/70. [D 20:42:48.765678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 16036. [D 20:42:48.765745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 16037. [D 20:42:48.765756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 16038. [D 20:42:48.765767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 16039. [D 20:42:48.765781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 16040. [D 20:42:48.765791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 16041. [D 20:42:48.765804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 16042. [D 20:42:48.765818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 16043. [D 20:42:48.765828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 16044. [D 20:42:48.765838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 16045. [D 20:42:48.765875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 16046. [D 20:42:48.765886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 16047. [D 20:42:48.765896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 16048. [D 20:42:48.765906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 16049. [D 20:42:48.765942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 16050. [D 20:42:48.765953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 16051. [D 20:42:48.765963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 16052. [D 20:42:48.765973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 16053. [D 20:42:48.766001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 16054. [D 20:42:48.766010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 16055. [D 20:42:48.766020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 16056. [D 20:42:48.766031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 16057. [D 20:42:48.766041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 16058. [D 20:42:48.766066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 16059. [D 20:42:48.766077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 16060. [D 20:42:48.766087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 16061. [D 20:42:48.766097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 16062. [D 20:42:48.766113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 16063. [D 20:42:48.766123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 16064. [D 20:42:48.766133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 16065. [D 20:42:48.766163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 16066. [D 20:42:48.766173] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 16067. [D 20:42:48.770173] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3932 [D 20:42:48.770191] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 33/70. [D 20:42:48.776874] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16067. [D 20:42:48.776907] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 34/70. [D 20:42:48.776920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 16067. [D 20:42:48.776931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 16068. [D 20:42:48.776942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 16069. [D 20:42:48.776952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 16070. [D 20:42:48.776962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 16071. [D 20:42:48.776972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 16072. [D 20:42:48.776983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 16073. [D 20:42:48.776993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 16074. [D 20:42:48.777017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 16075. [D 20:42:48.777029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 16076. [D 20:42:48.777039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 16077. [D 20:42:48.777055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 16078. [D 20:42:48.777065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 16079. [D 20:42:48.777074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 16080. [D 20:42:48.777102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 16081. [D 20:42:48.777112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 16082. [D 20:42:48.777127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 16083. [D 20:42:48.777137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 16084. [D 20:42:48.777147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 16085. [D 20:42:48.777173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 16086. [D 20:42:48.777183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 16087. [D 20:42:48.777197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 16088. [D 20:42:48.777206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 16089. [D 20:42:48.777216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 16090. [D 20:42:48.777244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 16091. [D 20:42:48.777259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 16092. [D 20:42:48.777269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 16093. [D 20:42:48.777279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 16094. [D 20:42:48.777308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 16095. [D 20:42:48.777318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 16096. [D 20:42:48.777333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 16097. [D 20:42:48.777343] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 16098. [D 20:42:48.777404] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.777419] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.777428] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.782080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.782094] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.782102] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.782118] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3943 [D 20:42:48.782128] element 0: offset: 0x2aaaab208df0, size: 24 [D 20:42:48.782138] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 35/70. [D 20:42:48.782866] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16098. [D 20:42:48.782898] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 36/70. [D 20:42:48.782962] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.782977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.782985] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.787292] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3943 [D 20:42:48.787309] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 37/70. [D 20:42:48.788284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 16098. [D 20:42:48.788343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 16099. [D 20:42:48.788354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 16100. [D 20:42:48.788364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 16101. [D 20:42:48.788379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 16102. [D 20:42:48.788389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 16103. [D 20:42:48.788399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 16104. [D 20:42:48.788413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 16105. [D 20:42:48.788423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 16106. [D 20:42:48.788433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 16107. [D 20:42:48.788487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 16108. [D 20:42:48.788498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 16109. [D 20:42:48.788507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 16110. [D 20:42:48.788532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 16111. [D 20:42:48.788542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 16112. [D 20:42:48.788552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 16113. [D 20:42:48.788562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 16114. [D 20:42:48.788572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 16115. [D 20:42:48.788582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 16116. [D 20:42:48.788609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 16117. [D 20:42:48.788620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 16118. [D 20:42:48.788631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 16119. [D 20:42:48.788640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 16120. [D 20:42:48.788651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 16121. [D 20:42:48.788674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 16122. [D 20:42:48.788692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 16123. [D 20:42:48.788703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 16124. [D 20:42:48.788712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 16125. [D 20:42:48.788738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 16126. [D 20:42:48.788748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 16127. [D 20:42:48.788758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 16128. [D 20:42:48.788768] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 16129. [D 20:42:48.788852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.788868] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.788876] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.788892] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3947 [D 20:42:48.788902] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:48.788912] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 38/70. [D 20:42:48.800139] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16129. [D 20:42:48.800161] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 39/70. [D 20:42:48.800225] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.800240] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.800248] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.805359] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.805372] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.805380] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.805395] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3949 [D 20:42:48.805405] element 0: offset: 0x2aaaab2033f0, size: 24 [D 20:42:48.805415] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 40/70. [D 20:42:48.809418] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3949 [D 20:42:48.809435] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 41/70. [D 20:42:48.809611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 16129. [D 20:42:48.809677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 16130. [D 20:42:48.809689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 16131. [D 20:42:48.809700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 16132. [D 20:42:48.809714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 16133. [D 20:42:48.809724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 16134. [D 20:42:48.809734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 16135. [D 20:42:48.809748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 16136. [D 20:42:48.809758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 16137. [D 20:42:48.809768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 16138. [D 20:42:48.809783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 16139. [D 20:42:48.809793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 16140. [D 20:42:48.809803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 16141. [D 20:42:48.809819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 16142. [D 20:42:48.809829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 16143. [D 20:42:48.809839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 16144. [D 20:42:48.809872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 16145. [D 20:42:48.809882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 16146. [D 20:42:48.809893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 16147. [D 20:42:48.809903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 16148. [D 20:42:48.809913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 16149. [D 20:42:48.809937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 16150. [D 20:42:48.809948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 16151. [D 20:42:48.809959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 16152. [D 20:42:48.809968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 16153. [D 20:42:48.809979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 16154. [D 20:42:48.809989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 16155. [D 20:42:48.810000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 16156. [D 20:42:48.810029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 16157. [D 20:42:48.810039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 16158. [D 20:42:48.810062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 16159. [D 20:42:48.810072] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 16160. [D 20:42:48.821359] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16160. [D 20:42:48.821424] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 42/70. [D 20:42:48.821525] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.821541] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.821550] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.831501] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.831515] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.831523] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.831539] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3952 [D 20:42:48.831548] element 0: offset: 0x2aaaab2418e0, size: 24 [D 20:42:48.831559] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 43/70. [D 20:42:48.835634] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3952 [D 20:42:48.835651] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 44/70. [D 20:42:48.835766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 16160. [D 20:42:48.835864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 16161. [D 20:42:48.835875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 16162. [D 20:42:48.835885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 16163. [D 20:42:48.835900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 16164. [D 20:42:48.835910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 16165. [D 20:42:48.835920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 16166. [D 20:42:48.835934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 16167. [D 20:42:48.835944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 16168. [D 20:42:48.835954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 16169. [D 20:42:48.835964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 16170. [D 20:42:48.835975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 16171. [D 20:42:48.835985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 16172. [D 20:42:48.835995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 16173. [D 20:42:48.836028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 16174. [D 20:42:48.836039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 16175. [D 20:42:48.836049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 16176. [D 20:42:48.836059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 16177. [D 20:42:48.836075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 16178. [D 20:42:48.836084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 16179. [D 20:42:48.836094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 16180. [D 20:42:48.836104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 16181. [D 20:42:48.836122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 16182. [D 20:42:48.836132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 16183. [D 20:42:48.836142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 16184. [D 20:42:48.836166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 16185. [D 20:42:48.836177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 16186. [D 20:42:48.836187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 16187. [D 20:42:48.836198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 16188. [D 20:42:48.836208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 16189. [D 20:42:48.836218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 16190. [D 20:42:48.836242] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 16191. [D 20:42:48.847169] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16191. [D 20:42:48.847188] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 45/70. [D 20:42:48.847251] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.847265] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.847274] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.852056] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3926 [D 20:42:48.852073] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 46/70. [D 20:42:48.852120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 16191. [D 20:42:48.852140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 16192. [D 20:42:48.852152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 16193. [D 20:42:48.852162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 16194. [D 20:42:48.852172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 16195. [D 20:42:48.852182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 16196. [D 20:42:48.852192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 16197. [D 20:42:48.852208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 16198. [D 20:42:48.852218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 16199. [D 20:42:48.852229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 16200. [D 20:42:48.852238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 16201. [D 20:42:48.852254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 16202. [D 20:42:48.852264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 16203. [D 20:42:48.852292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 16204. [D 20:42:48.852302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 16205. [D 20:42:48.852317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 16206. [D 20:42:48.852340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 16207. [D 20:42:48.852351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 16208. [D 20:42:48.852362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 16209. [D 20:42:48.852371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 16210. [D 20:42:48.852382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 16211. [D 20:42:48.852405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 16212. [D 20:42:48.852419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 16213. [D 20:42:48.852430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 16214. [D 20:42:48.852440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 16215. [D 20:42:48.852463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 16216. [D 20:42:48.852474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 16217. [D 20:42:48.852484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 16218. [D 20:42:48.852498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 16219. [D 20:42:48.852508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 16220. [D 20:42:48.852518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 16221. [D 20:42:48.852541] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 16222. [D 20:42:48.852580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.852595] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.852604] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.852620] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3955 [D 20:42:48.852629] element 0: offset: 0x2aaaab234fa0, size: 24 [D 20:42:48.852642] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 47/70. [D 20:42:48.859198] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16222. [D 20:42:48.859218] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 48/70. [D 20:42:48.859321] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.859335] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.859343] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.863548] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3955 [D 20:42:48.863565] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 49/70. [D 20:42:48.865521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 16222. [D 20:42:48.865572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 16223. [D 20:42:48.865584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 16224. [D 20:42:48.865595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 16225. [D 20:42:48.865605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 16226. [D 20:42:48.865616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 16227. [D 20:42:48.865626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 16228. [D 20:42:48.865636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 16229. [D 20:42:48.865646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 16230. [D 20:42:48.865656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 16231. [D 20:42:48.865666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 16232. [D 20:42:48.865683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 16233. [D 20:42:48.865693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 16234. [D 20:42:48.865702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 16235. [D 20:42:48.865753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 16236. [D 20:42:48.865764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 16237. [D 20:42:48.865774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 16238. [D 20:42:48.865784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 16239. [D 20:42:48.865794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 16240. [D 20:42:48.865805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 16241. [D 20:42:48.865815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 16242. [D 20:42:48.865845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 16243. [D 20:42:48.865873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 16244. [D 20:42:48.866327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 16245. [D 20:42:48.866339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 16246. [D 20:42:48.866349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 16247. [D 20:42:48.866360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 16248. [D 20:42:48.866370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 16249. [D 20:42:48.866379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 16250. [D 20:42:48.866394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 16251. [D 20:42:48.866405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 16252. [D 20:42:48.866414] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 16253. [D 20:42:48.866476] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.866491] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.866500] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.866516] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3959 [D 20:42:48.866525] element 0: offset: 0x2aaaab2033f0, size: 24 [D 20:42:48.866535] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 50/70. [D 20:42:48.872812] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16253. [D 20:42:48.872884] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 51/70. [D 20:42:48.872983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.872998] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.873009] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.878179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.878193] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.878201] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:48.878217] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3961 [D 20:42:48.878226] element 0: offset: 0x2aaaab211240, size: 24 [D 20:42:48.878237] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 52/70. [D 20:42:48.882369] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3961 [D 20:42:48.882386] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 53/70. [D 20:42:48.882507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 16253. [D 20:42:48.882612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 16254. [D 20:42:48.882623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 16255. [D 20:42:48.882633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 16256. [D 20:42:48.882644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 16257. [D 20:42:48.882654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 16258. [D 20:42:48.882664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 16259. [D 20:42:48.882674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 16260. [D 20:42:48.882684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 16261. [D 20:42:48.882694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 16262. [D 20:42:48.882704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 16263. [D 20:42:48.882722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 16264. [D 20:42:48.882732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 16265. [D 20:42:48.882742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 16266. [D 20:42:48.882752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 16267. [D 20:42:48.882762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 16268. [D 20:42:48.882772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 16269. [D 20:42:48.882801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 16270. [D 20:42:48.882812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 16271. [D 20:42:48.882823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 16272. [D 20:42:48.882833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 16273. [D 20:42:48.882843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 16274. [D 20:42:48.882854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 16275. [D 20:42:48.882878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 16276. [D 20:42:48.882889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 16277. [D 20:42:48.882899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 16278. [D 20:42:48.882909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 16279. [D 20:42:48.882941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 16280. [D 20:42:48.882953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 16281. [D 20:42:48.882963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 16282. [D 20:42:48.882973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 16283. [D 20:42:48.882983] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 16284. [D 20:42:48.893810] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16284. [D 20:42:48.893881] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 54/70. [D 20:42:48.893942] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.893957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.893966] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:48.896865] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3947 [D 20:42:48.896882] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 55/70. [D 20:42:48.898500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 16284. [D 20:42:48.898521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 16285. [D 20:42:48.898532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 16286. [D 20:42:48.898543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 16287. [D 20:42:48.898556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 16288. [D 20:42:48.898571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 16289. [D 20:42:48.898580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 16290. [D 20:42:48.898590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 16291. [D 20:42:48.898606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 16292. [D 20:42:48.898616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 16293. [D 20:42:48.898626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 16294. [D 20:42:48.898641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 16295. [D 20:42:48.898651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 16296. [D 20:42:48.898661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 16297. [D 20:42:48.898692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 16298. [D 20:42:48.898702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 16299. [D 20:42:48.898713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 16300. [D 20:42:48.898723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 16301. [D 20:42:48.898739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 16302. [D 20:42:48.898770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 16303. [D 20:42:48.898780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 16304. [D 20:42:48.898790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 16305. [D 20:42:48.898819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 16306. [D 20:42:48.898835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 16307. [D 20:42:48.898845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 16308. [D 20:42:48.898855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 16309. [D 20:42:48.898880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 16310. [D 20:42:48.898890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 16311. [D 20:42:48.898901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 16312. [D 20:42:48.898911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 16313. [D 20:42:48.898921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 16314. [D 20:42:48.898932] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 16315. [D 20:42:48.904431] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16315. [D 20:42:48.904447] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 56/70. [D 20:42:48.904493] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.904508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.904517] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.910354] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.910367] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.910375] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.910391] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3965 [D 20:42:48.910400] element 0: offset: 0x2aaaab208c70, size: 24 [D 20:42:48.910412] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 57/70. [D 20:42:48.977639] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3965 [D 20:42:48.977656] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 58/70. [D 20:42:48.977715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 16315. [D 20:42:48.977785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 16316. [D 20:42:48.977841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 16317. [D 20:42:48.977852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 16318. [D 20:42:48.977862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 16319. [D 20:42:48.977878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 16320. [D 20:42:48.977903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 16321. [D 20:42:48.977914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 16322. [D 20:42:48.977925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 16323. [D 20:42:48.977934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 16324. [D 20:42:48.977945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 16325. [D 20:42:48.977967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 16326. [D 20:42:48.977980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 16327. [D 20:42:48.978006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 16328. [D 20:42:48.978016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 16329. [D 20:42:48.978046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 16330. [D 20:42:48.978056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 16331. [D 20:42:48.978067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 16332. [D 20:42:48.978089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 16333. [D 20:42:48.978100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 16334. [D 20:42:48.978111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 16335. [D 20:42:48.978131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 16336. [D 20:42:48.978141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 16337. [D 20:42:48.978151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 16338. [D 20:42:48.978173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 16339. [D 20:42:48.978189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 16340. [D 20:42:48.978199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 16341. [D 20:42:48.978209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 16342. [D 20:42:48.978218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 16343. [D 20:42:48.978245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 16344. [D 20:42:48.978256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 16345. [D 20:42:48.978276] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 16346. [D 20:42:48.983701] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16346. [D 20:42:48.983718] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 59/70. [D 20:42:48.983783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:48.983797] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.983806] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:48.989568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:48.989582] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:48.989590] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:48.989606] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3968 [D 20:42:48.989616] element 0: offset: 0x2aaaab208df0, size: 24 [D 20:42:48.989626] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 60/70. [D 20:42:49.029500] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.029514] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.029523] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:49.029539] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3970 [D 20:42:49.029548] element 0: offset: 0x2aaaab234fa0, size: 24 [D 20:42:49.029558] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 0/70. [D 20:42:49.032375] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 675520, tag: 3970 [D 20:42:49.032392] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 1/70. [D 20:42:49.032449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 16346. [D 20:42:49.032519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 16347. [D 20:42:49.032574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 16348. [D 20:42:49.032585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 16349. [D 20:42:49.032596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 16350. [D 20:42:49.032607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 16351. [D 20:42:49.032616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 16352. [D 20:42:49.032627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 16353. [D 20:42:49.032636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 16354. [D 20:42:49.032653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 16355. [D 20:42:49.032663] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 16356. [D 20:42:49.035138] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3959 [D 20:42:49.035156] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 2/70. [D 20:42:49.035666] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16356. [D 20:42:49.035686] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 3/70. [D 20:42:49.035722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 16356. [D 20:42:49.035733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 16357. [D 20:42:49.035743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 16358. [D 20:42:49.035753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 16359. [D 20:42:49.035763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 16360. [D 20:42:49.035779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 16361. [D 20:42:49.035789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 16362. [D 20:42:49.035814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 16363. [D 20:42:49.035834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 16364. [D 20:42:49.035849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 16365. [D 20:42:49.035863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 16366. [D 20:42:49.035873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 16367. [D 20:42:49.035883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 16368. [D 20:42:49.035893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 16369. [D 20:42:49.035903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 16370. [D 20:42:49.035925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 16371. [D 20:42:49.035935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 16372. [D 20:42:49.035945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 16373. [D 20:42:49.035965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 16374. [D 20:42:49.035975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 16375. [D 20:42:49.036011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 16376. [D 20:42:49.036022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 16377. [D 20:42:49.036032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 16378. [D 20:42:49.036045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 16379. [D 20:42:49.036055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 16380. [D 20:42:49.036065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 16381. [D 20:42:49.036088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 16382. [D 20:42:49.036099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 16383. [D 20:42:49.036119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 16384. [D 20:42:49.036129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 16385. [D 20:42:49.036139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 16386. [D 20:42:49.036149] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 16387. [D 20:42:49.036209] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.036224] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.036233] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:49.040635] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.040649] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.040658] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:49.040673] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3973 [D 20:42:49.040683] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:42:49.040693] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 4/70. [D 20:42:49.042106] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16387. [D 20:42:49.042126] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 5/70. [D 20:42:49.042181] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.042195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.042204] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:49.042216] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.042225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.042234] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:49.051349] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.051363] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.051371] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:49.051387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3977 [D 20:42:49.051396] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:49.051406] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 6/70. [D 20:42:49.093504] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3968 [D 20:42:49.093522] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 7/70. [D 20:42:49.093581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 16387. [D 20:42:49.093676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 16388. [D 20:42:49.093690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 16389. [D 20:42:49.093701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 16390. [D 20:42:49.093712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 16391. [D 20:42:49.093723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 16392. [D 20:42:49.093734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 16393. [D 20:42:49.093744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 16394. [D 20:42:49.093768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 16395. [D 20:42:49.093779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 16396. [D 20:42:49.093789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 16397. [D 20:42:49.093799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 16398. [D 20:42:49.093847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 16399. [D 20:42:49.093857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 16400. [D 20:42:49.093867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 16401. [D 20:42:49.093878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 16402. [D 20:42:49.093901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 16403. [D 20:42:49.093913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 16404. [D 20:42:49.093924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 16405. [D 20:42:49.093934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 16406. [D 20:42:49.093944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 16407. [D 20:42:49.093969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 16408. [D 20:42:49.093980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 16409. [D 20:42:49.093990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 16410. [D 20:42:49.094000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 16411. [D 20:42:49.094010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 16412. [D 20:42:49.094033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 16413. [D 20:42:49.094058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 16414. [D 20:42:49.094068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 16415. [D 20:42:49.094079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 16416. [D 20:42:49.094103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 16417. [D 20:42:49.094113] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 16418. [D 20:42:49.099534] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16418. [D 20:42:49.099551] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 8/70. [D 20:42:49.099614] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.099629] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.099637] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:49.105443] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.105457] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.105465] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:49.105481] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3980 [D 20:42:49.105491] element 0: offset: 0x2aaaab22ec60, size: 24 [D 20:42:49.105501] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 9/70. [D 20:42:49.159640] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3917 [D 20:42:49.159658] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 10/70. [D 20:42:49.159720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 16418. [D 20:42:49.159818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 16419. [D 20:42:49.159832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 16420. [D 20:42:49.159843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 16421. [D 20:42:49.159854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 16422. [D 20:42:49.159864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 16423. [D 20:42:49.159874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 16424. [D 20:42:49.159884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 16425. [D 20:42:49.159917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 16426. [D 20:42:49.159928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 16427. [D 20:42:49.159954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 16428. [D 20:42:49.159965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 16429. [D 20:42:49.159977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 16430. [D 20:42:49.159999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 16431. [D 20:42:49.160012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 16432. [D 20:42:49.160022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 16433. [D 20:42:49.160045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 16434. [D 20:42:49.160055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 16435. [D 20:42:49.160077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 16436. [D 20:42:49.160087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 16437. [D 20:42:49.160098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 16438. [D 20:42:49.160120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 16439. [D 20:42:49.160130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 16440. [D 20:42:49.160157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 16441. [D 20:42:49.160168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 16442. [D 20:42:49.160192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 16443. [D 20:42:49.160202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 16444. [D 20:42:49.160215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 16445. [D 20:42:49.160225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 16446. [D 20:42:49.160248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 16447. [D 20:42:49.160258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 16448. [D 20:42:49.160268] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 16449. [D 20:42:49.165678] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16449. [D 20:42:49.165697] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 11/70. [D 20:42:49.165761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.165775] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.165784] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:49.171915] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.171929] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.171937] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:49.171953] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3983 [D 20:42:49.171962] element 0: offset: 0x2aaaab208c70, size: 24 [D 20:42:49.171972] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 12/70. [D 20:42:49.236196] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3980 [D 20:42:49.236213] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 13/70. [D 20:42:49.236274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 16449. [D 20:42:49.236382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 16450. [D 20:42:49.236396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 16451. [D 20:42:49.236407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 16452. [D 20:42:49.236418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 16453. [D 20:42:49.236428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 16454. [D 20:42:49.236439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 16455. [D 20:42:49.236449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 16456. [D 20:42:49.236459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 16457. [D 20:42:49.236469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 16458. [D 20:42:49.236481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 16459. [D 20:42:49.236491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 16460. [D 20:42:49.236501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 16461. [D 20:42:49.236511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 16462. [D 20:42:49.236530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 16463. [D 20:42:49.236540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 16464. [D 20:42:49.236550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 16465. [D 20:42:49.236577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 16466. [D 20:42:49.236587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 16467. [D 20:42:49.236597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 16468. [D 20:42:49.236613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 16469. [D 20:42:49.236623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 16470. [D 20:42:49.236633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 16471. [D 20:42:49.236662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 16472. [D 20:42:49.236673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 16473. [D 20:42:49.236684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 16474. [D 20:42:49.236694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 16475. [D 20:42:49.236718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 16476. [D 20:42:49.236728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 16477. [D 20:42:49.236738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 16478. [D 20:42:49.236761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 16479. [D 20:42:49.236771] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 16480. [D 20:42:49.242241] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16480. [D 20:42:49.242259] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 14/70. [D 20:42:49.242324] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.242338] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.242347] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:49.248076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.248090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.248098] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:49.248114] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3986 [D 20:42:49.248123] element 0: offset: 0x2aaaab234fa0, size: 24 [D 20:42:49.248133] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 15/70. [D 20:42:49.303136] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3977 [D 20:42:49.303153] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 16/70. [D 20:42:49.303210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 16480. [D 20:42:49.303276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 16481. [D 20:42:49.303331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 16482. [D 20:42:49.303343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 16483. [D 20:42:49.303354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 16484. [D 20:42:49.303364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 16485. [D 20:42:49.303375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 16486. [D 20:42:49.303395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 16487. [D 20:42:49.303411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 16488. [D 20:42:49.303421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 16489. [D 20:42:49.303431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 16490. [D 20:42:49.303454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 16491. [D 20:42:49.303465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 16492. [D 20:42:49.303475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 16493. [D 20:42:49.303497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 16494. [D 20:42:49.303508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 16495. [D 20:42:49.303518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 16496. [D 20:42:49.303542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 16497. [D 20:42:49.303555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 16498. [D 20:42:49.303565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 16499. [D 20:42:49.303575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 16500. [D 20:42:49.303591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 16501. [D 20:42:49.303618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 16502. [D 20:42:49.303628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 16503. [D 20:42:49.303639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 16504. [D 20:42:49.303650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 16505. [D 20:42:49.303673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 16506. [D 20:42:49.303688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 16507. [D 20:42:49.303698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 16508. [D 20:42:49.303708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 16509. [D 20:42:49.303723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 16510. [D 20:42:49.303733] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 16511. [D 20:42:49.309198] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16511. [D 20:42:49.309216] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 17/70. [D 20:42:49.309282] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.309296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.309305] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:49.315320] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.315334] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.315342] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:49.315358] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3989 [D 20:42:49.315368] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:42:49.315378] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 18/70. [D 20:42:49.414587] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3983 [D 20:42:49.414604] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 19/70. [D 20:42:49.414779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 16511. [D 20:42:49.414847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 16512. [D 20:42:49.414859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 16513. [D 20:42:49.414870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 16514. [D 20:42:49.414881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 16515. [D 20:42:49.414891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 16516. [D 20:42:49.414901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 16517. [D 20:42:49.414911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 16518. [D 20:42:49.414922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 16519. [D 20:42:49.414932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 16520. [D 20:42:49.414945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 16521. [D 20:42:49.414974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 16522. [D 20:42:49.414984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 16523. [D 20:42:49.415010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 16524. [D 20:42:49.415020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 16525. [D 20:42:49.415029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 16526. [D 20:42:49.415051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 16527. [D 20:42:49.415061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 16528. [D 20:42:49.415072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 16529. [D 20:42:49.415082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 16530. [D 20:42:49.415092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 16531. [D 20:42:49.415102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 16532. [D 20:42:49.415113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 16533. [D 20:42:49.415136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 16534. [D 20:42:49.415146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 16535. [D 20:42:49.415173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 16536. [D 20:42:49.415184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 16537. [D 20:42:49.415194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 16538. [D 20:42:49.415216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 16539. [D 20:42:49.415227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 16540. [D 20:42:49.415237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 16541. [D 20:42:49.415257] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 16542. [D 20:42:49.420705] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16542. [D 20:42:49.420722] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 20/70. [D 20:42:49.420786] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.420801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.420809] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:49.426987] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.427000] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.427008] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:49.427025] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3992 [D 20:42:49.427034] element 0: offset: 0x2aaaab2033f0, size: 24 [D 20:42:49.427044] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 21/70. [D 20:42:49.513208] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3989 [D 20:42:49.513226] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 22/70. [D 20:42:49.513310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 16542. [D 20:42:49.513384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 16543. [D 20:42:49.513396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 16544. [D 20:42:49.513406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 16545. [D 20:42:49.513417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 16546. [D 20:42:49.513461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 16547. [D 20:42:49.513471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 16548. [D 20:42:49.513484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 16549. [D 20:42:49.513494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 16550. [D 20:42:49.513510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 16551. [D 20:42:49.513521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 16552. [D 20:42:49.513551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 16553. [D 20:42:49.513562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 16554. [D 20:42:49.513574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 16555. [D 20:42:49.513599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 16556. [D 20:42:49.513609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 16557. [D 20:42:49.513631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 16558. [D 20:42:49.513642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 16559. [D 20:42:49.513652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 16560. [D 20:42:49.513674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 16561. [D 20:42:49.513685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 16562. [D 20:42:49.513695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 16563. [D 20:42:49.513716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 16564. [D 20:42:49.513728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 16565. [D 20:42:49.513738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 16566. [D 20:42:49.513759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 16567. [D 20:42:49.513770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 16568. [D 20:42:49.513780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 16569. [D 20:42:49.513812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 16570. [D 20:42:49.513832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 16571. [D 20:42:49.513842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 16572. [D 20:42:49.513853] openib_post_sr_rdmaw: ibv_post_send wr_id 63c210 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 16573. [D 20:42:49.519296] openib_check_cq: completed rdma wr_id 63c210, nic_wr_credit 16573. [D 20:42:49.519312] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 23/70. [D 20:42:49.519376] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.519391] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.519400] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:49.525585] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.525598] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.525606] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:49.525623] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3995 [D 20:42:49.525632] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:42:49.525642] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 24/70. [D 20:42:49.562024] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3992 [D 20:42:49.562041] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 25/70. [D 20:42:49.562100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 16573. [D 20:42:49.562172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 16574. [D 20:42:49.562229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 16575. [D 20:42:49.562240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 16576. [D 20:42:49.562251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 16577. [D 20:42:49.562261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 16578. [D 20:42:49.562271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 16579. [D 20:42:49.562292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 16580. [D 20:42:49.562302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 16581. [D 20:42:49.562312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 16582. [D 20:42:49.562322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 16583. [D 20:42:49.562332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 16584. [D 20:42:49.562357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 16585. [D 20:42:49.562367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 16586. [D 20:42:49.562395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 16587. [D 20:42:49.562409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 16588. [D 20:42:49.562419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 16589. [D 20:42:49.562441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 16590. [D 20:42:49.562451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 16591. [D 20:42:49.562461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 16592. [D 20:42:49.562483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 16593. [D 20:42:49.562494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 16594. [D 20:42:49.562510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 16595. [D 20:42:49.562531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 16596. [D 20:42:49.562542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 16597. [D 20:42:49.562553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 16598. [D 20:42:49.562563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 16599. [D 20:42:49.562573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 16600. [D 20:42:49.562583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 16601. [D 20:42:49.562596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 16602. [D 20:42:49.562606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 16603. [D 20:42:49.562616] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 16604. [D 20:42:49.568115] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16604. [D 20:42:49.568133] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 26/70. [D 20:42:49.568195] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.568210] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.568218] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:49.574275] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.574289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.574297] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:49.574313] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3998 [D 20:42:49.574322] element 0: offset: 0x2aaaab208df0, size: 24 [D 20:42:49.574334] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 27/70. [D 20:42:49.615412] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3995 [D 20:42:49.615429] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 28/70. [D 20:42:49.615495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 16604. [D 20:42:49.615605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 16605. [D 20:42:49.615619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 16606. [D 20:42:49.615630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 16607. [D 20:42:49.615641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 16608. [D 20:42:49.615657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 16609. [D 20:42:49.615687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 16610. [D 20:42:49.615698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 16611. [D 20:42:49.615708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 16612. [D 20:42:49.615718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 16613. [D 20:42:49.615728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 16614. [D 20:42:49.615752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 16615. [D 20:42:49.615767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 16616. [D 20:42:49.615779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 16617. [D 20:42:49.615789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 16618. [D 20:42:49.615799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 16619. [D 20:42:49.615809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 16620. [D 20:42:49.615835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 16621. [D 20:42:49.615845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 16622. [D 20:42:49.615855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 16623. [D 20:42:49.615878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 16624. [D 20:42:49.615888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 16625. [D 20:42:49.615898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 16626. [D 20:42:49.615908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 16627. [D 20:42:49.615918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 16628. [D 20:42:49.615928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 16629. [D 20:42:49.615938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 16630. [D 20:42:49.615948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 16631. [D 20:42:49.615971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 16632. [D 20:42:49.615982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 16633. [D 20:42:49.615992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 16634. [D 20:42:49.616012] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 16635. [D 20:42:49.621474] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16635. [D 20:42:49.621493] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 29/70. [D 20:42:49.621557] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.621571] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.621580] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:49.636825] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3986 [D 20:42:49.636842] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 30/70. [D 20:42:49.636905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 16635. [D 20:42:49.636992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 16636. [D 20:42:49.637006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 16637. [D 20:42:49.637017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 16638. [D 20:42:49.637027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 16639. [D 20:42:49.637038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 16640. [D 20:42:49.637049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 16641. [D 20:42:49.637059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 16642. [D 20:42:49.637080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 16643. [D 20:42:49.637091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 16644. [D 20:42:49.637101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 16645. [D 20:42:49.637110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 16646. [D 20:42:49.637120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 16647. [D 20:42:49.637133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 16648. [D 20:42:49.637172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 16649. [D 20:42:49.637182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 16650. [D 20:42:49.637195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 16651. [D 20:42:49.637205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 16652. [D 20:42:49.637231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 16653. [D 20:42:49.637243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 16654. [D 20:42:49.637253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 16655. [D 20:42:49.637266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 16656. [D 20:42:49.637276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 16657. [D 20:42:49.637286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 16658. [D 20:42:49.637314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 16659. [D 20:42:49.637420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 16660. [D 20:42:49.637433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 16661. [D 20:42:49.637443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 16662. [D 20:42:49.637453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 16663. [D 20:42:49.637469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 16664. [D 20:42:49.637479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 16665. [D 20:42:49.637489] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 16666. [D 20:42:49.642849] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16666. [D 20:42:49.642865] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 31/70. [D 20:42:49.642929] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.642944] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.642953] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:49.660647] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3998 [D 20:42:49.660664] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 32/70. [D 20:42:49.660726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 16666. [D 20:42:49.660802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 16667. [D 20:42:49.660849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 16668. [D 20:42:49.660862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 16669. [D 20:42:49.660874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 16670. [D 20:42:49.660884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 16671. [D 20:42:49.660894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 16672. [D 20:42:49.660918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 16673. [D 20:42:49.660928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 16674. [D 20:42:49.660951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 16675. [D 20:42:49.660962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 16676. [D 20:42:49.660972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 16677. [D 20:42:49.660998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 16678. [D 20:42:49.661024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 16679. [D 20:42:49.661035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 16680. [D 20:42:49.661048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 16681. [D 20:42:49.661080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 16682. [D 20:42:49.661092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 16683. [D 20:42:49.661115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 16684. [D 20:42:49.661126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 16685. [D 20:42:49.661147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 16686. [D 20:42:49.661157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 16687. [D 20:42:49.661186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 16688. [D 20:42:49.661212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 16689. [D 20:42:49.661222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 16690. [D 20:42:49.661233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 16691. [D 20:42:49.661243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 16692. [D 20:42:49.661253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 16693. [D 20:42:49.661284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 16694. [D 20:42:49.661295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 16695. [D 20:42:49.661305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 16696. [D 20:42:49.661315] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 16697. [D 20:42:49.666671] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16697. [D 20:42:49.666689] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 33/70. [D 20:42:49.666751] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.666766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.666774] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:49.673582] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.673596] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.673604] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:49.673622] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4001 [D 20:42:49.673631] element 0: offset: 0x2aaaab234cb0, size: 24 [D 20:42:49.673642] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 34/70. [D 20:42:49.727704] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4001 [D 20:42:49.727721] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 35/70. [D 20:42:49.727784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 16697. [D 20:42:49.727863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 16698. [D 20:42:49.727875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 16699. [D 20:42:49.727886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 16700. [D 20:42:49.727896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 16701. [D 20:42:49.727907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 16702. [D 20:42:49.727920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 16703. [D 20:42:49.727930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 16704. [D 20:42:49.727940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 16705. [D 20:42:49.727955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 16706. [D 20:42:49.728008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 16707. [D 20:42:49.728019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 16708. [D 20:42:49.728029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 16709. [D 20:42:49.728055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 16710. [D 20:42:49.728065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 16711. [D 20:42:49.728079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 16712. [D 20:42:49.728089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 16713. [D 20:42:49.728099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 16714. [D 20:42:49.728112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 16715. [D 20:42:49.728138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 16716. [D 20:42:49.728152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 16717. [D 20:42:49.728162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 16718. [D 20:42:49.728178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 16719. [D 20:42:49.728188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 16720. [D 20:42:49.728213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 16721. [D 20:42:49.728223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 16722. [D 20:42:49.728233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 16723. [D 20:42:49.728244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 16724. [D 20:42:49.728254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 16725. [D 20:42:49.728264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 16726. [D 20:42:49.728279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 16727. [D 20:42:49.728289] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 16728. [D 20:42:49.733722] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16728. [D 20:42:49.733740] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 36/70. [D 20:42:49.733808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.733823] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.733831] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:49.741285] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.741299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.741307] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:49.741324] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4004 [D 20:42:49.741333] element 0: offset: 0x2aaaab2091e0, size: 24 [D 20:42:49.741343] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 37/70. [D 20:42:49.757586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.757600] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.757609] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:49.757624] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4007 [D 20:42:49.757634] element 0: offset: 0x2aaaab22ec60, size: 24 [D 20:42:49.757643] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 38/70. [D 20:42:49.764855] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4004 [D 20:42:49.764872] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 39/70. [D 20:42:49.765057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 16728. [D 20:42:49.765141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 16729. [D 20:42:49.765153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 16730. [D 20:42:49.765163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 16731. [D 20:42:49.765173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 16732. [D 20:42:49.765183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 16733. [D 20:42:49.765193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 16734. [D 20:42:49.765203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 16735. [D 20:42:49.765213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 16736. [D 20:42:49.765222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 16737. [D 20:42:49.765232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 16738. [D 20:42:49.765248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 16739. [D 20:42:49.765258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 16740. [D 20:42:49.765267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 16741. [D 20:42:49.765278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 16742. [D 20:42:49.765307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 16743. [D 20:42:49.765321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 16744. [D 20:42:49.765331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 16745. [D 20:42:49.765340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 16746. [D 20:42:49.765371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 16747. [D 20:42:49.765481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 16748. [D 20:42:49.765509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 16749. [D 20:42:49.765522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 16750. [D 20:42:49.765532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 16751. [D 20:42:49.765548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 16752. [D 20:42:49.765558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 16753. [D 20:42:49.765568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 16754. [D 20:42:49.765578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 16755. [D 20:42:49.765588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 16756. [D 20:42:49.765597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 16757. [D 20:42:49.765607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 16758. [D 20:42:49.765641] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 16759. [D 20:42:49.772801] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16759. [D 20:42:49.772819] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 40/70. [D 20:42:49.772881] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.772896] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.772904] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:49.779894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.779908] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.779916] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:49.779932] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4011 [D 20:42:49.779941] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:49.779952] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 41/70. [D 20:42:49.779982] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.779991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.779999] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:49.780013] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4013 [D 20:42:49.780023] element 0: offset: 0x2aaaab208c70, size: 24 [D 20:42:49.780033] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 42/70. [D 20:42:49.810602] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4011 [D 20:42:49.810619] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 43/70. [D 20:42:49.810680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 16759. [D 20:42:49.810749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 16760. [D 20:42:49.810810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 16761. [D 20:42:49.810820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 16762. [D 20:42:49.810832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 16763. [D 20:42:49.810841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 16764. [D 20:42:49.810856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 16765. [D 20:42:49.810866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 16766. [D 20:42:49.810876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 16767. [D 20:42:49.810892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 16768. [D 20:42:49.810901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 16769. [D 20:42:49.810911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 16770. [D 20:42:49.810937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 16771. [D 20:42:49.810947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 16772. [D 20:42:49.810961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 16773. [D 20:42:49.810971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 16774. [D 20:42:49.810981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 16775. [D 20:42:49.810995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 16776. [D 20:42:49.811005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 16777. [D 20:42:49.811015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 16778. [D 20:42:49.811024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 16779. [D 20:42:49.811042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 16780. [D 20:42:49.811052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 16781. [D 20:42:49.811061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 16782. [D 20:42:49.811072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 16783. [D 20:42:49.811081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 16784. [D 20:42:49.811106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 16785. [D 20:42:49.811121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 16786. [D 20:42:49.811130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 16787. [D 20:42:49.811140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 16788. [D 20:42:49.811168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 16789. [D 20:42:49.811179] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 16790. [D 20:42:49.816663] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16790. [D 20:42:49.816680] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 44/70. [D 20:42:49.816743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.816758] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.816766] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:49.873415] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4007 [D 20:42:49.873432] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 45/70. [D 20:42:49.873491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 16790. [D 20:42:49.873559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 16791. [D 20:42:49.873579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 16792. [D 20:42:49.873590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 16793. [D 20:42:49.873600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 16794. [D 20:42:49.873610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 16795. [D 20:42:49.873626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 16796. [D 20:42:49.873635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 16797. [D 20:42:49.873645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 16798. [D 20:42:49.873661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 16799. [D 20:42:49.873723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 16800. [D 20:42:49.873734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 16801. [D 20:42:49.873744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 16802. [D 20:42:49.873754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 16803. [D 20:42:49.873763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 16804. [D 20:42:49.873779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 16805. [D 20:42:49.873788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 16806. [D 20:42:49.873798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 16807. [D 20:42:49.873809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 16808. [D 20:42:49.873834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 16809. [D 20:42:49.873845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 16810. [D 20:42:49.873855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 16811. [D 20:42:49.873864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 16812. [D 20:42:49.873875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 16813. [D 20:42:49.873885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 16814. [D 20:42:49.873894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 16815. [D 20:42:49.873904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 16816. [D 20:42:49.873914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 16817. [D 20:42:49.873932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 16818. [D 20:42:49.873942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 16819. [D 20:42:49.873952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 16820. [D 20:42:49.873961] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 16821. [D 20:42:49.879418] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16821. [D 20:42:49.879435] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 46/70. [D 20:42:49.879499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.879513] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.879522] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:49.885544] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.885558] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.885567] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:49.885582] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4016 [D 20:42:49.885592] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:42:49.885602] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 47/70. [D 20:42:49.931905] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4013 [D 20:42:49.931922] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 48/70. [D 20:42:49.931978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 16821. [D 20:42:49.932042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 16822. [D 20:42:49.932061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 16823. [D 20:42:49.932072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 16824. [D 20:42:49.932082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 16825. [D 20:42:49.932092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 16826. [D 20:42:49.932108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 16827. [D 20:42:49.932118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 16828. [D 20:42:49.932127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 16829. [D 20:42:49.932143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 16830. [D 20:42:49.932153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 16831. [D 20:42:49.932200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 16832. [D 20:42:49.932212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 16833. [D 20:42:49.932222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 16834. [D 20:42:49.932248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 16835. [D 20:42:49.932257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 16836. [D 20:42:49.932268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 16837. [D 20:42:49.932281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 16838. [D 20:42:49.932291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 16839. [D 20:42:49.932300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 16840. [D 20:42:49.932311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 16841. [D 20:42:49.932334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 16842. [D 20:42:49.932346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 16843. [D 20:42:49.932356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 16844. [D 20:42:49.932365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 16845. [D 20:42:49.932375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 16846. [D 20:42:49.932386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 16847. [D 20:42:49.932407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 16848. [D 20:42:49.932418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 16849. [D 20:42:49.932427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 16850. [D 20:42:49.932437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 16851. [D 20:42:49.932447] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 16852. [D 20:42:49.937906] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16852. [D 20:42:49.937940] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 49/70. [D 20:42:49.938004] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:49.938019] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.938028] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:49.943677] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.943691] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.943700] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:49.943715] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4019 [D 20:42:49.943724] element 0: offset: 0x2aaaab234fa0, size: 24 [D 20:42:49.943735] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 50/70. [D 20:42:49.949186] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:49.949200] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:49.949209] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:49.949224] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4022 [D 20:42:49.949234] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:42:49.949244] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 51/70. [D 20:42:50.018634] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4016 [D 20:42:50.018651] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 52/70. [D 20:42:50.018713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 16852. [D 20:42:50.018784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 16853. [D 20:42:50.018838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 16854. [D 20:42:50.018850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 16855. [D 20:42:50.018860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 16856. [D 20:42:50.018871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 16857. [D 20:42:50.018880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 16858. [D 20:42:50.018903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 16859. [D 20:42:50.018915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 16860. [D 20:42:50.018925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 16861. [D 20:42:50.018934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 16862. [D 20:42:50.018963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 16863. [D 20:42:50.018974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 16864. [D 20:42:50.018986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 16865. [D 20:42:50.019014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 16866. [D 20:42:50.019024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 16867. [D 20:42:50.019033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 16868. [D 20:42:50.019049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 16869. [D 20:42:50.019078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 16870. [D 20:42:50.019088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 16871. [D 20:42:50.019115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 16872. [D 20:42:50.019125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 16873. [D 20:42:50.019135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 16874. [D 20:42:50.019149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 16875. [D 20:42:50.019158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 16876. [D 20:42:50.019184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 16877. [D 20:42:50.019194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 16878. [D 20:42:50.019204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 16879. [D 20:42:50.019217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 16880. [D 20:42:50.019227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 16881. [D 20:42:50.019237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 16882. [D 20:42:50.019252] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 16883. [D 20:42:50.024635] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16883. [D 20:42:50.024653] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 53/70. [D 20:42:50.024717] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.024731] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.024740] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.030823] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.030837] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.030845] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.030861] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4025 [D 20:42:50.030870] element 0: offset: 0x2aaaab2033f0, size: 24 [D 20:42:50.030881] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 54/70. [D 20:42:50.087232] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4025 [D 20:42:50.087250] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 55/70. [D 20:42:50.087310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 16883. [D 20:42:50.087379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 16884. [D 20:42:50.087400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 16885. [D 20:42:50.087412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 16886. [D 20:42:50.087423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 16887. [D 20:42:50.087433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 16888. [D 20:42:50.087443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 16889. [D 20:42:50.087453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 16890. [D 20:42:50.087462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 16891. [D 20:42:50.087478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 16892. [D 20:42:50.087529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 16893. [D 20:42:50.087542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 16894. [D 20:42:50.087552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 16895. [D 20:42:50.087562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 16896. [D 20:42:50.087571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 16897. [D 20:42:50.087586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 16898. [D 20:42:50.087596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 16899. [D 20:42:50.087605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 16900. [D 20:42:50.087638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 16901. [D 20:42:50.087650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 16902. [D 20:42:50.087660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 16903. [D 20:42:50.087670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 16904. [D 20:42:50.087681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 16905. [D 20:42:50.087691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 16906. [D 20:42:50.087713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 16907. [D 20:42:50.087723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 16908. [D 20:42:50.087734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 16909. [D 20:42:50.087744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 16910. [D 20:42:50.087768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 16911. [D 20:42:50.087778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 16912. [D 20:42:50.087788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 16913. [D 20:42:50.087804] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 16914. [D 20:42:50.093300] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16914. [D 20:42:50.093317] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 56/70. [D 20:42:50.093379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.093393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.093402] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.099398] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.099412] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.099420] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.099436] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4028 [D 20:42:50.099446] element 0: offset: 0x2aaaab22c250, size: 24 [D 20:42:50.099456] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 57/70. [D 20:42:50.140635] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4022 [D 20:42:50.140652] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 58/70. [D 20:42:50.140709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 16914. [D 20:42:50.140778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 16915. [D 20:42:50.140837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 16916. [D 20:42:50.140848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 16917. [D 20:42:50.140858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 16918. [D 20:42:50.140868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 16919. [D 20:42:50.140878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 16920. [D 20:42:50.140888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 16921. [D 20:42:50.140898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 16922. [D 20:42:50.140913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 16923. [D 20:42:50.140922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 16924. [D 20:42:50.140932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 16925. [D 20:42:50.140942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 16926. [D 20:42:50.140969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 16927. [D 20:42:50.140979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 16928. [D 20:42:50.140989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 16929. [D 20:42:50.140998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 16930. [D 20:42:50.141014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 16931. [D 20:42:50.141024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 16932. [D 20:42:50.141050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 16933. [D 20:42:50.141060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 16934. [D 20:42:50.141070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 16935. [D 20:42:50.141084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 16936. [D 20:42:50.141094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 16937. [D 20:42:50.141130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 16938. [D 20:42:50.141140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 16939. [D 20:42:50.141150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 16940. [D 20:42:50.141160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 16941. [D 20:42:50.141170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 16942. [D 20:42:50.141190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 16943. [D 20:42:50.141201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 16944. [D 20:42:50.141212] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 16945. [D 20:42:50.146634] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16945. [D 20:42:50.146651] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 59/70. [D 20:42:50.146713] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.146728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.146736] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.152422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.152436] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.152444] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.152460] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4031 [D 20:42:50.152470] element 0: offset: 0x2aaaab208df0, size: 24 [D 20:42:50.152480] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 60/70. [D 20:42:50.224033] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4019 [D 20:42:50.224050] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 0/70. [D 20:42:50.224116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 16945. [D 20:42:50.224220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 16946. [D 20:42:50.224233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 16947. [D 20:42:50.224244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 16948. [D 20:42:50.224255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 16949. [D 20:42:50.224271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 16950. [D 20:42:50.224282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 16951. [D 20:42:50.224302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 16952. [D 20:42:50.224315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 16953. [D 20:42:50.224325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 16954. [D 20:42:50.224335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 16955. [D 20:42:50.224364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 16956. [D 20:42:50.224375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 16957. [D 20:42:50.224397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 16958. [D 20:42:50.224407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 16959. [D 20:42:50.224416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 16960. [D 20:42:50.224442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 16961. [D 20:42:50.224452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 16962. [D 20:42:50.224465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 16963. [D 20:42:50.224487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 16964. [D 20:42:50.224501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 16965. [D 20:42:50.224510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 16966. [D 20:42:50.224533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 16967. [D 20:42:50.224542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 16968. [D 20:42:50.224563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 16969. [D 20:42:50.224573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 16970. [D 20:42:50.224583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 16971. [D 20:42:50.224610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 16972. [D 20:42:50.224620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 16973. [D 20:42:50.224644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 16974. [D 20:42:50.224660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 16975. [D 20:42:50.224670] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 16976. [D 20:42:50.230074] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 16976. [D 20:42:50.230093] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 1/70. [D 20:42:50.230156] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.230171] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.230179] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.235786] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.235800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.235808] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.235824] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4034 [D 20:42:50.235833] element 0: offset: 0x2aaaab234cb0, size: 24 [D 20:42:50.235844] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 2/70. [D 20:42:50.310474] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4031 [D 20:42:50.310491] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 3/70. [D 20:42:50.310587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 16976. [D 20:42:50.310685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 16977. [D 20:42:50.310698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 16978. [D 20:42:50.310709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 16979. [D 20:42:50.310720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 16980. [D 20:42:50.310730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 16981. [D 20:42:50.310740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 16982. [D 20:42:50.310750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 16983. [D 20:42:50.310786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 16984. [D 20:42:50.310801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 16985. [D 20:42:50.310824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 16986. [D 20:42:50.310838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 16987. [D 20:42:50.310857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 16988. [D 20:42:50.310868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 16989. [D 20:42:50.310878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 16990. [D 20:42:50.310902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 16991. [D 20:42:50.310916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 16992. [D 20:42:50.310926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 16993. [D 20:42:50.310947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 16994. [D 20:42:50.310957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 16995. [D 20:42:50.310967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 16996. [D 20:42:50.310990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 16997. [D 20:42:50.311001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 16998. [D 20:42:50.311010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 16999. [D 20:42:50.311025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 17000. [D 20:42:50.311054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 17001. [D 20:42:50.311067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 17002. [D 20:42:50.311095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 17003. [D 20:42:50.311106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 17004. [D 20:42:50.311116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 17005. [D 20:42:50.311125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 17006. [D 20:42:50.311136] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 17007. [D 20:42:50.316519] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17007. [D 20:42:50.316537] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 4/70. [D 20:42:50.316600] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.316615] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.316623] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.322427] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.322441] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.322449] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.322464] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4037 [D 20:42:50.322474] element 0: offset: 0x2aaaab22e460, size: 24 [D 20:42:50.322484] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 5/70. [D 20:42:50.339842] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4028 [D 20:42:50.339859] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 6/70. [D 20:42:50.339916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 17007. [D 20:42:50.339985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17008. [D 20:42:50.339996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17009. [D 20:42:50.340006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17010. [D 20:42:50.340016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17011. [D 20:42:50.340032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17012. [D 20:42:50.340042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17013. [D 20:42:50.340051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17014. [D 20:42:50.340067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17015. [D 20:42:50.340077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17016. [D 20:42:50.340087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17017. [D 20:42:50.340157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17018. [D 20:42:50.340168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17019. [D 20:42:50.340177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17020. [D 20:42:50.340205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17021. [D 20:42:50.340215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17022. [D 20:42:50.340239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17023. [D 20:42:50.340249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17024. [D 20:42:50.340263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17025. [D 20:42:50.340286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17026. [D 20:42:50.340297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17027. [D 20:42:50.340317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17028. [D 20:42:50.340327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17029. [D 20:42:50.340337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17030. [D 20:42:50.340360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17031. [D 20:42:50.340372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17032. [D 20:42:50.340396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17033. [D 20:42:50.340405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17034. [D 20:42:50.340424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17035. [D 20:42:50.340435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17036. [D 20:42:50.340445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17037. [D 20:42:50.340455] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17038. [D 20:42:50.345842] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17038. [D 20:42:50.345861] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 7/70. [D 20:42:50.345925] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.345939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.345948] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.351813] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.351827] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.351835] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.351851] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4040 [D 20:42:50.351860] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:50.351870] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 8/70. [D 20:42:50.424313] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4034 [D 20:42:50.424331] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 9/70. [D 20:42:50.424511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17038. [D 20:42:50.424578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17039. [D 20:42:50.424589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17040. [D 20:42:50.424600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17041. [D 20:42:50.424614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17042. [D 20:42:50.424624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17043. [D 20:42:50.424634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17044. [D 20:42:50.424649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17045. [D 20:42:50.424659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17046. [D 20:42:50.424668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17047. [D 20:42:50.424699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17048. [D 20:42:50.424710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17049. [D 20:42:50.424720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17050. [D 20:42:50.424743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17051. [D 20:42:50.424757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17052. [D 20:42:50.424767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17053. [D 20:42:50.424776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17054. [D 20:42:50.424792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17055. [D 20:42:50.424820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17056. [D 20:42:50.424830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17057. [D 20:42:50.424845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17058. [D 20:42:50.424856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17059. [D 20:42:50.424865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17060. [D 20:42:50.424875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17061. [D 20:42:50.424907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17062. [D 20:42:50.424917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17063. [D 20:42:50.424927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17064. [D 20:42:50.424942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17065. [D 20:42:50.424952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17066. [D 20:42:50.424961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17067. [D 20:42:50.424977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17068. [D 20:42:50.425001] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17069. [D 20:42:50.430431] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17069. [D 20:42:50.430449] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 10/70. [D 20:42:50.430512] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.430526] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.430535] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.436442] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.436455] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.436463] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.436479] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4043 [D 20:42:50.436489] element 0: offset: 0x2aaaab2091e0, size: 24 [D 20:42:50.436501] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 11/70. [D 20:42:50.497497] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4037 [D 20:42:50.497514] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 12/70. [D 20:42:50.497576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 17069. [D 20:42:50.497695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 17070. [D 20:42:50.497709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 17071. [D 20:42:50.497720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 17072. [D 20:42:50.497730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 17073. [D 20:42:50.497740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 17074. [D 20:42:50.497762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 17075. [D 20:42:50.497778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 17076. [D 20:42:50.497789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 17077. [D 20:42:50.497799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 17078. [D 20:42:50.497809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 17079. [D 20:42:50.497832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 17080. [D 20:42:50.497842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 17081. [D 20:42:50.497866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 17082. [D 20:42:50.497877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 17083. [D 20:42:50.497890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 17084. [D 20:42:50.497912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 17085. [D 20:42:50.497924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 17086. [D 20:42:50.497942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 17087. [D 20:42:50.497953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 17088. [D 20:42:50.497963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 17089. [D 20:42:50.497973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 17090. [D 20:42:50.497995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 17091. [D 20:42:50.498005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 17092. [D 20:42:50.498014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 17093. [D 20:42:50.498038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 17094. [D 20:42:50.498048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 17095. [D 20:42:50.498058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 17096. [D 20:42:50.498081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 17097. [D 20:42:50.498091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 17098. [D 20:42:50.498101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 17099. [D 20:42:50.498125] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 17100. [D 20:42:50.503504] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17100. [D 20:42:50.503522] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 13/70. [D 20:42:50.503586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.503600] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.503608] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.509646] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.509661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.509669] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.509685] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4046 [D 20:42:50.509694] element 0: offset: 0x2aaaab22ec60, size: 24 [D 20:42:50.509704] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 14/70. [D 20:42:50.561434] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4040 [D 20:42:50.561452] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 15/70. [D 20:42:50.561511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 17100. [D 20:42:50.561582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17101. [D 20:42:50.561643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17102. [D 20:42:50.561653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17103. [D 20:42:50.561664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17104. [D 20:42:50.561674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17105. [D 20:42:50.561684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17106. [D 20:42:50.561706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17107. [D 20:42:50.561719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17108. [D 20:42:50.561729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17109. [D 20:42:50.561739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17110. [D 20:42:50.561754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17111. [D 20:42:50.561770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17112. [D 20:42:50.561779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17113. [D 20:42:50.561789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17114. [D 20:42:50.561812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17115. [D 20:42:50.561822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17116. [D 20:42:50.561845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17117. [D 20:42:50.561860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17118. [D 20:42:50.561870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17119. [D 20:42:50.561895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17120. [D 20:42:50.561905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17121. [D 20:42:50.561915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17122. [D 20:42:50.561942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17123. [D 20:42:50.561952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17124. [D 20:42:50.561966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17125. [D 20:42:50.561985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17126. [D 20:42:50.561996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17127. [D 20:42:50.562006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17128. [D 20:42:50.562028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17129. [D 20:42:50.562039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17130. [D 20:42:50.562059] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17131. [D 20:42:50.567495] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17131. [D 20:42:50.567513] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 16/70. [D 20:42:50.567576] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.567590] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.567598] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.573386] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.573400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.573408] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.573423] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4049 [D 20:42:50.573433] element 0: offset: 0x2aaaab208c70, size: 24 [D 20:42:50.573443] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 17/70. [D 20:42:50.663197] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4043 [D 20:42:50.663215] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 18/70. [D 20:42:50.663316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17131. [D 20:42:50.663422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17132. [D 20:42:50.663434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17133. [D 20:42:50.663444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17134. [D 20:42:50.663458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17135. [D 20:42:50.663468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17136. [D 20:42:50.663478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17137. [D 20:42:50.663492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17138. [D 20:42:50.663502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17139. [D 20:42:50.663511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17140. [D 20:42:50.663542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17141. [D 20:42:50.663557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17142. [D 20:42:50.663580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17143. [D 20:42:50.663594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17144. [D 20:42:50.663604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17145. [D 20:42:50.663614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17146. [D 20:42:50.663624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17147. [D 20:42:50.663639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17148. [D 20:42:50.663649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17149. [D 20:42:50.663659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17150. [D 20:42:50.663669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17151. [D 20:42:50.663698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17152. [D 20:42:50.663709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17153. [D 20:42:50.663729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17154. [D 20:42:50.663740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17155. [D 20:42:50.663750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17156. [D 20:42:50.663761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17157. [D 20:42:50.663781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17158. [D 20:42:50.663795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17159. [D 20:42:50.663804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17160. [D 20:42:50.663814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17161. [D 20:42:50.663837] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17162. [D 20:42:50.669279] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17162. [D 20:42:50.669297] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 19/70. [D 20:42:50.669360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.669375] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.669383] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.675066] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.675079] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.675088] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.675103] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4052 [D 20:42:50.675113] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:42:50.675123] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 20/70. [D 20:42:50.761525] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4046 [D 20:42:50.761542] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 21/70. [D 20:42:50.761661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 17162. [D 20:42:50.761770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 17163. [D 20:42:50.761781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 17164. [D 20:42:50.761792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 17165. [D 20:42:50.761806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 17166. [D 20:42:50.761816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 17167. [D 20:42:50.761826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 17168. [D 20:42:50.761841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 17169. [D 20:42:50.761851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 17170. [D 20:42:50.761860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 17171. [D 20:42:50.761876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 17172. [D 20:42:50.761890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 17173. [D 20:42:50.761900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 17174. [D 20:42:50.761912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 17175. [D 20:42:50.761938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 17176. [D 20:42:50.761948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 17177. [D 20:42:50.761968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 17178. [D 20:42:50.761979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 17179. [D 20:42:50.761989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 17180. [D 20:42:50.762012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 17181. [D 20:42:50.762023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 17182. [D 20:42:50.762033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 17183. [D 20:42:50.762048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 17184. [D 20:42:50.762058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 17185. [D 20:42:50.762067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 17186. [D 20:42:50.762092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 17187. [D 20:42:50.762102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 17188. [D 20:42:50.762112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 17189. [D 20:42:50.762136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 17190. [D 20:42:50.762146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 17191. [D 20:42:50.762160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 17192. [D 20:42:50.762184] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 17193. [D 20:42:50.767628] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17193. [D 20:42:50.767645] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 22/70. [D 20:42:50.767709] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.767723] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.767732] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.773899] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.773912] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.773921] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.773936] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4055 [D 20:42:50.773946] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:42:50.773956] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 23/70. [D 20:42:50.847997] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4052 [D 20:42:50.848014] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 24/70. [D 20:42:50.848112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17193. [D 20:42:50.848216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17194. [D 20:42:50.848228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17195. [D 20:42:50.848238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17196. [D 20:42:50.848253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17197. [D 20:42:50.848263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17198. [D 20:42:50.848272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17199. [D 20:42:50.848287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17200. [D 20:42:50.848296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17201. [D 20:42:50.848306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17202. [D 20:42:50.848335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17203. [D 20:42:50.848345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17204. [D 20:42:50.848360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17205. [D 20:42:50.848370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17206. [D 20:42:50.848380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17207. [D 20:42:50.848390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17208. [D 20:42:50.848417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17209. [D 20:42:50.848426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17210. [D 20:42:50.848436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17211. [D 20:42:50.848458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17212. [D 20:42:50.848469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17213. [D 20:42:50.848479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17214. [D 20:42:50.848498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17215. [D 20:42:50.848514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17216. [D 20:42:50.848523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17217. [D 20:42:50.848533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17218. [D 20:42:50.848559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17219. [D 20:42:50.848569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17220. [D 20:42:50.848583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17221. [D 20:42:50.848593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17222. [D 20:42:50.848621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17223. [D 20:42:50.848630] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17224. [D 20:42:50.854078] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17224. [D 20:42:50.854096] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 25/70. [D 20:42:50.854159] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.854173] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.854181] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.860000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.860013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.860021] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.860037] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4058 [D 20:42:50.860046] element 0: offset: 0x2aaaab2033f0, size: 24 [D 20:42:50.860056] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 26/70. [D 20:42:50.862489] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4049 [D 20:42:50.862506] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 27/70. [D 20:42:50.862754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 17224. [D 20:42:50.862795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17225. [D 20:42:50.862806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17226. [D 20:42:50.862817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17227. [D 20:42:50.862827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17228. [D 20:42:50.862836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17229. [D 20:42:50.862846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17230. [D 20:42:50.862856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17231. [D 20:42:50.862871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17232. [D 20:42:50.862881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17233. [D 20:42:50.862891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17234. [D 20:42:50.862901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17235. [D 20:42:50.862911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17236. [D 20:42:50.862921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17237. [D 20:42:50.862931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17238. [D 20:42:50.862946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17239. [D 20:42:50.862955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17240. [D 20:42:50.862965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17241. [D 20:42:50.862975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17242. [D 20:42:50.863005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17243. [D 20:42:50.863018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17244. [D 20:42:50.863028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17245. [D 20:42:50.863038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17246. [D 20:42:50.863064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17247. [D 20:42:50.863074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17248. [D 20:42:50.863086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17249. [D 20:42:50.863096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17250. [D 20:42:50.863106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17251. [D 20:42:50.863131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17252. [D 20:42:50.863141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17253. [D 20:42:50.863154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17254. [D 20:42:50.863164] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17255. [D 20:42:50.872701] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17255. [D 20:42:50.872778] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 28/70. [D 20:42:50.872840] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.872857] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.872866] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.878759] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.878773] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.878781] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.878797] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4061 [D 20:42:50.878806] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:42:50.878816] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 29/70. [D 20:42:50.898137] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4055 [D 20:42:50.898155] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 30/70. [D 20:42:50.898215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 17255. [D 20:42:50.898283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 17256. [D 20:42:50.898303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 17257. [D 20:42:50.898314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 17258. [D 20:42:50.898325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 17259. [D 20:42:50.898334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 17260. [D 20:42:50.898349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 17261. [D 20:42:50.898362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 17262. [D 20:42:50.898374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 17263. [D 20:42:50.898426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 17264. [D 20:42:50.898437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 17265. [D 20:42:50.898463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 17266. [D 20:42:50.898474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 17267. [D 20:42:50.898484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 17268. [D 20:42:50.898493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 17269. [D 20:42:50.898510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 17270. [D 20:42:50.898533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 17271. [D 20:42:50.898546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 17272. [D 20:42:50.898556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 17273. [D 20:42:50.898569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 17274. [D 20:42:50.898583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 17275. [D 20:42:50.898593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 17276. [D 20:42:50.898603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 17277. [D 20:42:50.898612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 17278. [D 20:42:50.898623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 17279. [D 20:42:50.898634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 17280. [D 20:42:50.898657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 17281. [D 20:42:50.898673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 17282. [D 20:42:50.898683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 17283. [D 20:42:50.898693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 17284. [D 20:42:50.898709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 17285. [D 20:42:50.898719] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 17286. [D 20:42:50.904143] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17286. [D 20:42:50.904160] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 31/70. [D 20:42:50.904224] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.904239] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.904248] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.910241] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.910255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.910263] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.910279] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4064 [D 20:42:50.910288] element 0: offset: 0x2aaaab234fa0, size: 24 [D 20:42:50.910298] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 32/70. [D 20:42:50.958258] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4064 [D 20:42:50.958287] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 33/70. [D 20:42:50.958352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 17286. [D 20:42:50.958428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 17287. [D 20:42:50.958439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 17288. [D 20:42:50.958495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 17289. [D 20:42:50.958509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 17290. [D 20:42:50.958519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 17291. [D 20:42:50.958529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 17292. [D 20:42:50.958539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 17293. [D 20:42:50.958549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 17294. [D 20:42:50.958559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 17295. [D 20:42:50.958576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 17296. [D 20:42:50.958599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 17297. [D 20:42:50.958609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 17298. [D 20:42:50.958635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 17299. [D 20:42:50.958646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 17300. [D 20:42:50.958659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 17301. [D 20:42:50.958669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 17302. [D 20:42:50.958679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 17303. [D 20:42:50.958693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 17304. [D 20:42:50.958702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 17305. [D 20:42:50.958712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 17306. [D 20:42:50.958742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 17307. [D 20:42:50.958759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 17308. [D 20:42:50.958801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 17309. [D 20:42:50.958811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 17310. [D 20:42:50.958835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 17311. [D 20:42:50.958845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 17312. [D 20:42:50.958856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 17313. [D 20:42:50.958865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 17314. [D 20:42:50.958893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 17315. [D 20:42:50.958904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 17316. [D 20:42:50.958913] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 17317. [D 20:42:50.964338] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17317. [D 20:42:50.964354] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 34/70. [D 20:42:50.964426] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:50.964442] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.964451] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:50.970520] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:50.970534] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:50.970542] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:50.970563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4067 [D 20:42:50.970573] element 0: offset: 0x2aaaab20e440, size: 24 [D 20:42:50.970583] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 35/70. [D 20:42:51.036058] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4067 [D 20:42:51.036115] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 36/70. [D 20:42:51.036178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 17317. [D 20:42:51.036251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 17318. [D 20:42:51.036262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 17319. [D 20:42:51.036277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 17320. [D 20:42:51.036287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 17321. [D 20:42:51.036297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 17322. [D 20:42:51.036312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 17323. [D 20:42:51.036322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 17324. [D 20:42:51.036331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 17325. [D 20:42:51.036342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 17326. [D 20:42:51.036352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 17327. [D 20:42:51.036412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 17328. [D 20:42:51.036423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 17329. [D 20:42:51.036434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 17330. [D 20:42:51.036443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 17331. [D 20:42:51.036454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 17332. [D 20:42:51.036465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 17333. [D 20:42:51.036475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 17334. [D 20:42:51.036501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 17335. [D 20:42:51.036512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 17336. [D 20:42:51.036528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 17337. [D 20:42:51.036539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 17338. [D 20:42:51.036549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 17339. [D 20:42:51.036572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 17340. [D 20:42:51.036590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 17341. [D 20:42:51.036601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 17342. [D 20:42:51.036612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 17343. [D 20:42:51.036621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 17344. [D 20:42:51.036644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 17345. [D 20:42:51.036654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 17346. [D 20:42:51.036663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 17347. [D 20:42:51.036685] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 17348. [D 20:42:51.042164] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17348. [D 20:42:51.042183] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 37/70. [D 20:42:51.042262] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.042278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.042286] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:51.048394] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.048408] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.048416] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:51.048443] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4070 [D 20:42:51.048453] element 0: offset: 0x2aaaab22c250, size: 24 [D 20:42:51.048464] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 38/70. [D 20:42:51.085859] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4058 [D 20:42:51.085876] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 39/70. [D 20:42:51.085939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17348. [D 20:42:51.086044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17349. [D 20:42:51.086058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17350. [D 20:42:51.086068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17351. [D 20:42:51.086079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17352. [D 20:42:51.086089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17353. [D 20:42:51.086099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17354. [D 20:42:51.086109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17355. [D 20:42:51.086119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17356. [D 20:42:51.086129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17357. [D 20:42:51.086138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17358. [D 20:42:51.086158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17359. [D 20:42:51.086181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17360. [D 20:42:51.086192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17361. [D 20:42:51.086201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17362. [D 20:42:51.086211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17363. [D 20:42:51.086236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17364. [D 20:42:51.086247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17365. [D 20:42:51.086256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17366. [D 20:42:51.086272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17367. [D 20:42:51.086282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17368. [D 20:42:51.086291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17369. [D 20:42:51.086316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17370. [D 20:42:51.086326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17371. [D 20:42:51.086342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17372. [D 20:42:51.086352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17373. [D 20:42:51.086362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17374. [D 20:42:51.086385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17375. [D 20:42:51.086400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17376. [D 20:42:51.086411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17377. [D 20:42:51.086422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17378. [D 20:42:51.086431] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17379. [D 20:42:51.091900] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17379. [D 20:42:51.091916] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 40/70. [D 20:42:51.091981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.091996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.092004] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:51.097808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.097822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.097830] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:51.097846] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4073 [D 20:42:51.097855] element 0: offset: 0x2aaaab234cb0, size: 24 [D 20:42:51.097866] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 41/70. [D 20:42:51.102255] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4073 [D 20:42:51.102272] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 42/70. [D 20:42:51.102412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17379. [D 20:42:51.102479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17380. [D 20:42:51.102490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17381. [D 20:42:51.102501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17382. [D 20:42:51.102511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17383. [D 20:42:51.102522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17384. [D 20:42:51.102531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17385. [D 20:42:51.102541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17386. [D 20:42:51.102551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17387. [D 20:42:51.102561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17388. [D 20:42:51.102571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17389. [D 20:42:51.102587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17390. [D 20:42:51.102596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17391. [D 20:42:51.102606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17392. [D 20:42:51.102616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17393. [D 20:42:51.102627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17394. [D 20:42:51.102636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17395. [D 20:42:51.102646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17396. [D 20:42:51.102688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17397. [D 20:42:51.102700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17398. [D 20:42:51.102710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17399. [D 20:42:51.102721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17400. [D 20:42:51.102730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17401. [D 20:42:51.102750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17402. [D 20:42:51.102767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17403. [D 20:42:51.102776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17404. [D 20:42:51.102786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17405. [D 20:42:51.102802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17406. [D 20:42:51.102811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17407. [D 20:42:51.102821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17408. [D 20:42:51.102849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17409. [D 20:42:51.102859] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17410. [D 20:42:51.113483] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17410. [D 20:42:51.113545] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 43/70. [D 20:42:51.113612] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.113628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.113637] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:51.119449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.119464] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.119473] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:51.119493] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4076 [D 20:42:51.119503] element 0: offset: 0x2aaaab22e460, size: 24 [D 20:42:51.119515] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 44/70. [D 20:42:51.123652] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4076 [D 20:42:51.123671] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 45/70. [D 20:42:51.123822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17410. [D 20:42:51.123886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17411. [D 20:42:51.123897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17412. [D 20:42:51.123908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17413. [D 20:42:51.123918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17414. [D 20:42:51.123928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17415. [D 20:42:51.123937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17416. [D 20:42:51.123953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17417. [D 20:42:51.123963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17418. [D 20:42:51.123973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17419. [D 20:42:51.123983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17420. [D 20:42:51.124018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17421. [D 20:42:51.124033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17422. [D 20:42:51.124062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17423. [D 20:42:51.124083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17424. [D 20:42:51.124098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17425. [D 20:42:51.124108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17426. [D 20:42:51.124118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17427. [D 20:42:51.124139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17428. [D 20:42:51.124149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17429. [D 20:42:51.124159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17430. [D 20:42:51.124169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17431. [D 20:42:51.124193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17432. [D 20:42:51.124203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17433. [D 20:42:51.124223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17434. [D 20:42:51.124236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17435. [D 20:42:51.124246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17436. [D 20:42:51.124272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17437. [D 20:42:51.124282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17438. [D 20:42:51.124291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17439. [D 20:42:51.124317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17440. [D 20:42:51.124328] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17441. [D 20:42:51.134999] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17441. [D 20:42:51.135019] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 46/70. [D 20:42:51.135087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.135101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.135110] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:51.145388] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4070 [D 20:42:51.145406] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 47/70. [D 20:42:51.145467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 17441. [D 20:42:51.145524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 17442. [D 20:42:51.145543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 17443. [D 20:42:51.145554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 17444. [D 20:42:51.145565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 17445. [D 20:42:51.145575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 17446. [D 20:42:51.145591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 17447. [D 20:42:51.145601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 17448. [D 20:42:51.145610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 17449. [D 20:42:51.145626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 17450. [D 20:42:51.145657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 17451. [D 20:42:51.145670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 17452. [D 20:42:51.145680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 17453. [D 20:42:51.145690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 17454. [D 20:42:51.145703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 17455. [D 20:42:51.145739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 17456. [D 20:42:51.145753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 17457. [D 20:42:51.145762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 17458. [D 20:42:51.145772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 17459. [D 20:42:51.145800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 17460. [D 20:42:51.145812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 17461. [D 20:42:51.145825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 17462. [D 20:42:51.145835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 17463. [D 20:42:51.145844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 17464. [D 20:42:51.145858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 17465. [D 20:42:51.145868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 17466. [D 20:42:51.145896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 17467. [D 20:42:51.145906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 17468. [D 20:42:51.145916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 17469. [D 20:42:51.145931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 17470. [D 20:42:51.145941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 17471. [D 20:42:51.145967] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 17472. [D 20:42:51.151394] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17472. [D 20:42:51.151412] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 48/70. [D 20:42:51.151475] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.151490] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.151499] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.196267] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4061 [D 20:42:51.196284] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 49/70. [D 20:42:51.196351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 17472. [D 20:42:51.196423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17473. [D 20:42:51.196436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17474. [D 20:42:51.196446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17475. [D 20:42:51.196457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17476. [D 20:42:51.196466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17477. [D 20:42:51.196484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17478. [D 20:42:51.196494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17479. [D 20:42:51.196504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17480. [D 20:42:51.196514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17481. [D 20:42:51.196524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17482. [D 20:42:51.196534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17483. [D 20:42:51.196560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17484. [D 20:42:51.196570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17485. [D 20:42:51.196580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17486. [D 20:42:51.196596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17487. [D 20:42:51.196605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17488. [D 20:42:51.196615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17489. [D 20:42:51.196641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17490. [D 20:42:51.196652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17491. [D 20:42:51.196662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17492. [D 20:42:51.196672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17493. [D 20:42:51.196681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17494. [D 20:42:51.196709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17495. [D 20:42:51.196720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17496. [D 20:42:51.196730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17497. [D 20:42:51.196743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17498. [D 20:42:51.196753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17499. [D 20:42:51.196763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17500. [D 20:42:51.196779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17501. [D 20:42:51.196788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17502. [D 20:42:51.196798] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17503. [D 20:42:51.202373] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17503. [D 20:42:51.202391] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 50/70. [D 20:42:51.202458] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.202473] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.202482] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:51.208975] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.208989] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.208997] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:51.209017] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4079 [D 20:42:51.209026] element 0: offset: 0x2aaaab23a4a0, size: 24 [D 20:42:51.209037] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 51/70. [D 20:42:51.279063] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4079 [D 20:42:51.279080] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 52/70. [D 20:42:51.279141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 17503. [D 20:42:51.279217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17504. [D 20:42:51.279229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17505. [D 20:42:51.279239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17506. [D 20:42:51.279250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17507. [D 20:42:51.279260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17508. [D 20:42:51.279276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17509. [D 20:42:51.279286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17510. [D 20:42:51.279295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17511. [D 20:42:51.279305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17512. [D 20:42:51.279315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17513. [D 20:42:51.279325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17514. [D 20:42:51.279334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17515. [D 20:42:51.279352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17516. [D 20:42:51.279361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17517. [D 20:42:51.279371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17518. [D 20:42:51.279426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17519. [D 20:42:51.279438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17520. [D 20:42:51.279448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17521. [D 20:42:51.279471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17522. [D 20:42:51.279482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17523. [D 20:42:51.279492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17524. [D 20:42:51.279502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17525. [D 20:42:51.279512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17526. [D 20:42:51.279522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17527. [D 20:42:51.279532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17528. [D 20:42:51.279542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17529. [D 20:42:51.279552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17530. [D 20:42:51.279584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17531. [D 20:42:51.279594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17532. [D 20:42:51.279606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17533. [D 20:42:51.279616] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17534. [D 20:42:51.280023] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.280039] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.280048] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.280064] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4082 [D 20:42:51.280074] element 0: offset: 0x2aaaab23d270, size: 24 [D 20:42:51.280084] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 53/70. [D 20:42:51.285486] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17534. [D 20:42:51.285508] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 54/70. [D 20:42:51.285574] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.285589] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.285597] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.289689] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4082 [D 20:42:51.289706] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 55/70. [D 20:42:51.297003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17534. [D 20:42:51.297058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17535. [D 20:42:51.297068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17536. [D 20:42:51.297079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17537. [D 20:42:51.297089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17538. [D 20:42:51.297099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17539. [D 20:42:51.297109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17540. [D 20:42:51.297124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17541. [D 20:42:51.297134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17542. [D 20:42:51.297144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17543. [D 20:42:51.297154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17544. [D 20:42:51.297190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17545. [D 20:42:51.297201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17546. [D 20:42:51.297212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17547. [D 20:42:51.297231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17548. [D 20:42:51.297245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17549. [D 20:42:51.297255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17550. [D 20:42:51.297275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17551. [D 20:42:51.297286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17552. [D 20:42:51.297295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17553. [D 20:42:51.297319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17554. [D 20:42:51.297329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17555. [D 20:42:51.297339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17556. [D 20:42:51.297353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17557. [D 20:42:51.297373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17558. [D 20:42:51.297384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17559. [D 20:42:51.297394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17560. [D 20:42:51.297417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17561. [D 20:42:51.297427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17562. [D 20:42:51.297437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17563. [D 20:42:51.297461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17564. [D 20:42:51.297471] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17565. [D 20:42:51.297565] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.297581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.297590] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.297605] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4085 [D 20:42:51.297615] element 0: offset: 0x2aaaab22fcc0, size: 24 [D 20:42:51.297625] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 56/70. [D 20:42:51.304486] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17565. [D 20:42:51.304507] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 57/70. [D 20:42:51.304608] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.304622] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.304631] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.310259] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.310273] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.310281] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.310297] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4088 [D 20:42:51.310306] element 0: offset: 0x2aaaab2092a0, size: 24 [D 20:42:51.310316] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 58/70. [D 20:42:51.315094] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4088 [D 20:42:51.315110] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 59/70. [D 20:42:51.315173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 17565. [D 20:42:51.315291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17566. [D 20:42:51.315303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17567. [D 20:42:51.315314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17568. [D 20:42:51.315324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17569. [D 20:42:51.315335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17570. [D 20:42:51.315345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17571. [D 20:42:51.315355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17572. [D 20:42:51.315365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17573. [D 20:42:51.315374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17574. [D 20:42:51.315384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17575. [D 20:42:51.315400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17576. [D 20:42:51.315410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17577. [D 20:42:51.315420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17578. [D 20:42:51.315429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17579. [D 20:42:51.315439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17580. [D 20:42:51.315449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17581. [D 20:42:51.315462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17582. [D 20:42:51.315472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17583. [D 20:42:51.315481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17584. [D 20:42:51.315702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17585. [D 20:42:51.315717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17586. [D 20:42:51.315726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17587. [D 20:42:51.315741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17588. [D 20:42:51.315751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17589. [D 20:42:51.315760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17590. [D 20:42:51.315775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17591. [D 20:42:51.315785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17592. [D 20:42:51.315795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17593. [D 20:42:51.315810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17594. [D 20:42:51.315835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17595. [D 20:42:51.315847] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17596. [D 20:42:51.322449] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17596. [D 20:42:51.322517] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 60/70. [D 20:42:51.322622] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.322639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.322647] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.332916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.332929] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.332938] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.332953] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4091 [D 20:42:51.332963] element 0: offset: 0x2aaaab2033f0, size: 24 [D 20:42:51.332973] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 0/70. [D 20:42:51.337345] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4091 [D 20:42:51.337364] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 1/70. [D 20:42:51.337482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 17596. [D 20:42:51.337550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17597. [D 20:42:51.337566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17598. [D 20:42:51.337578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17599. [D 20:42:51.337588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17600. [D 20:42:51.337597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17601. [D 20:42:51.337607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17602. [D 20:42:51.337616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17603. [D 20:42:51.337627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17604. [D 20:42:51.337639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17605. [D 20:42:51.337648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17606. [D 20:42:51.337658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17607. [D 20:42:51.337667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17608. [D 20:42:51.337686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17609. [D 20:42:51.337696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17610. [D 20:42:51.337705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17611. [D 20:42:51.337716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17612. [D 20:42:51.337764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17613. [D 20:42:51.337774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17614. [D 20:42:51.337784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17615. [D 20:42:51.337799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17616. [D 20:42:51.337822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17617. [D 20:42:51.337836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17618. [D 20:42:51.337845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17619. [D 20:42:51.337855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17620. [D 20:42:51.337869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17621. [D 20:42:51.337894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17622. [D 20:42:51.337909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17623. [D 20:42:51.337919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17624. [D 20:42:51.337942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17625. [D 20:42:51.337961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17626. [D 20:42:51.337971] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17627. [D 20:42:51.345620] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4085 [D 20:42:51.345641] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 2/70. [D 20:42:51.348986] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17627. [D 20:42:51.349008] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 3/70. [D 20:42:51.349023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 17627. [D 20:42:51.349036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 17628. [D 20:42:51.349048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 17629. [D 20:42:51.349060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 17630. [D 20:42:51.349072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 17631. [D 20:42:51.349085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 17632. [D 20:42:51.349097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 17633. [D 20:42:51.349109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 17634. [D 20:42:51.349121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 17635. [D 20:42:51.349133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 17636. [D 20:42:51.349145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 17637. [D 20:42:51.349157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 17638. [D 20:42:51.349169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 17639. [D 20:42:51.349306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 17640. [D 20:42:51.349318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 17641. [D 20:42:51.349328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 17642. [D 20:42:51.349338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 17643. [D 20:42:51.349348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 17644. [D 20:42:51.349359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 17645. [D 20:42:51.349378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 17646. [D 20:42:51.349401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 17647. [D 20:42:51.349418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 17648. [D 20:42:51.349428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 17649. [D 20:42:51.349437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 17650. [D 20:42:51.349447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 17651. [D 20:42:51.349456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 17652. [D 20:42:51.349466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 17653. [D 20:42:51.349475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 17654. [D 20:42:51.349485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 17655. [D 20:42:51.349494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 17656. [D 20:42:51.349503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 17657. [D 20:42:51.349513] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 17658. [D 20:42:51.349564] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.349574] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.349582] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.354940] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17658. [D 20:42:51.354960] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 4/70. [D 20:42:51.355024] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.355038] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.355047] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:51.355114] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.355126] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.355135] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:51.355158] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4094 [D 20:42:51.355168] element 0: offset: 0x2aaaab22c250, size: 24 [D 20:42:51.355185] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 5/70. [D 20:42:51.359421] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4094 [D 20:42:51.359437] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 6/70. [D 20:42:51.361190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 17658. [D 20:42:51.361247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17659. [D 20:42:51.361258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17660. [D 20:42:51.361269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17661. [D 20:42:51.361279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17662. [D 20:42:51.361289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17663. [D 20:42:51.361298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17664. [D 20:42:51.361308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17665. [D 20:42:51.361323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17666. [D 20:42:51.361332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17667. [D 20:42:51.361342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17668. [D 20:42:51.361352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17669. [D 20:42:51.361362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17670. [D 20:42:51.361371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17671. [D 20:42:51.361381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17672. [D 20:42:51.361397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17673. [D 20:42:51.361421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17674. [D 20:42:51.361431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17675. [D 20:42:51.361441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17676. [D 20:42:51.361450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17677. [D 20:42:51.361460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17678. [D 20:42:51.361476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17679. [D 20:42:51.361501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17680. [D 20:42:51.361515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17681. [D 20:42:51.361525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17682. [D 20:42:51.361534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17683. [D 20:42:51.361548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17684. [D 20:42:51.361557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17685. [D 20:42:51.361567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17686. [D 20:42:51.361583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17687. [D 20:42:51.361608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17688. [D 20:42:51.361621] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17689. [D 20:42:51.361679] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.361694] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.361703] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.361719] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4097 [D 20:42:51.361729] element 0: offset: 0x2aaaab234cb0, size: 24 [D 20:42:51.361738] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 7/70. [D 20:42:51.372838] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17689. [D 20:42:51.372860] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 8/70. [D 20:42:51.372924] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.372938] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.372947] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.379004] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.379018] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.379026] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.379042] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4100 [D 20:42:51.379051] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:42:51.379061] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 9/70. [D 20:42:51.383308] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4100 [D 20:42:51.383325] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 10/70. [D 20:42:51.383507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 17689. [D 20:42:51.383576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17690. [D 20:42:51.383588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17691. [D 20:42:51.383598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17692. [D 20:42:51.383612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17693. [D 20:42:51.383622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17694. [D 20:42:51.383632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17695. [D 20:42:51.383647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17696. [D 20:42:51.383656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17697. [D 20:42:51.383666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17698. [D 20:42:51.383682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17699. [D 20:42:51.383692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17700. [D 20:42:51.383701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17701. [D 20:42:51.383736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17702. [D 20:42:51.383748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17703. [D 20:42:51.383758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17704. [D 20:42:51.383768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17705. [D 20:42:51.383783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17706. [D 20:42:51.383793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17707. [D 20:42:51.383813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17708. [D 20:42:51.383823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17709. [D 20:42:51.383832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17710. [D 20:42:51.383842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17711. [D 20:42:51.383868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17712. [D 20:42:51.383878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17713. [D 20:42:51.383888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17714. [D 20:42:51.383898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17715. [D 20:42:51.383908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17716. [D 20:42:51.383918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17717. [D 20:42:51.383928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17718. [D 20:42:51.383948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17719. [D 20:42:51.383959] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17720. [D 20:42:51.391249] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17720. [D 20:42:51.391268] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 11/70. [D 20:42:51.391330] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.391344] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.391353] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.408641] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.408654] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.408663] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.408679] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4103 [D 20:42:51.408688] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:42:51.408699] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 12/70. [D 20:42:51.413711] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4103 [D 20:42:51.413728] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 13/70. [D 20:42:51.413800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 17720. [D 20:42:51.413878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17721. [D 20:42:51.413889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17722. [D 20:42:51.413900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17723. [D 20:42:51.413915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17724. [D 20:42:51.413924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17725. [D 20:42:51.413934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17726. [D 20:42:51.413949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17727. [D 20:42:51.413958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17728. [D 20:42:51.413968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17729. [D 20:42:51.413984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17730. [D 20:42:51.413994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17731. [D 20:42:51.414003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17732. [D 20:42:51.414019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17733. [D 20:42:51.414028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17734. [D 20:42:51.414038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17735. [D 20:42:51.414102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17736. [D 20:42:51.414112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17737. [D 20:42:51.414122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17738. [D 20:42:51.414136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17739. [D 20:42:51.414145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17740. [D 20:42:51.414155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17741. [D 20:42:51.414171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17742. [D 20:42:51.414180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17743. [D 20:42:51.414190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17744. [D 20:42:51.414200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17745. [D 20:42:51.414210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17746. [D 20:42:51.414219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17747. [D 20:42:51.414229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17748. [D 20:42:51.414257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17749. [D 20:42:51.414267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17750. [D 20:42:51.414278] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17751. [D 20:42:51.418429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.418446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.418455] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:51.418471] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4106 [D 20:42:51.418480] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:42:51.418491] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 14/70. [D 20:42:51.425189] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17751. [D 20:42:51.425211] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 15/70. [D 20:42:51.425273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.425288] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.425296] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:51.431175] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.431188] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.431197] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:51.431212] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4109 [D 20:42:51.431221] element 0: offset: 0x2aaaab23d270, size: 24 [D 20:42:51.431231] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 16/70. [D 20:42:51.433622] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4097 [D 20:42:51.433640] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 17/70. [D 20:42:51.433807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17751. [D 20:42:51.433872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17752. [D 20:42:51.433883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17753. [D 20:42:51.433894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17754. [D 20:42:51.433908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17755. [D 20:42:51.433918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17756. [D 20:42:51.433927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17757. [D 20:42:51.433942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17758. [D 20:42:51.433952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17759. [D 20:42:51.433962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17760. [D 20:42:51.433972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17761. [D 20:42:51.433997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17762. [D 20:42:51.434008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17763. [D 20:42:51.434039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17764. [D 20:42:51.434049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17765. [D 20:42:51.434059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17766. [D 20:42:51.434069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17767. [D 20:42:51.434080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17768. [D 20:42:51.434103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17769. [D 20:42:51.434114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17770. [D 20:42:51.434124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17771. [D 20:42:51.434134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17772. [D 20:42:51.434149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17773. [D 20:42:51.434158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17774. [D 20:42:51.434182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17775. [D 20:42:51.434192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17776. [D 20:42:51.434202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17777. [D 20:42:51.434216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17778. [D 20:42:51.434226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17779. [D 20:42:51.434250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17780. [D 20:42:51.434260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17781. [D 20:42:51.434270] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17782. [D 20:42:51.438539] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4109 [D 20:42:51.438557] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 18/70. [D 20:42:51.442480] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17782. [D 20:42:51.442538] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 19/70. [D 20:42:51.442553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 17782. [D 20:42:51.442565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17783. [D 20:42:51.442575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17784. [D 20:42:51.442585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17785. [D 20:42:51.442601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17786. [D 20:42:51.442611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17787. [D 20:42:51.442620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17788. [D 20:42:51.442630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17789. [D 20:42:51.442640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17790. [D 20:42:51.442684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17791. [D 20:42:51.442694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 17792. [D 20:42:51.442708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 17793. [D 20:42:51.442732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 17794. [D 20:42:51.442742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 17795. [D 20:42:51.442752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 17796. [D 20:42:51.442762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 17797. [D 20:42:51.442773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 17798. [D 20:42:51.442782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 17799. [D 20:42:51.442809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 17800. [D 20:42:51.442819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 17801. [D 20:42:51.442829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 17802. [D 20:42:51.442844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 17803. [D 20:42:51.442853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 17804. [D 20:42:51.442880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 17805. [D 20:42:51.442890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 17806. [D 20:42:51.442899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 17807. [D 20:42:51.442914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 17808. [D 20:42:51.442924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 17809. [D 20:42:51.442954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 17810. [D 20:42:51.442964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 17811. [D 20:42:51.442973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 17812. [D 20:42:51.442988] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 17813. [D 20:42:51.443074] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.443088] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.443097] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:51.448452] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 17813. [D 20:42:51.448493] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 20/70. [D 20:42:51.448556] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.448570] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.448579] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.449087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.449100] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.449109] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.449124] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4112 [D 20:42:51.449134] element 0: offset: 0x2aaaab2092a0, size: 24 [D 20:42:51.449144] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 21/70. [D 20:42:51.461253] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.461289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.461298] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:51.461324] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4115 [D 20:42:51.461334] element 0: offset: 0x2aaaab22fcc0, size: 24 [D 20:42:51.461345] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 22/70. [D 20:42:51.462226] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 655360, tag: 4115 [D 20:42:51.462278] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 23/70. [D 20:42:51.462358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 17813. [D 20:42:51.462427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 17814. [D 20:42:51.462438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 17815. [D 20:42:51.462448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 17816. [D 20:42:51.462464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 17817. [D 20:42:51.462476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 17818. [D 20:42:51.462486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 17819. [D 20:42:51.462496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 17820. [D 20:42:51.462537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 17821. [D 20:42:51.462547] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 17822. [D 20:42:51.466046] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17822. [D 20:42:51.466066] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 24/70. [D 20:42:51.466163] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.466180] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.466189] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:51.472363] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4112 [D 20:42:51.472381] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 25/70. [D 20:42:51.472455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17822. [D 20:42:51.472521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17823. [D 20:42:51.472533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17824. [D 20:42:51.472544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17825. [D 20:42:51.472554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17826. [D 20:42:51.472570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17827. [D 20:42:51.472579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17828. [D 20:42:51.472589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17829. [D 20:42:51.472605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17830. [D 20:42:51.472615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17831. [D 20:42:51.472625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17832. [D 20:42:51.472666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17833. [D 20:42:51.472677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17834. [D 20:42:51.472687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17835. [D 20:42:51.472697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17836. [D 20:42:51.472707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17837. [D 20:42:51.472716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17838. [D 20:42:51.472741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17839. [D 20:42:51.472752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17840. [D 20:42:51.472761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17841. [D 20:42:51.472776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17842. [D 20:42:51.472800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17843. [D 20:42:51.472812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17844. [D 20:42:51.472822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17845. [D 20:42:51.472831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17846. [D 20:42:51.472845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17847. [D 20:42:51.472854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17848. [D 20:42:51.472881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17849. [D 20:42:51.472891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17850. [D 20:42:51.472902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17851. [D 20:42:51.472926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17852. [D 20:42:51.472937] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17853. [D 20:42:51.478158] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.478174] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.478183] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:51.478210] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4118 [D 20:42:51.478220] element 0: offset: 0x2aaaab22c250, size: 24 [D 20:42:51.478232] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 26/70. [D 20:42:51.479501] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 17853. [D 20:42:51.479522] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 27/70. [D 20:42:51.479588] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.479602] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.479610] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:51.479623] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.479632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.479640] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.487854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.487868] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.487876] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.487893] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4121 [D 20:42:51.487902] element 0: offset: 0x5b0030, size: 24 [D 20:42:51.487912] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 28/70. [D 20:42:51.504211] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4106 [D 20:42:51.504235] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 29/70. [D 20:42:51.504295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 17853. [D 20:42:51.504363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 17854. [D 20:42:51.504383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 17855. [D 20:42:51.504394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 17856. [D 20:42:51.504405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 17857. [D 20:42:51.504414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 17858. [D 20:42:51.504431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 17859. [D 20:42:51.504440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 17860. [D 20:42:51.504450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 17861. [D 20:42:51.504460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 17862. [D 20:42:51.504471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 17863. [D 20:42:51.504480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 17864. [D 20:42:51.504528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 17865. [D 20:42:51.504538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 17866. [D 20:42:51.504548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 17867. [D 20:42:51.504558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 17868. [D 20:42:51.504582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 17869. [D 20:42:51.504593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 17870. [D 20:42:51.504604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 17871. [D 20:42:51.504613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 17872. [D 20:42:51.504640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 17873. [D 20:42:51.504650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 17874. [D 20:42:51.504659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 17875. [D 20:42:51.504690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 17876. [D 20:42:51.504700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 17877. [D 20:42:51.504712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 17878. [D 20:42:51.504722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 17879. [D 20:42:51.504731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 17880. [D 20:42:51.504745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 17881. [D 20:42:51.504767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 17882. [D 20:42:51.504781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 17883. [D 20:42:51.504791] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 17884. [D 20:42:51.510225] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 17884. [D 20:42:51.510242] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 30/70. [D 20:42:51.510314] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.510329] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.510338] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.515836] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.515849] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.515857] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.515877] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4124 [D 20:42:51.515887] element 0: offset: 0x61f800, size: 24 [D 20:42:51.515897] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 31/70. [D 20:42:51.567513] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4124 [D 20:42:51.567531] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 32/70. [D 20:42:51.567589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17884. [D 20:42:51.567667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17885. [D 20:42:51.567679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17886. [D 20:42:51.567689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17887. [D 20:42:51.567700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17888. [D 20:42:51.567709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17889. [D 20:42:51.567725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17890. [D 20:42:51.567735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17891. [D 20:42:51.567745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17892. [D 20:42:51.567761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17893. [D 20:42:51.567823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17894. [D 20:42:51.567833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17895. [D 20:42:51.567855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17896. [D 20:42:51.567865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17897. [D 20:42:51.567875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17898. [D 20:42:51.567888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17899. [D 20:42:51.567898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17900. [D 20:42:51.567907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17901. [D 20:42:51.567938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17902. [D 20:42:51.567949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17903. [D 20:42:51.567959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17904. [D 20:42:51.567969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17905. [D 20:42:51.567979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17906. [D 20:42:51.567990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17907. [D 20:42:51.568010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17908. [D 20:42:51.568026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17909. [D 20:42:51.568037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17910. [D 20:42:51.568046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17911. [D 20:42:51.568056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17912. [D 20:42:51.568066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17913. [D 20:42:51.568076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17914. [D 20:42:51.568094] openib_post_sr_rdmaw: ibv_post_send wr_id 6256a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17915. [D 20:42:51.573535] openib_check_cq: completed rdma wr_id 6256a0, nic_wr_credit 17915. [D 20:42:51.573553] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 33/70. [D 20:42:51.573617] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.573632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.573640] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.579266] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.579279] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.579288] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.579304] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4127 [D 20:42:51.579314] element 0: offset: 0x61f800, size: 24 [D 20:42:51.579324] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 34/70. [D 20:42:51.631844] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4127 [D 20:42:51.631861] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 35/70. [D 20:42:51.631919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17915. [D 20:42:51.631987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17916. [D 20:42:51.631998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17917. [D 20:42:51.632009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17918. [D 20:42:51.632019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17919. [D 20:42:51.632029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17920. [D 20:42:51.632039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17921. [D 20:42:51.632050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17922. [D 20:42:51.632059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17923. [D 20:42:51.632069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17924. [D 20:42:51.632079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17925. [D 20:42:51.632142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17926. [D 20:42:51.632154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17927. [D 20:42:51.632164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17928. [D 20:42:51.632188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17929. [D 20:42:51.632198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17930. [D 20:42:51.632214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17931. [D 20:42:51.632225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17932. [D 20:42:51.632234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17933. [D 20:42:51.632245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17934. [D 20:42:51.632272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17935. [D 20:42:51.632283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17936. [D 20:42:51.632293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17937. [D 20:42:51.632302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17938. [D 20:42:51.632313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17939. [D 20:42:51.632337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17940. [D 20:42:51.632349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17941. [D 20:42:51.632359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17942. [D 20:42:51.632369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17943. [D 20:42:51.632379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17944. [D 20:42:51.632389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17945. [D 20:42:51.632409] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17946. [D 20:42:51.637913] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 17946. [D 20:42:51.637931] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 36/70. [D 20:42:51.637994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.638009] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.638018] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.643477] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.643490] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.643499] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.643515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4130 [D 20:42:51.643524] element 0: offset: 0x61f800, size: 24 [D 20:42:51.643535] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 37/70. [D 20:42:51.672913] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4130 [D 20:42:51.672930] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 38/70. [D 20:42:51.672988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17946. [D 20:42:51.673086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17947. [D 20:42:51.673099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17948. [D 20:42:51.673110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17949. [D 20:42:51.673121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17950. [D 20:42:51.673131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17951. [D 20:42:51.673141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17952. [D 20:42:51.673150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17953. [D 20:42:51.673162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17954. [D 20:42:51.673179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17955. [D 20:42:51.673194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17956. [D 20:42:51.673203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17957. [D 20:42:51.673241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17958. [D 20:42:51.673254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17959. [D 20:42:51.673263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17960. [D 20:42:51.673274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17961. [D 20:42:51.673283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17962. [D 20:42:51.673293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17963. [D 20:42:51.673318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17964. [D 20:42:51.673328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17965. [D 20:42:51.673338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17966. [D 20:42:51.673348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17967. [D 20:42:51.673374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17968. [D 20:42:51.673384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 17969. [D 20:42:51.673395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 17970. [D 20:42:51.673405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 17971. [D 20:42:51.673415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 17972. [D 20:42:51.673425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 17973. [D 20:42:51.673435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 17974. [D 20:42:51.673461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 17975. [D 20:42:51.673471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 17976. [D 20:42:51.673481] openib_post_sr_rdmaw: ibv_post_send wr_id 63d7e0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 17977. [D 20:42:51.679002] openib_check_cq: completed rdma wr_id 63d7e0, nic_wr_credit 17977. [D 20:42:51.679020] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 39/70. [D 20:42:51.679083] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.679098] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.679106] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.684559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.684572] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.684581] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.684597] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4133 [D 20:42:51.684607] element 0: offset: 0x655b90, size: 24 [D 20:42:51.684617] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 40/70. [D 20:42:51.734129] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4133 [D 20:42:51.734147] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 41/70. [D 20:42:51.734208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 17977. [D 20:42:51.734278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 17978. [D 20:42:51.734298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 17979. [D 20:42:51.734309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 17980. [D 20:42:51.734319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 17981. [D 20:42:51.734329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 17982. [D 20:42:51.734344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 17983. [D 20:42:51.734354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 17984. [D 20:42:51.734363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 17985. [D 20:42:51.734379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 17986. [D 20:42:51.734435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 17987. [D 20:42:51.734446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 17988. [D 20:42:51.734472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 17989. [D 20:42:51.734482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 17990. [D 20:42:51.734492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 17991. [D 20:42:51.734510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 17992. [D 20:42:51.734520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 17993. [D 20:42:51.734530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 17994. [D 20:42:51.734540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 17995. [D 20:42:51.734551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 17996. [D 20:42:51.734573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 17997. [D 20:42:51.734583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 17998. [D 20:42:51.734594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 17999. [D 20:42:51.734604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 18000. [D 20:42:51.734613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 18001. [D 20:42:51.734641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 18002. [D 20:42:51.734651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 18003. [D 20:42:51.734660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 18004. [D 20:42:51.734670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 18005. [D 20:42:51.734696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 18006. [D 20:42:51.734706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 18007. [D 20:42:51.734717] openib_post_sr_rdmaw: ibv_post_send wr_id 6256a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 18008. [D 20:42:51.740182] openib_check_cq: completed rdma wr_id 6256a0, nic_wr_credit 18008. [D 20:42:51.740200] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 42/70. [D 20:42:51.740263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.740277] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.740286] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.745661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.745675] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.745683] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.745700] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4136 [D 20:42:51.745709] element 0: offset: 0x61f310, size: 24 [D 20:42:51.745720] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 43/70. [D 20:42:51.748236] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4121 [D 20:42:51.748253] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 44/70. [D 20:42:51.748302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 18008. [D 20:42:51.748331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18009. [D 20:42:51.748342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18010. [D 20:42:51.748352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18011. [D 20:42:51.748362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18012. [D 20:42:51.748373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18013. [D 20:42:51.748382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18014. [D 20:42:51.748414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18015. [D 20:42:51.748424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18016. [D 20:42:51.748438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18017. [D 20:42:51.748448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18018. [D 20:42:51.748458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18019. [D 20:42:51.748472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18020. [D 20:42:51.748482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18021. [D 20:42:51.748492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18022. [D 20:42:51.748508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18023. [D 20:42:51.748526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18024. [D 20:42:51.748535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18025. [D 20:42:51.748548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18026. [D 20:42:51.748564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18027. [D 20:42:51.748588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18028. [D 20:42:51.748602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18029. [D 20:42:51.748612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18030. [D 20:42:51.748621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18031. [D 20:42:51.748635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18032. [D 20:42:51.748645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18033. [D 20:42:51.748655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18034. [D 20:42:51.748684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18035. [D 20:42:51.748695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18036. [D 20:42:51.748709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18037. [D 20:42:51.748719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18038. [D 20:42:51.748729] openib_post_sr_rdmaw: ibv_post_send wr_id 691f50 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18039. [D 20:42:51.758706] openib_check_cq: completed rdma wr_id 691f50, nic_wr_credit 18039. [D 20:42:51.758775] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 45/70. [D 20:42:51.758881] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.758896] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.758905] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.765706] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.765720] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.765729] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.765745] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4139 [D 20:42:51.765755] element 0: offset: 0x61fad0, size: 24 [D 20:42:51.765765] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 46/70. [D 20:42:51.780705] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4136 [D 20:42:51.780722] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 47/70. [D 20:42:51.780784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 18039. [D 20:42:51.780860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 18040. [D 20:42:51.780871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 18041. [D 20:42:51.780882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 18042. [D 20:42:51.780893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 18043. [D 20:42:51.780903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 18044. [D 20:42:51.780914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 18045. [D 20:42:51.780924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 18046. [D 20:42:51.780934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 18047. [D 20:42:51.780950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 18048. [D 20:42:51.780960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 18049. [D 20:42:51.781008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 18050. [D 20:42:51.781019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 18051. [D 20:42:51.781043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 18052. [D 20:42:51.781055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 18053. [D 20:42:51.781065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 18054. [D 20:42:51.781074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 18055. [D 20:42:51.781088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 18056. [D 20:42:51.781112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 18057. [D 20:42:51.781126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 18058. [D 20:42:51.781135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 18059. [D 20:42:51.781145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 18060. [D 20:42:51.781160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 18061. [D 20:42:51.781187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 18062. [D 20:42:51.781243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 18063. [D 20:42:51.781259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 18064. [D 20:42:51.781269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 18065. [D 20:42:51.781279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 18066. [D 20:42:51.781305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 18067. [D 20:42:51.781315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 18068. [D 20:42:51.781325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 18069. [D 20:42:51.781335] openib_post_sr_rdmaw: ibv_post_send wr_id 691f50 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 18070. [D 20:42:51.786794] openib_check_cq: completed rdma wr_id 691f50, nic_wr_credit 18070. [D 20:42:51.786845] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 48/70. [D 20:42:51.786906] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.786920] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.786928] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.792351] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.792364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.792372] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.792388] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4142 [D 20:42:51.792397] element 0: offset: 0x5b0030, size: 24 [D 20:42:51.792408] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 49/70. [D 20:42:51.827891] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4139 [D 20:42:51.827908] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 50/70. [D 20:42:51.827969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 18070. [D 20:42:51.828035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18071. [D 20:42:51.828096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18072. [D 20:42:51.828106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18073. [D 20:42:51.828117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18074. [D 20:42:51.828133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18075. [D 20:42:51.828144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18076. [D 20:42:51.828153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18077. [D 20:42:51.828163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18078. [D 20:42:51.828173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18079. [D 20:42:51.828183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18080. [D 20:42:51.828193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18081. [D 20:42:51.828203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18082. [D 20:42:51.828229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18083. [D 20:42:51.828239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18084. [D 20:42:51.828253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18085. [D 20:42:51.828263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18086. [D 20:42:51.828273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18087. [D 20:42:51.828283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18088. [D 20:42:51.828300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18089. [D 20:42:51.828310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18090. [D 20:42:51.828320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18091. [D 20:42:51.828330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18092. [D 20:42:51.828339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18093. [D 20:42:51.828349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18094. [D 20:42:51.828359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18095. [D 20:42:51.828369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18096. [D 20:42:51.828386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18097. [D 20:42:51.828396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18098. [D 20:42:51.828405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18099. [D 20:42:51.828415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18100. [D 20:42:51.828425] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18101. [D 20:42:51.833976] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 18101. [D 20:42:51.833995] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 51/70. [D 20:42:51.834059] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.834073] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.834082] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.840672] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.840686] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.840694] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.840710] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4145 [D 20:42:51.840719] element 0: offset: 0x61f310, size: 24 [D 20:42:51.840730] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 52/70. [D 20:42:51.875412] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4142 [D 20:42:51.875429] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 53/70. [D 20:42:51.875489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 18101. [D 20:42:51.875601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 18102. [D 20:42:51.875614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 18103. [D 20:42:51.875625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 18104. [D 20:42:51.875635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 18105. [D 20:42:51.875646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 18106. [D 20:42:51.875656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 18107. [D 20:42:51.875665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 18108. [D 20:42:51.875682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 18109. [D 20:42:51.875692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 18110. [D 20:42:51.875702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 18111. [D 20:42:51.875712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 18112. [D 20:42:51.875746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 18113. [D 20:42:51.875756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 18114. [D 20:42:51.875766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 18115. [D 20:42:51.875776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 18116. [D 20:42:51.875786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 18117. [D 20:42:51.875797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 18118. [D 20:42:51.875821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 18119. [D 20:42:51.875831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 18120. [D 20:42:51.875841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 18121. [D 20:42:51.875851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 18122. [D 20:42:51.875875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 18123. [D 20:42:51.875885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 18124. [D 20:42:51.875899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 18125. [D 20:42:51.875909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 18126. [D 20:42:51.875918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 18127. [D 20:42:51.875942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 18128. [D 20:42:51.875952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 18129. [D 20:42:51.875962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 18130. [D 20:42:51.875972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 18131. [D 20:42:51.875981] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 18132. [D 20:42:51.881502] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 18132. [D 20:42:51.881520] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 54/70. [D 20:42:51.881583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.881597] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.881606] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.887001] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.887014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.887023] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:51.887038] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4148 [D 20:42:51.887048] element 0: offset: 0x61fad0, size: 24 [D 20:42:51.887058] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 55/70. [D 20:42:51.891399] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4148 [D 20:42:51.891415] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 56/70. [D 20:42:51.891480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 18132. [D 20:42:51.891550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 18133. [D 20:42:51.891561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 18134. [D 20:42:51.891572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 18135. [D 20:42:51.891588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 18136. [D 20:42:51.891599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 18137. [D 20:42:51.891608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 18138. [D 20:42:51.891619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 18139. [D 20:42:51.891629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 18140. [D 20:42:51.891638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 18141. [D 20:42:51.891648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 18142. [D 20:42:51.891665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 18143. [D 20:42:51.891675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 18144. [D 20:42:51.891685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 18145. [D 20:42:51.891695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 18146. [D 20:42:51.891735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 18147. [D 20:42:51.891745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 18148. [D 20:42:51.891755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 18149. [D 20:42:51.891771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 18150. [D 20:42:51.891804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 18151. [D 20:42:51.891817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 18152. [D 20:42:51.891827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 18153. [D 20:42:51.891837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 18154. [D 20:42:51.891864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 18155. [D 20:42:51.891878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 18156. [D 20:42:51.891890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 18157. [D 20:42:51.891900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 18158. [D 20:42:51.891910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 18159. [D 20:42:51.891937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 18160. [D 20:42:51.891952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 18161. [D 20:42:51.891962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 18162. [D 20:42:51.891972] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 18163. [D 20:42:51.903152] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 18163. [D 20:42:51.903170] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 57/70. [D 20:42:51.903277] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.903295] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.903304] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:51.978176] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4145 [D 20:42:51.978196] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 58/70. [D 20:42:51.978358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18163. [D 20:42:51.978424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18164. [D 20:42:51.978435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18165. [D 20:42:51.978446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18166. [D 20:42:51.978460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18167. [D 20:42:51.978470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18168. [D 20:42:51.978479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18169. [D 20:42:51.978495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18170. [D 20:42:51.978505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18171. [D 20:42:51.978515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18172. [D 20:42:51.978530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18173. [D 20:42:51.978540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18174. [D 20:42:51.978552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18175. [D 20:42:51.978562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18176. [D 20:42:51.978578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18177. [D 20:42:51.978588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18178. [D 20:42:51.978598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18179. [D 20:42:51.978656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18180. [D 20:42:51.978667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18181. [D 20:42:51.978677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18182. [D 20:42:51.978701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18183. [D 20:42:51.978711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18184. [D 20:42:51.978721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18185. [D 20:42:51.978731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18186. [D 20:42:51.978741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18187. [D 20:42:51.978751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18188. [D 20:42:51.978762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18189. [D 20:42:51.978772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18190. [D 20:42:51.978782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18191. [D 20:42:51.978820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18192. [D 20:42:51.978831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18193. [D 20:42:51.978840] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18194. [D 20:42:51.984356] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 18194. [D 20:42:51.984374] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 59/70. [D 20:42:51.984441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:51.984455] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.984464] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:51.991547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:51.991560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:51.991569] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:51.991594] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4151 [D 20:42:51.991604] element 0: offset: 0x5b0030, size: 24 [D 20:42:51.991614] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 60/70. [D 20:42:52.033048] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4151 [D 20:42:52.033066] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 0/70. [D 20:42:52.033129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18194. [D 20:42:52.033214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18195. [D 20:42:52.033226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18196. [D 20:42:52.033236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18197. [D 20:42:52.033247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18198. [D 20:42:52.033257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18199. [D 20:42:52.033268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18200. [D 20:42:52.033277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18201. [D 20:42:52.033288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18202. [D 20:42:52.033298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18203. [D 20:42:52.033348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18204. [D 20:42:52.033358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18205. [D 20:42:52.033383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18206. [D 20:42:52.033393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18207. [D 20:42:52.033403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18208. [D 20:42:52.033419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18209. [D 20:42:52.033429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18210. [D 20:42:52.033438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18211. [D 20:42:52.033468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18212. [D 20:42:52.033478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18213. [D 20:42:52.033491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18214. [D 20:42:52.033500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18215. [D 20:42:52.033510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18216. [D 20:42:52.033541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18217. [D 20:42:52.033551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18218. [D 20:42:52.033561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18219. [D 20:42:52.033571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18220. [D 20:42:52.033587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18221. [D 20:42:52.033596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18222. [D 20:42:52.033606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18223. [D 20:42:52.033616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18224. [D 20:42:52.033629] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18225. [D 20:42:52.038389] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.038406] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.038414] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:52.038431] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4154 [D 20:42:52.038440] element 0: offset: 0x61f310, size: 24 [D 20:42:52.038452] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 1/70. [D 20:42:52.039109] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18225. [D 20:42:52.039130] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 2/70. [D 20:42:52.039208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.039222] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.039231] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:52.043181] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4154 [D 20:42:52.043197] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 3/70. [D 20:42:52.045487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 18225. [D 20:42:52.045541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 18226. [D 20:42:52.045552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 18227. [D 20:42:52.045562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 18228. [D 20:42:52.045573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 18229. [D 20:42:52.045583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 18230. [D 20:42:52.045592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 18231. [D 20:42:52.045608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 18232. [D 20:42:52.045618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 18233. [D 20:42:52.045628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 18234. [D 20:42:52.045637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 18235. [D 20:42:52.045654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 18236. [D 20:42:52.045663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 18237. [D 20:42:52.045673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 18238. [D 20:42:52.045683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 18239. [D 20:42:52.045694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 18240. [D 20:42:52.045717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 18241. [D 20:42:52.045731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 18242. [D 20:42:52.045741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 18243. [D 20:42:52.045751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 18244. [D 20:42:52.045781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 18245. [D 20:42:52.045791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 18246. [D 20:42:52.045804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 18247. [D 20:42:52.045814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 18248. [D 20:42:52.045823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 18249. [D 20:42:52.045849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 18250. [D 20:42:52.045859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 18251. [D 20:42:52.045872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 18252. [D 20:42:52.045882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 18253. [D 20:42:52.045892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 18254. [D 20:42:52.045905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 18255. [D 20:42:52.045928] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 18256. [D 20:42:52.046073] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.046090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.046098] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:52.046115] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4157 [D 20:42:52.046124] element 0: offset: 0x2aaaab22fcc0, size: 24 [D 20:42:52.046135] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 4/70. [D 20:42:52.057152] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18256. [D 20:42:52.057173] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 5/70. [D 20:42:52.057245] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.057260] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.057268] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:52.062736] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.062749] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.062758] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:52.062773] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4160 [D 20:42:52.062782] element 0: offset: 0x2aaaab2092a0, size: 24 [D 20:42:52.062793] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 6/70. [D 20:42:52.067570] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4160 [D 20:42:52.067587] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 7/70. [D 20:42:52.067766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 18256. [D 20:42:52.067835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 18257. [D 20:42:52.067846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 18258. [D 20:42:52.067857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 18259. [D 20:42:52.067871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 18260. [D 20:42:52.067880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 18261. [D 20:42:52.067890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 18262. [D 20:42:52.067905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 18263. [D 20:42:52.067915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 18264. [D 20:42:52.067924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 18265. [D 20:42:52.067935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 18266. [D 20:42:52.067944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 18267. [D 20:42:52.067954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 18268. [D 20:42:52.067964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 18269. [D 20:42:52.067981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 18270. [D 20:42:52.068022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 18271. [D 20:42:52.068033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 18272. [D 20:42:52.068059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 18273. [D 20:42:52.068070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 18274. [D 20:42:52.068080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 18275. [D 20:42:52.068090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 18276. [D 20:42:52.068106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 18277. [D 20:42:52.068132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 18278. [D 20:42:52.068143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 18279. [D 20:42:52.068153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 18280. [D 20:42:52.068163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 18281. [D 20:42:52.068174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 18282. [D 20:42:52.068184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 18283. [D 20:42:52.068207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 18284. [D 20:42:52.068217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 18285. [D 20:42:52.068226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 18286. [D 20:42:52.068242] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 18287. [D 20:42:52.075616] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18287. [D 20:42:52.075680] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 8/70. [D 20:42:52.075787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.075803] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.075812] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:52.085416] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.085429] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.085438] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:52.085453] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4163 [D 20:42:52.085463] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:42:52.085473] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 9/70. [D 20:42:52.089719] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4163 [D 20:42:52.089736] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 10/70. [D 20:42:52.089848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 18287. [D 20:42:52.089925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 18288. [D 20:42:52.089936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 18289. [D 20:42:52.089947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 18290. [D 20:42:52.089961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 18291. [D 20:42:52.089971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 18292. [D 20:42:52.089981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 18293. [D 20:42:52.089994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 18294. [D 20:42:52.090003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 18295. [D 20:42:52.090013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 18296. [D 20:42:52.090029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 18297. [D 20:42:52.090073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 18298. [D 20:42:52.090458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 18299. [D 20:42:52.090505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 18300. [D 20:42:52.090518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 18301. [D 20:42:52.090528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 18302. [D 20:42:52.090541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 18303. [D 20:42:52.090551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 18304. [D 20:42:52.090561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 18305. [D 20:42:52.090596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 18306. [D 20:42:52.090606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 18307. [D 20:42:52.090616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 18308. [D 20:42:52.090626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 18309. [D 20:42:52.090642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 18310. [D 20:42:52.090651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 18311. [D 20:42:52.090672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 18312. [D 20:42:52.090682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 18313. [D 20:42:52.090692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 18314. [D 20:42:52.090701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 18315. [D 20:42:52.090719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 18316. [D 20:42:52.090743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 18317. [D 20:42:52.090757] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 18318. [D 20:42:52.092968] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4157 [D 20:42:52.092988] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 11/70. [D 20:42:52.101325] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18318. [D 20:42:52.101347] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 12/70. [D 20:42:52.101360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 18318. [D 20:42:52.101370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18319. [D 20:42:52.101380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18320. [D 20:42:52.101390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18321. [D 20:42:52.101400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18322. [D 20:42:52.101410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18323. [D 20:42:52.101420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18324. [D 20:42:52.101430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18325. [D 20:42:52.101439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18326. [D 20:42:52.101457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18327. [D 20:42:52.101466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18328. [D 20:42:52.101476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18329. [D 20:42:52.101486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18330. [D 20:42:52.101543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18331. [D 20:42:52.101556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18332. [D 20:42:52.101566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18333. [D 20:42:52.101590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18334. [D 20:42:52.101600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18335. [D 20:42:52.101610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18336. [D 20:42:52.101621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18337. [D 20:42:52.101631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18338. [D 20:42:52.101653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18339. [D 20:42:52.101663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18340. [D 20:42:52.101672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18341. [D 20:42:52.101683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18342. [D 20:42:52.101693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18343. [D 20:42:52.101703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18344. [D 20:42:52.101728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18345. [D 20:42:52.101745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18346. [D 20:42:52.101755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18347. [D 20:42:52.101764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18348. [D 20:42:52.101774] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18349. [D 20:42:52.101828] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.101843] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.101852] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:52.106916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.106930] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.106938] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:52.106954] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4166 [D 20:42:52.106963] element 0: offset: 0x2aaaab23a4a0, size: 24 [D 20:42:52.106974] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 13/70. [D 20:42:52.107293] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 18349. [D 20:42:52.107311] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 14/70. [D 20:42:52.107376] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.107390] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.107399] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:52.111582] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4166 [D 20:42:52.111599] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 15/70. [D 20:42:52.113612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 18349. [D 20:42:52.113665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 18350. [D 20:42:52.113675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 18351. [D 20:42:52.113686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 18352. [D 20:42:52.113696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 18353. [D 20:42:52.113706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 18354. [D 20:42:52.113715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 18355. [D 20:42:52.113745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 18356. [D 20:42:52.113757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 18357. [D 20:42:52.113767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 18358. [D 20:42:52.113778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 18359. [D 20:42:52.113787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 18360. [D 20:42:52.113802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 18361. [D 20:42:52.113830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 18362. [D 20:42:52.113841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 18363. [D 20:42:52.113852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 18364. [D 20:42:52.113862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 18365. [D 20:42:52.113887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 18366. [D 20:42:52.113897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 18367. [D 20:42:52.113908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 18368. [D 20:42:52.113917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 18369. [D 20:42:52.113927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 18370. [D 20:42:52.113955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 18371. [D 20:42:52.113966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 18372. [D 20:42:52.113976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 18373. [D 20:42:52.113989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 18374. [D 20:42:52.113998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 18375. [D 20:42:52.114019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 18376. [D 20:42:52.114030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 18377. [D 20:42:52.114040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 18378. [D 20:42:52.114050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 18379. [D 20:42:52.114060] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 18380. [D 20:42:52.125497] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18380. [D 20:42:52.125515] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 16/70. [D 20:42:52.125578] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.125593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.125601] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.131336] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.131350] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.131358] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.131373] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4169 [D 20:42:52.131383] element 0: offset: 0x2aaaab234db0, size: 24 [D 20:42:52.131393] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 17/70. [D 20:42:52.135673] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4169 [D 20:42:52.135690] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 18/70. [D 20:42:52.135755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18380. [D 20:42:52.135814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18381. [D 20:42:52.135826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18382. [D 20:42:52.135836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18383. [D 20:42:52.135846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18384. [D 20:42:52.135857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18385. [D 20:42:52.135866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18386. [D 20:42:52.135876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18387. [D 20:42:52.135886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18388. [D 20:42:52.135896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18389. [D 20:42:52.135905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18390. [D 20:42:52.135923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18391. [D 20:42:52.135933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18392. [D 20:42:52.135942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18393. [D 20:42:52.135987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18394. [D 20:42:52.136010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18395. [D 20:42:52.136020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18396. [D 20:42:52.136034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18397. [D 20:42:52.136043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18398. [D 20:42:52.136053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18399. [D 20:42:52.136068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18400. [D 20:42:52.136089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18401. [D 20:42:52.136099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18402. [D 20:42:52.136110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18403. [D 20:42:52.136119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18404. [D 20:42:52.136130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18405. [D 20:42:52.136139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18406. [D 20:42:52.136149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18407. [D 20:42:52.136178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18408. [D 20:42:52.136188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18409. [D 20:42:52.136197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18410. [D 20:42:52.136220] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18411. [D 20:42:52.147017] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18411. [D 20:42:52.147036] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 19/70. [D 20:42:52.147098] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.147112] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.147120] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.153658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.153672] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.153680] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.153695] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4172 [D 20:42:52.153704] element 0: offset: 0x2aaaab22c250, size: 24 [D 20:42:52.153715] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 20/70. [D 20:42:52.158055] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4172 [D 20:42:52.158072] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 21/70. [D 20:42:52.158135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18411. [D 20:42:52.158196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18412. [D 20:42:52.158216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18413. [D 20:42:52.158226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18414. [D 20:42:52.158236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18415. [D 20:42:52.158246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18416. [D 20:42:52.158261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18417. [D 20:42:52.158271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18418. [D 20:42:52.158280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18419. [D 20:42:52.158296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18420. [D 20:42:52.158306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18421. [D 20:42:52.158315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18422. [D 20:42:52.158331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18423. [D 20:42:52.158341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18424. [D 20:42:52.158350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18425. [D 20:42:52.158403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18426. [D 20:42:52.158413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18427. [D 20:42:52.158423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18428. [D 20:42:52.158448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18429. [D 20:42:52.158458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18430. [D 20:42:52.158468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18431. [D 20:42:52.158478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18432. [D 20:42:52.158488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18433. [D 20:42:52.158498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18434. [D 20:42:52.158513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18435. [D 20:42:52.158522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18436. [D 20:42:52.158532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18437. [D 20:42:52.158558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18438. [D 20:42:52.158568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18439. [D 20:42:52.158584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18440. [D 20:42:52.158594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18441. [D 20:42:52.158604] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18442. [D 20:42:52.169515] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18442. [D 20:42:52.169532] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 22/70. [D 20:42:52.169642] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.169658] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.169666] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.175959] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.175973] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.175981] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.175996] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4175 [D 20:42:52.176006] element 0: offset: 0x2aaaab23d270, size: 24 [D 20:42:52.176016] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 23/70. [D 20:42:52.180281] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4175 [D 20:42:52.180298] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 24/70. [D 20:42:52.180407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18442. [D 20:42:52.180474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18443. [D 20:42:52.180486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18444. [D 20:42:52.180496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18445. [D 20:42:52.180507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18446. [D 20:42:52.180516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18447. [D 20:42:52.180526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18448. [D 20:42:52.180536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18449. [D 20:42:52.180546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18450. [D 20:42:52.180555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18451. [D 20:42:52.180565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18452. [D 20:42:52.180582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18453. [D 20:42:52.180592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18454. [D 20:42:52.180601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18455. [D 20:42:52.180611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18456. [D 20:42:52.180622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18457. [D 20:42:52.180632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18458. [D 20:42:52.180642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18459. [D 20:42:52.180688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18460. [D 20:42:52.180700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18461. [D 20:42:52.180709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18462. [D 20:42:52.180719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18463. [D 20:42:52.180745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18464. [D 20:42:52.180755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18465. [D 20:42:52.180765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18466. [D 20:42:52.180774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18467. [D 20:42:52.180785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18468. [D 20:42:52.180808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18469. [D 20:42:52.180823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18470. [D 20:42:52.180835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18471. [D 20:42:52.180844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18472. [D 20:42:52.180854] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18473. [D 20:42:52.191868] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18473. [D 20:42:52.191886] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 25/70. [D 20:42:52.191950] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.191965] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.191973] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.198043] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.198057] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.198065] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.198080] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4178 [D 20:42:52.198090] element 0: offset: 0x2aaaab2092a0, size: 24 [D 20:42:52.198100] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 26/70. [D 20:42:52.202366] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4178 [D 20:42:52.202383] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 27/70. [D 20:42:52.202495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18473. [D 20:42:52.202559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18474. [D 20:42:52.202570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18475. [D 20:42:52.202580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18476. [D 20:42:52.202596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18477. [D 20:42:52.202605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18478. [D 20:42:52.202615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18479. [D 20:42:52.202630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18480. [D 20:42:52.202639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18481. [D 20:42:52.202649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18482. [D 20:42:52.202701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18483. [D 20:42:52.202711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18484. [D 20:42:52.202726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18485. [D 20:42:52.202749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18486. [D 20:42:52.202759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18487. [D 20:42:52.202769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18488. [D 20:42:52.202779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18489. [D 20:42:52.202790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18490. [D 20:42:52.202799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18491. [D 20:42:52.202809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18492. [D 20:42:52.202819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18493. [D 20:42:52.202851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18494. [D 20:42:52.202861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18495. [D 20:42:52.202873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18496. [D 20:42:52.202883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18497. [D 20:42:52.202892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18498. [D 20:42:52.202919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18499. [D 20:42:52.202928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18500. [D 20:42:52.202941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18501. [D 20:42:52.202951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18502. [D 20:42:52.202960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18503. [D 20:42:52.202989] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18504. [D 20:42:52.214000] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18504. [D 20:42:52.214018] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 28/70. [D 20:42:52.214081] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.214096] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.214105] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.240211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.240225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.240233] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.240249] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4181 [D 20:42:52.240258] element 0: offset: 0x2aaaab22fcc0, size: 24 [D 20:42:52.240268] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 29/70. [D 20:42:52.263028] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4181 [D 20:42:52.263045] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 30/70. [D 20:42:52.263109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18504. [D 20:42:52.263185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18505. [D 20:42:52.263196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18506. [D 20:42:52.263207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18507. [D 20:42:52.263217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18508. [D 20:42:52.263227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18509. [D 20:42:52.263242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18510. [D 20:42:52.263251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18511. [D 20:42:52.263261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18512. [D 20:42:52.263277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18513. [D 20:42:52.263335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18514. [D 20:42:52.263346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18515. [D 20:42:52.263370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18516. [D 20:42:52.263382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18517. [D 20:42:52.263392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18518. [D 20:42:52.263401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18519. [D 20:42:52.263415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18520. [D 20:42:52.263425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18521. [D 20:42:52.263450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18522. [D 20:42:52.263460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18523. [D 20:42:52.263470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18524. [D 20:42:52.263486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18525. [D 20:42:52.263509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18526. [D 20:42:52.263523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18527. [D 20:42:52.263533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18528. [D 20:42:52.263543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18529. [D 20:42:52.263566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18530. [D 20:42:52.263575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18531. [D 20:42:52.263590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18532. [D 20:42:52.263599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18533. [D 20:42:52.263609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18534. [D 20:42:52.263637] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18535. [D 20:42:52.269025] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18535. [D 20:42:52.269042] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 31/70. [D 20:42:52.269104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.269118] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.269127] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.275864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.275878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.275886] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.275902] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4184 [D 20:42:52.275911] element 0: offset: 0x2aaaab23a4a0, size: 24 [D 20:42:52.275921] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 32/70. [D 20:42:52.303841] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4184 [D 20:42:52.303858] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 33/70. [D 20:42:52.303917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18535. [D 20:42:52.303983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18536. [D 20:42:52.303994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18537. [D 20:42:52.304004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18538. [D 20:42:52.304015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18539. [D 20:42:52.304025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18540. [D 20:42:52.304035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18541. [D 20:42:52.304045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18542. [D 20:42:52.304055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18543. [D 20:42:52.304065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18544. [D 20:42:52.304075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18545. [D 20:42:52.304085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18546. [D 20:42:52.304125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18547. [D 20:42:52.304138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18548. [D 20:42:52.304148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18549. [D 20:42:52.304180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18550. [D 20:42:52.304191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18551. [D 20:42:52.304202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18552. [D 20:42:52.304212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18553. [D 20:42:52.304222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18554. [D 20:42:52.304251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18555. [D 20:42:52.304261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18556. [D 20:42:52.304272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18557. [D 20:42:52.304281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18558. [D 20:42:52.304291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18559. [D 20:42:52.304302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18560. [D 20:42:52.304312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18561. [D 20:42:52.304338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18562. [D 20:42:52.304348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18563. [D 20:42:52.304358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18564. [D 20:42:52.304384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18565. [D 20:42:52.304394] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18566. [D 20:42:52.309897] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18566. [D 20:42:52.309915] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 34/70. [D 20:42:52.309978] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.309992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.310001] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.316871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.316884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.316893] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.316908] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4187 [D 20:42:52.316917] element 0: offset: 0x2aaaab22c250, size: 24 [D 20:42:52.316927] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 35/70. [D 20:42:52.345728] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4187 [D 20:42:52.345745] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 36/70. [D 20:42:52.345802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18566. [D 20:42:52.345867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18567. [D 20:42:52.345877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18568. [D 20:42:52.345897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18569. [D 20:42:52.345908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18570. [D 20:42:52.345918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18571. [D 20:42:52.345933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18572. [D 20:42:52.345942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18573. [D 20:42:52.345952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18574. [D 20:42:52.345968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18575. [D 20:42:52.346016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18576. [D 20:42:52.346026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18577. [D 20:42:52.346036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18578. [D 20:42:52.346060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18579. [D 20:42:52.346070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18580. [D 20:42:52.346080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18581. [D 20:42:52.346094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18582. [D 20:42:52.346125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18583. [D 20:42:52.346135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18584. [D 20:42:52.346145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18585. [D 20:42:52.346161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18586. [D 20:42:52.346171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18587. [D 20:42:52.346191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18588. [D 20:42:52.346201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18589. [D 20:42:52.346211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18590. [D 20:42:52.346225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18591. [D 20:42:52.346235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18592. [D 20:42:52.346245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18593. [D 20:42:52.346272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18594. [D 20:42:52.346281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18595. [D 20:42:52.346291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18596. [D 20:42:52.346301] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18597. [D 20:42:52.346565] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.346581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.346589] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:52.346606] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4190 [D 20:42:52.346616] element 0: offset: 0x2aaaab2092a0, size: 24 [D 20:42:52.346627] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 37/70. [D 20:42:52.352291] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18597. [D 20:42:52.352311] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 38/70. [D 20:42:52.352372] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.352386] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.352395] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:52.354596] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 131072, tag: 4190 [D 20:42:52.354615] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 39/70. [D 20:42:52.358617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 18597. [D 20:42:52.358636] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 18598. [D 20:42:52.359014] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 18598. [D 20:42:52.359027] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 40/70. [D 20:42:52.359071] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.359086] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.359095] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.359115] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.359124] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.359132] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.359148] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4193 [D 20:42:52.359157] element 0: offset: 0x2aaaab22fcc0, size: 24 [D 20:42:52.359168] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 41/70. [D 20:42:52.362726] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.362740] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.362748] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:52.362764] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4196 [D 20:42:52.362773] element 0: offset: 0x2aaaab244d90, size: 24 [D 20:42:52.362783] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 42/70. [D 20:42:52.362873] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.362886] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.362894] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:52.365572] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4193 [D 20:42:52.365588] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 43/70. [D 20:42:52.365653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 18598. [D 20:42:52.365718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18599. [D 20:42:52.365735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18600. [D 20:42:52.365746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18601. [D 20:42:52.365757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18602. [D 20:42:52.365767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18603. [D 20:42:52.365777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18604. [D 20:42:52.365791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18605. [D 20:42:52.365800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18606. [D 20:42:52.365810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18607. [D 20:42:52.365826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18608. [D 20:42:52.365836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18609. [D 20:42:52.365845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18610. [D 20:42:52.365861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18611. [D 20:42:52.365870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18612. [D 20:42:52.365880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18613. [D 20:42:52.365923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18614. [D 20:42:52.365947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18615. [D 20:42:52.365957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18616. [D 20:42:52.365967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18617. [D 20:42:52.365977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18618. [D 20:42:52.365993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18619. [D 20:42:52.366003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18620. [D 20:42:52.366029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18621. [D 20:42:52.366039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18622. [D 20:42:52.366049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18623. [D 20:42:52.366062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18624. [D 20:42:52.366072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18625. [D 20:42:52.366082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18626. [D 20:42:52.366112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18627. [D 20:42:52.366138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18628. [D 20:42:52.366149] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18629. [D 20:42:52.375982] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18629. [D 20:42:52.376000] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 44/70. [D 20:42:52.376097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.376113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.376122] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.384235] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.384249] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.384257] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.384273] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4199 [D 20:42:52.384282] element 0: offset: 0x2aaaab23d270, size: 24 [D 20:42:52.384292] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 45/70. [D 20:42:52.388493] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4199 [D 20:42:52.388509] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 46/70. [D 20:42:52.388632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18629. [D 20:42:52.388698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18630. [D 20:42:52.388709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18631. [D 20:42:52.388719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18632. [D 20:42:52.388730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18633. [D 20:42:52.388739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18634. [D 20:42:52.388749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18635. [D 20:42:52.388760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18636. [D 20:42:52.388769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18637. [D 20:42:52.388779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18638. [D 20:42:52.388788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18639. [D 20:42:52.388842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18640. [D 20:42:52.388852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18641. [D 20:42:52.388862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18642. [D 20:42:52.388872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18643. [D 20:42:52.388884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18644. [D 20:42:52.388900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18645. [D 20:42:52.388910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18646. [D 20:42:52.388920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18647. [D 20:42:52.388930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18648. [D 20:42:52.388940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18649. [D 20:42:52.388965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18650. [D 20:42:52.388979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18651. [D 20:42:52.388988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18652. [D 20:42:52.388998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18653. [D 20:42:52.389008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18654. [D 20:42:52.389018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18655. [D 20:42:52.389028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18656. [D 20:42:52.389037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18657. [D 20:42:52.389065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18658. [D 20:42:52.389075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18659. [D 20:42:52.389085] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18660. [D 20:42:52.399868] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18660. [D 20:42:52.399886] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 47/70. [D 20:42:52.399949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.399964] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.399973] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.406616] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.406630] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.406638] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.406654] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4202 [D 20:42:52.406663] element 0: offset: 0x2aaaab22c250, size: 24 [D 20:42:52.406674] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 48/70. [D 20:42:52.410910] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4202 [D 20:42:52.410927] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 49/70. [D 20:42:52.411055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18660. [D 20:42:52.411150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18661. [D 20:42:52.411162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18662. [D 20:42:52.411172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18663. [D 20:42:52.411183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18664. [D 20:42:52.411192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18665. [D 20:42:52.411202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18666. [D 20:42:52.411212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18667. [D 20:42:52.411222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18668. [D 20:42:52.411232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18669. [D 20:42:52.411242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18670. [D 20:42:52.411258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18671. [D 20:42:52.411268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18672. [D 20:42:52.411277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18673. [D 20:42:52.411288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18674. [D 20:42:52.411316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18675. [D 20:42:52.411327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18676. [D 20:42:52.411337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18677. [D 20:42:52.411346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18678. [D 20:42:52.411357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18679. [D 20:42:52.411383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18680. [D 20:42:52.411393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18681. [D 20:42:52.411403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18682. [D 20:42:52.411417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18683. [D 20:42:52.411440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18684. [D 20:42:52.411455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18685. [D 20:42:52.411465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18686. [D 20:42:52.411474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18687. [D 20:42:52.411490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18688. [D 20:42:52.411499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18689. [D 20:42:52.411509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18690. [D 20:42:52.411525] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18691. [D 20:42:52.422289] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18691. [D 20:42:52.422306] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 50/70. [D 20:42:52.422369] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.422384] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.422393] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.429096] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.429110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.429118] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.429134] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4205 [D 20:42:52.429143] element 0: offset: 0x2aaaab22ff40, size: 24 [D 20:42:52.429154] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 51/70. [D 20:42:52.433358] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4205 [D 20:42:52.433375] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 52/70. [D 20:42:52.433547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18691. [D 20:42:52.433606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18692. [D 20:42:52.433617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18693. [D 20:42:52.433628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18694. [D 20:42:52.433638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18695. [D 20:42:52.433648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18696. [D 20:42:52.433658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18697. [D 20:42:52.433667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18698. [D 20:42:52.433682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18699. [D 20:42:52.433692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18700. [D 20:42:52.433701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18701. [D 20:42:52.433712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18702. [D 20:42:52.433722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18703. [D 20:42:52.433732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18704. [D 20:42:52.433741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18705. [D 20:42:52.433774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18706. [D 20:42:52.433789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18707. [D 20:42:52.433799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18708. [D 20:42:52.433809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18709. [D 20:42:52.433836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18710. [D 20:42:52.433846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18711. [D 20:42:52.433860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18712. [D 20:42:52.433870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18713. [D 20:42:52.433879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18714. [D 20:42:52.433893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18715. [D 20:42:52.433917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18716. [D 20:42:52.433931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18717. [D 20:42:52.433940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18718. [D 20:42:52.433950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18719. [D 20:42:52.433973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18720. [D 20:42:52.433983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18721. [D 20:42:52.433998] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18722. [D 20:42:52.444678] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18722. [D 20:42:52.444696] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 53/70. [D 20:42:52.444759] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.444773] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.444782] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.451396] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.451409] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.451418] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.451433] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4208 [D 20:42:52.451442] element 0: offset: 0x2aaaab244d90, size: 24 [D 20:42:52.451452] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 54/70. [D 20:42:52.455657] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4208 [D 20:42:52.455673] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 55/70. [D 20:42:52.455811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18722. [D 20:42:52.455901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18723. [D 20:42:52.455913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18724. [D 20:42:52.455924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18725. [D 20:42:52.455938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18726. [D 20:42:52.455948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18727. [D 20:42:52.455958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18728. [D 20:42:52.455972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18729. [D 20:42:52.455982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18730. [D 20:42:52.455992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18731. [D 20:42:52.456008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18732. [D 20:42:52.456018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18733. [D 20:42:52.456027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18734. [D 20:42:52.456043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18735. [D 20:42:52.456053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18736. [D 20:42:52.456063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18737. [D 20:42:52.456097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18738. [D 20:42:52.456110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18739. [D 20:42:52.456132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18740. [D 20:42:52.456144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18741. [D 20:42:52.456153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18742. [D 20:42:52.456164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18743. [D 20:42:52.456175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18744. [D 20:42:52.456200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18745. [D 20:42:52.456214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18746. [D 20:42:52.456224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18747. [D 20:42:52.456234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18748. [D 20:42:52.456261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18749. [D 20:42:52.456284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18750. [D 20:42:52.456294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18751. [D 20:42:52.456304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18752. [D 20:42:52.456327] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18753. [D 20:42:52.467037] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18753. [D 20:42:52.467054] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 56/70. [D 20:42:52.467117] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.467131] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.467140] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.600080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.600094] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.600102] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.600118] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4211 [D 20:42:52.600127] element 0: offset: 0x2aaaab22fcc0, size: 24 [D 20:42:52.600137] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 57/70. [D 20:42:52.603187] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4211 [D 20:42:52.603204] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 58/70. [D 20:42:52.603255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18753. [D 20:42:52.603323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18754. [D 20:42:52.603334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18755. [D 20:42:52.603352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18756. [D 20:42:52.603362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18757. [D 20:42:52.603372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18758. [D 20:42:52.603388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18759. [D 20:42:52.603398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18760. [D 20:42:52.603407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18761. [D 20:42:52.603423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18762. [D 20:42:52.603475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18763. [D 20:42:52.603489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18764. [D 20:42:52.603511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18765. [D 20:42:52.603521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18766. [D 20:42:52.603533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18767. [D 20:42:52.603560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18768. [D 20:42:52.603570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18769. [D 20:42:52.603583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18770. [D 20:42:52.603593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18771. [D 20:42:52.603603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18772. [D 20:42:52.603631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18773. [D 20:42:52.603648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18774. [D 20:42:52.603658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18775. [D 20:42:52.603668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18776. [D 20:42:52.603699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18777. [D 20:42:52.603709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18778. [D 20:42:52.603718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18779. [D 20:42:52.603733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18780. [D 20:42:52.603742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18781. [D 20:42:52.603752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18782. [D 20:42:52.603768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18783. [D 20:42:52.603778] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18784. [D 20:42:52.613947] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18784. [D 20:42:52.613965] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 59/70. [D 20:42:52.614061] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.614077] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.614086] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.621213] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.621227] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.621237] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.621253] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4214 [D 20:42:52.621262] element 0: offset: 0x2aaaab23a4a0, size: 24 [D 20:42:52.621273] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 60/70. [D 20:42:52.625554] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4214 [D 20:42:52.625570] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 0/70. [D 20:42:52.625714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18784. [D 20:42:52.625773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18785. [D 20:42:52.625784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18786. [D 20:42:52.625794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18787. [D 20:42:52.625805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18788. [D 20:42:52.625815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18789. [D 20:42:52.625825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18790. [D 20:42:52.625835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18791. [D 20:42:52.625845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18792. [D 20:42:52.625854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18793. [D 20:42:52.625864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18794. [D 20:42:52.625880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18795. [D 20:42:52.625890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18796. [D 20:42:52.625900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18797. [D 20:42:52.625910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18798. [D 20:42:52.625920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18799. [D 20:42:52.625930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18800. [D 20:42:52.625940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18801. [D 20:42:52.625977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18802. [D 20:42:52.625990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18803. [D 20:42:52.626000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18804. [D 20:42:52.626010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18805. [D 20:42:52.626033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18806. [D 20:42:52.626044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18807. [D 20:42:52.626055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18808. [D 20:42:52.626065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18809. [D 20:42:52.626075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18810. [D 20:42:52.626084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18811. [D 20:42:52.626107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18812. [D 20:42:52.626121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18813. [D 20:42:52.626131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18814. [D 20:42:52.626140] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18815. [D 20:42:52.636814] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18815. [D 20:42:52.636831] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 1/70. [D 20:42:52.636895] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.636909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.636918] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.643188] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.643201] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.643210] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.643226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4217 [D 20:42:52.643235] element 0: offset: 0x2aaaab22c250, size: 24 [D 20:42:52.643247] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 2/70. [D 20:42:52.647252] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4217 [D 20:42:52.647270] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 3/70. [D 20:42:52.647379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18815. [D 20:42:52.647463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18816. [D 20:42:52.647475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18817. [D 20:42:52.647485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18818. [D 20:42:52.647495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18819. [D 20:42:52.647505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18820. [D 20:42:52.647515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18821. [D 20:42:52.647525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18822. [D 20:42:52.647535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18823. [D 20:42:52.647545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18824. [D 20:42:52.647554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18825. [D 20:42:52.647571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18826. [D 20:42:52.647596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18827. [D 20:42:52.647610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18828. [D 20:42:52.647631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18829. [D 20:42:52.647644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18830. [D 20:42:52.647662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18831. [D 20:42:52.647673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18832. [D 20:42:52.647683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18833. [D 20:42:52.647693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18834. [D 20:42:52.647715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18835. [D 20:42:52.647725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18836. [D 20:42:52.647735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18837. [D 20:42:52.647750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18838. [D 20:42:52.647769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18839. [D 20:42:52.647780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18840. [D 20:42:52.647793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18841. [D 20:42:52.647803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18842. [D 20:42:52.647827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18843. [D 20:42:52.647837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18844. [D 20:42:52.647860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18845. [D 20:42:52.647870] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18846. [D 20:42:52.658901] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18846. [D 20:42:52.658919] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 4/70. [D 20:42:52.658981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.658996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.659004] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.665301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.665315] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.665323] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.665339] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4220 [D 20:42:52.665348] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:52.665359] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 5/70. [D 20:42:52.669594] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4220 [D 20:42:52.669611] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 6/70. [D 20:42:52.669666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18846. [D 20:42:52.669724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18847. [D 20:42:52.669735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18848. [D 20:42:52.669772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18849. [D 20:42:52.669783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18850. [D 20:42:52.669794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18851. [D 20:42:52.669804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18852. [D 20:42:52.669819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18853. [D 20:42:52.669841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18854. [D 20:42:52.669852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18855. [D 20:42:52.669862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18856. [D 20:42:52.669886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18857. [D 20:42:52.669896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18858. [D 20:42:52.669905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18859. [D 20:42:52.669915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18860. [D 20:42:52.669925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18861. [D 20:42:52.669948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18862. [D 20:42:52.669958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18863. [D 20:42:52.669974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18864. [D 20:42:52.669989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18865. [D 20:42:52.669999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18866. [D 20:42:52.670020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18867. [D 20:42:52.670030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18868. [D 20:42:52.670040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18869. [D 20:42:52.670050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18870. [D 20:42:52.670061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18871. [D 20:42:52.670080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18872. [D 20:42:52.670096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18873. [D 20:42:52.670117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18874. [D 20:42:52.670128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18875. [D 20:42:52.670149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18876. [D 20:42:52.670160] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18877. [D 20:42:52.675787] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18877. [D 20:42:52.675804] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 7/70. [D 20:42:52.675866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.675880] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.675889] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.693454] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.693468] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.693476] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.693491] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4223 [D 20:42:52.693500] element 0: offset: 0x2aaaab22ff40, size: 24 [D 20:42:52.693510] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 8/70. [D 20:42:52.697762] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4223 [D 20:42:52.697779] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 9/70. [D 20:42:52.697893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18877. [D 20:42:52.697980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18878. [D 20:42:52.697991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18879. [D 20:42:52.698002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18880. [D 20:42:52.698012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18881. [D 20:42:52.698022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18882. [D 20:42:52.698032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18883. [D 20:42:52.698042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18884. [D 20:42:52.698052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18885. [D 20:42:52.698061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18886. [D 20:42:52.698071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18887. [D 20:42:52.698088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18888. [D 20:42:52.698097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18889. [D 20:42:52.698107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18890. [D 20:42:52.698132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18891. [D 20:42:52.698142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18892. [D 20:42:52.698152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18893. [D 20:42:52.698175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18894. [D 20:42:52.698194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18895. [D 20:42:52.698204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18896. [D 20:42:52.698214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18897. [D 20:42:52.698228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18898. [D 20:42:52.698251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18899. [D 20:42:52.698263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18900. [D 20:42:52.698273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18901. [D 20:42:52.698283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18902. [D 20:42:52.698296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18903. [D 20:42:52.698305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18904. [D 20:42:52.698331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18905. [D 20:42:52.698341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18906. [D 20:42:52.698351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18907. [D 20:42:52.698377] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18908. [D 20:42:52.709237] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18908. [D 20:42:52.709261] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 10/70. [D 20:42:52.709323] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.709337] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.709346] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.715606] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.715620] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.715628] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.715643] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4226 [D 20:42:52.715653] element 0: offset: 0x2aaaab244d90, size: 24 [D 20:42:52.715663] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 11/70. [D 20:42:52.719909] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4226 [D 20:42:52.719926] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 12/70. [D 20:42:52.720063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18908. [D 20:42:52.720122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18909. [D 20:42:52.720134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18910. [D 20:42:52.720144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18911. [D 20:42:52.720154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18912. [D 20:42:52.720164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18913. [D 20:42:52.720174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18914. [D 20:42:52.720184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18915. [D 20:42:52.720194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18916. [D 20:42:52.720203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18917. [D 20:42:52.720213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18918. [D 20:42:52.720229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18919. [D 20:42:52.720239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18920. [D 20:42:52.720248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18921. [D 20:42:52.720259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18922. [D 20:42:52.720269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18923. [D 20:42:52.720279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18924. [D 20:42:52.720289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18925. [D 20:42:52.720326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18926. [D 20:42:52.720338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18927. [D 20:42:52.720348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18928. [D 20:42:52.720358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18929. [D 20:42:52.720383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18930. [D 20:42:52.720398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18931. [D 20:42:52.720409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18932. [D 20:42:52.720419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18933. [D 20:42:52.720429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18934. [D 20:42:52.720453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18935. [D 20:42:52.720463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18936. [D 20:42:52.720476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18937. [D 20:42:52.720486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18938. [D 20:42:52.720496] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18939. [D 20:42:52.731294] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18939. [D 20:42:52.731312] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 13/70. [D 20:42:52.731375] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.731390] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.731398] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.737757] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.737770] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.737778] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.737794] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4229 [D 20:42:52.737803] element 0: offset: 0x2aaaab23d270, size: 24 [D 20:42:52.737813] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 14/70. [D 20:42:52.742038] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4229 [D 20:42:52.742054] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 15/70. [D 20:42:52.742175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18939. [D 20:42:52.742243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18940. [D 20:42:52.742255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18941. [D 20:42:52.742265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18942. [D 20:42:52.742279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18943. [D 20:42:52.742288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18944. [D 20:42:52.742298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18945. [D 20:42:52.742313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18946. [D 20:42:52.742322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18947. [D 20:42:52.742332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18948. [D 20:42:52.742348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18949. [D 20:42:52.742357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18950. [D 20:42:52.742367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18951. [D 20:42:52.742377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18952. [D 20:42:52.742387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18953. [D 20:42:52.742397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18954. [D 20:42:52.742438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18955. [D 20:42:52.742463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18956. [D 20:42:52.742474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18957. [D 20:42:52.742484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18958. [D 20:42:52.742494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18959. [D 20:42:52.742504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18960. [D 20:42:52.742514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18961. [D 20:42:52.742538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18962. [D 20:42:52.742549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18963. [D 20:42:52.742558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18964. [D 20:42:52.742568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18965. [D 20:42:52.742583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18966. [D 20:42:52.742593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18967. [D 20:42:52.742613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18968. [D 20:42:52.742623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 18969. [D 20:42:52.742633] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 18970. [D 20:42:52.753405] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 18970. [D 20:42:52.753423] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 16/70. [D 20:42:52.753485] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.753499] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.753508] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.759856] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.759870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.759878] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.759894] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4232 [D 20:42:52.759903] element 0: offset: 0x2aaaab22fdc0, size: 24 [D 20:42:52.759913] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 17/70. [D 20:42:52.764176] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4232 [D 20:42:52.764193] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 18/70. [D 20:42:52.764329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 18970. [D 20:42:52.764388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 18971. [D 20:42:52.764400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 18972. [D 20:42:52.764410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 18973. [D 20:42:52.764420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 18974. [D 20:42:52.764430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 18975. [D 20:42:52.764441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 18976. [D 20:42:52.764450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 18977. [D 20:42:52.764460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 18978. [D 20:42:52.764475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 18979. [D 20:42:52.764485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 18980. [D 20:42:52.764494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 18981. [D 20:42:52.764505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 18982. [D 20:42:52.764516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 18983. [D 20:42:52.764525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 18984. [D 20:42:52.764540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 18985. [D 20:42:52.764551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 18986. [D 20:42:52.764560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 18987. [D 20:42:52.764570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 18988. [D 20:42:52.764612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 18989. [D 20:42:52.764625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 18990. [D 20:42:52.764635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 18991. [D 20:42:52.764671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 18992. [D 20:42:52.764682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 18993. [D 20:42:52.764693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 18994. [D 20:42:52.764702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 18995. [D 20:42:52.764731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 18996. [D 20:42:52.764740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 18997. [D 20:42:52.764754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 18998. [D 20:42:52.764764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 18999. [D 20:42:52.764773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 19000. [D 20:42:52.764787] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 19001. [D 20:42:52.775472] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19001. [D 20:42:52.775490] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 19/70. [D 20:42:52.775553] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.775568] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.775576] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.906059] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.906073] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.906081] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.906096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4235 [D 20:42:52.906106] element 0: offset: 0x2aaaab23a4a0, size: 24 [D 20:42:52.906115] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 20/70. [D 20:42:52.908638] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 237056, tag: 4235 [D 20:42:52.908655] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 21/70. [D 20:42:52.908698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 19001. [D 20:42:52.908718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 19002. [D 20:42:52.908729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 19003. [D 20:42:52.908739] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 19004. [D 20:42:52.909386] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19004. [D 20:42:52.909400] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 22/70. [D 20:42:52.909445] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.909461] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.909469] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.911982] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.911995] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.912004] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.912020] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4238 [D 20:42:52.912029] element 0: offset: 0x2aaaab22c250, size: 24 [D 20:42:52.912039] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 23/70. [D 20:42:52.912096] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.912108] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.912116] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.924507] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.924521] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.924530] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.924545] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4241 [D 20:42:52.924554] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:52.924565] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 24/70. [D 20:42:52.924614] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4241 [D 20:42:52.924646] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 25/70. [D 20:42:52.928085] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4241 [D 20:42:52.928101] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:52.928111] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 26/70. [D 20:42:52.928183] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.928195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.928203] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.939308] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.939322] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.939330] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.939416] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4245 [D 20:42:52.939426] element 0: offset: 0x2aaaab244d90, size: 24 [D 20:42:52.939437] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 27/70. [D 20:42:52.939484] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4245 [D 20:42:52.939545] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 28/70. [D 20:42:52.942762] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4245 [D 20:42:52.942778] element 0: offset: 0x2aaaab244d90, size: 24 [D 20:42:52.942788] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 29/70. [D 20:42:52.942860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.942872] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.942880] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.949917] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.949931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.949939] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.949987] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4249 [D 20:42:52.949997] element 0: offset: 0x2aaaab22fdc0, size: 24 [D 20:42:52.950007] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 30/70. [D 20:42:52.950055] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4249 [D 20:42:52.950082] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 31/70. [D 20:42:52.953298] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4249 [D 20:42:52.953314] element 0: offset: 0x2aaaab22fdc0, size: 24 [D 20:42:52.953324] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 32/70. [D 20:42:52.953395] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.953407] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.953415] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:52.956243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:52.956257] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.956265] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:52.956312] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4253 [D 20:42:52.956323] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:52.956333] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 33/70. [D 20:42:52.956380] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4253 [D 20:42:52.956405] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 34/70. [D 20:42:52.959576] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4253 [D 20:42:52.959591] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:52.959601] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 35/70. [D 20:42:52.959673] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:52.959685] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:52.959693] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:53.167188] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.167202] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.167211] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:53.167226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4259 [D 20:42:53.167236] element 0: offset: 0x2aaaab244d90, size: 24 [D 20:42:53.167246] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 36/70. [D 20:42:53.167284] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.167293] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.167302] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:53.167316] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4260 [D 20:42:53.167326] element 0: offset: 0x2aaaab22ff40, size: 24 [D 20:42:53.167335] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 37/70. [D 20:42:53.167860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.167874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.167882] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:53.167898] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4264 [D 20:42:53.167907] element 0: offset: 0x2aaaab22fdc0, size: 24 [D 20:42:53.167919] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 38/70. [D 20:42:53.186004] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.186018] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.186026] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.186074] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4267 [D 20:42:53.186085] element 0: offset: 0x2aaaab23d270, size: 24 [D 20:42:53.186095] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 39/70. [D 20:42:53.186191] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4267 [D 20:42:53.186256] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 40/70. [D 20:42:53.188403] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4267 [D 20:42:53.188419] element 0: offset: 0x2aaaab23d270, size: 24 [D 20:42:53.188430] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 41/70. [D 20:42:53.188570] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:53.188584] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.188593] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:53.199883] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.199897] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.199905] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.199921] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4270 [D 20:42:53.199931] element 0: offset: 0x2aaaab233b50, size: 24 [D 20:42:53.199941] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 42/70. [D 20:42:53.311589] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4259 [D 20:42:53.311607] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 43/70. [D 20:42:53.311734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19004. [D 20:42:53.311839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19005. [D 20:42:53.311849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19006. [D 20:42:53.311860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19007. [D 20:42:53.311870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19008. [D 20:42:53.311880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19009. [D 20:42:53.311890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19010. [D 20:42:53.311900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19011. [D 20:42:53.311909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19012. [D 20:42:53.311919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19013. [D 20:42:53.311929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19014. [D 20:42:53.311963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19015. [D 20:42:53.311979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19016. [D 20:42:53.312004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19017. [D 20:42:53.312019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19018. [D 20:42:53.312029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19019. [D 20:42:53.312039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19020. [D 20:42:53.312048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19021. [D 20:42:53.312058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19022. [D 20:42:53.312087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19023. [D 20:42:53.312097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19024. [D 20:42:53.312108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19025. [D 20:42:53.312129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19026. [D 20:42:53.312139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19027. [D 20:42:53.312160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19028. [D 20:42:53.312174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19029. [D 20:42:53.312185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19030. [D 20:42:53.312195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19031. [D 20:42:53.312216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19032. [D 20:42:53.312226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19033. [D 20:42:53.312236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19034. [D 20:42:53.312251] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19035. [D 20:42:53.317818] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 19035. [D 20:42:53.317836] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 44/70. [D 20:42:53.317901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:53.317915] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.317924] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:53.323883] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.323897] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.323905] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.323922] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4273 [D 20:42:53.323931] element 0: offset: 0x2aaaab236070, size: 24 [D 20:42:53.323941] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 45/70. [D 20:42:53.405009] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4273 [D 20:42:53.405026] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 46/70. [D 20:42:53.405134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19035. [D 20:42:53.405236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19036. [D 20:42:53.405248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19037. [D 20:42:53.405258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19038. [D 20:42:53.405269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19039. [D 20:42:53.405278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19040. [D 20:42:53.405288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19041. [D 20:42:53.405303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19042. [D 20:42:53.405314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19043. [D 20:42:53.405323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19044. [D 20:42:53.405333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19045. [D 20:42:53.405358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19046. [D 20:42:53.405367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19047. [D 20:42:53.405380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19048. [D 20:42:53.405402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19049. [D 20:42:53.405412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19050. [D 20:42:53.405433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19051. [D 20:42:53.405444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19052. [D 20:42:53.405454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19053. [D 20:42:53.405465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19054. [D 20:42:53.405475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19055. [D 20:42:53.405485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19056. [D 20:42:53.405495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19057. [D 20:42:53.405507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19058. [D 20:42:53.405529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19059. [D 20:42:53.405540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19060. [D 20:42:53.405550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19061. [D 20:42:53.405573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19062. [D 20:42:53.405586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19063. [D 20:42:53.405606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19064. [D 20:42:53.405620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19065. [D 20:42:53.405630] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19066. [D 20:42:53.411152] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 19066. [D 20:42:53.411170] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 47/70. [D 20:42:53.411233] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:53.411248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.411256] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:53.417017] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.417031] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.417040] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.417056] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4276 [D 20:42:53.417066] element 0: offset: 0x2aaaab202d30, size: 24 [D 20:42:53.417076] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 48/70. [D 20:42:53.474106] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4260 [D 20:42:53.474123] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 49/70. [D 20:42:53.474183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 19066. [D 20:42:53.474251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 19067. [D 20:42:53.474310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 19068. [D 20:42:53.474321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 19069. [D 20:42:53.474331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 19070. [D 20:42:53.474342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 19071. [D 20:42:53.474352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 19072. [D 20:42:53.474374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 19073. [D 20:42:53.474387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 19074. [D 20:42:53.474396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 19075. [D 20:42:53.474406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 19076. [D 20:42:53.474434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 19077. [D 20:42:53.474444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 19078. [D 20:42:53.474456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 19079. [D 20:42:53.474477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 19080. [D 20:42:53.474490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 19081. [D 20:42:53.474499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 19082. [D 20:42:53.474509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 19083. [D 20:42:53.474522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 19084. [D 20:42:53.474548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 19085. [D 20:42:53.474558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 19086. [D 20:42:53.474568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 19087. [D 20:42:53.474585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 19088. [D 20:42:53.474595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 19089. [D 20:42:53.474604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 19090. [D 20:42:53.474615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 19091. [D 20:42:53.474625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 19092. [D 20:42:53.474649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 19093. [D 20:42:53.474663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 19094. [D 20:42:53.474672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 19095. [D 20:42:53.474682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 19096. [D 20:42:53.474710] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 19097. [D 20:42:53.480109] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 19097. [D 20:42:53.480128] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 50/70. [D 20:42:53.480191] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:53.480205] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.480214] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:53.485702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.485716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.485725] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.485740] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4278 [D 20:42:53.485750] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:42:53.485761] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 51/70. [D 20:42:53.539321] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4276 [D 20:42:53.539339] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 52/70. [D 20:42:53.539394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19097. [D 20:42:53.539458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19098. [D 20:42:53.539469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19099. [D 20:42:53.539489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19100. [D 20:42:53.539500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19101. [D 20:42:53.539509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19102. [D 20:42:53.539525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19103. [D 20:42:53.539535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19104. [D 20:42:53.539544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19105. [D 20:42:53.539560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19106. [D 20:42:53.539609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19107. [D 20:42:53.539621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19108. [D 20:42:53.539631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19109. [D 20:42:53.539656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19110. [D 20:42:53.539666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19111. [D 20:42:53.539677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19112. [D 20:42:53.539687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19113. [D 20:42:53.539696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19114. [D 20:42:53.539706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19115. [D 20:42:53.539736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19116. [D 20:42:53.539747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19117. [D 20:42:53.539758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19118. [D 20:42:53.539768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19119. [D 20:42:53.539778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19120. [D 20:42:53.539791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19121. [D 20:42:53.539801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19122. [D 20:42:53.539811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19123. [D 20:42:53.539820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19124. [D 20:42:53.539831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19125. [D 20:42:53.539841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19126. [D 20:42:53.539851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19127. [D 20:42:53.539860] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19128. [D 20:42:53.545327] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 19128. [D 20:42:53.545345] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 53/70. [D 20:42:53.545408] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:53.545422] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.545431] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:53.551107] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.551120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.551128] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.551144] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4282 [D 20:42:53.551154] element 0: offset: 0x2aaaab23a4a0, size: 24 [D 20:42:53.551163] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 54/70. [D 20:42:53.647603] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4278 [D 20:42:53.647621] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 55/70. [D 20:42:53.647742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 19128. [D 20:42:53.647818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 19129. [D 20:42:53.647829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 19130. [D 20:42:53.647840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 19131. [D 20:42:53.647850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 19132. [D 20:42:53.647860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 19133. [D 20:42:53.647870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 19134. [D 20:42:53.647880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 19135. [D 20:42:53.647890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 19136. [D 20:42:53.647900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 19137. [D 20:42:53.647910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 19138. [D 20:42:53.647967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 19139. [D 20:42:53.647977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 19140. [D 20:42:53.647988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 19141. [D 20:42:53.648013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 19142. [D 20:42:53.648023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 19143. [D 20:42:53.648037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 19144. [D 20:42:53.648047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 19145. [D 20:42:53.648057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 19146. [D 20:42:53.648090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 19147. [D 20:42:53.648100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 19148. [D 20:42:53.648110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 19149. [D 20:42:53.648120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 19150. [D 20:42:53.648148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 19151. [D 20:42:53.648159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 19152. [D 20:42:53.648171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 19153. [D 20:42:53.648180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 19154. [D 20:42:53.648190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 19155. [D 20:42:53.648214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 19156. [D 20:42:53.648224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 19157. [D 20:42:53.648233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 19158. [D 20:42:53.648249] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 19159. [D 20:42:53.653678] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 19159. [D 20:42:53.653695] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 56/70. [D 20:42:53.653759] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:53.653773] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.653782] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:53.659440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.659454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.659462] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.659478] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4284 [D 20:42:53.659488] element 0: offset: 0x2aaaab22e310, size: 24 [D 20:42:53.659497] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 57/70. [D 20:42:53.715737] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4282 [D 20:42:53.715754] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 58/70. [D 20:42:53.715814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19159. [D 20:42:53.715880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19160. [D 20:42:53.715931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19161. [D 20:42:53.715942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19162. [D 20:42:53.715953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19163. [D 20:42:53.715963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19164. [D 20:42:53.715973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19165. [D 20:42:53.715983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19166. [D 20:42:53.716007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19167. [D 20:42:53.716017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19168. [D 20:42:53.716027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19169. [D 20:42:53.716055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19170. [D 20:42:53.716066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19171. [D 20:42:53.716089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19172. [D 20:42:53.716099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19173. [D 20:42:53.716112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19174. [D 20:42:53.716135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19175. [D 20:42:53.716149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19176. [D 20:42:53.716167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19177. [D 20:42:53.716178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19178. [D 20:42:53.716188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19179. [D 20:42:53.716211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19180. [D 20:42:53.716222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19181. [D 20:42:53.716232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19182. [D 20:42:53.716254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19183. [D 20:42:53.716264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19184. [D 20:42:53.716274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19185. [D 20:42:53.716302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19186. [D 20:42:53.716312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19187. [D 20:42:53.716325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19188. [D 20:42:53.716335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19189. [D 20:42:53.716356] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19190. [D 20:42:53.721739] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 19190. [D 20:42:53.721757] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 59/70. [D 20:42:53.721819] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:53.721834] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.721843] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:53.727763] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.727776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.727784] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.727801] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4288 [D 20:42:53.727810] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:53.727820] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 60/70. [D 20:42:53.775235] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4284 [D 20:42:53.775252] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 0/70. [D 20:42:53.775311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 19190. [D 20:42:53.775379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 19191. [D 20:42:53.775389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 19192. [D 20:42:53.775400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 19193. [D 20:42:53.775410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 19194. [D 20:42:53.775420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 19195. [D 20:42:53.775430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 19196. [D 20:42:53.775439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 19197. [D 20:42:53.775449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 19198. [D 20:42:53.775467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 19199. [D 20:42:53.775476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 19200. [D 20:42:53.775486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 19201. [D 20:42:53.775552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 19202. [D 20:42:53.775563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 19203. [D 20:42:53.775573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 19204. [D 20:42:53.775588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 19205. [D 20:42:53.775599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 19206. [D 20:42:53.775609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 19207. [D 20:42:53.775633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 19208. [D 20:42:53.775643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 19209. [D 20:42:53.775657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 19210. [D 20:42:53.775680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 19211. [D 20:42:53.775691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 19212. [D 20:42:53.775701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 19213. [D 20:42:53.775721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 19214. [D 20:42:53.775735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 19215. [D 20:42:53.775756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 19216. [D 20:42:53.775771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 19217. [D 20:42:53.775780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 19218. [D 20:42:53.775804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 19219. [D 20:42:53.775814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 19220. [D 20:42:53.775836] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 19221. [D 20:42:53.781234] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 19221. [D 20:42:53.781250] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 1/70. [D 20:42:53.781318] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:53.781333] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.781341] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:53.786897] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.786910] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.786918] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.786935] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4290 [D 20:42:53.786944] element 0: offset: 0x2aaaab23d330, size: 24 [D 20:42:53.786954] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 2/70. [D 20:42:53.850228] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4288 [D 20:42:53.850245] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 3/70. [D 20:42:53.850302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19221. [D 20:42:53.850367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19222. [D 20:42:53.850419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19223. [D 20:42:53.850432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19224. [D 20:42:53.850443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19225. [D 20:42:53.850454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19226. [D 20:42:53.850464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19227. [D 20:42:53.850487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19228. [D 20:42:53.850498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19229. [D 20:42:53.850518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19230. [D 20:42:53.850535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19231. [D 20:42:53.850558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19232. [D 20:42:53.850569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19233. [D 20:42:53.850579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19234. [D 20:42:53.850598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19235. [D 20:42:53.850613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19236. [D 20:42:53.850634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19237. [D 20:42:53.850648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19238. [D 20:42:53.850672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19239. [D 20:42:53.850686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19240. [D 20:42:53.850696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19241. [D 20:42:53.850705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19242. [D 20:42:53.850715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19243. [D 20:42:53.850743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19244. [D 20:42:53.850753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19245. [D 20:42:53.850767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19246. [D 20:42:53.850788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19247. [D 20:42:53.850802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19248. [D 20:42:53.850823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19249. [D 20:42:53.850834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19250. [D 20:42:53.850844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19251. [D 20:42:53.850854] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19252. [D 20:42:53.856226] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 19252. [D 20:42:53.856242] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 4/70. [D 20:42:53.856306] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:53.856320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.856329] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:53.862272] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.862286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.862294] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.862310] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4294 [D 20:42:53.862320] element 0: offset: 0x2aaaab244d90, size: 24 [D 20:42:53.862329] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 5/70. [D 20:42:53.961323] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4290 [D 20:42:53.961342] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 6/70. [D 20:42:53.961442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 19252. [D 20:42:53.961553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 19253. [D 20:42:53.961565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 19254. [D 20:42:53.961575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 19255. [D 20:42:53.961590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 19256. [D 20:42:53.961599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 19257. [D 20:42:53.961609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 19258. [D 20:42:53.961623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 19259. [D 20:42:53.961633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 19260. [D 20:42:53.961642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 19261. [D 20:42:53.961673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 19262. [D 20:42:53.961684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 19263. [D 20:42:53.961705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 19264. [D 20:42:53.961716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 19265. [D 20:42:53.961726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 19266. [D 20:42:53.961736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 19267. [D 20:42:53.961746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 19268. [D 20:42:53.961777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 19269. [D 20:42:53.961799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 19270. [D 20:42:53.961810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 19271. [D 20:42:53.961819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 19272. [D 20:42:53.961835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 19273. [D 20:42:53.961845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 19274. [D 20:42:53.961855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 19275. [D 20:42:53.961879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 19276. [D 20:42:53.961889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 19277. [D 20:42:53.961898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 19278. [D 20:42:53.961908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 19279. [D 20:42:53.961918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 19280. [D 20:42:53.961928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 19281. [D 20:42:53.961938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 19282. [D 20:42:53.961963] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 19283. [D 20:42:53.967412] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 19283. [D 20:42:53.967430] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 7/70. [D 20:42:53.967492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:53.967507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.967515] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:53.973185] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:53.973199] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:53.973207] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:53.973223] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4296 [D 20:42:53.973233] element 0: offset: 0x2aaaab22ff40, size: 24 [D 20:42:53.973243] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 8/70. [D 20:42:54.017481] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4294 [D 20:42:54.017499] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 9/70. [D 20:42:54.017557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19283. [D 20:42:54.017622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19284. [D 20:42:54.017641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19285. [D 20:42:54.017652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19286. [D 20:42:54.017663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19287. [D 20:42:54.017672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19288. [D 20:42:54.017687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19289. [D 20:42:54.017697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19290. [D 20:42:54.017706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19291. [D 20:42:54.017722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19292. [D 20:42:54.017731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19293. [D 20:42:54.017741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19294. [D 20:42:54.017751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19295. [D 20:42:54.017761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19296. [D 20:42:54.017770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19297. [D 20:42:54.017780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19298. [D 20:42:54.017829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19299. [D 20:42:54.017839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19300. [D 20:42:54.017849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19301. [D 20:42:54.017859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19302. [D 20:42:54.017874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19303. [D 20:42:54.017905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19304. [D 20:42:54.017915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19305. [D 20:42:54.017925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19306. [D 20:42:54.017935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19307. [D 20:42:54.017946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19308. [D 20:42:54.017956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19309. [D 20:42:54.017971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19310. [D 20:42:54.017982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19311. [D 20:42:54.017991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19312. [D 20:42:54.018015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19313. [D 20:42:54.018025] openib_post_sr_rdmaw: ibv_post_send wr_id 63d6d0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19314. [D 20:42:54.023481] openib_check_cq: completed rdma wr_id 63d6d0, nic_wr_credit 19314. [D 20:42:54.023499] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 10/70. [D 20:42:54.023561] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.023576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.023585] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.029522] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.029536] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.029545] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.029561] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4300 [D 20:42:54.029570] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:42:54.029582] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 11/70. [D 20:42:54.078034] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4296 [D 20:42:54.078051] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 12/70. [D 20:42:54.078113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 19314. [D 20:42:54.078182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 19315. [D 20:42:54.078211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 19316. [D 20:42:54.078222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 19317. [D 20:42:54.078233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 19318. [D 20:42:54.078243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 19319. [D 20:42:54.078253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 19320. [D 20:42:54.078263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 19321. [D 20:42:54.078275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 19322. [D 20:42:54.078305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 19323. [D 20:42:54.078315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 19324. [D 20:42:54.078329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 19325. [D 20:42:54.078339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 19326. [D 20:42:54.078349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 19327. [D 20:42:54.078358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 19328. [D 20:42:54.078380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 19329. [D 20:42:54.078390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 19330. [D 20:42:54.078400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 19331. [D 20:42:54.078413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 19332. [D 20:42:54.078423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 19333. [D 20:42:54.078445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 19334. [D 20:42:54.078456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 19335. [D 20:42:54.078466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 19336. [D 20:42:54.078476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 19337. [D 20:42:54.078487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 19338. [D 20:42:54.078496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 19339. [D 20:42:54.078507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 19340. [D 20:42:54.078530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 19341. [D 20:42:54.078546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 19342. [D 20:42:54.078556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 19343. [D 20:42:54.078566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 19344. [D 20:42:54.078593] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 19345. [D 20:42:54.084040] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19345. [D 20:42:54.084057] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 13/70. [D 20:42:54.084121] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.084136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.084144] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.089849] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.089862] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.089871] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.089887] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4302 [D 20:42:54.089896] element 0: offset: 0x2aaaab20ddc0, size: 24 [D 20:42:54.089906] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 14/70. [D 20:42:54.145550] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4300 [D 20:42:54.145567] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 15/70. [D 20:42:54.145622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19345. [D 20:42:54.145688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19346. [D 20:42:54.145699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19347. [D 20:42:54.145709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19348. [D 20:42:54.145719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19349. [D 20:42:54.145734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19350. [D 20:42:54.145744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19351. [D 20:42:54.145754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19352. [D 20:42:54.145769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19353. [D 20:42:54.145779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19354. [D 20:42:54.145789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19355. [D 20:42:54.145847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19356. [D 20:42:54.145858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19357. [D 20:42:54.145868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19358. [D 20:42:54.145878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19359. [D 20:42:54.145900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19360. [D 20:42:54.145910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19361. [D 20:42:54.145920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19362. [D 20:42:54.145943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19363. [D 20:42:54.145953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19364. [D 20:42:54.145963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19365. [D 20:42:54.145987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19366. [D 20:42:54.145996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19367. [D 20:42:54.146006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19368. [D 20:42:54.146016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19369. [D 20:42:54.146039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19370. [D 20:42:54.146049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19371. [D 20:42:54.146079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19372. [D 20:42:54.146089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19373. [D 20:42:54.146100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19374. [D 20:42:54.146124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19375. [D 20:42:54.146134] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19376. [D 20:42:54.151547] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19376. [D 20:42:54.151564] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 16/70. [D 20:42:54.151627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.151642] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.151650] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.157683] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.157696] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.157705] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.157720] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4306 [D 20:42:54.157729] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:42:54.157740] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 17/70. [D 20:42:54.243439] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4302 [D 20:42:54.243457] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 18/70. [D 20:42:54.243541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 19376. [D 20:42:54.243647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 19377. [D 20:42:54.243659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 19378. [D 20:42:54.243670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 19379. [D 20:42:54.243684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 19380. [D 20:42:54.243694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 19381. [D 20:42:54.243703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 19382. [D 20:42:54.243717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 19383. [D 20:42:54.243727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 19384. [D 20:42:54.243737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 19385. [D 20:42:54.243767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 19386. [D 20:42:54.243777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 19387. [D 20:42:54.243802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 19388. [D 20:42:54.243812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 19389. [D 20:42:54.243824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 19390. [D 20:42:54.243834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 19391. [D 20:42:54.243843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 19392. [D 20:42:54.243853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 19393. [D 20:42:54.243885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 19394. [D 20:42:54.243902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 19395. [D 20:42:54.243924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 19396. [D 20:42:54.243938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 19397. [D 20:42:54.243958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 19398. [D 20:42:54.243973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 19399. [D 20:42:54.243983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 19400. [D 20:42:54.243992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 19401. [D 20:42:54.244016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 19402. [D 20:42:54.244025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 19403. [D 20:42:54.244035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 19404. [D 20:42:54.244057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 19405. [D 20:42:54.244067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 19406. [D 20:42:54.244077] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 19407. [D 20:42:54.249506] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19407. [D 20:42:54.249524] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 19/70. [D 20:42:54.249587] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.249602] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.249610] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.255254] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.255268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.255276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.255292] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4308 [D 20:42:54.255302] element 0: offset: 0x2aaaab22c170, size: 24 [D 20:42:54.255313] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 20/70. [D 20:42:54.311456] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4306 [D 20:42:54.311473] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 21/70. [D 20:42:54.311532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19407. [D 20:42:54.311598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19408. [D 20:42:54.311653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19409. [D 20:42:54.311664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19410. [D 20:42:54.311675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19411. [D 20:42:54.311685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19412. [D 20:42:54.311695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19413. [D 20:42:54.311715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19414. [D 20:42:54.311731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19415. [D 20:42:54.311741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19416. [D 20:42:54.311751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19417. [D 20:42:54.311787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19418. [D 20:42:54.311797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19419. [D 20:42:54.311820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19420. [D 20:42:54.311830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19421. [D 20:42:54.311851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19422. [D 20:42:54.311861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19423. [D 20:42:54.311871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19424. [D 20:42:54.311882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19425. [D 20:42:54.311892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19426. [D 20:42:54.311916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19427. [D 20:42:54.311926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19428. [D 20:42:54.311936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19429. [D 20:42:54.311946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19430. [D 20:42:54.311956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19431. [D 20:42:54.311966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19432. [D 20:42:54.311988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19433. [D 20:42:54.311999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19434. [D 20:42:54.312009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19435. [D 20:42:54.312027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19436. [D 20:42:54.312038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19437. [D 20:42:54.312047] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19438. [D 20:42:54.317455] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19438. [D 20:42:54.317473] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 22/70. [D 20:42:54.317535] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.317550] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.317559] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.378541] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4308 [D 20:42:54.378558] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 23/70. [D 20:42:54.378617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 19438. [D 20:42:54.378685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 19439. [D 20:42:54.378739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 19440. [D 20:42:54.378750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 19441. [D 20:42:54.378761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 19442. [D 20:42:54.378771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 19443. [D 20:42:54.378781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 19444. [D 20:42:54.378801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 19445. [D 20:42:54.378817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 19446. [D 20:42:54.378827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 19447. [D 20:42:54.378836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 19448. [D 20:42:54.378867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 19449. [D 20:42:54.378877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 19450. [D 20:42:54.378901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 19451. [D 20:42:54.378914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 19452. [D 20:42:54.378924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 19453. [D 20:42:54.378933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 19454. [D 20:42:54.378973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 19455. [D 20:42:54.378983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 19456. [D 20:42:54.378993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 19457. [D 20:42:54.379003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 19458. [D 20:42:54.379013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 19459. [D 20:42:54.379037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 19460. [D 20:42:54.379047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 19461. [D 20:42:54.379063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 19462. [D 20:42:54.379072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 19463. [D 20:42:54.379082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 19464. [D 20:42:54.379092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 19465. [D 20:42:54.379102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 19466. [D 20:42:54.379112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 19467. [D 20:42:54.379122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 19468. [D 20:42:54.379139] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 19469. [D 20:42:54.384544] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19469. [D 20:42:54.384562] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 24/70. [D 20:42:54.384624] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.384638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.384647] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:54.390527] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.390541] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.390549] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:54.390566] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4311 [D 20:42:54.390576] element 0: offset: 0x2aaaab23a4a0, size: 24 [D 20:42:54.390586] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 25/70. [D 20:42:54.400422] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4270 [D 20:42:54.400439] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 26/70. [D 20:42:54.400490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 19469. [D 20:42:54.400536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 19470. [D 20:42:54.400547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 19471. [D 20:42:54.400557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 19472. [D 20:42:54.400567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 19473. [D 20:42:54.400578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 19474. [D 20:42:54.400588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 19475. [D 20:42:54.400598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 19476. [D 20:42:54.400607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 19477. [D 20:42:54.400617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 19478. [D 20:42:54.400627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 19479. [D 20:42:54.400643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 19480. [D 20:42:54.400653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 19481. [D 20:42:54.400663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 19482. [D 20:42:54.400698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 19483. [D 20:42:54.400708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 19484. [D 20:42:54.400718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 19485. [D 20:42:54.400730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 19486. [D 20:42:54.400746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 19487. [D 20:42:54.400768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 19488. [D 20:42:54.400779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 19489. [D 20:42:54.400788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 19490. [D 20:42:54.400798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 19491. [D 20:42:54.400808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 19492. [D 20:42:54.400818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 19493. [D 20:42:54.400828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 19494. [D 20:42:54.400837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 19495. [D 20:42:54.400867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 19496. [D 20:42:54.400878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 19497. [D 20:42:54.400890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 19498. [D 20:42:54.400900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 19499. [D 20:42:54.400910] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 19500. [D 20:42:54.410438] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19500. [D 20:42:54.410457] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 27/70. [D 20:42:54.410522] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.410537] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.410545] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:54.417558] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.417572] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.417580] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:54.417596] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4315 [D 20:42:54.417606] element 0: offset: 0x2aaaab22e310, size: 24 [D 20:42:54.417616] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 28/70. [D 20:42:54.451827] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.451841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.451849] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.451865] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4318 [D 20:42:54.451874] element 0: offset: 0x2aaaab23cf50, size: 24 [D 20:42:54.451885] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 29/70. [D 20:42:54.462179] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4264 [D 20:42:54.462196] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 30/70. [D 20:42:54.462258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 19500. [D 20:42:54.462325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 19501. [D 20:42:54.462337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 19502. [D 20:42:54.462347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 19503. [D 20:42:54.462403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 19504. [D 20:42:54.462414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 19505. [D 20:42:54.462424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 19506. [D 20:42:54.462434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 19507. [D 20:42:54.462444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 19508. [D 20:42:54.462453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 19509. [D 20:42:54.462467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 19510. [D 20:42:54.462483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 19511. [D 20:42:54.462493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 19512. [D 20:42:54.462520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 19513. [D 20:42:54.462534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 19514. [D 20:42:54.462544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 19515. [D 20:42:54.462554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 19516. [D 20:42:54.462570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 19517. [D 20:42:54.462580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 19518. [D 20:42:54.462603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 19519. [D 20:42:54.462614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 19520. [D 20:42:54.462623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 19521. [D 20:42:54.462634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 19522. [D 20:42:54.462644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 19523. [D 20:42:54.462654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 19524. [D 20:42:54.462664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 19525. [D 20:42:54.462690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 19526. [D 20:42:54.462701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 19527. [D 20:42:54.462710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 19528. [D 20:42:54.462720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 19529. [D 20:42:54.462731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 19530. [D 20:42:54.462753] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 19531. [D 20:42:54.468181] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19531. [D 20:42:54.468198] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 31/70. [D 20:42:54.468264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.468279] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.468287] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.473731] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.473745] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.473753] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.473769] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4321 [D 20:42:54.473778] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:54.473788] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 32/70. [D 20:42:54.502605] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4315 [D 20:42:54.502622] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 33/70. [D 20:42:54.502681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 19531. [D 20:42:54.502744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 19532. [D 20:42:54.502764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 19533. [D 20:42:54.502775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 19534. [D 20:42:54.502785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 19535. [D 20:42:54.502795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 19536. [D 20:42:54.502810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 19537. [D 20:42:54.502819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 19538. [D 20:42:54.502829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 19539. [D 20:42:54.502845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 19540. [D 20:42:54.502912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 19541. [D 20:42:54.502923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 19542. [D 20:42:54.502933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 19543. [D 20:42:54.502949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 19544. [D 20:42:54.502960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 19545. [D 20:42:54.502984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 19546. [D 20:42:54.502998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 19547. [D 20:42:54.503007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 19548. [D 20:42:54.503024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 19549. [D 20:42:54.503033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 19550. [D 20:42:54.503043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 19551. [D 20:42:54.503073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 19552. [D 20:42:54.503083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 19553. [D 20:42:54.503094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 19554. [D 20:42:54.503104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 19555. [D 20:42:54.503114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 19556. [D 20:42:54.503137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 19557. [D 20:42:54.503147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 19558. [D 20:42:54.503157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 19559. [D 20:42:54.503171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 19560. [D 20:42:54.503180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 19561. [D 20:42:54.503190] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 19562. [D 20:42:54.508598] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19562. [D 20:42:54.508614] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 34/70. [D 20:42:54.508677] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.508692] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.508700] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.515546] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.515560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.515568] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.515584] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4324 [D 20:42:54.515593] element 0: offset: 0x2aaaab244d90, size: 24 [D 20:42:54.515604] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 35/70. [D 20:42:54.578328] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4311 [D 20:42:54.578345] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 36/70. [D 20:42:54.578400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 19562. [D 20:42:54.578470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 19563. [D 20:42:54.578481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 19564. [D 20:42:54.578491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 19565. [D 20:42:54.578501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 19566. [D 20:42:54.578512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 19567. [D 20:42:54.578522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 19568. [D 20:42:54.578532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 19569. [D 20:42:54.578541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 19570. [D 20:42:54.578551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 19571. [D 20:42:54.578561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 19572. [D 20:42:54.578577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 19573. [D 20:42:54.578586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 19574. [D 20:42:54.578596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 19575. [D 20:42:54.578605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 19576. [D 20:42:54.578621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 19577. [D 20:42:54.578631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 19578. [D 20:42:54.578687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 19579. [D 20:42:54.578700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 19580. [D 20:42:54.578709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 19581. [D 20:42:54.578719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 19582. [D 20:42:54.578729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 19583. [D 20:42:54.578754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 19584. [D 20:42:54.578765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 19585. [D 20:42:54.578775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 19586. [D 20:42:54.578785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 19587. [D 20:42:54.578794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 19588. [D 20:42:54.578818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 19589. [D 20:42:54.578831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 19590. [D 20:42:54.578841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 19591. [D 20:42:54.578851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 19592. [D 20:42:54.578873] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 19593. [D 20:42:54.584330] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19593. [D 20:42:54.584347] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 37/70. [D 20:42:54.584411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.584425] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.584434] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.643972] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4324 [D 20:42:54.643990] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 38/70. [D 20:42:54.644045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 19593. [D 20:42:54.644109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 19594. [D 20:42:54.644120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 19595. [D 20:42:54.644151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 19596. [D 20:42:54.644161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 19597. [D 20:42:54.644171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 19598. [D 20:42:54.644181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 19599. [D 20:42:54.644191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 19600. [D 20:42:54.644201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 19601. [D 20:42:54.644224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 19602. [D 20:42:54.644235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 19603. [D 20:42:54.644248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 19604. [D 20:42:54.644270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 19605. [D 20:42:54.644283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 19606. [D 20:42:54.644304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 19607. [D 20:42:54.644316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 19608. [D 20:42:54.644336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 19609. [D 20:42:54.644346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 19610. [D 20:42:54.644356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 19611. [D 20:42:54.644378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 19612. [D 20:42:54.644388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 19613. [D 20:42:54.644398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 19614. [D 20:42:54.644419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 19615. [D 20:42:54.644429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 19616. [D 20:42:54.644439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 19617. [D 20:42:54.644467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 19618. [D 20:42:54.644477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 19619. [D 20:42:54.644501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 19620. [D 20:42:54.644511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 19621. [D 20:42:54.644522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 19622. [D 20:42:54.644532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 19623. [D 20:42:54.644558] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 19624. [D 20:42:54.650033] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19624. [D 20:42:54.650051] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 39/70. [D 20:42:54.650114] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.650128] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.650137] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:54.657033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.657047] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.657055] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:54.657071] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4327 [D 20:42:54.657080] element 0: offset: 0x2aaaab22ff40, size: 24 [D 20:42:54.657091] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 40/70. [D 20:42:54.683301] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4321 [D 20:42:54.683318] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 41/70. [D 20:42:54.683386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 19624. [D 20:42:54.683496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 19625. [D 20:42:54.683508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 19626. [D 20:42:54.683519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 19627. [D 20:42:54.683534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 19628. [D 20:42:54.683543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 19629. [D 20:42:54.683553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 19630. [D 20:42:54.683568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 19631. [D 20:42:54.683578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 19632. [D 20:42:54.683588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 19633. [D 20:42:54.683619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 19634. [D 20:42:54.683630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 19635. [D 20:42:54.683640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 19636. [D 20:42:54.683662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 19637. [D 20:42:54.683677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 19638. [D 20:42:54.683686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 19639. [D 20:42:54.683696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 19640. [D 20:42:54.683738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 19641. [D 20:42:54.683748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 19642. [D 20:42:54.683758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 19643. [D 20:42:54.683772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 19644. [D 20:42:54.683782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 19645. [D 20:42:54.683792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 19646. [D 20:42:54.683808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 19647. [D 20:42:54.683817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 19648. [D 20:42:54.683827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 19649. [D 20:42:54.683837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 19650. [D 20:42:54.683847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 19651. [D 20:42:54.683857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 19652. [D 20:42:54.683867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 19653. [D 20:42:54.683877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 19654. [D 20:42:54.683887] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 19655. [D 20:42:54.689362] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19655. [D 20:42:54.689415] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 42/70. [D 20:42:54.689469] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.689484] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.689493] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:54.695088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.695102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.695110] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:54.695127] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4330 [D 20:42:54.695136] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:42:54.695146] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 43/70. [D 20:42:54.719870] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.719884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.719892] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.719908] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4332 [D 20:42:54.719917] element 0: offset: 0x2aaaab23d3f0, size: 24 [D 20:42:54.719927] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 44/70. [D 20:42:54.737810] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4327 [D 20:42:54.737828] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 45/70. [D 20:42:54.737885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 19655. [D 20:42:54.737953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 19656. [D 20:42:54.737964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 19657. [D 20:42:54.737974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 19658. [D 20:42:54.737984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 19659. [D 20:42:54.737995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 19660. [D 20:42:54.738005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 19661. [D 20:42:54.738015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 19662. [D 20:42:54.738025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 19663. [D 20:42:54.738035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 19664. [D 20:42:54.738044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 19665. [D 20:42:54.738109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 19666. [D 20:42:54.738120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 19667. [D 20:42:54.738142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 19668. [D 20:42:54.738155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 19669. [D 20:42:54.738165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 19670. [D 20:42:54.738174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 19671. [D 20:42:54.738188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 19672. [D 20:42:54.738197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 19673. [D 20:42:54.738207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 19674. [D 20:42:54.738234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 19675. [D 20:42:54.738244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 19676. [D 20:42:54.738259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 19677. [D 20:42:54.738268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 19678. [D 20:42:54.738278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 19679. [D 20:42:54.738304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 19680. [D 20:42:54.738315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 19681. [D 20:42:54.738326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 19682. [D 20:42:54.738336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 19683. [D 20:42:54.738346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 19684. [D 20:42:54.738372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 19685. [D 20:42:54.738382] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 19686. [D 20:42:54.743807] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19686. [D 20:42:54.743825] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 46/70. [D 20:42:54.743887] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.743902] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.743911] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.750702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.750716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.750724] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.750740] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4336 [D 20:42:54.750749] element 0: offset: 0x2aaaab233b50, size: 24 [D 20:42:54.750759] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 47/70. [D 20:42:54.838295] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4336 [D 20:42:54.838312] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 48/70. [D 20:42:54.838440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 19686. [D 20:42:54.838515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 19687. [D 20:42:54.838526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 19688. [D 20:42:54.838537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 19689. [D 20:42:54.838551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 19690. [D 20:42:54.838560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 19691. [D 20:42:54.838570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 19692. [D 20:42:54.838585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 19693. [D 20:42:54.838594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 19694. [D 20:42:54.838604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 19695. [D 20:42:54.838620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 19696. [D 20:42:54.838630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 19697. [D 20:42:54.838639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 19698. [D 20:42:54.838695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 19699. [D 20:42:54.838706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 19700. [D 20:42:54.838716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 19701. [D 20:42:54.838740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 19702. [D 20:42:54.838750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 19703. [D 20:42:54.838760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 19704. [D 20:42:54.838770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 19705. [D 20:42:54.838780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 19706. [D 20:42:54.838790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 19707. [D 20:42:54.838817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 19708. [D 20:42:54.838832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 19709. [D 20:42:54.838844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 19710. [D 20:42:54.838853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 19711. [D 20:42:54.838876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 19712. [D 20:42:54.838886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 19713. [D 20:42:54.838896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 19714. [D 20:42:54.838910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 19715. [D 20:42:54.838920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 19716. [D 20:42:54.838930] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 19717. [D 20:42:54.844425] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19717. [D 20:42:54.844442] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 49/70. [D 20:42:54.844504] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.844518] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.844527] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.851341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.851355] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.851363] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.851379] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4339 [D 20:42:54.851388] element 0: offset: 0x2aaaab22c230, size: 24 [D 20:42:54.851398] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 50/70. [D 20:42:54.888125] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4339 [D 20:42:54.888142] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 51/70. [D 20:42:54.888208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 19717. [D 20:42:54.888283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 19718. [D 20:42:54.888295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 19719. [D 20:42:54.888305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 19720. [D 20:42:54.888316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 19721. [D 20:42:54.888325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 19722. [D 20:42:54.888341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 19723. [D 20:42:54.888350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 19724. [D 20:42:54.888360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 19725. [D 20:42:54.888375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 19726. [D 20:42:54.888385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 19727. [D 20:42:54.888395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 19728. [D 20:42:54.888411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 19729. [D 20:42:54.888420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 19730. [D 20:42:54.888430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 19731. [D 20:42:54.888446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 19732. [D 20:42:54.888520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 19733. [D 20:42:54.888531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 19734. [D 20:42:54.888541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 19735. [D 20:42:54.888557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 19736. [D 20:42:54.888568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 19737. [D 20:42:54.888591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 19738. [D 20:42:54.888605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 19739. [D 20:42:54.888615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 19740. [D 20:42:54.888625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 19741. [D 20:42:54.888641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 19742. [D 20:42:54.888651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 19743. [D 20:42:54.888661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 19744. [D 20:42:54.888676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 19745. [D 20:42:54.888686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 19746. [D 20:42:54.888696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 19747. [D 20:42:54.888728] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 19748. [D 20:42:54.894217] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19748. [D 20:42:54.894234] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 52/70. [D 20:42:54.894297] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.894311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.894320] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.900931] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.900945] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.900953] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.900969] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4342 [D 20:42:54.900978] element 0: offset: 0x2aaaab22e310, size: 24 [D 20:42:54.900988] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 53/70. [D 20:42:54.919652] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4330 [D 20:42:54.919669] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 54/70. [D 20:42:54.919727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19748. [D 20:42:54.919793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19749. [D 20:42:54.919813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19750. [D 20:42:54.919824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19751. [D 20:42:54.919866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19752. [D 20:42:54.919882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19753. [D 20:42:54.919893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19754. [D 20:42:54.919903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19755. [D 20:42:54.919918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19756. [D 20:42:54.919928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19757. [D 20:42:54.919954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19758. [D 20:42:54.919965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19759. [D 20:42:54.919974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19760. [D 20:42:54.919985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19761. [D 20:42:54.920004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19762. [D 20:42:54.920013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19763. [D 20:42:54.920023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19764. [D 20:42:54.920040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19765. [D 20:42:54.920050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19766. [D 20:42:54.920078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19767. [D 20:42:54.920088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19768. [D 20:42:54.920098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19769. [D 20:42:54.920112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19770. [D 20:42:54.920122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19771. [D 20:42:54.920147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19772. [D 20:42:54.920157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19773. [D 20:42:54.920167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19774. [D 20:42:54.920197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19775. [D 20:42:54.920207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19776. [D 20:42:54.920218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19777. [D 20:42:54.920237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19778. [D 20:42:54.920250] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19779. [D 20:42:54.925650] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19779. [D 20:42:54.925668] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 55/70. [D 20:42:54.925731] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.925745] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.925754] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.931336] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.931350] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.931358] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.931374] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4345 [D 20:42:54.931383] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:42:54.931393] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 56/70. [D 20:42:54.977908] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4342 [D 20:42:54.977924] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 57/70. [D 20:42:54.977983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 19779. [D 20:42:54.978046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 19780. [D 20:42:54.978098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 19781. [D 20:42:54.978110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 19782. [D 20:42:54.978120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 19783. [D 20:42:54.978131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 19784. [D 20:42:54.978140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 19785. [D 20:42:54.978150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 19786. [D 20:42:54.978174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 19787. [D 20:42:54.978184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 19788. [D 20:42:54.978193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 19789. [D 20:42:54.978209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 19790. [D 20:42:54.978219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 19791. [D 20:42:54.978229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 19792. [D 20:42:54.978238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 19793. [D 20:42:54.978248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 19794. [D 20:42:54.978271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 19795. [D 20:42:54.978280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 19796. [D 20:42:54.978302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 19797. [D 20:42:54.978312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 19798. [D 20:42:54.978327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 19799. [D 20:42:54.978338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 19800. [D 20:42:54.978348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 19801. [D 20:42:54.978358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 19802. [D 20:42:54.978368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 19803. [D 20:42:54.978392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 19804. [D 20:42:54.978423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 19805. [D 20:42:54.978433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 19806. [D 20:42:54.978443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 19807. [D 20:42:54.978453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 19808. [D 20:42:54.978477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 19809. [D 20:42:54.978487] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 19810. [D 20:42:54.983902] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19810. [D 20:42:54.983919] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 58/70. [D 20:42:54.983981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:54.983996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.984005] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:54.990563] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:54.990577] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:54.990586] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:54.990602] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4348 [D 20:42:54.990611] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:54.990622] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 59/70. [D 20:42:55.017281] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4345 [D 20:42:55.017298] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 60/70. [D 20:42:55.017485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19810. [D 20:42:55.017561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19811. [D 20:42:55.017572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19812. [D 20:42:55.017583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19813. [D 20:42:55.017593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19814. [D 20:42:55.017603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19815. [D 20:42:55.017613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19816. [D 20:42:55.017622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19817. [D 20:42:55.017632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19818. [D 20:42:55.017650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19819. [D 20:42:55.017659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19820. [D 20:42:55.017669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19821. [D 20:42:55.017715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19822. [D 20:42:55.017728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19823. [D 20:42:55.017738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19824. [D 20:42:55.017748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19825. [D 20:42:55.017772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19826. [D 20:42:55.017783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19827. [D 20:42:55.017793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19828. [D 20:42:55.017803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19829. [D 20:42:55.017813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19830. [D 20:42:55.017832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19831. [D 20:42:55.017842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19832. [D 20:42:55.017851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19833. [D 20:42:55.017861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19834. [D 20:42:55.017873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19835. [D 20:42:55.017898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19836. [D 20:42:55.017909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19837. [D 20:42:55.017920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19838. [D 20:42:55.017929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19839. [D 20:42:55.018010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19840. [D 20:42:55.018024] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19841. [D 20:42:55.023418] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19841. [D 20:42:55.023434] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 0/70. [D 20:42:55.023496] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.023511] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.023520] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.027336] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4318 [D 20:42:55.027353] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 1/70. [D 20:42:55.028722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 19841. [D 20:42:55.028741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 19842. [D 20:42:55.028752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 19843. [D 20:42:55.028762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 19844. [D 20:42:55.028777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 19845. [D 20:42:55.028788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 19846. [D 20:42:55.028797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 19847. [D 20:42:55.028807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 19848. [D 20:42:55.028817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 19849. [D 20:42:55.028827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 19850. [D 20:42:55.028837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 19851. [D 20:42:55.028854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 19852. [D 20:42:55.028863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 19853. [D 20:42:55.028873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 19854. [D 20:42:55.028883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 19855. [D 20:42:55.028911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 19856. [D 20:42:55.028921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 19857. [D 20:42:55.028931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 19858. [D 20:42:55.028941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 19859. [D 20:42:55.028956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 19860. [D 20:42:55.028978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 19861. [D 20:42:55.028988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 19862. [D 20:42:55.029002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 19863. [D 20:42:55.029012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 19864. [D 20:42:55.029021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 19865. [D 20:42:55.029042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 19866. [D 20:42:55.029052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 19867. [D 20:42:55.029063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 19868. [D 20:42:55.029072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 19869. [D 20:42:55.029082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 19870. [D 20:42:55.029096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 19871. [D 20:42:55.029120] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 19872. [D 20:42:55.029201] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.029216] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.029224] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.029240] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4351 [D 20:42:55.029250] element 0: offset: 0x2aaaab244d90, size: 24 [D 20:42:55.029261] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 2/70. [D 20:42:55.035966] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19872. [D 20:42:55.035985] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 3/70. [D 20:42:55.036088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.036102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.036111] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.041950] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.041963] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.041972] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.041988] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4354 [D 20:42:55.041997] element 0: offset: 0x2aaaab22c230, size: 24 [D 20:42:55.042009] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 4/70. [D 20:42:55.078902] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4348 [D 20:42:55.078920] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 5/70. [D 20:42:55.078983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 19872. [D 20:42:55.079096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 19873. [D 20:42:55.079111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 19874. [D 20:42:55.079122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 19875. [D 20:42:55.079133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 19876. [D 20:42:55.079143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 19877. [D 20:42:55.079153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 19878. [D 20:42:55.079163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 19879. [D 20:42:55.079179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 19880. [D 20:42:55.079189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 19881. [D 20:42:55.079199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 19882. [D 20:42:55.079209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 19883. [D 20:42:55.079247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 19884. [D 20:42:55.079259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 19885. [D 20:42:55.079269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 19886. [D 20:42:55.079283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 19887. [D 20:42:55.079310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 19888. [D 20:42:55.079324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 19889. [D 20:42:55.079333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 19890. [D 20:42:55.079346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 19891. [D 20:42:55.079373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 19892. [D 20:42:55.079383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 19893. [D 20:42:55.079396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 19894. [D 20:42:55.079406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 19895. [D 20:42:55.079428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 19896. [D 20:42:55.079439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 19897. [D 20:42:55.079450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 19898. [D 20:42:55.079464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 19899. [D 20:42:55.079473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 19900. [D 20:42:55.079483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 19901. [D 20:42:55.079509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 19902. [D 20:42:55.079520] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 19903. [D 20:42:55.084952] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19903. [D 20:42:55.084970] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 6/70. [D 20:42:55.085032] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.085047] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.085055] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.141528] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4351 [D 20:42:55.141545] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 7/70. [D 20:42:55.141600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 19903. [D 20:42:55.141667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 19904. [D 20:42:55.141677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 19905. [D 20:42:55.141688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 19906. [D 20:42:55.141698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 19907. [D 20:42:55.141708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 19908. [D 20:42:55.141718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 19909. [D 20:42:55.141728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 19910. [D 20:42:55.141738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 19911. [D 20:42:55.141748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 19912. [D 20:42:55.141757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 19913. [D 20:42:55.141822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 19914. [D 20:42:55.141833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 19915. [D 20:42:55.141851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 19916. [D 20:42:55.141862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 19917. [D 20:42:55.141872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 19918. [D 20:42:55.141882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 19919. [D 20:42:55.141893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 19920. [D 20:42:55.141903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 19921. [D 20:42:55.141912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 19922. [D 20:42:55.141922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 19923. [D 20:42:55.141946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 19924. [D 20:42:55.141955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 19925. [D 20:42:55.141965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 19926. [D 20:42:55.141980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 19927. [D 20:42:55.141990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 19928. [D 20:42:55.142012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 19929. [D 20:42:55.142024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 19930. [D 20:42:55.142033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 19931. [D 20:42:55.142043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 19932. [D 20:42:55.142054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 19933. [D 20:42:55.142064] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 19934. [D 20:42:55.147529] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19934. [D 20:42:55.147546] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 8/70. [D 20:42:55.147607] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.147622] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.147630] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:55.153510] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.153524] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.153533] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:55.153549] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4357 [D 20:42:55.153558] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:42:55.153569] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 9/70. [D 20:42:55.177847] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4332 [D 20:42:55.177864] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 10/70. [D 20:42:55.177923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 19934. [D 20:42:55.177998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 19935. [D 20:42:55.178009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 19936. [D 20:42:55.178020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 19937. [D 20:42:55.178030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 19938. [D 20:42:55.178040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 19939. [D 20:42:55.178056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 19940. [D 20:42:55.178066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 19941. [D 20:42:55.178075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 19942. [D 20:42:55.178091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 19943. [D 20:42:55.178139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 19944. [D 20:42:55.178149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 19945. [D 20:42:55.178159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 19946. [D 20:42:55.178169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 19947. [D 20:42:55.178179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 19948. [D 20:42:55.178189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 19949. [D 20:42:55.178200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 19950. [D 20:42:55.178210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 19951. [D 20:42:55.178237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 19952. [D 20:42:55.178247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 19953. [D 20:42:55.178257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 19954. [D 20:42:55.178267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 19955. [D 20:42:55.178283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 19956. [D 20:42:55.178293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 19957. [D 20:42:55.178303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 19958. [D 20:42:55.178328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 19959. [D 20:42:55.178338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 19960. [D 20:42:55.178348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 19961. [D 20:42:55.178359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 19962. [D 20:42:55.178369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 19963. [D 20:42:55.178379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 19964. [D 20:42:55.178403] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 19965. [D 20:42:55.183857] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19965. [D 20:42:55.183874] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 11/70. [D 20:42:55.183937] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.183951] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.183960] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:55.189754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.189768] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.189776] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:55.189792] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4359 [D 20:42:55.189801] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:42:55.189813] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 12/70. [D 20:42:55.219394] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.219408] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.219416] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.219431] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4363 [D 20:42:55.219441] element 0: offset: 0x2aaaab22e310, size: 24 [D 20:42:55.219451] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 13/70. [D 20:42:55.245294] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4354 [D 20:42:55.245311] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 14/70. [D 20:42:55.245376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 19965. [D 20:42:55.245453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 19966. [D 20:42:55.245464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 19967. [D 20:42:55.245475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 19968. [D 20:42:55.245485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 19969. [D 20:42:55.245495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 19970. [D 20:42:55.245511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 19971. [D 20:42:55.245520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 19972. [D 20:42:55.245530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 19973. [D 20:42:55.245546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 19974. [D 20:42:55.245614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 19975. [D 20:42:55.245625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 19976. [D 20:42:55.245635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 19977. [D 20:42:55.245651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 19978. [D 20:42:55.245662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 19979. [D 20:42:55.245685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 19980. [D 20:42:55.245696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 19981. [D 20:42:55.245705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 19982. [D 20:42:55.245716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 19983. [D 20:42:55.245726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 19984. [D 20:42:55.245735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 19985. [D 20:42:55.245745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 19986. [D 20:42:55.245761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 19987. [D 20:42:55.245787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 19988. [D 20:42:55.245799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 19989. [D 20:42:55.245808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 19990. [D 20:42:55.245818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 19991. [D 20:42:55.245843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 19992. [D 20:42:55.245853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 19993. [D 20:42:55.245863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 19994. [D 20:42:55.245874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 19995. [D 20:42:55.245884] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 19996. [D 20:42:55.251309] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 19996. [D 20:42:55.251327] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 15/70. [D 20:42:55.251390] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.251405] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.251413] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.257200] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.257213] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.257222] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.257237] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4366 [D 20:42:55.257247] element 0: offset: 0x2aaaab23cf50, size: 24 [D 20:42:55.257257] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 16/70. [D 20:42:55.287558] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4366 [D 20:42:55.287574] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 17/70. [D 20:42:55.287642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 19996. [D 20:42:55.287719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 19997. [D 20:42:55.287730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 19998. [D 20:42:55.287741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 19999. [D 20:42:55.287751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20000. [D 20:42:55.287761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20001. [D 20:42:55.287776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20002. [D 20:42:55.287785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20003. [D 20:42:55.287795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20004. [D 20:42:55.287811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20005. [D 20:42:55.287860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20006. [D 20:42:55.287873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20007. [D 20:42:55.287893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20008. [D 20:42:55.287907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20009. [D 20:42:55.287917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20010. [D 20:42:55.287927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20011. [D 20:42:55.287940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20012. [D 20:42:55.287950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20013. [D 20:42:55.287960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20014. [D 20:42:55.287970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20015. [D 20:42:55.287987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20016. [D 20:42:55.287997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20017. [D 20:42:55.288006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20018. [D 20:42:55.288032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20019. [D 20:42:55.288042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20020. [D 20:42:55.288058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20021. [D 20:42:55.288069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20022. [D 20:42:55.288079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20023. [D 20:42:55.288089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20024. [D 20:42:55.288099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20025. [D 20:42:55.288109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20026. [D 20:42:55.288118] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20027. [D 20:42:55.293641] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20027. [D 20:42:55.293660] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 18/70. [D 20:42:55.293724] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.293738] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.293747] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.299595] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.299608] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.299617] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.299632] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4369 [D 20:42:55.299642] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:55.299653] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 19/70. [D 20:42:55.339947] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4369 [D 20:42:55.339964] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 20/70. [D 20:42:55.340021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20027. [D 20:42:55.340088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20028. [D 20:42:55.340147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20029. [D 20:42:55.340158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20030. [D 20:42:55.340169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20031. [D 20:42:55.340184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20032. [D 20:42:55.340195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20033. [D 20:42:55.340205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20034. [D 20:42:55.340215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20035. [D 20:42:55.340224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20036. [D 20:42:55.340234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20037. [D 20:42:55.340244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20038. [D 20:42:55.340254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20039. [D 20:42:55.340275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20040. [D 20:42:55.340285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20041. [D 20:42:55.340295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20042. [D 20:42:55.340305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20043. [D 20:42:55.340315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20044. [D 20:42:55.340340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20045. [D 20:42:55.340351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20046. [D 20:42:55.340361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20047. [D 20:42:55.340371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20048. [D 20:42:55.340385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20049. [D 20:42:55.340395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20050. [D 20:42:55.340405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20051. [D 20:42:55.340415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20052. [D 20:42:55.340447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20053. [D 20:42:55.340457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20054. [D 20:42:55.340469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20055. [D 20:42:55.340479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20056. [D 20:42:55.340491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20057. [D 20:42:55.340515] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20058. [D 20:42:55.346004] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20058. [D 20:42:55.346022] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 21/70. [D 20:42:55.346084] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.346099] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.346107] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.351962] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.351975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.351984] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.351999] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4372 [D 20:42:55.352009] element 0: offset: 0x2aaaab2091c0, size: 24 [D 20:42:55.352019] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 22/70. [D 20:42:55.371983] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4372 [D 20:42:55.372000] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 23/70. [D 20:42:55.372066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20058. [D 20:42:55.372142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20059. [D 20:42:55.372153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20060. [D 20:42:55.372164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20061. [D 20:42:55.372174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20062. [D 20:42:55.372184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20063. [D 20:42:55.372199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20064. [D 20:42:55.372208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20065. [D 20:42:55.372218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20066. [D 20:42:55.372234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20067. [D 20:42:55.372284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20068. [D 20:42:55.372295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20069. [D 20:42:55.372321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20070. [D 20:42:55.372334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20071. [D 20:42:55.372344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20072. [D 20:42:55.372354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20073. [D 20:42:55.372381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20074. [D 20:42:55.372390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20075. [D 20:42:55.372403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20076. [D 20:42:55.372413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20077. [D 20:42:55.372423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20078. [D 20:42:55.372436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20079. [D 20:42:55.372463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20080. [D 20:42:55.372476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20081. [D 20:42:55.372485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20082. [D 20:42:55.372507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20083. [D 20:42:55.372518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20084. [D 20:42:55.372528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20085. [D 20:42:55.372538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20086. [D 20:42:55.372548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20087. [D 20:42:55.372558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20088. [D 20:42:55.372585] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20089. [D 20:42:55.378063] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20089. [D 20:42:55.378081] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 24/70. [D 20:42:55.378143] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.378158] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.378167] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.383984] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.383998] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.384006] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.384021] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4375 [D 20:42:55.384031] element 0: offset: 0x2aaaab2034f0, size: 24 [D 20:42:55.384041] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 25/70. [D 20:42:55.403347] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4357 [D 20:42:55.403364] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 26/70. [D 20:42:55.403427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 20089. [D 20:42:55.403506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 20090. [D 20:42:55.403517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 20091. [D 20:42:55.403530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 20092. [D 20:42:55.403541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 20093. [D 20:42:55.403551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 20094. [D 20:42:55.403561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 20095. [D 20:42:55.403571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 20096. [D 20:42:55.403583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 20097. [D 20:42:55.403599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 20098. [D 20:42:55.403651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 20099. [D 20:42:55.403663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 20100. [D 20:42:55.403683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 20101. [D 20:42:55.403697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 20102. [D 20:42:55.403707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 20103. [D 20:42:55.403717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 20104. [D 20:42:55.403745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 20105. [D 20:42:55.403755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 20106. [D 20:42:55.403769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 20107. [D 20:42:55.403779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 20108. [D 20:42:55.403789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 20109. [D 20:42:55.403815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 20110. [D 20:42:55.403825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 20111. [D 20:42:55.403837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 20112. [D 20:42:55.403847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 20113. [D 20:42:55.403856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 20114. [D 20:42:55.403883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 20115. [D 20:42:55.403893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 20116. [D 20:42:55.403906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 20117. [D 20:42:55.403915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 20118. [D 20:42:55.403925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 20119. [D 20:42:55.403950] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 20120. [D 20:42:55.409366] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20120. [D 20:42:55.409385] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 27/70. [D 20:42:55.409486] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.409502] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.409510] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.415375] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.415388] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.415397] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.415412] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4378 [D 20:42:55.415422] element 0: offset: 0x2aaaab244d90, size: 24 [D 20:42:55.415432] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 28/70. [D 20:42:55.454510] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4363 [D 20:42:55.454527] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 29/70. [D 20:42:55.454587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 20120. [D 20:42:55.454660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 20121. [D 20:42:55.454671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 20122. [D 20:42:55.454681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 20123. [D 20:42:55.454692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 20124. [D 20:42:55.454702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 20125. [D 20:42:55.454718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 20126. [D 20:42:55.454728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 20127. [D 20:42:55.454738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 20128. [D 20:42:55.454748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 20129. [D 20:42:55.454797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 20130. [D 20:42:55.454809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 20131. [D 20:42:55.454836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 20132. [D 20:42:55.454847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 20133. [D 20:42:55.454857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 20134. [D 20:42:55.454866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 20135. [D 20:42:55.454882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 20136. [D 20:42:55.454906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 20137. [D 20:42:55.454918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 20138. [D 20:42:55.454928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 20139. [D 20:42:55.454938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 20140. [D 20:42:55.454950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 20141. [D 20:42:55.454960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 20142. [D 20:42:55.454985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 20143. [D 20:42:55.454995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 20144. [D 20:42:55.455005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 20145. [D 20:42:55.455029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 20146. [D 20:42:55.455039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 20147. [D 20:42:55.455049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 20148. [D 20:42:55.455064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 20149. [D 20:42:55.455074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 20150. [D 20:42:55.455100] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 20151. [D 20:42:55.460517] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20151. [D 20:42:55.460534] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 30/70. [D 20:42:55.460598] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.460613] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.460621] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.466263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.466276] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.466285] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.466300] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4381 [D 20:42:55.466309] element 0: offset: 0x2aaaab20c830, size: 24 [D 20:42:55.466321] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 31/70. [D 20:42:55.522793] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4359 [D 20:42:55.522810] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 32/70. [D 20:42:55.522867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 20151. [D 20:42:55.522934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 20152. [D 20:42:55.522954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 20153. [D 20:42:55.522964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 20154. [D 20:42:55.522974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 20155. [D 20:42:55.522984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 20156. [D 20:42:55.523000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 20157. [D 20:42:55.523010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 20158. [D 20:42:55.523019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 20159. [D 20:42:55.523035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 20160. [D 20:42:55.523085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 20161. [D 20:42:55.523096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 20162. [D 20:42:55.523116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 20163. [D 20:42:55.523130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 20164. [D 20:42:55.523140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 20165. [D 20:42:55.523150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 20166. [D 20:42:55.523186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 20167. [D 20:42:55.523196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 20168. [D 20:42:55.523206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 20169. [D 20:42:55.523217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 20170. [D 20:42:55.523226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 20171. [D 20:42:55.523236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 20172. [D 20:42:55.523263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 20173. [D 20:42:55.523274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 20174. [D 20:42:55.523284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 20175. [D 20:42:55.523307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 20176. [D 20:42:55.523317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 20177. [D 20:42:55.523328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 20178. [D 20:42:55.523337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 20179. [D 20:42:55.523347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 20180. [D 20:42:55.523377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 20181. [D 20:42:55.523388] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 20182. [D 20:42:55.528793] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20182. [D 20:42:55.528810] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 33/70. [D 20:42:55.528874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.528888] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.528896] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.534674] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.534687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.534696] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.534712] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4383 [D 20:42:55.534721] element 0: offset: 0x2aaaab233c10, size: 24 [D 20:42:55.534732] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 34/70. [D 20:42:55.609569] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4375 [D 20:42:55.609587] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 35/70. [D 20:42:55.609741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20182. [D 20:42:55.609813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20183. [D 20:42:55.609826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20184. [D 20:42:55.609839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20185. [D 20:42:55.609851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20186. [D 20:42:55.609863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20187. [D 20:42:55.609875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20188. [D 20:42:55.609887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20189. [D 20:42:55.609899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20190. [D 20:42:55.609911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20191. [D 20:42:55.609923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20192. [D 20:42:55.609935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20193. [D 20:42:55.609947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20194. [D 20:42:55.609959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20195. [D 20:42:55.609972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20196. [D 20:42:55.609984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20197. [D 20:42:55.609996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20198. [D 20:42:55.610008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20199. [D 20:42:55.610020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20200. [D 20:42:55.610032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20201. [D 20:42:55.610045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20202. [D 20:42:55.610057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20203. [D 20:42:55.610069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20204. [D 20:42:55.610081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20205. [D 20:42:55.610093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20206. [D 20:42:55.610105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20207. [D 20:42:55.610117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20208. [D 20:42:55.610129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20209. [D 20:42:55.610142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20210. [D 20:42:55.610154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20211. [D 20:42:55.610167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20212. [D 20:42:55.610177] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20213. [D 20:42:55.615671] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20213. [D 20:42:55.615690] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 36/70. [D 20:42:55.615742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.615757] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.615766] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.621543] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.621555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.621564] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.621579] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4387 [D 20:42:55.621588] element 0: offset: 0x2aaaab23d3f0, size: 24 [D 20:42:55.621599] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 37/70. [D 20:42:55.656793] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4381 [D 20:42:55.656809] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 38/70. [D 20:42:55.656969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 20213. [D 20:42:55.657072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 20214. [D 20:42:55.657085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 20215. [D 20:42:55.657098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 20216. [D 20:42:55.657111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 20217. [D 20:42:55.657124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 20218. [D 20:42:55.657137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 20219. [D 20:42:55.657149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 20220. [D 20:42:55.657162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 20221. [D 20:42:55.657175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 20222. [D 20:42:55.657187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 20223. [D 20:42:55.657200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 20224. [D 20:42:55.657212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 20225. [D 20:42:55.657225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 20226. [D 20:42:55.657237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 20227. [D 20:42:55.657250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 20228. [D 20:42:55.657262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 20229. [D 20:42:55.657275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 20230. [D 20:42:55.657288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 20231. [D 20:42:55.657301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 20232. [D 20:42:55.657313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 20233. [D 20:42:55.657326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 20234. [D 20:42:55.657338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 20235. [D 20:42:55.657350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 20236. [D 20:42:55.657363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 20237. [D 20:42:55.657375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 20238. [D 20:42:55.657388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 20239. [D 20:42:55.657401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 20240. [D 20:42:55.657413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 20241. [D 20:42:55.657426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 20242. [D 20:42:55.657449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 20243. [D 20:42:55.657460] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 20244. [D 20:42:55.662990] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20244. [D 20:42:55.663008] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 39/70. [D 20:42:55.663060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.663076] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.663084] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.669048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.669061] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.669069] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.669085] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4390 [D 20:42:55.669095] element 0: offset: 0x2aaaab22c230, size: 24 [D 20:42:55.669105] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 40/70. [D 20:42:55.734817] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4383 [D 20:42:55.734835] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 41/70. [D 20:42:55.734992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 20244. [D 20:42:55.735068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 20245. [D 20:42:55.735081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 20246. [D 20:42:55.735093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 20247. [D 20:42:55.735106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 20248. [D 20:42:55.735118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 20249. [D 20:42:55.735131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 20250. [D 20:42:55.735143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 20251. [D 20:42:55.735156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 20252. [D 20:42:55.735169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 20253. [D 20:42:55.735181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 20254. [D 20:42:55.735193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 20255. [D 20:42:55.735209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 20256. [D 20:42:55.735222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 20257. [D 20:42:55.735234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 20258. [D 20:42:55.735246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 20259. [D 20:42:55.735259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 20260. [D 20:42:55.735271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 20261. [D 20:42:55.735284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 20262. [D 20:42:55.735296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 20263. [D 20:42:55.735309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 20264. [D 20:42:55.735321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 20265. [D 20:42:55.735334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 20266. [D 20:42:55.735346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 20267. [D 20:42:55.735358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 20268. [D 20:42:55.735371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 20269. [D 20:42:55.735384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 20270. [D 20:42:55.735396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 20271. [D 20:42:55.735409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 20272. [D 20:42:55.735421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 20273. [D 20:42:55.735433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 20274. [D 20:42:55.735444] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 20275. [D 20:42:55.740924] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20275. [D 20:42:55.740943] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 42/70. [D 20:42:55.740994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.741010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.741018] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.746560] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.746572] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.746581] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.746597] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4392 [D 20:42:55.746606] element 0: offset: 0x2aaaab23cf50, size: 24 [D 20:42:55.746617] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 43/70. [D 20:42:55.790093] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4387 [D 20:42:55.790110] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 44/70. [D 20:42:55.790272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20275. [D 20:42:55.790353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20276. [D 20:42:55.790366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20277. [D 20:42:55.790379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20278. [D 20:42:55.790391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20279. [D 20:42:55.790404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20280. [D 20:42:55.790417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20281. [D 20:42:55.790429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20282. [D 20:42:55.790442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20283. [D 20:42:55.790455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20284. [D 20:42:55.790467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20285. [D 20:42:55.790479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20286. [D 20:42:55.790491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20287. [D 20:42:55.790504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20288. [D 20:42:55.790517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20289. [D 20:42:55.790529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20290. [D 20:42:55.790542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20291. [D 20:42:55.790554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20292. [D 20:42:55.790567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20293. [D 20:42:55.790580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20294. [D 20:42:55.790592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20295. [D 20:42:55.790605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20296. [D 20:42:55.790617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20297. [D 20:42:55.790630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20298. [D 20:42:55.790642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20299. [D 20:42:55.790655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20300. [D 20:42:55.790667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20301. [D 20:42:55.790680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20302. [D 20:42:55.790693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20303. [D 20:42:55.790706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20304. [D 20:42:55.790718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20305. [D 20:42:55.790729] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20306. [D 20:42:55.796210] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20306. [D 20:42:55.796229] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 45/70. [D 20:42:55.796281] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.796296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.796305] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.802056] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.802068] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.802077] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.802092] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4396 [D 20:42:55.802102] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:55.802112] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 46/70. [D 20:42:55.831546] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4378 [D 20:42:55.831562] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 47/70. [D 20:42:55.831719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 20306. [D 20:42:55.831821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 20307. [D 20:42:55.831835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 20308. [D 20:42:55.831847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 20309. [D 20:42:55.831860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 20310. [D 20:42:55.831872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 20311. [D 20:42:55.831885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 20312. [D 20:42:55.831898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 20313. [D 20:42:55.831910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 20314. [D 20:42:55.831922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 20315. [D 20:42:55.831935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 20316. [D 20:42:55.831947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 20317. [D 20:42:55.831959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 20318. [D 20:42:55.831972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 20319. [D 20:42:55.831984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 20320. [D 20:42:55.831997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 20321. [D 20:42:55.832009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 20322. [D 20:42:55.832021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 20323. [D 20:42:55.832034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 20324. [D 20:42:55.832046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 20325. [D 20:42:55.832059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 20326. [D 20:42:55.832071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 20327. [D 20:42:55.832083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 20328. [D 20:42:55.832096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 20329. [D 20:42:55.832108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 20330. [D 20:42:55.832120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 20331. [D 20:42:55.832133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 20332. [D 20:42:55.832145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 20333. [D 20:42:55.832157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 20334. [D 20:42:55.832170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 20335. [D 20:42:55.832182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 20336. [D 20:42:55.832192] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 20337. [D 20:42:55.837676] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20337. [D 20:42:55.837695] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 48/70. [D 20:42:55.837745] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.837761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.837769] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.843934] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.843947] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.843956] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.843971] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4399 [D 20:42:55.843981] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:42:55.843991] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 49/70. [D 20:42:55.923620] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4392 [D 20:42:55.923637] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 50/70. [D 20:42:55.923795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 20337. [D 20:42:55.923898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 20338. [D 20:42:55.923911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 20339. [D 20:42:55.923923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 20340. [D 20:42:55.923936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 20341. [D 20:42:55.923948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 20342. [D 20:42:55.923961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 20343. [D 20:42:55.923973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 20344. [D 20:42:55.923986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 20345. [D 20:42:55.923998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 20346. [D 20:42:55.924011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 20347. [D 20:42:55.924023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 20348. [D 20:42:55.924035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 20349. [D 20:42:55.924048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 20350. [D 20:42:55.924060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 20351. [D 20:42:55.924072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 20352. [D 20:42:55.924084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 20353. [D 20:42:55.924097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 20354. [D 20:42:55.924109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 20355. [D 20:42:55.924121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 20356. [D 20:42:55.924134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 20357. [D 20:42:55.924146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 20358. [D 20:42:55.924159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 20359. [D 20:42:55.924171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 20360. [D 20:42:55.924184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 20361. [D 20:42:55.924196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 20362. [D 20:42:55.924209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 20363. [D 20:42:55.924221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 20364. [D 20:42:55.924234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 20365. [D 20:42:55.924246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 20366. [D 20:42:55.924258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 20367. [D 20:42:55.924268] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 20368. [D 20:42:55.929756] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20368. [D 20:42:55.929775] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 51/70. [D 20:42:55.929827] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.929842] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.929851] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:55.935431] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:55.935444] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.935452] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:55.935467] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4401 [D 20:42:55.935477] element 0: offset: 0x2aaaab22e310, size: 24 [D 20:42:55.935487] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 52/70. [D 20:42:55.984258] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4396 [D 20:42:55.984274] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 53/70. [D 20:42:55.984438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20368. [D 20:42:55.984512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20369. [D 20:42:55.984525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20370. [D 20:42:55.984538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20371. [D 20:42:55.984551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20372. [D 20:42:55.984563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20373. [D 20:42:55.984576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20374. [D 20:42:55.984589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20375. [D 20:42:55.984601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20376. [D 20:42:55.984614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20377. [D 20:42:55.984626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20378. [D 20:42:55.984639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20379. [D 20:42:55.984651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20380. [D 20:42:55.984664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20381. [D 20:42:55.984676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20382. [D 20:42:55.984689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20383. [D 20:42:55.984701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20384. [D 20:42:55.984714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20385. [D 20:42:55.984727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20386. [D 20:42:55.984739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20387. [D 20:42:55.984752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20388. [D 20:42:55.984764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20389. [D 20:42:55.984776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20390. [D 20:42:55.984789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20391. [D 20:42:55.984801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20392. [D 20:42:55.984813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20393. [D 20:42:55.984826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20394. [D 20:42:55.984838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20395. [D 20:42:55.984851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20396. [D 20:42:55.984864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20397. [D 20:42:55.984877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20398. [D 20:42:55.984887] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20399. [D 20:42:55.990369] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20399. [D 20:42:55.990387] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 54/70. [D 20:42:55.990437] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:55.990453] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:55.990461] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.034993] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4399 [D 20:42:56.035009] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 55/70. [D 20:42:56.035175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 20399. [D 20:42:56.035258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 20400. [D 20:42:56.035272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 20401. [D 20:42:56.035285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 20402. [D 20:42:56.035297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 20403. [D 20:42:56.035310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 20404. [D 20:42:56.035322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 20405. [D 20:42:56.035335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 20406. [D 20:42:56.035347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 20407. [D 20:42:56.035360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 20408. [D 20:42:56.035372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 20409. [D 20:42:56.035385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 20410. [D 20:42:56.035398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 20411. [D 20:42:56.035410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 20412. [D 20:42:56.035423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 20413. [D 20:42:56.035435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 20414. [D 20:42:56.035448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 20415. [D 20:42:56.035460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 20416. [D 20:42:56.035473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 20417. [D 20:42:56.035485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 20418. [D 20:42:56.035498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 20419. [D 20:42:56.035510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 20420. [D 20:42:56.035523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 20421. [D 20:42:56.035536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 20422. [D 20:42:56.035548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 20423. [D 20:42:56.035560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 20424. [D 20:42:56.035573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 20425. [D 20:42:56.035586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 20426. [D 20:42:56.035598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 20427. [D 20:42:56.035610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 20428. [D 20:42:56.035623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 20429. [D 20:42:56.035633] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 20430. [D 20:42:56.041158] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20430. [D 20:42:56.041177] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 56/70. [D 20:42:56.041228] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.041244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.041252] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.101290] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4390 [D 20:42:56.101306] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 57/70. [D 20:42:56.101457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 20430. [D 20:42:56.101537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 20431. [D 20:42:56.101550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 20432. [D 20:42:56.101562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 20433. [D 20:42:56.101575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 20434. [D 20:42:56.101587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 20435. [D 20:42:56.101600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 20436. [D 20:42:56.101613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 20437. [D 20:42:56.101625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 20438. [D 20:42:56.101638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 20439. [D 20:42:56.101651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 20440. [D 20:42:56.101663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 20441. [D 20:42:56.101675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 20442. [D 20:42:56.101688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 20443. [D 20:42:56.101700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 20444. [D 20:42:56.101713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 20445. [D 20:42:56.101725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 20446. [D 20:42:56.101738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 20447. [D 20:42:56.101750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 20448. [D 20:42:56.101763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 20449. [D 20:42:56.101775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 20450. [D 20:42:56.101788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 20451. [D 20:42:56.101800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 20452. [D 20:42:56.101813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 20453. [D 20:42:56.101826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 20454. [D 20:42:56.101838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 20455. [D 20:42:56.101850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 20456. [D 20:42:56.101863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 20457. [D 20:42:56.101875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 20458. [D 20:42:56.101888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 20459. [D 20:42:56.101900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 20460. [D 20:42:56.101911] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 20461. [D 20:42:56.107407] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20461. [D 20:42:56.107426] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 58/70. [D 20:42:56.107477] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.107493] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.107501] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.114292] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.114305] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.114313] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.114329] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4405 [D 20:42:56.114339] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:42:56.114348] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 59/70. [D 20:42:56.118799] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.118813] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.118821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.118836] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4408 [D 20:42:56.118845] element 0: offset: 0x2aaaab2034f0, size: 24 [D 20:42:56.118856] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 60/70. [D 20:42:56.176223] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.176237] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.176246] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.176261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4411 [D 20:42:56.176270] element 0: offset: 0x2aaaab23a5d0, size: 24 [D 20:42:56.176281] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 0/70. [D 20:42:56.186255] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4401 [D 20:42:56.186271] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 1/70. [D 20:42:56.186422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 20461. [D 20:42:56.186496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 20462. [D 20:42:56.186509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 20463. [D 20:42:56.186522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 20464. [D 20:42:56.186534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 20465. [D 20:42:56.186546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 20466. [D 20:42:56.186558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 20467. [D 20:42:56.186570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 20468. [D 20:42:56.186583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 20469. [D 20:42:56.186595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 20470. [D 20:42:56.186608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 20471. [D 20:42:56.186620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 20472. [D 20:42:56.186632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 20473. [D 20:42:56.186645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 20474. [D 20:42:56.186658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 20475. [D 20:42:56.186670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 20476. [D 20:42:56.186682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 20477. [D 20:42:56.186695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 20478. [D 20:42:56.186707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 20479. [D 20:42:56.186719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 20480. [D 20:42:56.186732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 20481. [D 20:42:56.186744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 20482. [D 20:42:56.186757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 20483. [D 20:42:56.186769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 20484. [D 20:42:56.186781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 20485. [D 20:42:56.186793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 20486. [D 20:42:56.186806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 20487. [D 20:42:56.186818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 20488. [D 20:42:56.186830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 20489. [D 20:42:56.186842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 20490. [D 20:42:56.186855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 20491. [D 20:42:56.186865] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 20492. [D 20:42:56.192356] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20492. [D 20:42:56.192374] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 2/70. [D 20:42:56.192426] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.192441] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.192450] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.198056] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.198068] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.198077] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.198092] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4413 [D 20:42:56.198101] element 0: offset: 0x2aaaab233c10, size: 24 [D 20:42:56.198111] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 3/70. [D 20:42:56.217208] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4408 [D 20:42:56.217225] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 4/70. [D 20:42:56.217382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20492. [D 20:42:56.217458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20493. [D 20:42:56.217470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20494. [D 20:42:56.217489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20495. [D 20:42:56.217707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20496. [D 20:42:56.217719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20497. [D 20:42:56.217728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20498. [D 20:42:56.217738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20499. [D 20:42:56.217748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20500. [D 20:42:56.217758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20501. [D 20:42:56.217768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20502. [D 20:42:56.217778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20503. [D 20:42:56.217805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20504. [D 20:42:56.217818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20505. [D 20:42:56.217830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20506. [D 20:42:56.217842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20507. [D 20:42:56.217855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20508. [D 20:42:56.217867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20509. [D 20:42:56.217880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20510. [D 20:42:56.217893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20511. [D 20:42:56.217905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20512. [D 20:42:56.217917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20513. [D 20:42:56.217930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20514. [D 20:42:56.217942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20515. [D 20:42:56.217955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20516. [D 20:42:56.217967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20517. [D 20:42:56.217980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20518. [D 20:42:56.217992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20519. [D 20:42:56.218005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20520. [D 20:42:56.218017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20521. [D 20:42:56.218030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20522. [D 20:42:56.218040] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20523. [D 20:42:56.223320] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20523. [D 20:42:56.223339] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 5/70. [D 20:42:56.223390] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.223406] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.223415] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.228915] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.228928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.228936] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.228952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4417 [D 20:42:56.228961] element 0: offset: 0x2aaaab23d3f0, size: 24 [D 20:42:56.228971] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 6/70. [D 20:42:56.233419] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4417 [D 20:42:56.233435] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 7/70. [D 20:42:56.233593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20523. [D 20:42:56.233693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20524. [D 20:42:56.233706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20525. [D 20:42:56.233719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20526. [D 20:42:56.233731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20527. [D 20:42:56.233743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20528. [D 20:42:56.233755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20529. [D 20:42:56.233767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20530. [D 20:42:56.233780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20531. [D 20:42:56.233792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20532. [D 20:42:56.233805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20533. [D 20:42:56.233817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20534. [D 20:42:56.233830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20535. [D 20:42:56.233842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20536. [D 20:42:56.233855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20537. [D 20:42:56.233867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20538. [D 20:42:56.233879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20539. [D 20:42:56.233892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20540. [D 20:42:56.233904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20541. [D 20:42:56.233917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20542. [D 20:42:56.233929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20543. [D 20:42:56.233942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20544. [D 20:42:56.233954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20545. [D 20:42:56.233966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20546. [D 20:42:56.233979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20547. [D 20:42:56.233991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20548. [D 20:42:56.234004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20549. [D 20:42:56.234016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20550. [D 20:42:56.234028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20551. [D 20:42:56.234040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20552. [D 20:42:56.234053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20553. [D 20:42:56.234063] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20554. [D 20:42:56.244396] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20554. [D 20:42:56.244465] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 8/70. [D 20:42:56.244522] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.244538] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.244546] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.249881] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.249894] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.249902] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.249917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4420 [D 20:42:56.249926] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:42:56.249936] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 9/70. [D 20:42:56.254530] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4420 [D 20:42:56.254547] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 10/70. [D 20:42:56.254703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20554. [D 20:42:56.254778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20555. [D 20:42:56.254790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20556. [D 20:42:56.254803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20557. [D 20:42:56.254815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20558. [D 20:42:56.254827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20559. [D 20:42:56.254839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20560. [D 20:42:56.254852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20561. [D 20:42:56.254864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20562. [D 20:42:56.254877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20563. [D 20:42:56.254889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20564. [D 20:42:56.254901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20565. [D 20:42:56.254913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20566. [D 20:42:56.254926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20567. [D 20:42:56.254938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20568. [D 20:42:56.254951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20569. [D 20:42:56.254963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20570. [D 20:42:56.254975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20571. [D 20:42:56.254988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20572. [D 20:42:56.255000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20573. [D 20:42:56.255013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20574. [D 20:42:56.255025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20575. [D 20:42:56.255037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20576. [D 20:42:56.255050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20577. [D 20:42:56.255062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20578. [D 20:42:56.255074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20579. [D 20:42:56.255087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20580. [D 20:42:56.255099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20581. [D 20:42:56.255112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20582. [D 20:42:56.255124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20583. [D 20:42:56.255137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20584. [D 20:42:56.255147] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20585. [D 20:42:56.265503] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20585. [D 20:42:56.265551] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 11/70. [D 20:42:56.265607] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.265622] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.265631] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.270974] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.270987] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.270995] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.271010] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4423 [D 20:42:56.271020] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:56.271030] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 12/70. [D 20:42:56.275423] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4423 [D 20:42:56.275439] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 13/70. [D 20:42:56.275646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20585. [D 20:42:56.275747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20586. [D 20:42:56.275759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20587. [D 20:42:56.275769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20588. [D 20:42:56.275779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20589. [D 20:42:56.275789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20590. [D 20:42:56.275799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20591. [D 20:42:56.275809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20592. [D 20:42:56.275818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20593. [D 20:42:56.275984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20594. [D 20:42:56.276008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20595. [D 20:42:56.276019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20596. [D 20:42:56.276029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20597. [D 20:42:56.276038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20598. [D 20:42:56.276055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20599. [D 20:42:56.276065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20600. [D 20:42:56.276074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20601. [D 20:42:56.276091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20602. [D 20:42:56.276101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20603. [D 20:42:56.276110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20604. [D 20:42:56.276121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20605. [D 20:42:56.276150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20606. [D 20:42:56.276161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20607. [D 20:42:56.276171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20608. [D 20:42:56.276181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20609. [D 20:42:56.276191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20610. [D 20:42:56.276201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20611. [D 20:42:56.276227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20612. [D 20:42:56.276241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20613. [D 20:42:56.276251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20614. [D 20:42:56.276260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20615. [D 20:42:56.276276] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20616. [D 20:42:56.286536] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20616. [D 20:42:56.286556] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 14/70. [D 20:42:56.286621] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.286636] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.286644] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.291995] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.292008] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.292017] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.292032] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4426 [D 20:42:56.292042] element 0: offset: 0x2aaaab23cf50, size: 24 [D 20:42:56.292052] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 15/70. [D 20:42:56.296583] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4426 [D 20:42:56.296600] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 16/70. [D 20:42:56.296781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20616. [D 20:42:56.296849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20617. [D 20:42:56.296861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20618. [D 20:42:56.296871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20619. [D 20:42:56.296885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20620. [D 20:42:56.296895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20621. [D 20:42:56.296905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20622. [D 20:42:56.296920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20623. [D 20:42:56.296929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20624. [D 20:42:56.296939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20625. [D 20:42:56.296955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20626. [D 20:42:56.296964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20627. [D 20:42:56.296974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20628. [D 20:42:56.296990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20629. [D 20:42:56.297000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20630. [D 20:42:56.297009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20631. [D 20:42:56.297025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20632. [D 20:42:56.297035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20633. [D 20:42:56.297044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20634. [D 20:42:56.297054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20635. [D 20:42:56.297064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20636. [D 20:42:56.297074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20637. [D 20:42:56.297085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20638. [D 20:42:56.297095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20639. [D 20:42:56.297105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20640. [D 20:42:56.297114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20641. [D 20:42:56.297125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20642. [D 20:42:56.297138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20643. [D 20:42:56.297148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20644. [D 20:42:56.297157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20645. [D 20:42:56.297167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20646. [D 20:42:56.297185] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20647. [D 20:42:56.303740] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4413 [D 20:42:56.303759] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 17/70. [D 20:42:56.307657] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20647. [D 20:42:56.307706] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 18/70. [D 20:42:56.307720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 20647. [D 20:42:56.307734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 20648. [D 20:42:56.307747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 20649. [D 20:42:56.307756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 20650. [D 20:42:56.307772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 20651. [D 20:42:56.307783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 20652. [D 20:42:56.307793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 20653. [D 20:42:56.307803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 20654. [D 20:42:56.307813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 20655. [D 20:42:56.307823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 20656. [D 20:42:56.307833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 20657. [D 20:42:56.307850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 20658. [D 20:42:56.307860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 20659. [D 20:42:56.307870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 20660. [D 20:42:56.307880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 20661. [D 20:42:56.307890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 20662. [D 20:42:56.307900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 20663. [D 20:42:56.307910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 20664. [D 20:42:56.307946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 20665. [D 20:42:56.307957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 20666. [D 20:42:56.307967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 20667. [D 20:42:56.307977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 20668. [D 20:42:56.307987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 20669. [D 20:42:56.308012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 20670. [D 20:42:56.308023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 20671. [D 20:42:56.308033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 20672. [D 20:42:56.308043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 20673. [D 20:42:56.308070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 20674. [D 20:42:56.308081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 20675. [D 20:42:56.308091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 20676. [D 20:42:56.308104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 20677. [D 20:42:56.308114] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 20678. [D 20:42:56.308184] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.308198] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.308207] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.313494] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.313508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.313516] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.313532] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4429 [D 20:42:56.313541] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:56.313551] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 19/70. [D 20:42:56.313677] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 20678. [D 20:42:56.313700] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 20/70. [D 20:42:56.313767] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.313782] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.313790] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.318210] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4429 [D 20:42:56.318227] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 21/70. [D 20:42:56.319146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20678. [D 20:42:56.319212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20679. [D 20:42:56.319224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20680. [D 20:42:56.319234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20681. [D 20:42:56.319244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20682. [D 20:42:56.319254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20683. [D 20:42:56.319264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20684. [D 20:42:56.319274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20685. [D 20:42:56.319284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20686. [D 20:42:56.319294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20687. [D 20:42:56.319311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20688. [D 20:42:56.319328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20689. [D 20:42:56.319338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20690. [D 20:42:56.319348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20691. [D 20:42:56.319374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20692. [D 20:42:56.319385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20693. [D 20:42:56.319399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20694. [D 20:42:56.319409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20695. [D 20:42:56.319419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20696. [D 20:42:56.319434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20697. [D 20:42:56.319472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20698. [D 20:42:56.319489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20699. [D 20:42:56.319499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20700. [D 20:42:56.319509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20701. [D 20:42:56.319519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20702. [D 20:42:56.319528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20703. [D 20:42:56.319538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20704. [D 20:42:56.319547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20705. [D 20:42:56.319557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20706. [D 20:42:56.319566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20707. [D 20:42:56.319576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20708. [D 20:42:56.319585] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20709. [D 20:42:56.319627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.319638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.319646] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.319660] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4431 [D 20:42:56.319670] element 0: offset: 0x2aaaab244e90, size: 24 [D 20:42:56.319679] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 22/70. [D 20:42:56.330822] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20709. [D 20:42:56.330844] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 23/70. [D 20:42:56.330914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.330929] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.330937] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.336580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.336593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.336602] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.336617] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4435 [D 20:42:56.336626] element 0: offset: 0x2aaaab2034f0, size: 24 [D 20:42:56.336636] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 24/70. [D 20:42:56.342092] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4435 [D 20:42:56.342109] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 25/70. [D 20:42:56.342176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20709. [D 20:42:56.342255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20710. [D 20:42:56.342266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20711. [D 20:42:56.342276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20712. [D 20:42:56.342287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20713. [D 20:42:56.342297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20714. [D 20:42:56.342312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20715. [D 20:42:56.342322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20716. [D 20:42:56.342331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20717. [D 20:42:56.342347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20718. [D 20:42:56.342357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20719. [D 20:42:56.342367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20720. [D 20:42:56.342382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20721. [D 20:42:56.342393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20722. [D 20:42:56.342402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20723. [D 20:42:56.342446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20724. [D 20:42:56.342457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20725. [D 20:42:56.342467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20726. [D 20:42:56.342477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20727. [D 20:42:56.342487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20728. [D 20:42:56.342497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20729. [D 20:42:56.342534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20730. [D 20:42:56.342581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20731. [D 20:42:56.342594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20732. [D 20:42:56.342604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20733. [D 20:42:56.342619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20734. [D 20:42:56.342630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20735. [D 20:42:56.342640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20736. [D 20:42:56.342650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20737. [D 20:42:56.342660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20738. [D 20:42:56.342670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20739. [D 20:42:56.342680] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20740. [D 20:42:56.350469] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20740. [D 20:42:56.350487] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 26/70. [D 20:42:56.350586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.350602] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.350610] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.358549] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4405 [D 20:42:56.358565] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 27/70. [D 20:42:56.359321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 20740. [D 20:42:56.359341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 20741. [D 20:42:56.359353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 20742. [D 20:42:56.359362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 20743. [D 20:42:56.359373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 20744. [D 20:42:56.359382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 20745. [D 20:42:56.359392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 20746. [D 20:42:56.359402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 20747. [D 20:42:56.359417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 20748. [D 20:42:56.359427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 20749. [D 20:42:56.359437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 20750. [D 20:42:56.359447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 20751. [D 20:42:56.359457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 20752. [D 20:42:56.359467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 20753. [D 20:42:56.359476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 20754. [D 20:42:56.359511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 20755. [D 20:42:56.359521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 20756. [D 20:42:56.359532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 20757. [D 20:42:56.359542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 20758. [D 20:42:56.359552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 20759. [D 20:42:56.359562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 20760. [D 20:42:56.359572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 20761. [D 20:42:56.359596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 20762. [D 20:42:56.359606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 20763. [D 20:42:56.359615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 20764. [D 20:42:56.359626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 20765. [D 20:42:56.359648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 20766. [D 20:42:56.359657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 20767. [D 20:42:56.359672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 20768. [D 20:42:56.359682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 20769. [D 20:42:56.359692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 20770. [D 20:42:56.359708] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 20771. [D 20:42:56.359787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.359804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.359824] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.359841] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4438 [D 20:42:56.359850] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:56.359860] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 28/70. [D 20:42:56.365203] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20771. [D 20:42:56.365221] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 29/70. [D 20:42:56.365288] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.365303] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.365311] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.369549] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4438 [D 20:42:56.369566] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 30/70. [D 20:42:56.371749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20771. [D 20:42:56.371810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20772. [D 20:42:56.371822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20773. [D 20:42:56.371832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20774. [D 20:42:56.371847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20775. [D 20:42:56.371857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20776. [D 20:42:56.371866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20777. [D 20:42:56.371880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20778. [D 20:42:56.371890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20779. [D 20:42:56.371899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20780. [D 20:42:56.371910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20781. [D 20:42:56.371919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20782. [D 20:42:56.371963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20783. [D 20:42:56.371973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20784. [D 20:42:56.371986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20785. [D 20:42:56.372010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20786. [D 20:42:56.372022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20787. [D 20:42:56.372032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20788. [D 20:42:56.372044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20789. [D 20:42:56.372059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20790. [D 20:42:56.372069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20791. [D 20:42:56.372079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20792. [D 20:42:56.372113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20793. [D 20:42:56.372125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20794. [D 20:42:56.372135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20795. [D 20:42:56.372144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20796. [D 20:42:56.372160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20797. [D 20:42:56.372170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20798. [D 20:42:56.372196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20799. [D 20:42:56.372205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20800. [D 20:42:56.372215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20801. [D 20:42:56.372229] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20802. [D 20:42:56.372310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.372326] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.372335] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.372351] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4441 [D 20:42:56.372360] element 0: offset: 0x2aaaab20e290, size: 24 [D 20:42:56.372371] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 31/70. [D 20:42:56.375774] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4411 [D 20:42:56.375790] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 32/70. [D 20:42:56.383663] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20802. [D 20:42:56.383736] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 33/70. [D 20:42:56.383754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 20802. [D 20:42:56.383765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 20803. [D 20:42:56.383776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 20804. [D 20:42:56.383786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 20805. [D 20:42:56.383800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 20806. [D 20:42:56.383810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 20807. [D 20:42:56.383819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 20808. [D 20:42:56.383836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 20809. [D 20:42:56.383845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 20810. [D 20:42:56.383855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 20811. [D 20:42:56.383871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 20812. [D 20:42:56.383881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 20813. [D 20:42:56.383890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 20814. [D 20:42:56.383906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 20815. [D 20:42:56.383916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 20816. [D 20:42:56.383926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 20817. [D 20:42:56.383941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 20818. [D 20:42:56.383951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 20819. [D 20:42:56.383961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 20820. [D 20:42:56.384026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 20821. [D 20:42:56.384037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 20822. [D 20:42:56.384047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 20823. [D 20:42:56.384064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 20824. [D 20:42:56.384074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 20825. [D 20:42:56.384085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 20826. [D 20:42:56.384095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 20827. [D 20:42:56.384106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 20828. [D 20:42:56.384116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 20829. [D 20:42:56.384148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 20830. [D 20:42:56.384159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 20831. [D 20:42:56.384173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 20832. [D 20:42:56.384185] openib_post_sr_rdmaw: ibv_post_send wr_id 655e40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 20833. [D 20:42:56.384249] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.384263] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.384272] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.389959] openib_check_cq: completed rdma wr_id 655e40, nic_wr_credit 20833. [D 20:42:56.389982] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 34/70. [D 20:42:56.390080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.390096] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.390105] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.395993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.396006] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.396015] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.396030] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4444 [D 20:42:56.396040] element 0: offset: 0x2aaaab23d3f0, size: 24 [D 20:42:56.396050] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 35/70. [D 20:42:56.416851] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4431 [D 20:42:56.416868] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 36/70. [D 20:42:56.416930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 20833. [D 20:42:56.417000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 20834. [D 20:42:56.417020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 20835. [D 20:42:56.417031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 20836. [D 20:42:56.417041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 20837. [D 20:42:56.417051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 20838. [D 20:42:56.417066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 20839. [D 20:42:56.417076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 20840. [D 20:42:56.417085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 20841. [D 20:42:56.417101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 20842. [D 20:42:56.417160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 20843. [D 20:42:56.417171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 20844. [D 20:42:56.417195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 20845. [D 20:42:56.417208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 20846. [D 20:42:56.417218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 20847. [D 20:42:56.417228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 20848. [D 20:42:56.417241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 20849. [D 20:42:56.417251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 20850. [D 20:42:56.417280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 20851. [D 20:42:56.417290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 20852. [D 20:42:56.417300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 20853. [D 20:42:56.417314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 20854. [D 20:42:56.417340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 20855. [D 20:42:56.417353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 20856. [D 20:42:56.417362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 20857. [D 20:42:56.417373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 20858. [D 20:42:56.417386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 20859. [D 20:42:56.417396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 20860. [D 20:42:56.417406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 20861. [D 20:42:56.417416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 20862. [D 20:42:56.417433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 20863. [D 20:42:56.417444] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 20864. [D 20:42:56.422859] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20864. [D 20:42:56.422877] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 37/70. [D 20:42:56.422941] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.422956] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.422965] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.428801] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.428814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.428823] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.428839] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4446 [D 20:42:56.428848] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:42:56.428858] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 38/70. [D 20:42:56.497276] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4441 [D 20:42:56.497293] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 39/70. [D 20:42:56.497360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 20864. [D 20:42:56.497468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 20865. [D 20:42:56.497482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 20866. [D 20:42:56.497493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 20867. [D 20:42:56.497514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 20868. [D 20:42:56.497524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 20869. [D 20:42:56.497550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 20870. [D 20:42:56.497561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 20871. [D 20:42:56.497575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 20872. [D 20:42:56.497585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 20873. [D 20:42:56.497595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 20874. [D 20:42:56.497617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 20875. [D 20:42:56.497627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 20876. [D 20:42:56.497637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 20877. [D 20:42:56.497660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 20878. [D 20:42:56.497672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 20879. [D 20:42:56.497682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 20880. [D 20:42:56.497701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 20881. [D 20:42:56.497717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 20882. [D 20:42:56.497735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 20883. [D 20:42:56.497746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 20884. [D 20:42:56.497756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 20885. [D 20:42:56.497781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 20886. [D 20:42:56.497794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 20887. [D 20:42:56.497814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 20888. [D 20:42:56.497825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 20889. [D 20:42:56.497835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 20890. [D 20:42:56.497856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 20891. [D 20:42:56.497866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 20892. [D 20:42:56.497876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 20893. [D 20:42:56.497900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 20894. [D 20:42:56.497910] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 20895. [D 20:42:56.503326] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20895. [D 20:42:56.503347] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 40/70. [D 20:42:56.503413] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.503427] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.503435] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.510446] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.510460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.510468] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.510484] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4450 [D 20:42:56.510494] element 0: offset: 0x2aaaab233c10, size: 24 [D 20:42:56.510504] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 41/70. [D 20:42:56.514624] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4450 [D 20:42:56.514640] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 42/70. [D 20:42:56.514697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 20895. [D 20:42:56.514712] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.514771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 20896. [D 20:42:56.514776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.514809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 20897. [D 20:42:56.514823] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.514836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 20898. [D 20:42:56.514859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 20899. [D 20:42:56.514873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 20900. [D 20:42:56.514900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 20901. [D 20:42:56.514860] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4453 [D 20:42:56.514916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 20902. [D 20:42:56.514934] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:56.514941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 20903. [D 20:42:56.514955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 20904. [D 20:42:56.514965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 20905. [D 20:42:56.514975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 20906. [D 20:42:56.515002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 20907. [D 20:42:56.515016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 20908. [D 20:42:56.515026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 20909. [D 20:42:56.515036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 20910. [D 20:42:56.515051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 20911. [D 20:42:56.515062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 20912. [D 20:42:56.515072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 20913. [D 20:42:56.515097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 20914. [D 20:42:56.515108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 20915. [D 20:42:56.515118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 20916. [D 20:42:56.515133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 20917. [D 20:42:56.515155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 20918. [D 20:42:56.515166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 20919. [D 20:42:56.515182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 20920. [D 20:42:56.515206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 20921. [D 20:42:56.515219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 20922. [D 20:42:56.515241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 20923. [D 20:42:56.515254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 20924. [D 20:42:56.515275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 20925. [D 20:42:56.515287] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 20926. [D 20:42:56.515317] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 43/70. [D 20:42:56.523620] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20926. [D 20:42:56.523648] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 44/70. [D 20:42:56.523752] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.523766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.523774] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.528202] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4453 [D 20:42:56.528219] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 45/70. [D 20:42:56.533199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 20926. [D 20:42:56.533266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 20927. [D 20:42:56.533278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 20928. [D 20:42:56.533288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 20929. [D 20:42:56.533299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 20930. [D 20:42:56.533309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 20931. [D 20:42:56.533319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 20932. [D 20:42:56.533329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 20933. [D 20:42:56.533339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 20934. [D 20:42:56.533349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 20935. [D 20:42:56.533359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 20936. [D 20:42:56.533375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 20937. [D 20:42:56.533385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 20938. [D 20:42:56.533395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 20939. [D 20:42:56.533405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 20940. [D 20:42:56.533438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 20941. [D 20:42:56.533451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 20942. [D 20:42:56.533460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 20943. [D 20:42:56.533470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 20944. [D 20:42:56.533486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 20945. [D 20:42:56.533496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 20946. [D 20:42:56.533535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 20947. [D 20:42:56.533546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 20948. [D 20:42:56.533556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 20949. [D 20:42:56.533569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 20950. [D 20:42:56.533579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 20951. [D 20:42:56.533589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 20952. [D 20:42:56.533605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 20953. [D 20:42:56.533614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 20954. [D 20:42:56.533624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 20955. [D 20:42:56.533659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 20956. [D 20:42:56.533672] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 20957. [D 20:42:56.533755] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.533770] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.533779] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.533794] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4456 [D 20:42:56.533804] element 0: offset: 0x2aaaab2339c0, size: 24 [D 20:42:56.533816] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 46/70. [D 20:42:56.540224] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4444 [D 20:42:56.540241] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 47/70. [D 20:42:56.540688] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 20957. [D 20:42:56.540747] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 48/70. [D 20:42:56.540764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 20957. [D 20:42:56.540775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 20958. [D 20:42:56.540786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 20959. [D 20:42:56.540801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 20960. [D 20:42:56.540812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 20961. [D 20:42:56.540821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 20962. [D 20:42:56.540832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 20963. [D 20:42:56.540841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 20964. [D 20:42:56.540851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 20965. [D 20:42:56.540861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 20966. [D 20:42:56.540878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 20967. [D 20:42:56.540888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 20968. [D 20:42:56.540897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 20969. [D 20:42:56.540908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 20970. [D 20:42:56.540917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 20971. [D 20:42:56.540927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 20972. [D 20:42:56.540937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 20973. [D 20:42:56.540954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 20974. [D 20:42:56.540964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 20975. [D 20:42:56.540974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 20976. [D 20:42:56.540984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 20977. [D 20:42:56.541035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 20978. [D 20:42:56.541045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 20979. [D 20:42:56.541055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 20980. [D 20:42:56.541071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 20981. [D 20:42:56.541081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 20982. [D 20:42:56.541090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 20983. [D 20:42:56.541106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 20984. [D 20:42:56.541127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 20985. [D 20:42:56.541137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 20986. [D 20:42:56.541148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 20987. [D 20:42:56.541158] openib_post_sr_rdmaw: ibv_post_send wr_id 655e40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 20988. [D 20:42:56.541210] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.541225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.541233] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.543834] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4456 [D 20:42:56.543851] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 49/70. [D 20:42:56.546512] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.546526] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.546535] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.546551] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4459 [D 20:42:56.546560] element 0: offset: 0x2aaaab2338b0, size: 24 [D 20:42:56.546570] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 50/70. [D 20:42:56.550882] openib_check_cq: completed rdma wr_id 655e40, nic_wr_credit 20988. [D 20:42:56.550938] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 51/70. [D 20:42:56.550954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 20988. [D 20:42:56.550966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 20989. [D 20:42:56.550976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 20990. [D 20:42:56.550986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 20991. [D 20:42:56.551002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 20992. [D 20:42:56.551012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 20993. [D 20:42:56.551022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 20994. [D 20:42:56.551039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 20995. [D 20:42:56.551048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 20996. [D 20:42:56.551058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 20997. [D 20:42:56.551074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 20998. [D 20:42:56.551084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 20999. [D 20:42:56.551093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 21000. [D 20:42:56.551109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 21001. [D 20:42:56.551119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21002. [D 20:42:56.551129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21003. [D 20:42:56.551169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21004. [D 20:42:56.551179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 21005. [D 20:42:56.551192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 21006. [D 20:42:56.551206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 21007. [D 20:42:56.551216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 21008. [D 20:42:56.551226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 21009. [D 20:42:56.551241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21010. [D 20:42:56.551251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21011. [D 20:42:56.551261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21012. [D 20:42:56.551276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 21013. [D 20:42:56.551286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 21014. [D 20:42:56.551296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 21015. [D 20:42:56.551328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 21016. [D 20:42:56.551347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 21017. [D 20:42:56.551359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21018. [D 20:42:56.551368] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21019. [D 20:42:56.551419] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.551434] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.551442] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.555649] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4459 [D 20:42:56.555667] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 52/70. [D 20:42:56.556619] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.556632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.556641] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.556656] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4462 [D 20:42:56.556665] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:56.556676] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 53/70. [D 20:42:56.557589] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 21019. [D 20:42:56.557644] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 54/70. [D 20:42:56.557659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 21019. [D 20:42:56.557696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 21020. [D 20:42:56.557709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 21021. [D 20:42:56.557719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 21022. [D 20:42:56.557730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 21023. [D 20:42:56.557740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 21024. [D 20:42:56.557750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 21025. [D 20:42:56.557760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 21026. [D 20:42:56.557770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 21027. [D 20:42:56.557780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 21028. [D 20:42:56.557790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 21029. [D 20:42:56.557825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 21030. [D 20:42:56.557836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 21031. [D 20:42:56.557846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 21032. [D 20:42:56.557855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 21033. [D 20:42:56.557871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 21034. [D 20:42:56.557881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 21035. [D 20:42:56.557902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 21036. [D 20:42:56.557912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 21037. [D 20:42:56.557922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 21038. [D 20:42:56.557931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 21039. [D 20:42:56.557949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 21040. [D 20:42:56.557980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 21041. [D 20:42:56.557991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 21042. [D 20:42:56.558000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 21043. [D 20:42:56.558031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 21044. [D 20:42:56.558045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 21045. [D 20:42:56.558056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 21046. [D 20:42:56.558066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 21047. [D 20:42:56.558081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 21048. [D 20:42:56.558091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 21049. [D 20:42:56.558114] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 21050. [D 20:42:56.558157] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.558173] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.558181] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.564853] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.564867] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.564876] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.564891] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4465 [D 20:42:56.564901] element 0: offset: 0x2aaaab23a5d0, size: 24 [D 20:42:56.564911] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 55/70. [D 20:42:56.568758] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 21050. [D 20:42:56.568815] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 56/70. [D 20:42:56.568891] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.568906] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.568915] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.572953] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4465 [D 20:42:56.572970] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 57/70. [D 20:42:56.573893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 21050. [D 20:42:56.573945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 21051. [D 20:42:56.573956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 21052. [D 20:42:56.573967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 21053. [D 20:42:56.573977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 21054. [D 20:42:56.573988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 21055. [D 20:42:56.573998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 21056. [D 20:42:56.574008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 21057. [D 20:42:56.574023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 21058. [D 20:42:56.574033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 21059. [D 20:42:56.574043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 21060. [D 20:42:56.574053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 21061. [D 20:42:56.574063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 21062. [D 20:42:56.574073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 21063. [D 20:42:56.574083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21064. [D 20:42:56.574099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21065. [D 20:42:56.574109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21066. [D 20:42:56.574118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 21067. [D 20:42:56.574129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 21068. [D 20:42:56.574140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 21069. [D 20:42:56.574149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 21070. [D 20:42:56.574211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 21071. [D 20:42:56.574223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21072. [D 20:42:56.574233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21073. [D 20:42:56.574247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21074. [D 20:42:56.574257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 21075. [D 20:42:56.574267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 21076. [D 20:42:56.574280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 21077. [D 20:42:56.574290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 21078. [D 20:42:56.574300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 21079. [D 20:42:56.574310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21080. [D 20:42:56.574320] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21081. [D 20:42:56.574395] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.574410] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.574418] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.574435] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4468 [D 20:42:56.574444] element 0: offset: 0x61f310, size: 24 [D 20:42:56.574454] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 58/70. [D 20:42:56.585716] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 21081. [D 20:42:56.585740] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 59/70. [D 20:42:56.585809] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.585824] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.585832] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.589914] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4468 [D 20:42:56.589931] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 60/70. [D 20:42:56.595982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 21081. [D 20:42:56.596039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 21082. [D 20:42:56.596050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 21083. [D 20:42:56.596061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 21084. [D 20:42:56.596071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 21085. [D 20:42:56.596082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 21086. [D 20:42:56.596092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 21087. [D 20:42:56.596102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 21088. [D 20:42:56.596112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 21089. [D 20:42:56.596122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 21090. [D 20:42:56.596132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 21091. [D 20:42:56.596148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 21092. [D 20:42:56.596158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 21093. [D 20:42:56.596168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 21094. [D 20:42:56.596178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 21095. [D 20:42:56.596189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 21096. [D 20:42:56.596199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 21097. [D 20:42:56.596214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 21098. [D 20:42:56.596225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 21099. [D 20:42:56.596234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 21100. [D 20:42:56.596244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 21101. [D 20:42:56.596295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 21102. [D 20:42:56.596308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 21103. [D 20:42:56.596317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 21104. [D 20:42:56.596328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 21105. [D 20:42:56.596338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 21106. [D 20:42:56.596347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 21107. [D 20:42:56.596358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 21108. [D 20:42:56.596375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 21109. [D 20:42:56.596385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 21110. [D 20:42:56.596395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 21111. [D 20:42:56.596424] openib_post_sr_rdmaw: ibv_post_send wr_id 691f50 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 21112. [D 20:42:56.602218] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4462 [D 20:42:56.602236] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 0/70. [D 20:42:56.607935] openib_check_cq: completed rdma wr_id 691f50, nic_wr_credit 21112. [D 20:42:56.608005] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 1/70. [D 20:42:56.608022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21112. [D 20:42:56.608033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21113. [D 20:42:56.608044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21114. [D 20:42:56.608054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21115. [D 20:42:56.608067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21116. [D 20:42:56.608077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21117. [D 20:42:56.608087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21118. [D 20:42:56.608103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21119. [D 20:42:56.608112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21120. [D 20:42:56.608122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21121. [D 20:42:56.608138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21122. [D 20:42:56.608148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21123. [D 20:42:56.608157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21124. [D 20:42:56.608173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21125. [D 20:42:56.608183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21126. [D 20:42:56.608192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21127. [D 20:42:56.608208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21128. [D 20:42:56.608218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21129. [D 20:42:56.608227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21130. [D 20:42:56.608267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21131. [D 20:42:56.608280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21132. [D 20:42:56.608289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21133. [D 20:42:56.608300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21134. [D 20:42:56.608310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21135. [D 20:42:56.608320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21136. [D 20:42:56.608335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21137. [D 20:42:56.608345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21138. [D 20:42:56.608355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21139. [D 20:42:56.608365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21140. [D 20:42:56.608395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21141. [D 20:42:56.608405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21142. [D 20:42:56.608419] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21143. [D 20:42:56.608479] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.608494] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.608502] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.614102] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 21143. [D 20:42:56.614128] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 2/70. [D 20:42:56.614194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.614208] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.614217] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.614237] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.614246] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.614254] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.614270] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4471 [D 20:42:56.614280] element 0: offset: 0x61f310, size: 24 [D 20:42:56.614290] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 3/70. [D 20:42:56.618649] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4471 [D 20:42:56.618665] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 4/70. [D 20:42:56.619892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 21143. [D 20:42:56.619952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 21144. [D 20:42:56.619964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 21145. [D 20:42:56.619974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 21146. [D 20:42:56.619989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 21147. [D 20:42:56.619998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 21148. [D 20:42:56.620009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 21149. [D 20:42:56.620022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 21150. [D 20:42:56.620032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 21151. [D 20:42:56.620042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 21152. [D 20:42:56.620052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 21153. [D 20:42:56.620062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 21154. [D 20:42:56.620072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 21155. [D 20:42:56.620082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 21156. [D 20:42:56.620135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21157. [D 20:42:56.620146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21158. [D 20:42:56.620156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21159. [D 20:42:56.620166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 21160. [D 20:42:56.620176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 21161. [D 20:42:56.620186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 21162. [D 20:42:56.620204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 21163. [D 20:42:56.620232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 21164. [D 20:42:56.620246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21165. [D 20:42:56.620256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21166. [D 20:42:56.620273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21167. [D 20:42:56.620284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 21168. [D 20:42:56.620294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 21169. [D 20:42:56.620304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 21170. [D 20:42:56.620315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 21171. [D 20:42:56.620337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 21172. [D 20:42:56.620352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21173. [D 20:42:56.620363] openib_post_sr_rdmaw: ibv_post_send wr_id 61e4a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21174. [D 20:42:56.620421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.620436] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.620444] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.620460] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4474 [D 20:42:56.620470] element 0: offset: 0x655b90, size: 24 [D 20:42:56.620480] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 5/70. [D 20:42:56.628366] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4446 [D 20:42:56.628382] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 6/70. [D 20:42:56.631517] openib_check_cq: completed rdma wr_id 61e4a0, nic_wr_credit 21174. [D 20:42:56.631573] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 7/70. [D 20:42:56.631590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 21174. [D 20:42:56.631601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 21175. [D 20:42:56.631613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 21176. [D 20:42:56.631623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 21177. [D 20:42:56.631638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 21178. [D 20:42:56.631648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 21179. [D 20:42:56.631657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 21180. [D 20:42:56.631673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 21181. [D 20:42:56.631683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 21182. [D 20:42:56.631693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 21183. [D 20:42:56.631709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 21184. [D 20:42:56.631718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 21185. [D 20:42:56.631728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 21186. [D 20:42:56.631744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 21187. [D 20:42:56.631754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 21188. [D 20:42:56.631763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 21189. [D 20:42:56.631779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 21190. [D 20:42:56.631789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 21191. [D 20:42:56.631798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 21192. [D 20:42:56.631814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 21193. [D 20:42:56.631824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 21194. [D 20:42:56.631876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 21195. [D 20:42:56.631887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 21196. [D 20:42:56.631896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 21197. [D 20:42:56.631907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 21198. [D 20:42:56.631917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 21199. [D 20:42:56.631927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 21200. [D 20:42:56.631937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 21201. [D 20:42:56.631948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 21202. [D 20:42:56.631975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 21203. [D 20:42:56.631990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 21204. [D 20:42:56.632000] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 21205. [D 20:42:56.632063] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.632077] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.632086] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.637535] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 21205. [D 20:42:56.637553] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 8/70. [D 20:42:56.637618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.637632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.637641] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.643736] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.643750] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.643758] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.643774] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4477 [D 20:42:56.643783] element 0: offset: 0x63c550, size: 24 [D 20:42:56.643793] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 9/70. [D 20:42:56.648139] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4477 [D 20:42:56.648155] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 10/70. [D 20:42:56.648264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 21205. [D 20:42:56.648334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 21206. [D 20:42:56.648346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 21207. [D 20:42:56.648356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 21208. [D 20:42:56.648370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 21209. [D 20:42:56.648380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 21210. [D 20:42:56.648389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 21211. [D 20:42:56.648403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 21212. [D 20:42:56.648413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 21213. [D 20:42:56.648423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 21214. [D 20:42:56.648438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 21215. [D 20:42:56.648448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 21216. [D 20:42:56.648458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 21217. [D 20:42:56.648474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 21218. [D 20:42:56.648483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21219. [D 20:42:56.648493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21220. [D 20:42:56.648533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21221. [D 20:42:56.648546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 21222. [D 20:42:56.648556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 21223. [D 20:42:56.648566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 21224. [D 20:42:56.648582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 21225. [D 20:42:56.648592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 21226. [D 20:42:56.648601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21227. [D 20:42:56.648617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21228. [D 20:42:56.648627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21229. [D 20:42:56.648663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 21230. [D 20:42:56.648674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 21231. [D 20:42:56.648684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 21232. [D 20:42:56.648694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 21233. [D 20:42:56.648704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 21234. [D 20:42:56.648715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21235. [D 20:42:56.648724] openib_post_sr_rdmaw: ibv_post_send wr_id 61e4a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21236. [D 20:42:56.659605] openib_check_cq: completed rdma wr_id 61e4a0, nic_wr_credit 21236. [D 20:42:56.659626] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 11/70. [D 20:42:56.659690] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.659704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.659713] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.666295] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.666309] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.666317] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.666334] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4480 [D 20:42:56.666343] element 0: offset: 0x5b0030, size: 24 [D 20:42:56.666353] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 12/70. [D 20:42:56.670792] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4480 [D 20:42:56.670809] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 13/70. [D 20:42:56.670959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 21236. [D 20:42:56.671028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 21237. [D 20:42:56.671040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 21238. [D 20:42:56.671050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 21239. [D 20:42:56.671064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 21240. [D 20:42:56.671074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 21241. [D 20:42:56.671083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 21242. [D 20:42:56.671097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 21243. [D 20:42:56.671107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 21244. [D 20:42:56.671117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 21245. [D 20:42:56.671127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 21246. [D 20:42:56.671137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 21247. [D 20:42:56.671147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 21248. [D 20:42:56.671156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 21249. [D 20:42:56.671173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21250. [D 20:42:56.671182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21251. [D 20:42:56.671192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21252. [D 20:42:56.671203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 21253. [D 20:42:56.671223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 21254. [D 20:42:56.671233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 21255. [D 20:42:56.671243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 21256. [D 20:42:56.671260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 21257. [D 20:42:56.671270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21258. [D 20:42:56.671280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21259. [D 20:42:56.671290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21260. [D 20:42:56.671300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 21261. [D 20:42:56.671310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 21262. [D 20:42:56.671319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 21263. [D 20:42:56.671380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 21264. [D 20:42:56.671391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 21265. [D 20:42:56.671401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21266. [D 20:42:56.671412] openib_post_sr_rdmaw: ibv_post_send wr_id 6256a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21267. [D 20:42:56.681932] openib_check_cq: completed rdma wr_id 6256a0, nic_wr_credit 21267. [D 20:42:56.682015] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 14/70. [D 20:42:56.682082] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.682098] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.682106] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.688675] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.688688] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.688697] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.688716] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4483 [D 20:42:56.688725] element 0: offset: 0x61f310, size: 24 [D 20:42:56.688736] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 15/70. [D 20:42:56.691980] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4474 [D 20:42:56.691997] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 16/70. [D 20:42:56.692057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21267. [D 20:42:56.692118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21268. [D 20:42:56.692130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21269. [D 20:42:56.692148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21270. [D 20:42:56.692160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21271. [D 20:42:56.692170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21272. [D 20:42:56.692186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21273. [D 20:42:56.692196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21274. [D 20:42:56.692205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21275. [D 20:42:56.692221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21276. [D 20:42:56.692231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21277. [D 20:42:56.692274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21278. [D 20:42:56.692287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21279. [D 20:42:56.692297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21280. [D 20:42:56.692327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21281. [D 20:42:56.692338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21282. [D 20:42:56.692353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21283. [D 20:42:56.692363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21284. [D 20:42:56.692387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21285. [D 20:42:56.692397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21286. [D 20:42:56.692408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21287. [D 20:42:56.692418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21288. [D 20:42:56.692428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21289. [D 20:42:56.692452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21290. [D 20:42:56.692463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21291. [D 20:42:56.692472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21292. [D 20:42:56.692486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21293. [D 20:42:56.692509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21294. [D 20:42:56.692521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21295. [D 20:42:56.692531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21296. [D 20:42:56.692541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21297. [D 20:42:56.692556] openib_post_sr_rdmaw: ibv_post_send wr_id 6256a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21298. [D 20:42:56.696205] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4483 [D 20:42:56.696223] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 17/70. [D 20:42:56.702815] openib_check_cq: completed rdma wr_id 6256a0, nic_wr_credit 21298. [D 20:42:56.702870] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 18/70. [D 20:42:56.702885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 21298. [D 20:42:56.702902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 21299. [D 20:42:56.702913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 21300. [D 20:42:56.702923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 21301. [D 20:42:56.702937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 21302. [D 20:42:56.702947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 21303. [D 20:42:56.702956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 21304. [D 20:42:56.702972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 21305. [D 20:42:56.703013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 21306. [D 20:42:56.703022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 21307. [D 20:42:56.703035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 21308. [D 20:42:56.703045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 21309. [D 20:42:56.703072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 21310. [D 20:42:56.703082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 21311. [D 20:42:56.703092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21312. [D 20:42:56.703103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21313. [D 20:42:56.703112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21314. [D 20:42:56.703123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 21315. [D 20:42:56.703133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 21316. [D 20:42:56.703143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 21317. [D 20:42:56.703152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 21318. [D 20:42:56.703162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 21319. [D 20:42:56.703182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21320. [D 20:42:56.703191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21321. [D 20:42:56.703218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21322. [D 20:42:56.703229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 21323. [D 20:42:56.703239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 21324. [D 20:42:56.703249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 21325. [D 20:42:56.703259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 21326. [D 20:42:56.703269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 21327. [D 20:42:56.703278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21328. [D 20:42:56.703296] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21329. [D 20:42:56.703371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.703386] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.703394] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.709388] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.709402] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.709410] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.709426] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4486 [D 20:42:56.709436] element 0: offset: 0x67efc0, size: 24 [D 20:42:56.709446] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 19/70. [D 20:42:56.709715] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 21329. [D 20:42:56.709734] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 20/70. [D 20:42:56.709797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.709812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.709821] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.716546] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.716559] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.716568] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.716583] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4489 [D 20:42:56.716592] element 0: offset: 0x655b90, size: 24 [D 20:42:56.716602] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 21/70. [D 20:42:56.720976] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4489 [D 20:42:56.720992] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 22/70. [D 20:42:56.721173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 21329. [D 20:42:56.721240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 21330. [D 20:42:56.721252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 21331. [D 20:42:56.721263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 21332. [D 20:42:56.721277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 21333. [D 20:42:56.721287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 21334. [D 20:42:56.721297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 21335. [D 20:42:56.721311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 21336. [D 20:42:56.721321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 21337. [D 20:42:56.721330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 21338. [D 20:42:56.721341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 21339. [D 20:42:56.721351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 21340. [D 20:42:56.721361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 21341. [D 20:42:56.721370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 21342. [D 20:42:56.721402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 21343. [D 20:42:56.721412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 21344. [D 20:42:56.721424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 21345. [D 20:42:56.721434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 21346. [D 20:42:56.721444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 21347. [D 20:42:56.721457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 21348. [D 20:42:56.721567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 21349. [D 20:42:56.721580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 21350. [D 20:42:56.721608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 21351. [D 20:42:56.721619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 21352. [D 20:42:56.721629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 21353. [D 20:42:56.721639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 21354. [D 20:42:56.721655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 21355. [D 20:42:56.721665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 21356. [D 20:42:56.721674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 21357. [D 20:42:56.721690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 21358. [D 20:42:56.721700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 21359. [D 20:42:56.721709] openib_post_sr_rdmaw: ibv_post_send wr_id 6256a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 21360. [D 20:42:56.721757] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.721772] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.721780] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.721796] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4492 [D 20:42:56.721806] element 0: offset: 0x6151c0, size: 24 [D 20:42:56.721816] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 23/70. [D 20:42:56.727811] openib_check_cq: completed rdma wr_id 6256a0, nic_wr_credit 21360. [D 20:42:56.727847] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 24/70. [D 20:42:56.727924] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.727939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.727947] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.732369] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4492 [D 20:42:56.732386] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 25/70. [D 20:42:56.732531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21360. [D 20:42:56.732593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21361. [D 20:42:56.732604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21362. [D 20:42:56.732615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21363. [D 20:42:56.732629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21364. [D 20:42:56.732639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21365. [D 20:42:56.732649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21366. [D 20:42:56.732663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21367. [D 20:42:56.732672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21368. [D 20:42:56.732682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21369. [D 20:42:56.732698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21370. [D 20:42:56.732708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21371. [D 20:42:56.732717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21372. [D 20:42:56.732733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21373. [D 20:42:56.732743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21374. [D 20:42:56.732753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21375. [D 20:42:56.732769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21376. [D 20:42:56.732779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21377. [D 20:42:56.732789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21378. [D 20:42:56.732851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21379. [D 20:42:56.732861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21380. [D 20:42:56.733042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21381. [D 20:42:56.733054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21382. [D 20:42:56.733064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21383. [D 20:42:56.733075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21384. [D 20:42:56.733085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21385. [D 20:42:56.733095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21386. [D 20:42:56.733106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21387. [D 20:42:56.733115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21388. [D 20:42:56.733125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21389. [D 20:42:56.733135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21390. [D 20:42:56.733146] openib_post_sr_rdmaw: ibv_post_send wr_id 64dc60 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21391. [D 20:42:56.744238] openib_check_cq: completed rdma wr_id 64dc60, nic_wr_credit 21391. [D 20:42:56.744258] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 26/70. [D 20:42:56.744362] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.744378] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.744387] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.756587] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.756600] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.756609] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.756625] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4495 [D 20:42:56.756634] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:56.756644] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 27/70. [D 20:42:56.761160] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4495 [D 20:42:56.761177] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 28/70. [D 20:42:56.761318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21391. [D 20:42:56.761387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21392. [D 20:42:56.761398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21393. [D 20:42:56.761409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21394. [D 20:42:56.761419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21395. [D 20:42:56.761429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21396. [D 20:42:56.761439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21397. [D 20:42:56.761449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21398. [D 20:42:56.761459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21399. [D 20:42:56.761469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21400. [D 20:42:56.761479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21401. [D 20:42:56.761495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21402. [D 20:42:56.761505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21403. [D 20:42:56.761515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21404. [D 20:42:56.761534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21405. [D 20:42:56.761543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21406. [D 20:42:56.761553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21407. [D 20:42:56.761612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21408. [D 20:42:56.761624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21409. [D 20:42:56.761634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21410. [D 20:42:56.761644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21411. [D 20:42:56.761654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21412. [D 20:42:56.761664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21413. [D 20:42:56.761765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21414. [D 20:42:56.761778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21415. [D 20:42:56.761788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21416. [D 20:42:56.761802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21417. [D 20:42:56.761812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21418. [D 20:42:56.761822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21419. [D 20:42:56.761836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21420. [D 20:42:56.761846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21421. [D 20:42:56.761855] openib_post_sr_rdmaw: ibv_post_send wr_id 6256a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21422. [D 20:42:56.768392] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4486 [D 20:42:56.768410] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 29/70. [D 20:42:56.772312] openib_check_cq: completed rdma wr_id 6256a0, nic_wr_credit 21422. [D 20:42:56.772380] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 30/70. [D 20:42:56.772396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 21422. [D 20:42:56.772407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 21423. [D 20:42:56.772418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 21424. [D 20:42:56.772427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 21425. [D 20:42:56.772441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 21426. [D 20:42:56.772451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 21427. [D 20:42:56.772461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 21428. [D 20:42:56.772476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 21429. [D 20:42:56.772486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 21430. [D 20:42:56.772496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 21431. [D 20:42:56.772511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 21432. [D 20:42:56.772521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 21433. [D 20:42:56.772531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 21434. [D 20:42:56.772547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 21435. [D 20:42:56.772556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 21436. [D 20:42:56.772566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 21437. [D 20:42:56.772576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 21438. [D 20:42:56.772586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 21439. [D 20:42:56.772596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 21440. [D 20:42:56.772606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 21441. [D 20:42:56.772666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 21442. [D 20:42:56.772677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 21443. [D 20:42:56.772687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 21444. [D 20:42:56.772697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 21445. [D 20:42:56.772707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 21446. [D 20:42:56.772717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 21447. [D 20:42:56.772733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 21448. [D 20:42:56.772759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 21449. [D 20:42:56.772770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 21450. [D 20:42:56.772781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 21451. [D 20:42:56.772791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 21452. [D 20:42:56.772801] openib_post_sr_rdmaw: ibv_post_send wr_id 64dc60 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 21453. [D 20:42:56.772844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.772859] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.772867] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.778320] openib_check_cq: completed rdma wr_id 64dc60, nic_wr_credit 21453. [D 20:42:56.778339] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 31/70. [D 20:42:56.778386] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.778401] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.778409] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:56.784836] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.784849] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.784858] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:56.784873] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4499 [D 20:42:56.784883] element 0: offset: 0x2aaaab23a5d0, size: 24 [D 20:42:56.784893] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 32/70. [D 20:42:56.784995] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.785007] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.785016] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.785031] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4502 [D 20:42:56.785040] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:56.785051] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 33/70. [D 20:42:56.785567] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.785581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.785589] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.785604] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4504 [D 20:42:56.785613] element 0: offset: 0x2aaaab23d3f0, size: 24 [D 20:42:56.785623] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 34/70. [D 20:42:56.790168] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4502 [D 20:42:56.790185] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 35/70. [D 20:42:56.790247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21453. [D 20:42:56.790312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21454. [D 20:42:56.790324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21455. [D 20:42:56.790334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21456. [D 20:42:56.790344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21457. [D 20:42:56.790355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21458. [D 20:42:56.790364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21459. [D 20:42:56.790374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21460. [D 20:42:56.790384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21461. [D 20:42:56.790395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21462. [D 20:42:56.790404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21463. [D 20:42:56.790414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21464. [D 20:42:56.790424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21465. [D 20:42:56.790434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21466. [D 20:42:56.790444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21467. [D 20:42:56.790454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21468. [D 20:42:56.790507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21469. [D 20:42:56.790517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21470. [D 20:42:56.790528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21471. [D 20:42:56.790538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21472. [D 20:42:56.790556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21473. [D 20:42:56.790566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21474. [D 20:42:56.790576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21475. [D 20:42:56.790592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21476. [D 20:42:56.790602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21477. [D 20:42:56.790877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21478. [D 20:42:56.790888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21479. [D 20:42:56.790898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21480. [D 20:42:56.790908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21481. [D 20:42:56.790918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21482. [D 20:42:56.790929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21483. [D 20:42:56.790946] openib_post_sr_rdmaw: ibv_post_send wr_id 67eee0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21484. [D 20:42:56.795596] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4504 [D 20:42:56.795615] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 36/70. [D 20:42:56.799271] openib_check_cq: completed rdma wr_id 67eee0, nic_wr_credit 21484. [D 20:42:56.799339] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 37/70. [D 20:42:56.799356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 21484. [D 20:42:56.799368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 21485. [D 20:42:56.799378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 21486. [D 20:42:56.799398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 21487. [D 20:42:56.799410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 21488. [D 20:42:56.799420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 21489. [D 20:42:56.799430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 21490. [D 20:42:56.799440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 21491. [D 20:42:56.799450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 21492. [D 20:42:56.799507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 21493. [D 20:42:56.799529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 21494. [D 20:42:56.799540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 21495. [D 20:42:56.799550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 21496. [D 20:42:56.799560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 21497. [D 20:42:56.799576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 21498. [D 20:42:56.799586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 21499. [D 20:42:56.799596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 21500. [D 20:42:56.799628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 21501. [D 20:42:56.799639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 21502. [D 20:42:56.799651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 21503. [D 20:42:56.799660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 21504. [D 20:42:56.799670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 21505. [D 20:42:56.799684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 21506. [D 20:42:56.799694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 21507. [D 20:42:56.799704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 21508. [D 20:42:56.799738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 21509. [D 20:42:56.799749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 21510. [D 20:42:56.799772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 21511. [D 20:42:56.799783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 21512. [D 20:42:56.799793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 21513. [D 20:42:56.799803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 21514. [D 20:42:56.799813] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 21515. [D 20:42:56.799889] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.799904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.799912] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.811155] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 21515. [D 20:42:56.811225] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 38/70. [D 20:42:56.811329] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.811345] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.811354] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.826125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.826138] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.826147] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.826162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4508 [D 20:42:56.826172] element 0: offset: 0x2aaaab2339c0, size: 24 [D 20:42:56.826182] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 39/70. [D 20:42:56.826214] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.826223] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.826231] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.826245] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4510 [D 20:42:56.826254] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:56.826264] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 40/70. [D 20:42:56.830872] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4508 [D 20:42:56.830930] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 41/70. [D 20:42:56.831083] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4510 [D 20:42:56.831075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21515. [D 20:42:56.831156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21516. [D 20:42:56.831169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21517. [D 20:42:56.831184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21518. [D 20:42:56.831194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21519. [D 20:42:56.831204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21520. [D 20:42:56.831214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21521. [D 20:42:56.831229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21522. [D 20:42:56.831239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21523. [D 20:42:56.831249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21524. [D 20:42:56.831259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21525. [D 20:42:56.831269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21526. [D 20:42:56.831279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21527. [D 20:42:56.831288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21528. [D 20:42:56.831305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21529. [D 20:42:56.831315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21530. [D 20:42:56.831325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21531. [D 20:42:56.831335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21532. [D 20:42:56.831346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21533. [D 20:42:56.831414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21534. [D 20:42:56.831439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21535. [D 20:42:56.831449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21536. [D 20:42:56.831459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21537. [D 20:42:56.831469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21538. [D 20:42:56.831485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21539. [D 20:42:56.831495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21540. [D 20:42:56.831505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21541. [D 20:42:56.831521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21542. [D 20:42:56.831531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21543. [D 20:42:56.831541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21544. [D 20:42:56.831568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21545. [D 20:42:56.831578] openib_post_sr_rdmaw: ibv_post_send wr_id 64dc60 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21546. [D 20:42:56.831614] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 42/70. [D 20:42:56.835182] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4499 [D 20:42:56.835199] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 43/70. [D 20:42:56.842754] openib_check_cq: completed rdma wr_id 64dc60, nic_wr_credit 21546. [D 20:42:56.842775] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 44/70. [D 20:42:56.842806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 21546. [D 20:42:56.842818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 21547. [D 20:42:56.842827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 21548. [D 20:42:56.842841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 21549. [D 20:42:56.842851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 21550. [D 20:42:56.842861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 21551. [D 20:42:56.842874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 21552. [D 20:42:56.842884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 21553. [D 20:42:56.842894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 21554. [D 20:42:56.842910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 21555. [D 20:42:56.842920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 21556. [D 20:42:56.842929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 21557. [D 20:42:56.842959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 21558. [D 20:42:56.842971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 21559. [D 20:42:56.842985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 21560. [D 20:42:56.842994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 21561. [D 20:42:56.843018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 21562. [D 20:42:56.843028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 21563. [D 20:42:56.843040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 21564. [D 20:42:56.843055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 21565. [D 20:42:56.843065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 21566. [D 20:42:56.843090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 21567. [D 20:42:56.843100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 21568. [D 20:42:56.843110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 21569. [D 20:42:56.843124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 21570. [D 20:42:56.843151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 21571. [D 20:42:56.843164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 21572. [D 20:42:56.843173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 21573. [D 20:42:56.843183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 21574. [D 20:42:56.843200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 21575. [D 20:42:56.843222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 21576. [D 20:42:56.843236] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 21577. [D 20:42:56.843247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 21578. [D 20:42:56.843258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 21579. [D 20:42:56.843281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 21580. [D 20:42:56.843291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 21581. [D 20:42:56.843302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 21582. [D 20:42:56.843312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 21583. [D 20:42:56.843323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 21584. [D 20:42:56.843333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 21585. [D 20:42:56.843354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 21586. [D 20:42:56.843364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 21587. [D 20:42:56.843381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 21588. [D 20:42:56.843391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 21589. [D 20:42:56.843416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 21590. [D 20:42:56.843428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 21591. [D 20:42:56.843437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 21592. [D 20:42:56.843448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 21593. [D 20:42:56.843459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 21594. [D 20:42:56.843468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 21595. [D 20:42:56.843479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 21596. [D 20:42:56.843489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 21597. [D 20:42:56.843515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 21598. [D 20:42:56.843528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 21599. [D 20:42:56.843538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 21600. [D 20:42:56.843548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 21601. [D 20:42:56.843576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 21602. [D 20:42:56.843587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 21603. [D 20:42:56.843601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 21604. [D 20:42:56.843611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 21605. [D 20:42:56.843621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 21606. [D 20:42:56.843635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 21607. [D 20:42:56.843658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 21608. [D 20:42:56.843670] openib_post_sr_rdmaw: ibv_post_send wr_id 63d740 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 21609. [D 20:42:56.843749] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.843765] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.843773] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.849894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.849907] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.849916] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.849942] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4513 [D 20:42:56.849952] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:56.849963] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 45/70. [D 20:42:56.853815] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 21609. [D 20:42:56.853832] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 46/70. [D 20:42:56.862368] openib_check_cq: completed rdma wr_id 63d740, nic_wr_credit 21608. [D 20:42:56.862387] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 47/70. [D 20:42:56.862427] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.862441] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.862450] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.862517] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.862527] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.862535] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.866915] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4513 [D 20:42:56.866932] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 48/70. [D 20:42:56.868018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21608. [D 20:42:56.868078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21609. [D 20:42:56.868089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21610. [D 20:42:56.868099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21611. [D 20:42:56.868110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21612. [D 20:42:56.868120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21613. [D 20:42:56.868130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21614. [D 20:42:56.868141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21615. [D 20:42:56.868150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21616. [D 20:42:56.868160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21617. [D 20:42:56.868170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21618. [D 20:42:56.868188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21619. [D 20:42:56.868198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21620. [D 20:42:56.868207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21621. [D 20:42:56.868260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21622. [D 20:42:56.868270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21623. [D 20:42:56.868281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21624. [D 20:42:56.868314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21625. [D 20:42:56.868325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21626. [D 20:42:56.868334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21627. [D 20:42:56.868345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21628. [D 20:42:56.868360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21629. [D 20:42:56.868370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21630. [D 20:42:56.868380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21631. [D 20:42:56.868396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21632. [D 20:42:56.868406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21633. [D 20:42:56.868416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21634. [D 20:42:56.868443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21635. [D 20:42:56.868453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21636. [D 20:42:56.868467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21637. [D 20:42:56.868477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21638. [D 20:42:56.868487] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21639. [D 20:42:56.873964] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 21639. [D 20:42:56.873982] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 49/70. [D 20:42:56.874047] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.874062] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.874070] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:56.880300] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.880313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.880322] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:56.880338] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4517 [D 20:42:56.880348] element 0: offset: 0x64dd40, size: 24 [D 20:42:56.880358] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 50/70. [D 20:42:56.880383] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.880393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.880401] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.880415] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4518 [D 20:42:56.880424] element 0: offset: 0x655b90, size: 24 [D 20:42:56.880434] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 51/70. [D 20:42:56.885004] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.885042] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.885051] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.885080] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4523 [D 20:42:56.885091] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:56.885106] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 52/70. [D 20:42:56.885145] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.885155] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.885163] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:56.885177] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4525 [D 20:42:56.885187] element 0: offset: 0x2aaaab23d3f0, size: 24 [D 20:42:56.885197] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 53/70. [D 20:42:56.889751] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4525 [D 20:42:56.889811] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 54/70. [D 20:42:56.889942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 21639. [D 20:42:56.890013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 21640. [D 20:42:56.890023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 21641. [D 20:42:56.890033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 21642. [D 20:42:56.890043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 21643. [D 20:42:56.890053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 21644. [D 20:42:56.890063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 21645. [D 20:42:56.890073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 21646. [D 20:42:56.890083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 21647. [D 20:42:56.890092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 21648. [D 20:42:56.890102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 21649. [D 20:42:56.890112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 21650. [D 20:42:56.890122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 21651. [D 20:42:56.890131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 21652. [D 20:42:56.890141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 21653. [D 20:42:56.890151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 21654. [D 20:42:56.890161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 21655. [D 20:42:56.890170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 21656. [D 20:42:56.890180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 21657. [D 20:42:56.890190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 21658. [D 20:42:56.890200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 21659. [D 20:42:56.890210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 21660. [D 20:42:56.890219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 21661. [D 20:42:56.890229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 21662. [D 20:42:56.890239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 21663. [D 20:42:56.890248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 21664. [D 20:42:56.890258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 21665. [D 20:42:56.890268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 21666. [D 20:42:56.890278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 21667. [D 20:42:56.890289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 21668. [D 20:42:56.890299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 21669. [D 20:42:56.890309] openib_post_sr_rdmaw: ibv_post_send wr_id 61f790 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 21670. [D 20:42:56.890806] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4517 [D 20:42:56.890843] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 55/70. [D 20:42:56.897592] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4523 [D 20:42:56.897653] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 56/70. [D 20:42:56.901558] openib_check_cq: completed rdma wr_id 61f790, nic_wr_credit 21670. [D 20:42:56.901626] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 57/70. [D 20:42:56.901643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 21670. [D 20:42:56.901655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 21671. [D 20:42:56.901665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 21672. [D 20:42:56.901675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 21673. [D 20:42:56.901691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 21674. [D 20:42:56.901701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 21675. [D 20:42:56.901711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 21676. [D 20:42:56.901727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 21677. [D 20:42:56.901737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 21678. [D 20:42:56.901788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 21679. [D 20:42:56.901799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 21680. [D 20:42:56.901809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 21681. [D 20:42:56.901819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 21682. [D 20:42:56.901828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 21683. [D 20:42:56.901838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 21684. [D 20:42:56.901849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 21685. [D 20:42:56.901862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 21686. [D 20:42:56.901886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 21687. [D 20:42:56.901897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 21688. [D 20:42:56.901914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 21689. [D 20:42:56.901924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 21690. [D 20:42:56.901934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 21691. [D 20:42:56.901944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 21692. [D 20:42:56.901955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 21693. [D 20:42:56.901965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 21694. [D 20:42:56.901977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 21695. [D 20:42:56.901993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 21696. [D 20:42:56.902003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 21697. [D 20:42:56.902013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 21698. [D 20:42:56.902039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 21699. [D 20:42:56.902050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 21700. [D 20:42:56.902060] openib_post_sr_rdmaw: ibv_post_send wr_id 67eee0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 21701. [D 20:42:56.902073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21702. [D 20:42:56.902083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21703. [D 20:42:56.902099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21704. [D 20:42:56.902109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21705. [D 20:42:56.902139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21706. [D 20:42:56.902149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21707. [D 20:42:56.902159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21708. [D 20:42:56.902170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21709. [D 20:42:56.902190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21710. [D 20:42:56.902204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21711. [D 20:42:56.902214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21712. [D 20:42:56.902224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21713. [D 20:42:56.902234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21714. [D 20:42:56.902244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21715. [D 20:42:56.902270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21716. [D 20:42:56.902280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21717. [D 20:42:56.902289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21718. [D 20:42:56.902302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21719. [D 20:42:56.902330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21720. [D 20:42:56.902340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21721. [D 20:42:56.902350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21722. [D 20:42:56.902360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21723. [D 20:42:56.902389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21724. [D 20:42:56.902399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21725. [D 20:42:56.902409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21726. [D 20:42:56.902419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21727. [D 20:42:56.902429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21728. [D 20:42:56.902439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21729. [D 20:42:56.902448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21730. [D 20:42:56.902465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21731. [D 20:42:56.902474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21732. [D 20:42:56.902484] openib_post_sr_rdmaw: ibv_post_send wr_id 6256a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21733. [D 20:42:56.902562] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.902579] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.902588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:56.913349] openib_check_cq: completed rdma wr_id 67eee0, nic_wr_credit 21733. [D 20:42:56.913368] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 58/70. [D 20:42:56.925111] openib_check_cq: completed rdma wr_id 6256a0, nic_wr_credit 21732. [D 20:42:56.925134] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 59/70. [D 20:42:56.925178] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.925193] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.925201] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.925228] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.925237] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.925245] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.930457] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4518 [D 20:42:56.930475] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 60/70. [D 20:42:56.930647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 21732. [D 20:42:56.930714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 21733. [D 20:42:56.930725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 21734. [D 20:42:56.930736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 21735. [D 20:42:56.930750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 21736. [D 20:42:56.930760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 21737. [D 20:42:56.930770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 21738. [D 20:42:56.930785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 21739. [D 20:42:56.930795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 21740. [D 20:42:56.930805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 21741. [D 20:42:56.930820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 21742. [D 20:42:56.930830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 21743. [D 20:42:56.930840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 21744. [D 20:42:56.930894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 21745. [D 20:42:56.930906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 21746. [D 20:42:56.930916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 21747. [D 20:42:56.930940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 21748. [D 20:42:56.930950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 21749. [D 20:42:56.930960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 21750. [D 20:42:56.930971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 21751. [D 20:42:56.930981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 21752. [D 20:42:56.930991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 21753. [D 20:42:56.931016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 21754. [D 20:42:56.931032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 21755. [D 20:42:56.931042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 21756. [D 20:42:56.931052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 21757. [D 20:42:56.931076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 21758. [D 20:42:56.931087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 21759. [D 20:42:56.931101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 21760. [D 20:42:56.931112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 21761. [D 20:42:56.931122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 21762. [D 20:42:56.931149] openib_post_sr_rdmaw: ibv_post_send wr_id 657200 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 21763. [D 20:42:56.936696] openib_check_cq: completed rdma wr_id 657200, nic_wr_credit 21763. [D 20:42:56.936714] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 0/70. [D 20:42:56.936779] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.936794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.936802] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:56.950723] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.950737] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.950746] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:56.950772] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4530 [D 20:42:56.950782] element 0: offset: 0x2aaaab23a5d0, size: 24 [D 20:42:56.950793] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 1/70. [D 20:42:56.952963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.952978] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.952986] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.953002] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4532 [D 20:42:56.953011] element 0: offset: 0x2aaaab2339c0, size: 24 [D 20:42:56.953022] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 2/70. [D 20:42:56.955251] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.955297] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.955307] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.955336] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4533 [D 20:42:56.955346] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:56.955360] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 3/70. [D 20:42:56.955962] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4532 [D 20:42:56.955985] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 4/70. [D 20:42:56.956031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21763. [D 20:42:56.956049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21764. [D 20:42:56.956059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21765. [D 20:42:56.956070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21766. [D 20:42:56.956080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21767. [D 20:42:56.956090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21768. [D 20:42:56.956100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21769. [D 20:42:56.956116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21770. [D 20:42:56.956125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21771. [D 20:42:56.956135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21772. [D 20:42:56.956146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21773. [D 20:42:56.956156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21774. [D 20:42:56.956166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21775. [D 20:42:56.956176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21776. [D 20:42:56.956192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21777. [D 20:42:56.956202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21778. [D 20:42:56.956237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21779. [D 20:42:56.956247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21780. [D 20:42:56.956270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21781. [D 20:42:56.956286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21782. [D 20:42:56.956296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21783. [D 20:42:56.956306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21784. [D 20:42:56.956322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21785. [D 20:42:56.956332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21786. [D 20:42:56.956358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21787. [D 20:42:56.956368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21788. [D 20:42:56.956378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21789. [D 20:42:56.956393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21790. [D 20:42:56.956403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21791. [D 20:42:56.956412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21792. [D 20:42:56.956441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21793. [D 20:42:56.956460] openib_post_sr_rdmaw: ibv_post_send wr_id 657200 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21794. [D 20:42:56.961067] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4530 [D 20:42:56.961086] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 5/70. [D 20:42:56.962497] openib_check_cq: completed rdma wr_id 657200, nic_wr_credit 21794. [D 20:42:56.962553] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 6/70. [D 20:42:56.962569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 21794. [D 20:42:56.962580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 21795. [D 20:42:56.962592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 21796. [D 20:42:56.962602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 21797. [D 20:42:56.962612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 21798. [D 20:42:56.962622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 21799. [D 20:42:56.962632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 21800. [D 20:42:56.962647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 21801. [D 20:42:56.962657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 21802. [D 20:42:56.962667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 21803. [D 20:42:56.962677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 21804. [D 20:42:56.962688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 21805. [D 20:42:56.962719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 21806. [D 20:42:56.962730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 21807. [D 20:42:56.962740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 21808. [D 20:42:56.962750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 21809. [D 20:42:56.962773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 21810. [D 20:42:56.962783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 21811. [D 20:42:56.962794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 21812. [D 20:42:56.962803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 21813. [D 20:42:56.962813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 21814. [D 20:42:56.962842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 21815. [D 20:42:56.962852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 21816. [D 20:42:56.962863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 21817. [D 20:42:56.962873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 21818. [D 20:42:56.962883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 21819. [D 20:42:56.962897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 21820. [D 20:42:56.962920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 21821. [D 20:42:56.962930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 21822. [D 20:42:56.962943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 21823. [D 20:42:56.962953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 21824. [D 20:42:56.962963] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 21825. [D 20:42:56.963032] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.963048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.963057] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:56.974340] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 21825. [D 20:42:56.974371] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 7/70. [D 20:42:56.974471] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:56.974487] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.974496] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:56.994337] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.994351] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.994359] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:56.994381] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4538 [D 20:42:56.994391] element 0: offset: 0x2aaaab2339c0, size: 24 [D 20:42:56.994402] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 8/70. [D 20:42:56.994430] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:56.994439] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:56.994447] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:56.994461] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4540 [D 20:42:56.994470] element 0: offset: 0x2aaaab23d3f0, size: 24 [D 20:42:56.994480] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 9/70. [D 20:42:56.998904] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4538 [D 20:42:56.998921] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 10/70. [D 20:42:56.998984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 21825. [D 20:42:56.999093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 21826. [D 20:42:56.999105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 21827. [D 20:42:56.999116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 21828. [D 20:42:56.999130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 21829. [D 20:42:56.999140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 21830. [D 20:42:56.999150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 21831. [D 20:42:56.999164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 21832. [D 20:42:56.999174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 21833. [D 20:42:56.999184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 21834. [D 20:42:56.999200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 21835. [D 20:42:56.999210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 21836. [D 20:42:56.999219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 21837. [D 20:42:56.999252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 21838. [D 20:42:56.999263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 21839. [D 20:42:56.999273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 21840. [D 20:42:56.999283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 21841. [D 20:42:56.999300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 21842. [D 20:42:56.999309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 21843. [D 20:42:56.999319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 21844. [D 20:42:56.999335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 21845. [D 20:42:56.999345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 21846. [D 20:42:56.999356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 21847. [D 20:42:56.999365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 21848. [D 20:42:56.999375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 21849. [D 20:42:56.999409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 21850. [D 20:42:56.999418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 21851. [D 20:42:56.999437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 21852. [D 20:42:56.999447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 21853. [D 20:42:56.999480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 21854. [D 20:42:56.999497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 21855. [D 20:42:56.999507] openib_post_sr_rdmaw: ibv_post_send wr_id 657200 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 21856. [D 20:42:57.001395] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4540 [D 20:42:57.001407] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 11/70. [D 20:42:57.008841] openib_check_cq: completed rdma wr_id 657200, nic_wr_credit 21856. [D 20:42:57.008888] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 12/70. [D 20:42:57.008916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21856. [D 20:42:57.008928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21857. [D 20:42:57.008941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21858. [D 20:42:57.008954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21859. [D 20:42:57.008964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21860. [D 20:42:57.008976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21861. [D 20:42:57.008991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21862. [D 20:42:57.009001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21863. [D 20:42:57.009010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21864. [D 20:42:57.009056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21865. [D 20:42:57.009069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21866. [D 20:42:57.009079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21867. [D 20:42:57.009089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21868. [D 20:42:57.009100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21869. [D 20:42:57.009109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21870. [D 20:42:57.009142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21871. [D 20:42:57.009153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21872. [D 20:42:57.009163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21873. [D 20:42:57.009186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21874. [D 20:42:57.009197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21875. [D 20:42:57.009207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21876. [D 20:42:57.009217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21877. [D 20:42:57.009227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21878. [D 20:42:57.009238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21879. [D 20:42:57.009261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21880. [D 20:42:57.009276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21881. [D 20:42:57.009286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21882. [D 20:42:57.009295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21883. [D 20:42:57.009310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21884. [D 20:42:57.009320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21885. [D 20:42:57.009330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21886. [D 20:42:57.009364] openib_post_sr_rdmaw: ibv_post_send wr_id 63c4d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21887. [D 20:42:57.009406] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.009421] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.009430] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.012613] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4533 [D 20:42:57.012629] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 13/70. [D 20:42:57.020734] openib_check_cq: completed rdma wr_id 63c4d0, nic_wr_credit 21887. [D 20:42:57.020790] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 14/70. [D 20:42:57.020806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 21887. [D 20:42:57.020819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 21888. [D 20:42:57.020832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 21889. [D 20:42:57.020842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 21890. [D 20:42:57.020857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 21891. [D 20:42:57.020868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 21892. [D 20:42:57.020878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 21893. [D 20:42:57.020888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 21894. [D 20:42:57.020898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 21895. [D 20:42:57.020908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 21896. [D 20:42:57.020918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 21897. [D 20:42:57.020935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 21898. [D 20:42:57.020962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 21899. [D 20:42:57.020976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 21900. [D 20:42:57.020986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 21901. [D 20:42:57.020996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 21902. [D 20:42:57.021011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 21903. [D 20:42:57.021036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 21904. [D 20:42:57.021049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 21905. [D 20:42:57.021059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 21906. [D 20:42:57.021069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 21907. [D 20:42:57.021083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 21908. [D 20:42:57.021092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 21909. [D 20:42:57.021118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 21910. [D 20:42:57.021128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 21911. [D 20:42:57.021140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 21912. [D 20:42:57.021154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 21913. [D 20:42:57.021174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 21914. [D 20:42:57.021185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 21915. [D 20:42:57.021195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 21916. [D 20:42:57.021205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 21917. [D 20:42:57.021220] openib_post_sr_rdmaw: ibv_post_send wr_id 657200 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 21918. [D 20:42:57.021276] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.021292] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.021300] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.028407] openib_check_cq: completed rdma wr_id 657200, nic_wr_credit 21918. [D 20:42:57.028426] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 15/70. [D 20:42:57.028474] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.028489] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.028497] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:57.044544] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.044557] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.044566] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:57.044581] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4543 [D 20:42:57.044591] element 0: offset: 0x2aaaab23d3f0, size: 24 [D 20:42:57.044601] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 16/70. [D 20:42:57.046827] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.046841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.046849] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.046864] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4546 [D 20:42:57.046874] element 0: offset: 0x2aaaab2339c0, size: 24 [D 20:42:57.046884] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 17/70. [D 20:42:57.051024] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4546 [D 20:42:57.051041] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 18/70. [D 20:42:57.051106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 21918. [D 20:42:57.051175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 21919. [D 20:42:57.051187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 21920. [D 20:42:57.051197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 21921. [D 20:42:57.051209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 21922. [D 20:42:57.051219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 21923. [D 20:42:57.051229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 21924. [D 20:42:57.051240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 21925. [D 20:42:57.051250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 21926. [D 20:42:57.051260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 21927. [D 20:42:57.051275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 21928. [D 20:42:57.051304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 21929. [D 20:42:57.051317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 21930. [D 20:42:57.051327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 21931. [D 20:42:57.051337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 21932. [D 20:42:57.051350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 21933. [D 20:42:57.051360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 21934. [D 20:42:57.051370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 21935. [D 20:42:57.051406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 21936. [D 20:42:57.051418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 21937. [D 20:42:57.051451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 21938. [D 20:42:57.051462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 21939. [D 20:42:57.051472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 21940. [D 20:42:57.051482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 21941. [D 20:42:57.051492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 21942. [D 20:42:57.051502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 21943. [D 20:42:57.051528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 21944. [D 20:42:57.051540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 21945. [D 20:42:57.051563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 21946. [D 20:42:57.051573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 21947. [D 20:42:57.051584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 21948. [D 20:42:57.051595] openib_post_sr_rdmaw: ibv_post_send wr_id 657200 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 21949. [D 20:42:57.060055] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.060071] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.060080] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.060096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4549 [D 20:42:57.060106] element 0: offset: 0x2aaaab23d160, size: 24 [D 20:42:57.060116] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 19/70. [D 20:42:57.062315] openib_check_cq: completed rdma wr_id 657200, nic_wr_credit 21949. [D 20:42:57.062373] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 20/70. [D 20:42:57.062479] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.062495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.062504] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.066944] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4549 [D 20:42:57.066961] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 21/70. [D 20:42:57.067103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 21949. [D 20:42:57.067163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 21950. [D 20:42:57.067175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 21951. [D 20:42:57.067185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 21952. [D 20:42:57.067196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 21953. [D 20:42:57.067206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 21954. [D 20:42:57.067216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 21955. [D 20:42:57.067226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 21956. [D 20:42:57.067236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 21957. [D 20:42:57.067246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 21958. [D 20:42:57.067256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 21959. [D 20:42:57.067273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 21960. [D 20:42:57.067306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 21961. [D 20:42:57.067317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 21962. [D 20:42:57.067326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 21963. [D 20:42:57.067337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 21964. [D 20:42:57.067347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 21965. [D 20:42:57.067357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 21966. [D 20:42:57.067389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 21967. [D 20:42:57.067399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 21968. [D 20:42:57.067410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 21969. [D 20:42:57.067419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 21970. [D 20:42:57.067455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 21971. [D 20:42:57.067466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 21972. [D 20:42:57.067476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 21973. [D 20:42:57.067487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 21974. [D 20:42:57.067497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 21975. [D 20:42:57.067507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 21976. [D 20:42:57.067531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 21977. [D 20:42:57.067542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 21978. [D 20:42:57.067552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 21979. [D 20:42:57.067572] openib_post_sr_rdmaw: ibv_post_send wr_id 657200 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 21980. [D 20:42:57.074614] openib_check_cq: completed rdma wr_id 657200, nic_wr_credit 21980. [D 20:42:57.074649] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 22/70. [D 20:42:57.074711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.074725] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.074734] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.079076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.079090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.079098] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.079114] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4552 [D 20:42:57.079124] element 0: offset: 0x2aaaab216d10, size: 24 [D 20:42:57.079134] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 23/70. [D 20:42:57.083717] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4552 [D 20:42:57.083734] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 24/70. [D 20:42:57.087531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 21980. [D 20:42:57.087592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 21981. [D 20:42:57.087603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 21982. [D 20:42:57.087614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 21983. [D 20:42:57.087624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 21984. [D 20:42:57.087635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 21985. [D 20:42:57.087644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 21986. [D 20:42:57.087654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 21987. [D 20:42:57.087670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 21988. [D 20:42:57.087679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 21989. [D 20:42:57.087689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 21990. [D 20:42:57.087699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 21991. [D 20:42:57.087709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 21992. [D 20:42:57.087719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 21993. [D 20:42:57.087729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 21994. [D 20:42:57.087780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 21995. [D 20:42:57.087792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 21996. [D 20:42:57.087801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 21997. [D 20:42:57.087824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 21998. [D 20:42:57.087834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 21999. [D 20:42:57.087845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22000. [D 20:42:57.087855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22001. [D 20:42:57.087874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22002. [D 20:42:57.087891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22003. [D 20:42:57.087901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22004. [D 20:42:57.087911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22005. [D 20:42:57.087927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22006. [D 20:42:57.087953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22007. [D 20:42:57.087964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 22008. [D 20:42:57.087974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 22009. [D 20:42:57.087984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 22010. [D 20:42:57.087995] openib_post_sr_rdmaw: ibv_post_send wr_id 657200 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 22011. [D 20:42:57.090118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.090135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.090143] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.090159] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4555 [D 20:42:57.090168] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:42:57.090178] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 25/70. [D 20:42:57.099130] openib_check_cq: completed rdma wr_id 657200, nic_wr_credit 22011. [D 20:42:57.099167] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 26/70. [D 20:42:57.099241] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.099256] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.099264] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.109325] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4543 [D 20:42:57.109341] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 27/70. [D 20:42:57.109402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 22011. [D 20:42:57.109473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 22012. [D 20:42:57.109484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 22013. [D 20:42:57.109495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 22014. [D 20:42:57.109506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 22015. [D 20:42:57.109516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 22016. [D 20:42:57.109532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 22017. [D 20:42:57.109542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 22018. [D 20:42:57.109556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 22019. [D 20:42:57.109566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 22020. [D 20:42:57.109583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 22021. [D 20:42:57.109593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 22022. [D 20:42:57.109603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 22023. [D 20:42:57.109613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 22024. [D 20:42:57.109623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 22025. [D 20:42:57.109633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 22026. [D 20:42:57.109685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 22027. [D 20:42:57.109697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 22028. [D 20:42:57.109707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 22029. [D 20:42:57.109717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 22030. [D 20:42:57.109741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 22031. [D 20:42:57.109753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 22032. [D 20:42:57.109763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 22033. [D 20:42:57.109773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 22034. [D 20:42:57.109783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 22035. [D 20:42:57.109793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 22036. [D 20:42:57.109803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 22037. [D 20:42:57.109813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 22038. [D 20:42:57.109830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 22039. [D 20:42:57.109840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 22040. [D 20:42:57.109850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 22041. [D 20:42:57.109878] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 22042. [D 20:42:57.110481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.110497] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.110506] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.110522] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4558 [D 20:42:57.110532] element 0: offset: 0x64dd40, size: 24 [D 20:42:57.110542] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 28/70. [D 20:42:57.115361] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 22042. [D 20:42:57.115417] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 29/70. [D 20:42:57.115489] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.115504] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.115513] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.118507] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4555 [D 20:42:57.118525] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 30/70. [D 20:42:57.121150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 22042. [D 20:42:57.121215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 22043. [D 20:42:57.121227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 22044. [D 20:42:57.121237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 22045. [D 20:42:57.121248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 22046. [D 20:42:57.121258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 22047. [D 20:42:57.121268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 22048. [D 20:42:57.121278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 22049. [D 20:42:57.121288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 22050. [D 20:42:57.121298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 22051. [D 20:42:57.121308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 22052. [D 20:42:57.121323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 22053. [D 20:42:57.121333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 22054. [D 20:42:57.121343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 22055. [D 20:42:57.121353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 22056. [D 20:42:57.121363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 22057. [D 20:42:57.121375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 22058. [D 20:42:57.121385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 22059. [D 20:42:57.121395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 22060. [D 20:42:57.121445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 22061. [D 20:42:57.121455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 22062. [D 20:42:57.121465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 22063. [D 20:42:57.121476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 22064. [D 20:42:57.121500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 22065. [D 20:42:57.121510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 22066. [D 20:42:57.121521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 22067. [D 20:42:57.121530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 22068. [D 20:42:57.121541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 22069. [D 20:42:57.121575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 22070. [D 20:42:57.121586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 22071. [D 20:42:57.121599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 22072. [D 20:42:57.121618] openib_post_sr_rdmaw: ibv_post_send wr_id 6625c0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 22073. [D 20:42:57.123809] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.123825] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.123834] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.123850] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4560 [D 20:42:57.123860] element 0: offset: 0x61fad0, size: 24 [D 20:42:57.123869] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 31/70. [D 20:42:57.127536] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4558 [D 20:42:57.127553] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 32/70. [D 20:42:57.132894] openib_check_cq: completed rdma wr_id 6625c0, nic_wr_credit 22073. [D 20:42:57.132949] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 33/70. [D 20:42:57.132964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 22073. [D 20:42:57.132980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 22074. [D 20:42:57.132991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 22075. [D 20:42:57.133001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 22076. [D 20:42:57.133016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 22077. [D 20:42:57.133026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 22078. [D 20:42:57.133035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 22079. [D 20:42:57.133046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 22080. [D 20:42:57.133055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 22081. [D 20:42:57.133065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 22082. [D 20:42:57.133075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 22083. [D 20:42:57.133091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 22084. [D 20:42:57.133101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 22085. [D 20:42:57.133111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 22086. [D 20:42:57.133151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 22087. [D 20:42:57.133162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 22088. [D 20:42:57.133172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 22089. [D 20:42:57.133183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 22090. [D 20:42:57.133192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 22091. [D 20:42:57.133216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 22092. [D 20:42:57.133226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22093. [D 20:42:57.133236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22094. [D 20:42:57.133263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22095. [D 20:42:57.133274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22096. [D 20:42:57.133287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22097. [D 20:42:57.133302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22098. [D 20:42:57.133311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22099. [D 20:42:57.133334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22100. [D 20:42:57.133344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 22101. [D 20:42:57.133354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 22102. [D 20:42:57.133370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 22103. [D 20:42:57.133380] openib_post_sr_rdmaw: ibv_post_send wr_id 657110 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 22104. [D 20:42:57.133440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.133455] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.133463] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.144520] openib_check_cq: completed rdma wr_id 657110, nic_wr_credit 22104. [D 20:42:57.144593] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 34/70. [D 20:42:57.144654] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.144669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.144677] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.157716] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.157729] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.157737] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.157754] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4565 [D 20:42:57.157763] element 0: offset: 0x67efc0, size: 24 [D 20:42:57.157773] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 35/70. [D 20:42:57.157808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.157818] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.157826] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.157841] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4567 [D 20:42:57.157851] element 0: offset: 0x61ee20, size: 24 [D 20:42:57.157861] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 36/70. [D 20:42:57.160339] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4565 [D 20:42:57.160385] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 37/70. [D 20:42:57.160529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 22104. [D 20:42:57.160583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 22105. [D 20:42:57.160594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 22106. [D 20:42:57.160604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 22107. [D 20:42:57.160614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 22108. [D 20:42:57.160624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 22109. [D 20:42:57.160634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 22110. [D 20:42:57.160644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 22111. [D 20:42:57.160654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 22112. [D 20:42:57.160664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 22113. [D 20:42:57.160674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 22114. [D 20:42:57.160684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 22115. [D 20:42:57.160694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 22116. [D 20:42:57.160704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 22117. [D 20:42:57.160714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 22118. [D 20:42:57.160723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 22119. [D 20:42:57.160733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 22120. [D 20:42:57.160743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 22121. [D 20:42:57.160753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 22122. [D 20:42:57.160763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 22123. [D 20:42:57.160773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 22124. [D 20:42:57.160783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 22125. [D 20:42:57.160793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 22126. [D 20:42:57.160803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 22127. [D 20:42:57.160813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 22128. [D 20:42:57.160824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 22129. [D 20:42:57.160834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 22130. [D 20:42:57.160844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 22131. [D 20:42:57.160854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 22132. [D 20:42:57.160864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 22133. [D 20:42:57.160874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 22134. [D 20:42:57.160884] openib_post_sr_rdmaw: ibv_post_send wr_id 661c70 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 22135. [D 20:42:57.162839] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.162893] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.162902] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:57.162934] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4570 [D 20:42:57.162944] element 0: offset: 0x655b10, size: 24 [D 20:42:57.162958] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 38/70. [D 20:42:57.163257] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4567 [D 20:42:57.163275] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 39/70. [D 20:42:57.168299] openib_check_cq: completed rdma wr_id 661c70, nic_wr_credit 22135. [D 20:42:57.168326] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 40/70. [D 20:42:57.168346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 22135. [D 20:42:57.168357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 22136. [D 20:42:57.168371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 22137. [D 20:42:57.168381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 22138. [D 20:42:57.168392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 22139. [D 20:42:57.168402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 22140. [D 20:42:57.168412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 22141. [D 20:42:57.168422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 22142. [D 20:42:57.168438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 22143. [D 20:42:57.168448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 22144. [D 20:42:57.168457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 22145. [D 20:42:57.168467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 22146. [D 20:42:57.168477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 22147. [D 20:42:57.168489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 22148. [D 20:42:57.168499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 22149. [D 20:42:57.168509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 22150. [D 20:42:57.168519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 22151. [D 20:42:57.168529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 22152. [D 20:42:57.168540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 22153. [D 20:42:57.168550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 22154. [D 20:42:57.168560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22155. [D 20:42:57.168570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22156. [D 20:42:57.168599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22157. [D 20:42:57.168610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22158. [D 20:42:57.168620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22159. [D 20:42:57.168630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22160. [D 20:42:57.168645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22161. [D 20:42:57.168673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22162. [D 20:42:57.168683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 22163. [D 20:42:57.168694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 22164. [D 20:42:57.168704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 22165. [D 20:42:57.168726] openib_post_sr_rdmaw: ibv_post_send wr_id 6506a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 22166. [D 20:42:57.168776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.168792] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.168801] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:57.171225] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4560 [D 20:42:57.171281] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 41/70. [D 20:42:57.171483] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4570 [D 20:42:57.171500] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 42/70. [D 20:42:57.179946] openib_check_cq: completed rdma wr_id 6506a0, nic_wr_credit 22166. [D 20:42:57.179965] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 43/70. [D 20:42:57.180077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.180093] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.180102] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.181907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 22166. [D 20:42:57.181923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 22167. [D 20:42:57.181934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 22168. [D 20:42:57.181944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 22169. [D 20:42:57.181954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 22170. [D 20:42:57.181969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 22171. [D 20:42:57.181979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 22172. [D 20:42:57.181989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 22173. [D 20:42:57.182005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 22174. [D 20:42:57.182015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 22175. [D 20:42:57.182024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 22176. [D 20:42:57.182040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 22177. [D 20:42:57.182050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 22178. [D 20:42:57.182060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 22179. [D 20:42:57.182075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 22180. [D 20:42:57.182101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 22181. [D 20:42:57.182114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 22182. [D 20:42:57.182124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 22183. [D 20:42:57.182134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 22184. [D 20:42:57.182158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 22185. [D 20:42:57.182168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 22186. [D 20:42:57.182182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 22187. [D 20:42:57.182192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 22188. [D 20:42:57.182202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 22189. [D 20:42:57.182238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 22190. [D 20:42:57.182248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 22191. [D 20:42:57.182258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 22192. [D 20:42:57.182274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 22193. [D 20:42:57.182298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 22194. [D 20:42:57.182310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 22195. [D 20:42:57.182319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 22196. [D 20:42:57.182329] openib_post_sr_rdmaw: ibv_post_send wr_id 661c70 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 22197. [D 20:42:57.182344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 22198. [D 20:42:57.182354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 22199. [D 20:42:57.182364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 22200. [D 20:42:57.182394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 22201. [D 20:42:57.182404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 22202. [D 20:42:57.182417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 22203. [D 20:42:57.182427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 22204. [D 20:42:57.182437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 22205. [D 20:42:57.182460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 22206. [D 20:42:57.182470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 22207. [D 20:42:57.182484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 22208. [D 20:42:57.182494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 22209. [D 20:42:57.182504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 22210. [D 20:42:57.182530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 22211. [D 20:42:57.182540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 22212. [D 20:42:57.182554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 22213. [D 20:42:57.182563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 22214. [D 20:42:57.182573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 22215. [D 20:42:57.182600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 22216. [D 20:42:57.182614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 22217. [D 20:42:57.182627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 22218. [D 20:42:57.182637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 22219. [D 20:42:57.182646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 22220. [D 20:42:57.182668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 22221. [D 20:42:57.182678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 22222. [D 20:42:57.182689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 22223. [D 20:42:57.182699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 22224. [D 20:42:57.182709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 22225. [D 20:42:57.182719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 22226. [D 20:42:57.182744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 22227. [D 20:42:57.182754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 22228. [D 20:42:57.182769] openib_post_sr_rdmaw: ibv_post_send wr_id 656fe0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 22229. [D 20:42:57.184495] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.184511] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.184520] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.184546] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4573 [D 20:42:57.184556] element 0: offset: 0x655b90, size: 24 [D 20:42:57.184567] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 44/70. [D 20:42:57.193663] openib_check_cq: completed rdma wr_id 661c70, nic_wr_credit 22229. [D 20:42:57.193681] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 45/70. [D 20:42:57.201895] openib_check_cq: completed rdma wr_id 656fe0, nic_wr_credit 22228. [D 20:42:57.201910] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 46/70. [D 20:42:57.201953] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.201967] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.201975] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.202033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.202043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.202051] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.204417] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4573 [D 20:42:57.204467] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 47/70. [D 20:42:57.215285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 22228. [D 20:42:57.215304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 22229. [D 20:42:57.215316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 22230. [D 20:42:57.215325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 22231. [D 20:42:57.215336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 22232. [D 20:42:57.215349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 22233. [D 20:42:57.215359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 22234. [D 20:42:57.215369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 22235. [D 20:42:57.215385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 22236. [D 20:42:57.215395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 22237. [D 20:42:57.215405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 22238. [D 20:42:57.215415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 22239. [D 20:42:57.215441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 22240. [D 20:42:57.215451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 22241. [D 20:42:57.215464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 22242. [D 20:42:57.215474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 22243. [D 20:42:57.215484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 22244. [D 20:42:57.215507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 22245. [D 20:42:57.215517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 22246. [D 20:42:57.215526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 22247. [D 20:42:57.215540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 22248. [D 20:42:57.215557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 22249. [D 20:42:57.215579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 22250. [D 20:42:57.215593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 22251. [D 20:42:57.215603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 22252. [D 20:42:57.215613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 22253. [D 20:42:57.215628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 22254. [D 20:42:57.215638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 22255. [D 20:42:57.215647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 22256. [D 20:42:57.215663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 22257. [D 20:42:57.215686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 22258. [D 20:42:57.215699] openib_post_sr_rdmaw: ibv_post_send wr_id 627a20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 22259. [D 20:42:57.218089] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.218106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.218115] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.218149] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4578 [D 20:42:57.218159] element 0: offset: 0x64dd40, size: 24 [D 20:42:57.218170] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 48/70. [D 20:42:57.218199] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.218209] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.218217] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.218232] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4579 [D 20:42:57.218241] element 0: offset: 0x5b0030, size: 24 [D 20:42:57.218251] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 49/70. [D 20:42:57.220387] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.220400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.220409] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:57.220425] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4582 [D 20:42:57.220434] element 0: offset: 0x627bb0, size: 24 [D 20:42:57.220445] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 50/70. [D 20:42:57.221180] openib_check_cq: completed rdma wr_id 627a20, nic_wr_credit 22259. [D 20:42:57.221198] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 51/70. [D 20:42:57.221340] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.221355] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.221363] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:57.226112] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4582 [D 20:42:57.226150] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 52/70. [D 20:42:57.226170] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4578 [D 20:42:57.226187] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 53/70. [D 20:42:57.226257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 22259. [D 20:42:57.226270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 22260. [D 20:42:57.226280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 22261. [D 20:42:57.226295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 22262. [D 20:42:57.226307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 22263. [D 20:42:57.226317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 22264. [D 20:42:57.226327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 22265. [D 20:42:57.226337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 22266. [D 20:42:57.226347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 22267. [D 20:42:57.226357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 22268. [D 20:42:57.226375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 22269. [D 20:42:57.226384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 22270. [D 20:42:57.226394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 22271. [D 20:42:57.226404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 22272. [D 20:42:57.226414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 22273. [D 20:42:57.226424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 22274. [D 20:42:57.226434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 22275. [D 20:42:57.226476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 22276. [D 20:42:57.226488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 22277. [D 20:42:57.226498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 22278. [D 20:42:57.226509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 22279. [D 20:42:57.226518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 22280. [D 20:42:57.226528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 22281. [D 20:42:57.226541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 22282. [D 20:42:57.226558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 22283. [D 20:42:57.226582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 22284. [D 20:42:57.226597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 22285. [D 20:42:57.226606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 22286. [D 20:42:57.226631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 22287. [D 20:42:57.226641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 22288. [D 20:42:57.226651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 22289. [D 20:42:57.226661] openib_post_sr_rdmaw: ibv_post_send wr_id 6253c0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 22290. [D 20:42:57.226673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 22291. [D 20:42:57.226683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 22292. [D 20:42:57.226693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 22293. [D 20:42:57.226710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 22294. [D 20:42:57.226719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 22295. [D 20:42:57.226747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 22296. [D 20:42:57.226757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 22297. [D 20:42:57.226767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 22298. [D 20:42:57.226781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 22299. [D 20:42:57.226790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 22300. [D 20:42:57.226800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 22301. [D 20:42:57.226828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 22302. [D 20:42:57.226839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 22303. [D 20:42:57.226852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 22304. [D 20:42:57.226862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 22305. [D 20:42:57.226871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 22306. [D 20:42:57.226885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 22307. [D 20:42:57.226895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 22308. [D 20:42:57.226905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 22309. [D 20:42:57.226934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 22310. [D 20:42:57.226966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22311. [D 20:42:57.226977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22312. [D 20:42:57.226987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22313. [D 20:42:57.226997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22314. [D 20:42:57.227007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22315. [D 20:42:57.227018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22316. [D 20:42:57.227044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22317. [D 20:42:57.227060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22318. [D 20:42:57.227070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 22319. [D 20:42:57.227080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 22320. [D 20:42:57.227095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 22321. [D 20:42:57.227105] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 22322. [D 20:42:57.228994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.229040] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.229050] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:57.229080] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4585 [D 20:42:57.229091] element 0: offset: 0x691f20, size: 24 [D 20:42:57.229104] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 54/70. [D 20:42:57.237837] openib_check_cq: completed rdma wr_id 6253c0, nic_wr_credit 22322. [D 20:42:57.237865] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 55/70. [D 20:42:57.249395] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22321. [D 20:42:57.249412] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 56/70. [D 20:42:57.249460] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.249475] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.249483] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:57.249549] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.249563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.249571] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.251970] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4585 [D 20:42:57.251995] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 57/70. [D 20:42:57.255261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 22321. [D 20:42:57.255279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 22322. [D 20:42:57.255291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 22323. [D 20:42:57.255302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 22324. [D 20:42:57.255314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 22325. [D 20:42:57.255330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 22326. [D 20:42:57.255340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 22327. [D 20:42:57.255350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 22328. [D 20:42:57.255360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 22329. [D 20:42:57.255370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 22330. [D 20:42:57.255380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 22331. [D 20:42:57.255390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 22332. [D 20:42:57.255406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 22333. [D 20:42:57.255416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 22334. [D 20:42:57.255426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 22335. [D 20:42:57.255436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 22336. [D 20:42:57.255478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 22337. [D 20:42:57.255493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 22338. [D 20:42:57.255503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 22339. [D 20:42:57.255525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 22340. [D 20:42:57.255536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 22341. [D 20:42:57.255546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 22342. [D 20:42:57.255556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 22343. [D 20:42:57.255566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 22344. [D 20:42:57.255583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 22345. [D 20:42:57.255609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 22346. [D 20:42:57.255619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 22347. [D 20:42:57.255629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 22348. [D 20:42:57.255639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 22349. [D 20:42:57.255662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 22350. [D 20:42:57.255672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 22351. [D 20:42:57.255682] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 22352. [D 20:42:57.264905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.264946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.264955] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.264985] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4588 [D 20:42:57.264995] element 0: offset: 0x61ee20, size: 24 [D 20:42:57.265008] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 58/70. [D 20:42:57.266798] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22352. [D 20:42:57.266854] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 59/70. [D 20:42:57.266984] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.266998] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.267007] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.269110] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4588 [D 20:42:57.269130] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 60/70. [D 20:42:57.272468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 22352. [D 20:42:57.272485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 22353. [D 20:42:57.272497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 22354. [D 20:42:57.272508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 22355. [D 20:42:57.272518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 22356. [D 20:42:57.272533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 22357. [D 20:42:57.272543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 22358. [D 20:42:57.272553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 22359. [D 20:42:57.272563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 22360. [D 20:42:57.272581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 22361. [D 20:42:57.272591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 22362. [D 20:42:57.272620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 22363. [D 20:42:57.272631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 22364. [D 20:42:57.272641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 22365. [D 20:42:57.272655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 22366. [D 20:42:57.272665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 22367. [D 20:42:57.272675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 22368. [D 20:42:57.272705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 22369. [D 20:42:57.272720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 22370. [D 20:42:57.272730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 22371. [D 20:42:57.272740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22372. [D 20:42:57.272764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22373. [D 20:42:57.272775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22374. [D 20:42:57.272785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22375. [D 20:42:57.272796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22376. [D 20:42:57.272805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22377. [D 20:42:57.272815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22378. [D 20:42:57.272838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22379. [D 20:42:57.272848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 22380. [D 20:42:57.272870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 22381. [D 20:42:57.272879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 22382. [D 20:42:57.272889] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 22383. [D 20:42:57.275180] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.275221] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.275230] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.275261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4591 [D 20:42:57.275271] element 0: offset: 0x61fad0, size: 24 [D 20:42:57.275286] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 0/70. [D 20:42:57.275373] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4579 [D 20:42:57.275391] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 1/70. [D 20:42:57.284123] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22383. [D 20:42:57.284142] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 2/70. [D 20:42:57.284175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 22383. [D 20:42:57.284186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 22384. [D 20:42:57.284196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 22385. [D 20:42:57.284206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 22386. [D 20:42:57.284216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 22387. [D 20:42:57.284226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 22388. [D 20:42:57.284237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 22389. [D 20:42:57.284249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 22390. [D 20:42:57.284259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 22391. [D 20:42:57.284269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 22392. [D 20:42:57.284279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 22393. [D 20:42:57.284298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 22394. [D 20:42:57.284307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 22395. [D 20:42:57.284317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 22396. [D 20:42:57.284328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 22397. [D 20:42:57.284338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 22398. [D 20:42:57.284347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 22399. [D 20:42:57.284357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 22400. [D 20:42:57.284390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 22401. [D 20:42:57.284399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 22402. [D 20:42:57.284412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 22403. [D 20:42:57.284422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 22404. [D 20:42:57.284432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 22405. [D 20:42:57.284456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 22406. [D 20:42:57.284466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 22407. [D 20:42:57.284476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 22408. [D 20:42:57.284487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 22409. [D 20:42:57.284497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 22410. [D 20:42:57.284520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 22411. [D 20:42:57.284530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 22412. [D 20:42:57.284540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 22413. [D 20:42:57.284555] openib_post_sr_rdmaw: ibv_post_send wr_id 67eee0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 22414. [D 20:42:57.284595] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.284611] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.284619] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.287109] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4591 [D 20:42:57.287161] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 3/70. [D 20:42:57.290080] openib_check_cq: completed rdma wr_id 67eee0, nic_wr_credit 22414. [D 20:42:57.290099] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 4/70. [D 20:42:57.290158] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.290175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.290183] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.290866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 22414. [D 20:42:57.290883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 22415. [D 20:42:57.290894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 22416. [D 20:42:57.290904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 22417. [D 20:42:57.290914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 22418. [D 20:42:57.290924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 22419. [D 20:42:57.290934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 22420. [D 20:42:57.290944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 22421. [D 20:42:57.290960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 22422. [D 20:42:57.290970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 22423. [D 20:42:57.290980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 22424. [D 20:42:57.290990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 22425. [D 20:42:57.291015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 22426. [D 20:42:57.291026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 22427. [D 20:42:57.291036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 22428. [D 20:42:57.291046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 22429. [D 20:42:57.291057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 22430. [D 20:42:57.291079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 22431. [D 20:42:57.291089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 22432. [D 20:42:57.291102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 22433. [D 20:42:57.291119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 22434. [D 20:42:57.291129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 22435. [D 20:42:57.291148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 22436. [D 20:42:57.291159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 22437. [D 20:42:57.291168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 22438. [D 20:42:57.291178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 22439. [D 20:42:57.291188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 22440. [D 20:42:57.291205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 22441. [D 20:42:57.291215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 22442. [D 20:42:57.291225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 22443. [D 20:42:57.291249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 22444. [D 20:42:57.291259] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 22445. [D 20:42:57.299775] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.299791] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.299800] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.299826] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4595 [D 20:42:57.299836] element 0: offset: 0x655b10, size: 24 [D 20:42:57.299847] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 5/70. [D 20:42:57.299877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.299886] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.299894] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.299909] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4596 [D 20:42:57.299918] element 0: offset: 0x661d30, size: 24 [D 20:42:57.299928] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 6/70. [D 20:42:57.302564] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22445. [D 20:42:57.302583] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 7/70. [D 20:42:57.302697] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.302712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.302721] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.304954] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4595 [D 20:42:57.305005] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 8/70. [D 20:42:57.308134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 22445. [D 20:42:57.308153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 22446. [D 20:42:57.308166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 22447. [D 20:42:57.308176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 22448. [D 20:42:57.308186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 22449. [D 20:42:57.308203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 22450. [D 20:42:57.308212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 22451. [D 20:42:57.308222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 22452. [D 20:42:57.308233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 22453. [D 20:42:57.308243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 22454. [D 20:42:57.308253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 22455. [D 20:42:57.308263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 22456. [D 20:42:57.308279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 22457. [D 20:42:57.308289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 22458. [D 20:42:57.308298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 22459. [D 20:42:57.308309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 22460. [D 20:42:57.308335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 22461. [D 20:42:57.308345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 22462. [D 20:42:57.308356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 22463. [D 20:42:57.308366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 22464. [D 20:42:57.308376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22465. [D 20:42:57.308386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22466. [D 20:42:57.308409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22467. [D 20:42:57.308437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22468. [D 20:42:57.308447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22469. [D 20:42:57.308461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22470. [D 20:42:57.308471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22471. [D 20:42:57.308481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22472. [D 20:42:57.308495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 22473. [D 20:42:57.308518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 22474. [D 20:42:57.308531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 22475. [D 20:42:57.308540] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 22476. [D 20:42:57.310815] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.310839] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.310848] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.310878] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4600 [D 20:42:57.310888] element 0: offset: 0x655b90, size: 24 [D 20:42:57.310899] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 9/70. [D 20:42:57.314018] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22476. [D 20:42:57.314036] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 10/70. [D 20:42:57.314152] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.314195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.314204] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.316242] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4600 [D 20:42:57.316280] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 11/70. [D 20:42:57.316333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 22476. [D 20:42:57.316349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 22477. [D 20:42:57.316359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 22478. [D 20:42:57.316374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 22479. [D 20:42:57.316384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 22480. [D 20:42:57.316394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 22481. [D 20:42:57.316409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 22482. [D 20:42:57.316419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 22483. [D 20:42:57.316429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 22484. [D 20:42:57.316445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 22485. [D 20:42:57.316471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 22486. [D 20:42:57.316482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 22487. [D 20:42:57.316492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 22488. [D 20:42:57.316503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 22489. [D 20:42:57.316513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 22490. [D 20:42:57.316523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 22491. [D 20:42:57.316536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 22492. [D 20:42:57.316561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 22493. [D 20:42:57.316571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 22494. [D 20:42:57.316590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 22495. [D 20:42:57.316600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 22496. [D 20:42:57.316610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 22497. [D 20:42:57.316620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 22498. [D 20:42:57.316630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 22499. [D 20:42:57.316647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 22500. [D 20:42:57.316656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 22501. [D 20:42:57.316666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 22502. [D 20:42:57.316690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 22503. [D 20:42:57.316701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 22504. [D 20:42:57.316711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 22505. [D 20:42:57.316721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 22506. [D 20:42:57.316734] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 22507. [D 20:42:57.322298] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22507. [D 20:42:57.322314] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 12/70. [D 20:42:57.322454] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.322499] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.322507] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.337809] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4596 [D 20:42:57.337830] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 13/70. [D 20:42:57.337886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 22507. [D 20:42:57.337919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 22508. [D 20:42:57.337930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 22509. [D 20:42:57.337940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 22510. [D 20:42:57.337956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 22511. [D 20:42:57.337967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 22512. [D 20:42:57.337977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 22513. [D 20:42:57.337987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 22514. [D 20:42:57.337996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 22515. [D 20:42:57.338007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 22516. [D 20:42:57.338017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 22517. [D 20:42:57.338029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 22518. [D 20:42:57.338039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 22519. [D 20:42:57.338049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 22520. [D 20:42:57.338059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 22521. [D 20:42:57.338077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 22522. [D 20:42:57.338086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 22523. [D 20:42:57.338123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 22524. [D 20:42:57.338133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 22525. [D 20:42:57.338143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 22526. [D 20:42:57.338158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 22527. [D 20:42:57.338168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 22528. [D 20:42:57.338178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 22529. [D 20:42:57.338208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 22530. [D 20:42:57.338224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 22531. [D 20:42:57.338234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 22532. [D 20:42:57.338244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 22533. [D 20:42:57.338261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 22534. [D 20:42:57.338270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 22535. [D 20:42:57.338280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 22536. [D 20:42:57.338304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 22537. [D 20:42:57.338314] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 22538. [D 20:42:57.343773] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22538. [D 20:42:57.343788] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 14/70. [D 20:42:57.343837] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.343853] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.343861] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:57.386327] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.386340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.386349] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:57.386375] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4603 [D 20:42:57.386385] element 0: offset: 0x655d10, size: 24 [D 20:42:57.386396] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 15/70. [D 20:42:57.388802] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4603 [D 20:42:57.388845] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 16/70. [D 20:42:57.388890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 22538. [D 20:42:57.388908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 22539. [D 20:42:57.388918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 22540. [D 20:42:57.388928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 22541. [D 20:42:57.388938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 22542. [D 20:42:57.388948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 22543. [D 20:42:57.388958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 22544. [D 20:42:57.388968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 22545. [D 20:42:57.388978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 22546. [D 20:42:57.388988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 22547. [D 20:42:57.388999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 22548. [D 20:42:57.389019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 22549. [D 20:42:57.389029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 22550. [D 20:42:57.389039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 22551. [D 20:42:57.389048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 22552. [D 20:42:57.389072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 22553. [D 20:42:57.389092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 22554. [D 20:42:57.389102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 22555. [D 20:42:57.389112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 22556. [D 20:42:57.389122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 22557. [D 20:42:57.389137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 22558. [D 20:42:57.389147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 22559. [D 20:42:57.389157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 22560. [D 20:42:57.389180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 22561. [D 20:42:57.389191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 22562. [D 20:42:57.389206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 22563. [D 20:42:57.389217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 22564. [D 20:42:57.389226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 22565. [D 20:42:57.389237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 22566. [D 20:42:57.389260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 22567. [D 20:42:57.389271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 22568. [D 20:42:57.389284] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 22569. [D 20:42:57.394759] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22569. [D 20:42:57.394774] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 17/70. [D 20:42:57.394834] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.394851] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.394859] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:57.696420] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.696435] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.696443] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:57.696467] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4607 [D 20:42:57.696477] element 0: offset: 0x691f20, size: 24 [D 20:42:57.696488] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 18/70. [D 20:42:57.696516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.696526] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.696534] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.696548] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4608 [D 20:42:57.696557] element 0: offset: 0x61f310, size: 24 [D 20:42:57.696567] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 19/70. [D 20:42:57.699045] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4607 [D 20:42:57.699089] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 20/70. [D 20:42:57.699224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 22569. [D 20:42:57.699247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 22570. [D 20:42:57.699257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 22571. [D 20:42:57.699267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 22572. [D 20:42:57.699283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 22573. [D 20:42:57.699293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 22574. [D 20:42:57.699303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 22575. [D 20:42:57.699313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 22576. [D 20:42:57.699330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 22577. [D 20:42:57.699340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 22578. [D 20:42:57.699350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 22579. [D 20:42:57.699361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 22580. [D 20:42:57.699386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 22581. [D 20:42:57.699408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 22582. [D 20:42:57.699419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 22583. [D 20:42:57.699429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 22584. [D 20:42:57.699451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 22585. [D 20:42:57.699461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 22586. [D 20:42:57.699481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 22587. [D 20:42:57.699492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 22588. [D 20:42:57.699506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22589. [D 20:42:57.699516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22590. [D 20:42:57.699526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22591. [D 20:42:57.699551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22592. [D 20:42:57.699562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22593. [D 20:42:57.699587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22594. [D 20:42:57.699597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22595. [D 20:42:57.699607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22596. [D 20:42:57.699622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 22597. [D 20:42:57.699632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 22598. [D 20:42:57.699653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 22599. [D 20:42:57.699669] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 22600. [D 20:42:57.710986] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22600. [D 20:42:57.711013] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 21/70. [D 20:42:57.711133] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.711151] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.711159] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.727274] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.727289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.727297] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.727323] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4613 [D 20:42:57.727333] element 0: offset: 0x67efc0, size: 24 [D 20:42:57.727344] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 22/70. [D 20:42:57.727372] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.727381] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.727389] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:57.727404] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4615 [D 20:42:57.727413] element 0: offset: 0x61ee20, size: 24 [D 20:42:57.727423] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 23/70. [D 20:42:57.732039] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4613 [D 20:42:57.732083] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 24/70. [D 20:42:57.732099] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4615 [D 20:42:57.732109] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 25/70. [D 20:42:57.732217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 22600. [D 20:42:57.732305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 22601. [D 20:42:57.732317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 22602. [D 20:42:57.732327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 22603. [D 20:42:57.732342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 22604. [D 20:42:57.732352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 22605. [D 20:42:57.732361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 22606. [D 20:42:57.732376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 22607. [D 20:42:57.732386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 22608. [D 20:42:57.732396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 22609. [D 20:42:57.732406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 22610. [D 20:42:57.732432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 22611. [D 20:42:57.732442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 22612. [D 20:42:57.732462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 22613. [D 20:42:57.732472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 22614. [D 20:42:57.732483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 22615. [D 20:42:57.732504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 22616. [D 20:42:57.732515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 22617. [D 20:42:57.732525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 22618. [D 20:42:57.732535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 22619. [D 20:42:57.732560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 22620. [D 20:42:57.732570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 22621. [D 20:42:57.732580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 22622. [D 20:42:57.732622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 22623. [D 20:42:57.732643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 22624. [D 20:42:57.732654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 22625. [D 20:42:57.732664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 22626. [D 20:42:57.732674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 22627. [D 20:42:57.732696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 22628. [D 20:42:57.732706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 22629. [D 20:42:57.732716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 22630. [D 20:42:57.732726] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 22631. [D 20:42:57.732744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 22632. [D 20:42:57.732754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 22633. [D 20:42:57.732764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 22634. [D 20:42:57.732779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 22635. [D 20:42:57.732789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 22636. [D 20:42:57.732799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 22637. [D 20:42:57.732809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 22638. [D 20:42:57.732819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 22639. [D 20:42:57.732829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 22640. [D 20:42:57.732844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 22641. [D 20:42:57.732893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 22642. [D 20:42:57.732904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 22643. [D 20:42:57.732913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 22644. [D 20:42:57.732929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 22645. [D 20:42:57.732939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 22646. [D 20:42:57.732949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 22647. [D 20:42:57.732965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 22648. [D 20:42:57.732974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 22649. [D 20:42:57.732984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 22650. [D 20:42:57.733012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 22651. [D 20:42:57.733022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 22652. [D 20:42:57.733036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 22653. [D 20:42:57.733046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 22654. [D 20:42:57.733058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 22655. [D 20:42:57.733073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 22656. [D 20:42:57.733083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 22657. [D 20:42:57.733093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 22658. [D 20:42:57.733109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 22659. [D 20:42:57.733119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 22660. [D 20:42:57.733146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 22661. [D 20:42:57.733156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 22662. [D 20:42:57.733167] openib_post_sr_rdmaw: ibv_post_send wr_id 63c490 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 22663. [D 20:42:57.742163] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22663. [D 20:42:57.742184] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 26/70. [D 20:42:57.749174] openib_check_cq: completed rdma wr_id 63c490, nic_wr_credit 22662. [D 20:42:57.749237] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 27/70. [D 20:42:57.749307] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.749322] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.749331] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:57.749356] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.749365] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.749374] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.749397] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.749406] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.749414] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.749438] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4618 [D 20:42:57.749448] element 0: offset: 0x625550, size: 24 [D 20:42:57.749459] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 28/70. [D 20:42:57.751583] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4618 [D 20:42:57.751636] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 29/70. [D 20:42:57.751775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 22662. [D 20:42:57.751795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 22663. [D 20:42:57.751807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 22664. [D 20:42:57.751817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 22665. [D 20:42:57.751828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 22666. [D 20:42:57.751838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 22667. [D 20:42:57.751848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 22668. [D 20:42:57.751864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 22669. [D 20:42:57.751874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 22670. [D 20:42:57.751884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 22671. [D 20:42:57.751894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 22672. [D 20:42:57.751925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 22673. [D 20:42:57.751935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 22674. [D 20:42:57.751950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 22675. [D 20:42:57.751960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 22676. [D 20:42:57.751969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 22677. [D 20:42:57.751984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 22678. [D 20:42:57.751994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 22679. [D 20:42:57.752004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 22680. [D 20:42:57.752019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 22681. [D 20:42:57.752029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22682. [D 20:42:57.752039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22683. [D 20:42:57.752067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22684. [D 20:42:57.752077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22685. [D 20:42:57.752087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22686. [D 20:42:57.752102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22687. [D 20:42:57.752111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22688. [D 20:42:57.752121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22689. [D 20:42:57.752137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 22690. [D 20:42:57.752147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 22691. [D 20:42:57.752157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 22692. [D 20:42:57.752173] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 22693. [D 20:42:57.757710] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4608 [D 20:42:57.757730] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 30/70. [D 20:42:57.763597] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22693. [D 20:42:57.763636] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 31/70. [D 20:42:57.763651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 22693. [D 20:42:57.763662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 22694. [D 20:42:57.763675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 22695. [D 20:42:57.763685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 22696. [D 20:42:57.763695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 22697. [D 20:42:57.763705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 22698. [D 20:42:57.763715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 22699. [D 20:42:57.763730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 22700. [D 20:42:57.763740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 22701. [D 20:42:57.763750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 22702. [D 20:42:57.763760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 22703. [D 20:42:57.763776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 22704. [D 20:42:57.763786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 22705. [D 20:42:57.763796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 22706. [D 20:42:57.763806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 22707. [D 20:42:57.763817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 22708. [D 20:42:57.763827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 22709. [D 20:42:57.763841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 22710. [D 20:42:57.763851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 22711. [D 20:42:57.763861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 22712. [D 20:42:57.763871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 22713. [D 20:42:57.763941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 22714. [D 20:42:57.763952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 22715. [D 20:42:57.763962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 22716. [D 20:42:57.763973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 22717. [D 20:42:57.763983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 22718. [D 20:42:57.763993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 22719. [D 20:42:57.764003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 22720. [D 20:42:57.764013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 22721. [D 20:42:57.764023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 22722. [D 20:42:57.764033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 22723. [D 20:42:57.764061] openib_post_sr_rdmaw: ibv_post_send wr_id 643500 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 22724. [D 20:42:57.764132] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.764148] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.764156] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.764181] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.764191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.764199] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.764225] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4621 [D 20:42:57.764235] element 0: offset: 0x63d860, size: 24 [D 20:42:57.764246] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 32/70. [D 20:42:57.775300] openib_check_cq: completed rdma wr_id 643500, nic_wr_credit 22724. [D 20:42:57.775320] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 33/70. [D 20:42:57.775439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.775454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.775462] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.779754] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4621 [D 20:42:57.779771] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 34/70. [D 20:42:57.790130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 22724. [D 20:42:57.790185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 22725. [D 20:42:57.790196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 22726. [D 20:42:57.790206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 22727. [D 20:42:57.790217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 22728. [D 20:42:57.790227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 22729. [D 20:42:57.790237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 22730. [D 20:42:57.790247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 22731. [D 20:42:57.790264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 22732. [D 20:42:57.790274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 22733. [D 20:42:57.790283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 22734. [D 20:42:57.790294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 22735. [D 20:42:57.790305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 22736. [D 20:42:57.790314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 22737. [D 20:42:57.790329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 22738. [D 20:42:57.790340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 22739. [D 20:42:57.790350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 22740. [D 20:42:57.790359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 22741. [D 20:42:57.790376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 22742. [D 20:42:57.790386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 22743. [D 20:42:57.790395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 22744. [D 20:42:57.790431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 22745. [D 20:42:57.790442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 22746. [D 20:42:57.790452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 22747. [D 20:42:57.790462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 22748. [D 20:42:57.790477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 22749. [D 20:42:57.790487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 22750. [D 20:42:57.790497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 22751. [D 20:42:57.790513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 22752. [D 20:42:57.790522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 22753. [D 20:42:57.790532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 22754. [D 20:42:57.790567] openib_post_sr_rdmaw: ibv_post_send wr_id 643500 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 22755. [D 20:42:57.793011] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.793028] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.793036] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.793053] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4624 [D 20:42:57.793062] element 0: offset: 0x627a90, size: 24 [D 20:42:57.793073] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 35/70. [D 20:42:57.801885] openib_check_cq: completed rdma wr_id 643500, nic_wr_credit 22755. [D 20:42:57.801905] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 36/70. [D 20:42:57.801976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.801991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.802000] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.804043] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4624 [D 20:42:57.804080] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 37/70. [D 20:42:57.807739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 22755. [D 20:42:57.807757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 22756. [D 20:42:57.807769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 22757. [D 20:42:57.807779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 22758. [D 20:42:57.807789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 22759. [D 20:42:57.807804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 22760. [D 20:42:57.807814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 22761. [D 20:42:57.807824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 22762. [D 20:42:57.807840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 22763. [D 20:42:57.807850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 22764. [D 20:42:57.807860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 22765. [D 20:42:57.807876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 22766. [D 20:42:57.807886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 22767. [D 20:42:57.807896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 22768. [D 20:42:57.807912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 22769. [D 20:42:57.807921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 22770. [D 20:42:57.807931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 22771. [D 20:42:57.807964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 22772. [D 20:42:57.807980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 22773. [D 20:42:57.808002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 22774. [D 20:42:57.808016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 22775. [D 20:42:57.808026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 22776. [D 20:42:57.808036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 22777. [D 20:42:57.808050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 22778. [D 20:42:57.808060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 22779. [D 20:42:57.808081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 22780. [D 20:42:57.808095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 22781. [D 20:42:57.808105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 22782. [D 20:42:57.808115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 22783. [D 20:42:57.808142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 22784. [D 20:42:57.808152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 22785. [D 20:42:57.808167] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 22786. [D 20:42:57.810415] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.810433] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.810441] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.810469] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4627 [D 20:42:57.810480] element 0: offset: 0x5b0030, size: 24 [D 20:42:57.810490] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 38/70. [D 20:42:57.819427] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22786. [D 20:42:57.819446] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 39/70. [D 20:42:57.819531] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.819546] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.819554] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.823793] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4627 [D 20:42:57.823809] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 40/70. [D 20:42:57.826340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 22786. [D 20:42:57.826395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 22787. [D 20:42:57.826407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 22788. [D 20:42:57.826417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 22789. [D 20:42:57.826428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 22790. [D 20:42:57.826438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 22791. [D 20:42:57.826448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 22792. [D 20:42:57.826459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 22793. [D 20:42:57.826468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 22794. [D 20:42:57.826478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 22795. [D 20:42:57.826488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 22796. [D 20:42:57.826506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 22797. [D 20:42:57.826544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 22798. [D 20:42:57.826554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 22799. [D 20:42:57.826565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 22800. [D 20:42:57.826575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 22801. [D 20:42:57.826596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 22802. [D 20:42:57.826606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 22803. [D 20:42:57.826617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 22804. [D 20:42:57.826627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 22805. [D 20:42:57.826637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22806. [D 20:42:57.826672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22807. [D 20:42:57.826683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22808. [D 20:42:57.826694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22809. [D 20:42:57.826703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22810. [D 20:42:57.826720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22811. [D 20:42:57.826730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22812. [D 20:42:57.826757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22813. [D 20:42:57.826767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 22814. [D 20:42:57.826780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 22815. [D 20:42:57.826808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 22816. [D 20:42:57.826825] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 22817. [D 20:42:57.829058] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.829074] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.829082] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.829099] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4630 [D 20:42:57.829108] element 0: offset: 0x625730, size: 24 [D 20:42:57.829118] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 41/70. [D 20:42:57.838065] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22817. [D 20:42:57.838085] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 42/70. [D 20:42:57.838152] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.838167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.838175] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.842524] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4630 [D 20:42:57.842540] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 43/70. [D 20:42:57.844213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 22817. [D 20:42:57.844272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 22818. [D 20:42:57.844284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 22819. [D 20:42:57.844294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 22820. [D 20:42:57.844309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 22821. [D 20:42:57.844319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 22822. [D 20:42:57.844328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 22823. [D 20:42:57.844339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 22824. [D 20:42:57.844350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 22825. [D 20:42:57.844360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 22826. [D 20:42:57.844372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 22827. [D 20:42:57.844388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 22828. [D 20:42:57.844420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 22829. [D 20:42:57.844431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 22830. [D 20:42:57.844441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 22831. [D 20:42:57.844451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 22832. [D 20:42:57.844489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 22833. [D 20:42:57.844499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 22834. [D 20:42:57.844509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 22835. [D 20:42:57.844525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 22836. [D 20:42:57.844535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 22837. [D 20:42:57.844545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 22838. [D 20:42:57.844570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 22839. [D 20:42:57.844580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 22840. [D 20:42:57.844590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 22841. [D 20:42:57.844600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 22842. [D 20:42:57.844610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 22843. [D 20:42:57.844620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 22844. [D 20:42:57.844630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 22845. [D 20:42:57.844641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 22846. [D 20:42:57.844654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 22847. [D 20:42:57.844663] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 22848. [D 20:42:57.846877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.846892] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.846901] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:57.846917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4633 [D 20:42:57.846926] element 0: offset: 0x627bb0, size: 24 [D 20:42:57.846936] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 44/70. [D 20:42:57.855931] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22848. [D 20:42:57.855952] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 45/70. [D 20:42:57.856014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.856029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.856037] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:57.858181] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4633 [D 20:42:57.858219] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 46/70. [D 20:42:57.866998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 22848. [D 20:42:57.867017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 22849. [D 20:42:57.867029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 22850. [D 20:42:57.867039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 22851. [D 20:42:57.867051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 22852. [D 20:42:57.867067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 22853. [D 20:42:57.867077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 22854. [D 20:42:57.867087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 22855. [D 20:42:57.867103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 22856. [D 20:42:57.867113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 22857. [D 20:42:57.867123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 22858. [D 20:42:57.867139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 22859. [D 20:42:57.867149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 22860. [D 20:42:57.867158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 22861. [D 20:42:57.867175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 22862. [D 20:42:57.867198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 22863. [D 20:42:57.867212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 22864. [D 20:42:57.867224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 22865. [D 20:42:57.867233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 22866. [D 20:42:57.867244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 22867. [D 20:42:57.867268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22868. [D 20:42:57.867278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22869. [D 20:42:57.867292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22870. [D 20:42:57.867302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22871. [D 20:42:57.867312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22872. [D 20:42:57.867339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22873. [D 20:42:57.867350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22874. [D 20:42:57.867365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22875. [D 20:42:57.867376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 22876. [D 20:42:57.867386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 22877. [D 20:42:57.867396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 22878. [D 20:42:57.867419] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 22879. [D 20:42:57.875271] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 22879. [D 20:42:57.875286] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 47/70. [D 20:42:57.875342] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.875358] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.875367] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:57.904256] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.904270] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.904278] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:57.904304] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4636 [D 20:42:57.904314] element 0: offset: 0x61f310, size: 24 [D 20:42:57.904324] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 48/70. [D 20:42:57.908848] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4636 [D 20:42:57.908864] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 49/70. [D 20:42:57.908925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 22879. [D 20:42:57.908990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 22880. [D 20:42:57.909002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 22881. [D 20:42:57.909013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 22882. [D 20:42:57.909022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 22883. [D 20:42:57.909038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 22884. [D 20:42:57.909047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 22885. [D 20:42:57.909057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 22886. [D 20:42:57.909073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 22887. [D 20:42:57.909083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 22888. [D 20:42:57.909092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 22889. [D 20:42:57.909133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 22890. [D 20:42:57.909146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 22891. [D 20:42:57.909156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 22892. [D 20:42:57.909171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 22893. [D 20:42:57.909182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 22894. [D 20:42:57.909192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 22895. [D 20:42:57.909205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 22896. [D 20:42:57.909240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 22897. [D 20:42:57.909261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 22898. [D 20:42:57.909272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 22899. [D 20:42:57.909282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 22900. [D 20:42:57.909293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 22901. [D 20:42:57.909303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 22902. [D 20:42:57.909313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 22903. [D 20:42:57.909324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 22904. [D 20:42:57.909334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 22905. [D 20:42:57.909349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 22906. [D 20:42:57.909359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 22907. [D 20:42:57.909387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 22908. [D 20:42:57.909398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 22909. [D 20:42:57.909407] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 22910. [D 20:42:57.914856] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 22910. [D 20:42:57.914874] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 50/70. [D 20:42:57.914937] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.914952] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.914961] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:57.917203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.917216] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.917225] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:57.917241] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4638 [D 20:42:57.917250] element 0: offset: 0x64dd40, size: 24 [D 20:42:57.917260] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 51/70. [D 20:42:57.949003] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4638 [D 20:42:57.949020] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 52/70. [D 20:42:57.949076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 22910. [D 20:42:57.949144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 22911. [D 20:42:57.949164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 22912. [D 20:42:57.949177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 22913. [D 20:42:57.949187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 22914. [D 20:42:57.949197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 22915. [D 20:42:57.949211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 22916. [D 20:42:57.949221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 22917. [D 20:42:57.949231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 22918. [D 20:42:57.949247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 22919. [D 20:42:57.949257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 22920. [D 20:42:57.949267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 22921. [D 20:42:57.949282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 22922. [D 20:42:57.949292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 22923. [D 20:42:57.949302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 22924. [D 20:42:57.949370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 22925. [D 20:42:57.949381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 22926. [D 20:42:57.949392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 22927. [D 20:42:57.949402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 22928. [D 20:42:57.949412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 22929. [D 20:42:57.949428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 22930. [D 20:42:57.949438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 22931. [D 20:42:57.949448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 22932. [D 20:42:57.949458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 22933. [D 20:42:57.949468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 22934. [D 20:42:57.949487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 22935. [D 20:42:57.949512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 22936. [D 20:42:57.949523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 22937. [D 20:42:57.949533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 22938. [D 20:42:57.949543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 22939. [D 20:42:57.949553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 22940. [D 20:42:57.949564] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 22941. [D 20:42:57.955001] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 22941. [D 20:42:57.955018] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 53/70. [D 20:42:57.955082] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:57.955096] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.955105] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:57.992033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:57.992047] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:57.992055] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:57.992071] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4642 [D 20:42:57.992081] element 0: offset: 0x63d860, size: 24 [D 20:42:57.992091] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 54/70. [D 20:42:57.994137] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4642 [D 20:42:57.994189] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 55/70. [D 20:42:57.994236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 22941. [D 20:42:57.994254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 22942. [D 20:42:57.994265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 22943. [D 20:42:57.994275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 22944. [D 20:42:57.994285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 22945. [D 20:42:57.994295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 22946. [D 20:42:57.994305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 22947. [D 20:42:57.994315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 22948. [D 20:42:57.994325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 22949. [D 20:42:57.994336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 22950. [D 20:42:57.994354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 22951. [D 20:42:57.994364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 22952. [D 20:42:57.994374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 22953. [D 20:42:57.994384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 22954. [D 20:42:57.994395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 22955. [D 20:42:57.994408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 22956. [D 20:42:57.994418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 22957. [D 20:42:57.994428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 22958. [D 20:42:57.994438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 22959. [D 20:42:57.994450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 22960. [D 20:42:57.994460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 22961. [D 20:42:57.994470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 22962. [D 20:42:57.994480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 22963. [D 20:42:57.994490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 22964. [D 20:42:57.994517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 22965. [D 20:42:57.994527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 22966. [D 20:42:57.994543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 22967. [D 20:42:57.994553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 22968. [D 20:42:57.994563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 22969. [D 20:42:57.994573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 22970. [D 20:42:57.994584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 22971. [D 20:42:57.994613] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 22972. [D 20:42:58.000111] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 22972. [D 20:42:58.000126] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 56/70. [D 20:42:58.000188] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.000205] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.000214] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:58.167654] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.167668] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.167677] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:58.167703] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4645 [D 20:42:58.167713] element 0: offset: 0x661d30, size: 24 [D 20:42:58.167723] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 57/70. [D 20:42:58.172126] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4645 [D 20:42:58.172142] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 58/70. [D 20:42:58.172219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 22972. [D 20:42:58.172288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 22973. [D 20:42:58.172321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 22974. [D 20:42:58.172334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 22975. [D 20:42:58.172345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 22976. [D 20:42:58.172355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 22977. [D 20:42:58.172365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 22978. [D 20:42:58.172375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 22979. [D 20:42:58.172391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 22980. [D 20:42:58.172401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 22981. [D 20:42:58.172411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 22982. [D 20:42:58.172421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 22983. [D 20:42:58.172463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 22984. [D 20:42:58.172473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 22985. [D 20:42:58.172485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 22986. [D 20:42:58.172495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 22987. [D 20:42:58.172523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 22988. [D 20:42:58.172533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 22989. [D 20:42:58.172544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 22990. [D 20:42:58.172558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 22991. [D 20:42:58.172568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 22992. [D 20:42:58.172578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 22993. [D 20:42:58.172604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 22994. [D 20:42:58.172614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 22995. [D 20:42:58.172629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 22996. [D 20:42:58.172639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 22997. [D 20:42:58.172649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 22998. [D 20:42:58.172677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 22999. [D 20:42:58.172692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 23000. [D 20:42:58.172702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 23001. [D 20:42:58.172712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 23002. [D 20:42:58.172741] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 23003. [D 20:42:58.178386] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23003. [D 20:42:58.178401] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 59/70. [D 20:42:58.178495] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.178511] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.178519] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:58.213210] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.213224] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.213232] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:58.213248] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4650 [D 20:42:58.213257] element 0: offset: 0x627a90, size: 24 [D 20:42:58.213267] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 60/70. [D 20:42:58.215790] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4650 [D 20:42:58.215807] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 0/70. [D 20:42:58.215838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.215847] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.215856] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:58.215859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 23003. [D 20:42:58.215872] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4652 [D 20:42:58.215931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 23004. [D 20:42:58.215945] element 0: offset: 0x5b0030, size: 24 [D 20:42:58.215957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 23005. [D 20:42:58.215981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 23006. [D 20:42:58.215997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 23007. [D 20:42:58.216051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 23008. [D 20:42:58.216063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 23009. [D 20:42:58.216073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 23010. [D 20:42:58.216083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 23011. [D 20:42:58.216093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 23012. [D 20:42:58.216103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 23013. [D 20:42:58.216118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 23014. [D 20:42:58.216145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 23015. [D 20:42:58.216156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 23016. [D 20:42:58.216167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 23017. [D 20:42:58.216177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 23018. [D 20:42:58.216187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 23019. [D 20:42:58.216197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 23020. [D 20:42:58.216207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 23021. [D 20:42:58.216217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 23022. [D 20:42:58.216233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 23023. [D 20:42:58.216242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 23024. [D 20:42:58.216252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 23025. [D 20:42:58.216289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 23026. [D 20:42:58.216310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 23027. [D 20:42:58.216325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 23028. [D 20:42:58.216335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 23029. [D 20:42:58.216350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 23030. [D 20:42:58.216361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 23031. [D 20:42:58.216370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 23032. [D 20:42:58.216381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 23033. [D 20:42:58.216391] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 23034. [D 20:42:58.216427] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 1/70. [D 20:42:58.216467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.216477] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.216486] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:58.216502] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4655 [D 20:42:58.216511] element 0: offset: 0x655b90, size: 24 [D 20:42:58.216521] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 2/70. [D 20:42:58.216539] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.216548] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.216556] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:58.216570] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4657 [D 20:42:58.216580] element 0: offset: 0x625550, size: 24 [D 20:42:58.216591] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 3/70. [D 20:42:58.226389] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 23034. [D 20:42:58.226410] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 4/70. [D 20:42:58.226527] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.226542] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.226551] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:58.231899] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4657 [D 20:42:58.231946] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 5/70. [D 20:42:58.233088] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4655 [D 20:42:58.233115] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 6/70. [D 20:42:58.233460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 23034. [D 20:42:58.233522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23035. [D 20:42:58.233533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23036. [D 20:42:58.233544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23037. [D 20:42:58.233559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23038. [D 20:42:58.233568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 23039. [D 20:42:58.233578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 23040. [D 20:42:58.233593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 23041. [D 20:42:58.233603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 23042. [D 20:42:58.233613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 23043. [D 20:42:58.233641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 23044. [D 20:42:58.233650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 23045. [D 20:42:58.233665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 23046. [D 20:42:58.233675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 23047. [D 20:42:58.233685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 23048. [D 20:42:58.233700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 23049. [D 20:42:58.233709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 23050. [D 20:42:58.233719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 23051. [D 20:42:58.233729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 23052. [D 20:42:58.233740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 23053. [D 20:42:58.233750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 23054. [D 20:42:58.233783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 23055. [D 20:42:58.233795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 23056. [D 20:42:58.233805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 23057. [D 20:42:58.233817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 23058. [D 20:42:58.233827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 23059. [D 20:42:58.233837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 23060. [D 20:42:58.233851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 23061. [D 20:42:58.233860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 23062. [D 20:42:58.233870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 23063. [D 20:42:58.233902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 23064. [D 20:42:58.233913] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 23065. [D 20:42:58.233927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 23066. [D 20:42:58.233937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 23067. [D 20:42:58.233950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 23068. [D 20:42:58.233960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 23069. [D 20:42:58.233970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 23070. [D 20:42:58.233985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 23071. [D 20:42:58.233995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 23072. [D 20:42:58.234005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 23073. [D 20:42:58.234020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 23074. [D 20:42:58.234030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 23075. [D 20:42:58.234040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 23076. [D 20:42:58.234055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 23077. [D 20:42:58.234065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 23078. [D 20:42:58.234075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 23079. [D 20:42:58.234086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 23080. [D 20:42:58.234096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 23081. [D 20:42:58.234106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 23082. [D 20:42:58.234127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 23083. [D 20:42:58.234137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 23084. [D 20:42:58.234147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 23085. [D 20:42:58.234157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 23086. [D 20:42:58.234172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 23087. [D 20:42:58.234182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 23088. [D 20:42:58.234192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 23089. [D 20:42:58.234207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 23090. [D 20:42:58.234217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 23091. [D 20:42:58.234227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 23092. [D 20:42:58.234243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 23093. [D 20:42:58.234275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 23094. [D 20:42:58.234287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 23095. [D 20:42:58.234297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 23096. [D 20:42:58.234307] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 23097. [D 20:42:58.236052] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.236069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.236078] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:58.236104] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4660 [D 20:42:58.236114] element 0: offset: 0x655b10, size: 24 [D 20:42:58.236124] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 7/70. [D 20:42:58.245284] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 23097. [D 20:42:58.245307] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 8/70. [D 20:42:58.256976] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23096. [D 20:42:58.257050] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 9/70. [D 20:42:58.257117] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.257131] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.257140] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:58.257196] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.257206] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.257214] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:58.261134] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4660 [D 20:42:58.261150] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 10/70. [D 20:42:58.268053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 23096. [D 20:42:58.268121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 23097. [D 20:42:58.268133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 23098. [D 20:42:58.268143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 23099. [D 20:42:58.268154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 23100. [D 20:42:58.268164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 23101. [D 20:42:58.268174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 23102. [D 20:42:58.268184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 23103. [D 20:42:58.268194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 23104. [D 20:42:58.268204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 23105. [D 20:42:58.268214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 23106. [D 20:42:58.268229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 23107. [D 20:42:58.268239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 23108. [D 20:42:58.268249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 23109. [D 20:42:58.268260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 23110. [D 20:42:58.268270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 23111. [D 20:42:58.268280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 23112. [D 20:42:58.268319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 23113. [D 20:42:58.268330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 23114. [D 20:42:58.268341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 23115. [D 20:42:58.268367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 23116. [D 20:42:58.268377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 23117. [D 20:42:58.268390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 23118. [D 20:42:58.268405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 23119. [D 20:42:58.268415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 23120. [D 20:42:58.268424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 23121. [D 20:42:58.268440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 23122. [D 20:42:58.268466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 23123. [D 20:42:58.268478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 23124. [D 20:42:58.268488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 23125. [D 20:42:58.268497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 23126. [D 20:42:58.268514] openib_post_sr_rdmaw: ibv_post_send wr_id 661840 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 23127. [D 20:42:58.270805] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4652 [D 20:42:58.270824] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 11/70. [D 20:42:58.270855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.270865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.270873] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:58.270889] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4664 [D 20:42:58.270899] element 0: offset: 0x61ee50, size: 24 [D 20:42:58.270909] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 12/70. [D 20:42:58.270932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.270942] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.270950] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:58.270963] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4666 [D 20:42:58.270973] element 0: offset: 0x655dd0, size: 24 [D 20:42:58.270983] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 13/70. [D 20:42:58.279900] openib_check_cq: completed rdma wr_id 661840, nic_wr_credit 23127. [D 20:42:58.279921] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 14/70. [D 20:42:58.279974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 23127. [D 20:42:58.279986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 23128. [D 20:42:58.279996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 23129. [D 20:42:58.280007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 23130. [D 20:42:58.280012] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.280033] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.280041] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:58.280017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 23131. [D 20:42:58.281702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 23132. [D 20:42:58.281713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 23133. [D 20:42:58.281724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 23134. [D 20:42:58.281738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 23135. [D 20:42:58.281748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 23136. [D 20:42:58.281758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 23137. [D 20:42:58.281772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 23138. [D 20:42:58.281782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 23139. [D 20:42:58.281792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 23140. [D 20:42:58.281808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 23141. [D 20:42:58.281818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 23142. [D 20:42:58.281827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 23143. [D 20:42:58.281844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 23144. [D 20:42:58.281854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 23145. [D 20:42:58.281863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 23146. [D 20:42:58.281874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 23147. [D 20:42:58.281884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 23148. [D 20:42:58.281894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 23149. [D 20:42:58.281904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 23150. [D 20:42:58.281920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 23151. [D 20:42:58.281930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 23152. [D 20:42:58.281940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 23153. [D 20:42:58.282002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 23154. [D 20:42:58.282012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 23155. [D 20:42:58.282022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 23156. [D 20:42:58.282038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 23157. [D 20:42:58.282048] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 23158. [D 20:42:58.284722] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4664 [D 20:42:58.284741] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 15/70. [D 20:42:58.286955] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4666 [D 20:42:58.286971] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 16/70. [D 20:42:58.287768] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23158. [D 20:42:58.287827] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 17/70. [D 20:42:58.287844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 23158. [D 20:42:58.287855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23159. [D 20:42:58.287866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23160. [D 20:42:58.287876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23161. [D 20:42:58.287891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23162. [D 20:42:58.287900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 23163. [D 20:42:58.287910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 23164. [D 20:42:58.287926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 23165. [D 20:42:58.287936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 23166. [D 20:42:58.287945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 23167. [D 20:42:58.287978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 23168. [D 20:42:58.287988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 23169. [D 20:42:58.288000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 23170. [D 20:42:58.288010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 23171. [D 20:42:58.288020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 23172. [D 20:42:58.288034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 23173. [D 20:42:58.288043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 23174. [D 20:42:58.288053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 23175. [D 20:42:58.288083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 23176. [D 20:42:58.288094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 23177. [D 20:42:58.288105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 23178. [D 20:42:58.288114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 23179. [D 20:42:58.288141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 23180. [D 20:42:58.288151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 23181. [D 20:42:58.288161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 23182. [D 20:42:58.288171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 23183. [D 20:42:58.288196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 23184. [D 20:42:58.288208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 23185. [D 20:42:58.288218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 23186. [D 20:42:58.288228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 23187. [D 20:42:58.288239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 23188. [D 20:42:58.288249] openib_post_sr_rdmaw: ibv_post_send wr_id 661840 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 23189. [D 20:42:58.288262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 23190. [D 20:42:58.288272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 23191. [D 20:42:58.288282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 23192. [D 20:42:58.288293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 23193. [D 20:42:58.288303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 23194. [D 20:42:58.288313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 23195. [D 20:42:58.288323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 23196. [D 20:42:58.288353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 23197. [D 20:42:58.288363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 23198. [D 20:42:58.288373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 23199. [D 20:42:58.288384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 23200. [D 20:42:58.288394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 23201. [D 20:42:58.288404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 23202. [D 20:42:58.288414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 23203. [D 20:42:58.288424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 23204. [D 20:42:58.288434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 23205. [D 20:42:58.288465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 23206. [D 20:42:58.288475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 23207. [D 20:42:58.288487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 23208. [D 20:42:58.288497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 23209. [D 20:42:58.288510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 23210. [D 20:42:58.288525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 23211. [D 20:42:58.288535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 23212. [D 20:42:58.288544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 23213. [D 20:42:58.288560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 23214. [D 20:42:58.288570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 23215. [D 20:42:58.288596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 23216. [D 20:42:58.288611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 23217. [D 20:42:58.288620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 23218. [D 20:42:58.288630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 23219. [D 20:42:58.288647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 23220. [D 20:42:58.288656] openib_post_sr_rdmaw: ibv_post_send wr_id 6625c0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 23221. [D 20:42:58.288715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.288729] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.288738] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:58.295463] openib_check_cq: completed rdma wr_id 661840, nic_wr_credit 23221. [D 20:42:58.295482] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 18/70. [D 20:42:58.296161] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.296177] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.296186] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:58.296202] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4668 [D 20:42:58.296211] element 0: offset: 0x691fe0, size: 24 [D 20:42:58.296221] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 19/70. [D 20:42:58.301357] openib_check_cq: completed rdma wr_id 6625c0, nic_wr_credit 23220. [D 20:42:58.301374] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 20/70. [D 20:42:58.301414] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.301429] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.301438] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:58.301475] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.301485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.301493] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:58.339310] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4668 [D 20:42:58.339327] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 21/70. [D 20:42:58.339386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 23220. [D 20:42:58.339454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 23221. [D 20:42:58.339466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 23222. [D 20:42:58.339477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 23223. [D 20:42:58.339486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 23224. [D 20:42:58.339502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 23225. [D 20:42:58.339512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 23226. [D 20:42:58.339522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 23227. [D 20:42:58.339538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 23228. [D 20:42:58.339547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 23229. [D 20:42:58.339557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 23230. [D 20:42:58.339574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 23231. [D 20:42:58.339583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 23232. [D 20:42:58.339593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 23233. [D 20:42:58.339609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 23234. [D 20:42:58.339669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 23235. [D 20:42:58.339679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 23236. [D 20:42:58.339704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 23237. [D 20:42:58.339714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 23238. [D 20:42:58.339724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 23239. [D 20:42:58.339737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 23240. [D 20:42:58.339747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 23241. [D 20:42:58.339757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 23242. [D 20:42:58.339773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 23243. [D 20:42:58.339782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 23244. [D 20:42:58.339810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 23245. [D 20:42:58.339820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 23246. [D 20:42:58.339830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 23247. [D 20:42:58.339861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 23248. [D 20:42:58.339872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 23249. [D 20:42:58.339882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 23250. [D 20:42:58.339892] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 23251. [D 20:42:58.345308] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 23251. [D 20:42:58.345324] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 22/70. [D 20:42:58.345388] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.345403] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.345411] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:58.420515] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.420528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.420537] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:58.420553] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4672 [D 20:42:58.420562] element 0: offset: 0x63d860, size: 24 [D 20:42:58.420572] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 23/70. [D 20:42:58.425086] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4672 [D 20:42:58.425103] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 24/70. [D 20:42:58.425160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 23251. [D 20:42:58.425224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 23252. [D 20:42:58.425268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 23253. [D 20:42:58.425279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 23254. [D 20:42:58.425290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 23255. [D 20:42:58.425300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 23256. [D 20:42:58.425310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 23257. [D 20:42:58.425321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 23258. [D 20:42:58.425343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 23259. [D 20:42:58.425354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 23260. [D 20:42:58.425364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 23261. [D 20:42:58.425379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 23262. [D 20:42:58.425390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 23263. [D 20:42:58.425416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 23264. [D 20:42:58.425426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 23265. [D 20:42:58.425451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 23266. [D 20:42:58.425461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 23267. [D 20:42:58.425484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 23268. [D 20:42:58.425494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 23269. [D 20:42:58.425504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 23270. [D 20:42:58.425514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 23271. [D 20:42:58.425541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 23272. [D 20:42:58.425552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 23273. [D 20:42:58.425574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 23274. [D 20:42:58.425584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 23275. [D 20:42:58.425595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 23276. [D 20:42:58.425605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 23277. [D 20:42:58.425615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 23278. [D 20:42:58.425625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 23279. [D 20:42:58.425692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 23280. [D 20:42:58.425705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 23281. [D 20:42:58.425715] openib_post_sr_rdmaw: ibv_post_send wr_id 62b0c0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 23282. [D 20:42:58.431081] openib_check_cq: completed rdma wr_id 62b0c0, nic_wr_credit 23282. [D 20:42:58.431096] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 25/70. [D 20:42:58.431162] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.431176] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.431185] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:58.599818] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.599832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.599841] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:58.599856] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4675 [D 20:42:58.599865] element 0: offset: 0x650390, size: 24 [D 20:42:58.599875] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 26/70. [D 20:42:58.604513] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4675 [D 20:42:58.604528] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 27/70. [D 20:42:58.604597] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.604610] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.604618] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:58.604634] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4678 [D 20:42:58.604643] element 0: offset: 0x625730, size: 24 [D 20:42:58.604654] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 28/70. [D 20:42:58.604703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 23282. [D 20:42:58.604769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23283. [D 20:42:58.604780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23284. [D 20:42:58.604791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23285. [D 20:42:58.604805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23286. [D 20:42:58.604815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 23287. [D 20:42:58.604840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 23288. [D 20:42:58.604850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 23289. [D 20:42:58.604860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 23290. [D 20:42:58.604870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 23291. [D 20:42:58.604880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 23292. [D 20:42:58.604890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 23293. [D 20:42:58.604900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 23294. [D 20:42:58.604936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 23295. [D 20:42:58.604947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 23296. [D 20:42:58.604970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 23297. [D 20:42:58.604984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 23298. [D 20:42:58.605005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 23299. [D 20:42:58.605018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 23300. [D 20:42:58.605027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 23301. [D 20:42:58.605040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 23302. [D 20:42:58.605055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 23303. [D 20:42:58.605065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 23304. [D 20:42:58.605074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 23305. [D 20:42:58.605090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 23306. [D 20:42:58.605100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 23307. [D 20:42:58.605110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 23308. [D 20:42:58.605137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 23309. [D 20:42:58.605146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 23310. [D 20:42:58.605157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 23311. [D 20:42:58.605167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 23312. [D 20:42:58.605177] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 23313. [D 20:42:58.609443] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4678 [D 20:42:58.609461] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 29/70. [D 20:42:58.616518] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23313. [D 20:42:58.616571] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 30/70. [D 20:42:58.616586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 23313. [D 20:42:58.616602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 23314. [D 20:42:58.616613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 23315. [D 20:42:58.616623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 23316. [D 20:42:58.616638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 23317. [D 20:42:58.616647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 23318. [D 20:42:58.616657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 23319. [D 20:42:58.616672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 23320. [D 20:42:58.616695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 23321. [D 20:42:58.616722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 23322. [D 20:42:58.616732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 23323. [D 20:42:58.616744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 23324. [D 20:42:58.616766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 23325. [D 20:42:58.616778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 23326. [D 20:42:58.616787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 23327. [D 20:42:58.616809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 23328. [D 20:42:58.616819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 23329. [D 20:42:58.616843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 23330. [D 20:42:58.616852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 23331. [D 20:42:58.616875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 23332. [D 20:42:58.616885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 23333. [D 20:42:58.616912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 23334. [D 20:42:58.616922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 23335. [D 20:42:58.616944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 23336. [D 20:42:58.616953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 23337. [D 20:42:58.616977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 23338. [D 20:42:58.616997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 23339. [D 20:42:58.617010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 23340. [D 20:42:58.617020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 23341. [D 20:42:58.617030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 23342. [D 20:42:58.617045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 23343. [D 20:42:58.617055] openib_post_sr_rdmaw: ibv_post_send wr_id 63c490 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 23344. [D 20:42:58.617125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.617140] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.617149] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:58.623113] openib_check_cq: completed rdma wr_id 63c490, nic_wr_credit 23344. [D 20:42:58.623131] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 31/70. [D 20:42:58.623179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.623194] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.623202] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:58.630845] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.630859] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.630867] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:58.630883] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4681 [D 20:42:58.630892] element 0: offset: 0x655b90, size: 24 [D 20:42:58.630902] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 32/70. [D 20:42:58.630950] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.630962] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.630970] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:58.630986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4684 [D 20:42:58.630995] element 0: offset: 0x625550, size: 24 [D 20:42:58.631005] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 33/70. [D 20:42:58.635389] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4684 [D 20:42:58.635445] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 34/70. [D 20:42:58.635583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 23344. [D 20:42:58.635603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 23345. [D 20:42:58.635614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 23346. [D 20:42:58.635624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 23347. [D 20:42:58.635648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 23348. [D 20:42:58.635658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 23349. [D 20:42:58.635673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 23350. [D 20:42:58.635684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 23351. [D 20:42:58.635694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 23352. [D 20:42:58.635705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 23353. [D 20:42:58.635734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 23354. [D 20:42:58.635745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 23355. [D 20:42:58.635766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 23356. [D 20:42:58.635809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 23357. [D 20:42:58.635821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 23358. [D 20:42:58.635832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 23359. [D 20:42:58.635842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 23360. [D 20:42:58.635852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 23361. [D 20:42:58.635881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 23362. [D 20:42:58.635891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 23363. [D 20:42:58.635903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 23364. [D 20:42:58.635925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 23365. [D 20:42:58.635936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 23366. [D 20:42:58.635946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 23367. [D 20:42:58.635967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 23368. [D 20:42:58.635977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 23369. [D 20:42:58.636002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 23370. [D 20:42:58.636020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 23371. [D 20:42:58.636031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 23372. [D 20:42:58.636054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 23373. [D 20:42:58.636065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 23374. [D 20:42:58.636088] openib_post_sr_rdmaw: ibv_post_send wr_id 653770 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 23375. [D 20:42:58.645957] openib_check_cq: completed rdma wr_id 653770, nic_wr_credit 23375. [D 20:42:58.645975] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 35/70. [D 20:42:58.646057] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.646073] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.646082] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:58.658729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.658743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.658751] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:58.658778] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4688 [D 20:42:58.658788] element 0: offset: 0x61f7d0, size: 24 [D 20:42:58.658799] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 36/70. [D 20:42:58.658827] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.658836] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.658845] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:58.658860] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4690 [D 20:42:58.658869] element 0: offset: 0x5b0030, size: 24 [D 20:42:58.658879] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 37/70. [D 20:42:58.663284] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4688 [D 20:42:58.663339] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 38/70. [D 20:42:58.663355] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4690 [D 20:42:58.663366] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 39/70. [D 20:42:58.667315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 23375. [D 20:42:58.667382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23376. [D 20:42:58.667392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23377. [D 20:42:58.667403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23378. [D 20:42:58.667418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23379. [D 20:42:58.667428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 23380. [D 20:42:58.667438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 23381. [D 20:42:58.667453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 23382. [D 20:42:58.667463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 23383. [D 20:42:58.667473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 23384. [D 20:42:58.667489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 23385. [D 20:42:58.667499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 23386. [D 20:42:58.667509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 23387. [D 20:42:58.667525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 23388. [D 20:42:58.667556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 23389. [D 20:42:58.667569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 23390. [D 20:42:58.667579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 23391. [D 20:42:58.667589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 23392. [D 20:42:58.667603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 23393. [D 20:42:58.667628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 23394. [D 20:42:58.667639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 23395. [D 20:42:58.667649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 23396. [D 20:42:58.667665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 23397. [D 20:42:58.667690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 23398. [D 20:42:58.667701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 23399. [D 20:42:58.667713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 23400. [D 20:42:58.667723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 23401. [D 20:42:58.667734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 23402. [D 20:42:58.667744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 23403. [D 20:42:58.667753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 23404. [D 20:42:58.667763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 23405. [D 20:42:58.667781] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 23406. [D 20:42:58.667795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 23407. [D 20:42:58.667805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 23408. [D 20:42:58.667833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 23409. [D 20:42:58.667843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 23410. [D 20:42:58.667855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 23411. [D 20:42:58.667865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 23412. [D 20:42:58.667877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 23413. [D 20:42:58.667906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 23414. [D 20:42:58.667921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 23415. [D 20:42:58.667932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 23416. [D 20:42:58.667942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 23417. [D 20:42:58.667975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 23418. [D 20:42:58.667985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 23419. [D 20:42:58.667995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 23420. [D 20:42:58.668005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 23421. [D 20:42:58.668016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 23422. [D 20:42:58.668026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 23423. [D 20:42:58.668036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 23424. [D 20:42:58.668045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 23425. [D 20:42:58.668056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 23426. [D 20:42:58.668066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 23427. [D 20:42:58.668091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 23428. [D 20:42:58.668105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 23429. [D 20:42:58.668115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 23430. [D 20:42:58.668124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 23431. [D 20:42:58.668135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 23432. [D 20:42:58.668145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 23433. [D 20:42:58.668155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 23434. [D 20:42:58.668165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 23435. [D 20:42:58.668197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 23436. [D 20:42:58.668207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 23437. [D 20:42:58.668219] openib_post_sr_rdmaw: ibv_post_send wr_id 653770 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 23438. [D 20:42:58.669866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.669885] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.669894] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:58.669923] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4693 [D 20:42:58.669934] element 0: offset: 0x61fad0, size: 24 [D 20:42:58.669944] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 40/70. [D 20:42:58.673929] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23438. [D 20:42:58.673950] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 41/70. [D 20:42:58.674874] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4681 [D 20:42:58.674893] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 42/70. [D 20:42:58.685603] openib_check_cq: completed rdma wr_id 653770, nic_wr_credit 23437. [D 20:42:58.685622] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 43/70. [D 20:42:58.685663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 23437. [D 20:42:58.685675] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.685676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 23438. [D 20:42:58.685709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 23439. [D 20:42:58.685730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 23440. [D 20:42:58.685740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 23441. [D 20:42:58.685750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 23442. [D 20:42:58.685764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 23443. [D 20:42:58.685774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 23444. [D 20:42:58.685784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 23445. [D 20:42:58.685799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 23446. [D 20:42:58.685809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 23447. [D 20:42:58.685819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 23448. [D 20:42:58.685850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 23449. [D 20:42:58.685859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 23450. [D 20:42:58.685873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 23451. [D 20:42:58.685883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 23452. [D 20:42:58.685893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 23453. [D 20:42:58.685919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 23454. [D 20:42:58.685929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 23455. [D 20:42:58.685943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 23456. [D 20:42:58.685953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 23457. [D 20:42:58.685965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 23458. [D 20:42:58.685988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 23459. [D 20:42:58.685998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 23460. [D 20:42:58.686009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 23461. [D 20:42:58.686019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 23462. [D 20:42:58.686029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 23463. [D 20:42:58.686052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 23464. [D 20:42:58.686063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 23465. [D 20:42:58.685695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.686094] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:58.686208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 23466. [D 20:42:58.686224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 23467. [D 20:42:58.686234] openib_post_sr_rdmaw: ibv_post_send wr_id 632830 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 23468. [D 20:42:58.686278] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.686289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.686300] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:58.688353] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4693 [D 20:42:58.688407] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 44/70. [D 20:42:58.697270] openib_check_cq: completed rdma wr_id 632830, nic_wr_credit 23468. [D 20:42:58.697289] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 45/70. [D 20:42:58.697670] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.697682] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.697692] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:58.701636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 23468. [D 20:42:58.701650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 23469. [D 20:42:58.701665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 23470. [D 20:42:58.701675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 23471. [D 20:42:58.701685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 23472. [D 20:42:58.701695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 23473. [D 20:42:58.701705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 23474. [D 20:42:58.701724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 23475. [D 20:42:58.701734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 23476. [D 20:42:58.701744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 23477. [D 20:42:58.701754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 23478. [D 20:42:58.701765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 23479. [D 20:42:58.701775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 23480. [D 20:42:58.701785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 23481. [D 20:42:58.701803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 23482. [D 20:42:58.701813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 23483. [D 20:42:58.701823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 23484. [D 20:42:58.701854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 23485. [D 20:42:58.701864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 23486. [D 20:42:58.701876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 23487. [D 20:42:58.701886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 23488. [D 20:42:58.701904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 23489. [D 20:42:58.701930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 23490. [D 20:42:58.701943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 23491. [D 20:42:58.701953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 23492. [D 20:42:58.701966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 23493. [D 20:42:58.701989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 23494. [D 20:42:58.701999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 23495. [D 20:42:58.702010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 23496. [D 20:42:58.702020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 23497. [D 20:42:58.702030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 23498. [D 20:42:58.702041] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 23499. [D 20:42:58.708383] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23499. [D 20:42:58.708397] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 46/70. [D 20:42:58.710702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.710716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.710726] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:58.720253] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.720267] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.720278] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:58.720309] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4698 [D 20:42:58.720320] element 0: offset: 0x655dd0, size: 24 [D 20:42:58.720332] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 47/70. [D 20:42:58.720754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.720768] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.720777] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:58.720792] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4700 [D 20:42:58.720802] element 0: offset: 0x61ee50, size: 24 [D 20:42:58.720812] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 48/70. [D 20:42:58.722532] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4698 [D 20:42:58.722589] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 49/70. [D 20:42:58.722626] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.722641] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.722650] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:58.722665] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4703 [D 20:42:58.722675] element 0: offset: 0x2aaaab216b60, size: 24 [D 20:42:58.722685] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 50/70. [D 20:42:58.722700] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.722709] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.722718] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:58.722732] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4705 [D 20:42:58.722742] element 0: offset: 0x2aaaab23bb50, size: 24 [D 20:42:58.722751] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 51/70. [D 20:42:58.722774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 23499. [D 20:42:58.722785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23500. [D 20:42:58.722795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23501. [D 20:42:58.722805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23502. [D 20:42:58.722815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23503. [D 20:42:58.722825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 23504. [D 20:42:58.722835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 23505. [D 20:42:58.722875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 23506. [D 20:42:58.722885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 23507. [D 20:42:58.722895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 23508. [D 20:42:58.722905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 23509. [D 20:42:58.722915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 23510. [D 20:42:58.722925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 23511. [D 20:42:58.722934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 23512. [D 20:42:58.722944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 23513. [D 20:42:58.722954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 23514. [D 20:42:58.722964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 23515. [D 20:42:58.722974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 23516. [D 20:42:58.722985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 23517. [D 20:42:58.723008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 23518. [D 20:42:58.723018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 23519. [D 20:42:58.723028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 23520. [D 20:42:58.723038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 23521. [D 20:42:58.723048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 23522. [D 20:42:58.723063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 23523. [D 20:42:58.723092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 23524. [D 20:42:58.723102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 23525. [D 20:42:58.723112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 23526. [D 20:42:58.723122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 23527. [D 20:42:58.723133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 23528. [D 20:42:58.723143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 23529. [D 20:42:58.723167] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 23530. [D 20:42:58.725363] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4703 [D 20:42:58.725456] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 52/70. [D 20:42:58.728303] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4705 [D 20:42:58.728325] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 53/70. [D 20:42:58.728653] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23530. [D 20:42:58.728667] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 54/70. [D 20:42:58.728679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 23530. [D 20:42:58.728690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 23531. [D 20:42:58.728700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 23532. [D 20:42:58.728711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 23533. [D 20:42:58.728721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 23534. [D 20:42:58.728731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 23535. [D 20:42:58.728741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 23536. [D 20:42:58.728751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 23537. [D 20:42:58.728761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 23538. [D 20:42:58.728771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 23539. [D 20:42:58.728804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 23540. [D 20:42:58.728814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 23541. [D 20:42:58.728824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 23542. [D 20:42:58.728834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 23543. [D 20:42:58.728844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 23544. [D 20:42:58.728860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 23545. [D 20:42:58.728870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 23546. [D 20:42:58.728889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 23547. [D 20:42:58.728899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 23548. [D 20:42:58.728917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 23549. [D 20:42:58.728927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 23550. [D 20:42:58.728937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 23551. [D 20:42:58.728948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 23552. [D 20:42:58.728972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 23553. [D 20:42:58.728983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 23554. [D 20:42:58.728993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 23555. [D 20:42:58.729003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 23556. [D 20:42:58.729013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 23557. [D 20:42:58.729024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 23558. [D 20:42:58.729034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 23559. [D 20:42:58.729044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 23560. [D 20:42:58.729068] openib_post_sr_rdmaw: ibv_post_send wr_id 643500 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 23561. [D 20:42:58.729079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 23562. [D 20:42:58.729094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 23563. [D 20:42:58.729119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 23564. [D 20:42:58.729130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 23565. [D 20:42:58.729140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 23566. [D 20:42:58.729150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 23567. [D 20:42:58.729162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 23568. [D 20:42:58.729179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 23569. [D 20:42:58.729220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 23570. [D 20:42:58.729232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 23571. [D 20:42:58.729243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 23572. [D 20:42:58.729253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 23573. [D 20:42:58.729275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 23574. [D 20:42:58.729285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 23575. [D 20:42:58.729295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 23576. [D 20:42:58.729311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 23577. [D 20:42:58.729321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 23578. [D 20:42:58.729331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 23579. [D 20:42:58.729346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 23580. [D 20:42:58.729356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 23581. [D 20:42:58.729365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 23582. [D 20:42:58.729389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 23583. [D 20:42:58.729399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 23584. [D 20:42:58.729410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 23585. [D 20:42:58.729420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 23586. [D 20:42:58.729440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 23587. [D 20:42:58.729454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 23588. [D 20:42:58.729463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 23589. [D 20:42:58.729473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 23590. [D 20:42:58.729489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 23591. [D 20:42:58.729499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 23592. [D 20:42:58.729509] openib_post_sr_rdmaw: ibv_post_send wr_id 631000 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 23593. [D 20:42:58.729542] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.729553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.729562] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:58.736090] openib_check_cq: completed rdma wr_id 643500, nic_wr_credit 23593. [D 20:42:58.736108] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 55/70. [D 20:42:58.747656] openib_check_cq: completed rdma wr_id 631000, nic_wr_credit 23592. [D 20:42:58.747716] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 56/70. [D 20:42:58.749918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.749934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.749944] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:58.749962] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.749973] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.749982] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:58.755529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:58.755545] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.755556] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:58.755588] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4708 [D 20:42:58.755599] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:58.755614] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 57/70. [D 20:42:58.759317] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4700 [D 20:42:58.759396] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 58/70. [D 20:42:58.759481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 23592. [D 20:42:58.759498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 23593. [D 20:42:58.759510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 23594. [D 20:42:58.759520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 23595. [D 20:42:58.759530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 23596. [D 20:42:58.759541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 23597. [D 20:42:58.759551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 23598. [D 20:42:58.759561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 23599. [D 20:42:58.759617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 23600. [D 20:42:58.759628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 23601. [D 20:42:58.759638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 23602. [D 20:42:58.759648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 23603. [D 20:42:58.759658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 23604. [D 20:42:58.759683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 23605. [D 20:42:58.759693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 23606. [D 20:42:58.759703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 23607. [D 20:42:58.759723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 23608. [D 20:42:58.759739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 23609. [D 20:42:58.759759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 23610. [D 20:42:58.759769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 23611. [D 20:42:58.759779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 23612. [D 20:42:58.759790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 23613. [D 20:42:58.759801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 23614. [D 20:42:58.759824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 23615. [D 20:42:58.759835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 23616. [D 20:42:58.759845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 23617. [D 20:42:58.759855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 23618. [D 20:42:58.759864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 23619. [D 20:42:58.759881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 23620. [D 20:42:58.759891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 23621. [D 20:42:58.759900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 23622. [D 20:42:58.759911] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 23623. [D 20:42:58.761027] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4708 [D 20:42:58.761047] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 59/70. [D 20:42:58.765351] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23623. [D 20:42:58.765367] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 60/70. [D 20:42:58.765378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 23623. [D 20:42:58.765388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23624. [D 20:42:58.765399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23625. [D 20:42:58.765409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23626. [D 20:42:58.765419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23627. [D 20:42:58.765433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 23628. [D 20:42:58.765443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 23629. [D 20:42:58.765453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 23630. [D 20:42:58.765463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 23631. [D 20:42:58.765481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 23632. [D 20:42:58.765491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 23633. [D 20:42:58.765501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 23634. [D 20:42:58.765512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 23635. [D 20:42:58.765547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 23636. [D 20:42:58.765557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 23637. [D 20:42:58.765567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 23638. [D 20:42:58.765577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 23639. [D 20:42:58.765610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 23640. [D 20:42:58.765620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 23641. [D 20:42:58.765635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 23642. [D 20:42:58.765645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 23643. [D 20:42:58.765655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 23644. [D 20:42:58.765691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 23645. [D 20:42:58.765701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 23646. [D 20:42:58.765711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 23647. [D 20:42:58.765736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 23648. [D 20:42:58.765747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 23649. [D 20:42:58.765757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 23650. [D 20:42:58.765767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 23651. [D 20:42:58.765777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 23652. [D 20:42:58.765792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 23653. [D 20:42:58.765815] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 23654. [D 20:42:58.765869] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.765899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.765909] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:58.771328] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 23654. [D 20:42:58.771343] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 0/70. [D 20:42:58.773629] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:58.773643] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:58.773652] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:59.046661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.046677] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.046688] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:59.046719] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4713 [D 20:42:59.046730] element 0: offset: 0x2aaaab20d940, size: 24 [D 20:42:59.046742] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 1/70. [D 20:42:59.046760] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.046773] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.046782] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.046796] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4714 [D 20:42:59.046807] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:59.046820] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 2/70. [D 20:42:59.046873] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.046882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.046891] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:59.046917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4717 [D 20:42:59.046927] element 0: offset: 0x2aaaab216bf0, size: 24 [D 20:42:59.046936] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 3/70. [D 20:42:59.051678] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4713 [D 20:42:59.051709] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 4/70. [D 20:42:59.053474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 23654. [D 20:42:59.053488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 23655. [D 20:42:59.053499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 23656. [D 20:42:59.053509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 23657. [D 20:42:59.053519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 23658. [D 20:42:59.053529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 23659. [D 20:42:59.053539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 23660. [D 20:42:59.053549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 23661. [D 20:42:59.053559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 23662. [D 20:42:59.053569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 23663. [D 20:42:59.053580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 23664. [D 20:42:59.053589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 23665. [D 20:42:59.053599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 23666. [D 20:42:59.053609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 23667. [D 20:42:59.053620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 23668. [D 20:42:59.053629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 23669. [D 20:42:59.053640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 23670. [D 20:42:59.053650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 23671. [D 20:42:59.053660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 23672. [D 20:42:59.053670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 23673. [D 20:42:59.053685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 23674. [D 20:42:59.053695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 23675. [D 20:42:59.053705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 23676. [D 20:42:59.053715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 23677. [D 20:42:59.053726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 23678. [D 20:42:59.053736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 23679. [D 20:42:59.053768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 23680. [D 20:42:59.053779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 23681. [D 20:42:59.053790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 23682. [D 20:42:59.053800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 23683. [D 20:42:59.053810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 23684. [D 20:42:59.053820] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 23685. [D 20:42:59.056055] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4717 [D 20:42:59.056073] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 5/70. [D 20:42:59.058476] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.058492] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.058503] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:59.058535] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4720 [D 20:42:59.058546] element 0: offset: 0x2aaaab209330, size: 24 [D 20:42:59.058557] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 6/70. [D 20:42:59.063241] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23685. [D 20:42:59.063297] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 7/70. [D 20:42:59.063313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 23685. [D 20:42:59.063325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 23686. [D 20:42:59.063336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 23687. [D 20:42:59.063346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 23688. [D 20:42:59.063360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 23689. [D 20:42:59.063370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 23690. [D 20:42:59.063380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 23691. [D 20:42:59.063396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 23692. [D 20:42:59.063406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 23693. [D 20:42:59.063415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 23694. [D 20:42:59.063453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 23695. [D 20:42:59.063463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 23696. [D 20:42:59.063477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 23697. [D 20:42:59.063486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 23698. [D 20:42:59.063497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 23699. [D 20:42:59.063510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 23700. [D 20:42:59.063538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 23701. [D 20:42:59.063550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 23702. [D 20:42:59.063560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 23703. [D 20:42:59.063571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 23704. [D 20:42:59.063584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 23705. [D 20:42:59.063608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 23706. [D 20:42:59.063622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 23707. [D 20:42:59.063632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 23708. [D 20:42:59.063642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 23709. [D 20:42:59.063655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 23710. [D 20:42:59.063665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 23711. [D 20:42:59.063675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 23712. [D 20:42:59.063685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 23713. [D 20:42:59.063695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 23714. [D 20:42:59.063715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 23715. [D 20:42:59.063725] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 23716. [D 20:42:59.065937] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.065952] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.065962] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:59.068337] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4720 [D 20:42:59.068361] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 8/70. [D 20:42:59.075069] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 23716. [D 20:42:59.075085] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 9/70. [D 20:42:59.075123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 23716. [D 20:42:59.075135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23717. [D 20:42:59.075145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23718. [D 20:42:59.075156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23719. [D 20:42:59.075166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23720. [D 20:42:59.075177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 23721. [D 20:42:59.075188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 23722. [D 20:42:59.075198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 23723. [D 20:42:59.075208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 23724. [D 20:42:59.075240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 23725. [D 20:42:59.075251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 23726. [D 20:42:59.075261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 23727. [D 20:42:59.075271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 23728. [D 20:42:59.075281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 23729. [D 20:42:59.075306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 23730. [D 20:42:59.075317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 23731. [D 20:42:59.075327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 23732. [D 20:42:59.075344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 23733. [D 20:42:59.075354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 23734. [D 20:42:59.075363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 23735. [D 20:42:59.075379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 23736. [D 20:42:59.075403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 23737. [D 20:42:59.075415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 23738. [D 20:42:59.075425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 23739. [D 20:42:59.075440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 23740. [D 20:42:59.075451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 23741. [D 20:42:59.075475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 23742. [D 20:42:59.075485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 23743. [D 20:42:59.075495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 23744. [D 20:42:59.075506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 23745. [D 20:42:59.075516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 23746. [D 20:42:59.075526] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 23747. [D 20:42:59.075570] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.075584] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.075593] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:59.086922] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23747. [D 20:42:59.086965] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 10/70. [D 20:42:59.089228] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.089242] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.089252] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:59.093817] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4714 [D 20:42:59.093878] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 11/70. [D 20:42:59.094345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 23747. [D 20:42:59.094361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 23748. [D 20:42:59.094372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 23749. [D 20:42:59.094383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 23750. [D 20:42:59.094393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 23751. [D 20:42:59.094404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 23752. [D 20:42:59.094414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 23753. [D 20:42:59.094429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 23754. [D 20:42:59.094439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 23755. [D 20:42:59.094449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 23756. [D 20:42:59.094459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 23757. [D 20:42:59.094476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 23758. [D 20:42:59.094486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 23759. [D 20:42:59.094496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 23760. [D 20:42:59.094506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 23761. [D 20:42:59.094533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 23762. [D 20:42:59.094548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 23763. [D 20:42:59.094557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 23764. [D 20:42:59.094568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 23765. [D 20:42:59.094582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 23766. [D 20:42:59.094592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 23767. [D 20:42:59.094618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 23768. [D 20:42:59.094628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 23769. [D 20:42:59.094638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 23770. [D 20:42:59.094664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 23771. [D 20:42:59.094675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 23772. [D 20:42:59.094686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 23773. [D 20:42:59.094696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 23774. [D 20:42:59.094708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 23775. [D 20:42:59.094723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 23776. [D 20:42:59.094745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 23777. [D 20:42:59.094756] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 23778. [D 20:42:59.105020] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.105036] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.105047] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.105082] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4724 [D 20:42:59.105094] element 0: offset: 0x2aaaab216bf0, size: 24 [D 20:42:59.105106] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 12/70. [D 20:42:59.105126] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.105136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.105144] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:59.105160] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4726 [D 20:42:59.105169] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:42:59.105182] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 13/70. [D 20:42:59.106077] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 23778. [D 20:42:59.106093] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 14/70. [D 20:42:59.108439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.108453] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.108462] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:59.111118] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4726 [D 20:42:59.111173] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 15/70. [D 20:42:59.111665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 23778. [D 20:42:59.111684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 23779. [D 20:42:59.111695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 23780. [D 20:42:59.111705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 23781. [D 20:42:59.111716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 23782. [D 20:42:59.111726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 23783. [D 20:42:59.111736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 23784. [D 20:42:59.111749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 23785. [D 20:42:59.111765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 23786. [D 20:42:59.111775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 23787. [D 20:42:59.111785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 23788. [D 20:42:59.111807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 23789. [D 20:42:59.111817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 23790. [D 20:42:59.111827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 23791. [D 20:42:59.111843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 23792. [D 20:42:59.111853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 23793. [D 20:42:59.111863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 23794. [D 20:42:59.111878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 23795. [D 20:42:59.111960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 23796. [D 20:42:59.111971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 23797. [D 20:42:59.111981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 23798. [D 20:42:59.111991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 23799. [D 20:42:59.112001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 23800. [D 20:42:59.112011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 23801. [D 20:42:59.112029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 23802. [D 20:42:59.112057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 23803. [D 20:42:59.112067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 23804. [D 20:42:59.112077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 23805. [D 20:42:59.112094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 23806. [D 20:42:59.112104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 23807. [D 20:42:59.112113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 23808. [D 20:42:59.112124] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 23809. [D 20:42:59.114513] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4724 [D 20:42:59.114531] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 16/70. [D 20:42:59.123351] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23809. [D 20:42:59.123368] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 17/70. [D 20:42:59.123403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 23809. [D 20:42:59.123414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 23810. [D 20:42:59.123424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 23811. [D 20:42:59.123436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 23812. [D 20:42:59.123446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 23813. [D 20:42:59.123458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 23814. [D 20:42:59.123473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 23815. [D 20:42:59.123483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 23816. [D 20:42:59.123493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 23817. [D 20:42:59.123509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 23818. [D 20:42:59.123519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 23819. [D 20:42:59.123528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 23820. [D 20:42:59.123539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 23821. [D 20:42:59.123548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 23822. [D 20:42:59.123563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 23823. [D 20:42:59.123576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 23824. [D 20:42:59.123586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 23825. [D 20:42:59.123596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 23826. [D 20:42:59.123620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 23827. [D 20:42:59.123631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 23828. [D 20:42:59.123640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 23829. [D 20:42:59.123651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 23830. [D 20:42:59.123661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 23831. [D 20:42:59.123670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 23832. [D 20:42:59.123680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 23833. [D 20:42:59.123697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 23834. [D 20:42:59.123707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 23835. [D 20:42:59.123717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 23836. [D 20:42:59.123727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 23837. [D 20:42:59.123737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 23838. [D 20:42:59.123747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 23839. [D 20:42:59.123757] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 23840. [D 20:42:59.123807] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.123822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.123832] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:59.126760] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.126774] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.126784] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.126817] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4728 [D 20:42:59.126828] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:42:59.126841] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 18/70. [D 20:42:59.135134] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 23840. [D 20:42:59.135150] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 19/70. [D 20:42:59.137465] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.137479] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.137489] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:59.159766] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4728 [D 20:42:59.159848] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 20/70. [D 20:42:59.165040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 23840. [D 20:42:59.165059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 23841. [D 20:42:59.165070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 23842. [D 20:42:59.165081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 23843. [D 20:42:59.165096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 23844. [D 20:42:59.165107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 23845. [D 20:42:59.165117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 23846. [D 20:42:59.165128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 23847. [D 20:42:59.165138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 23848. [D 20:42:59.165148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 23849. [D 20:42:59.165158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 23850. [D 20:42:59.165176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 23851. [D 20:42:59.165186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 23852. [D 20:42:59.165195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 23853. [D 20:42:59.165223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 23854. [D 20:42:59.165234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 23855. [D 20:42:59.165248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 23856. [D 20:42:59.165258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 23857. [D 20:42:59.165268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 23858. [D 20:42:59.165295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 23859. [D 20:42:59.165308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 23860. [D 20:42:59.165321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 23861. [D 20:42:59.165331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 23862. [D 20:42:59.165341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 23863. [D 20:42:59.165365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 23864. [D 20:42:59.165375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 23865. [D 20:42:59.165385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 23866. [D 20:42:59.165401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 23867. [D 20:42:59.165411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 23868. [D 20:42:59.165437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 23869. [D 20:42:59.165447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 23870. [D 20:42:59.165457] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 23871. [D 20:42:59.169696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.169712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.169723] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.169759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4732 [D 20:42:59.169770] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:59.169783] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 21/70. [D 20:42:59.170941] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23871. [D 20:42:59.170956] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 22/70. [D 20:42:59.173314] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.173327] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.173336] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:59.175489] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4732 [D 20:42:59.175510] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 23/70. [D 20:42:59.176781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 23871. [D 20:42:59.176796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23872. [D 20:42:59.176808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23873. [D 20:42:59.176818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23874. [D 20:42:59.176830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23875. [D 20:42:59.176846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 23876. [D 20:42:59.176855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 23877. [D 20:42:59.176865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 23878. [D 20:42:59.176881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 23879. [D 20:42:59.176891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 23880. [D 20:42:59.176901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 23881. [D 20:42:59.176931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 23882. [D 20:42:59.176947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 23883. [D 20:42:59.176957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 23884. [D 20:42:59.176967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 23885. [D 20:42:59.176983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 23886. [D 20:42:59.176993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 23887. [D 20:42:59.177014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 23888. [D 20:42:59.177030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 23889. [D 20:42:59.177040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 23890. [D 20:42:59.177064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 23891. [D 20:42:59.177074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 23892. [D 20:42:59.177084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 23893. [D 20:42:59.177094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 23894. [D 20:42:59.177110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 23895. [D 20:42:59.177120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 23896. [D 20:42:59.177130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 23897. [D 20:42:59.177154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 23898. [D 20:42:59.177163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 23899. [D 20:42:59.177174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 23900. [D 20:42:59.177184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 23901. [D 20:42:59.177194] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 23902. [D 20:42:59.179450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.179464] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.179475] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.179490] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4734 [D 20:42:59.179503] element 0: offset: 0x2aaaab216bf0, size: 24 [D 20:42:59.179513] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 24/70. [D 20:42:59.188434] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 23902. [D 20:42:59.188450] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 25/70. [D 20:42:59.190746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.190759] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.190770] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:59.199711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.199764] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.199774] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.199813] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4738 [D 20:42:59.199827] element 0: offset: 0x2aaaab20fd40, size: 24 [D 20:42:59.199841] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 26/70. [D 20:42:59.204275] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4738 [D 20:42:59.204312] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 27/70. [D 20:42:59.204411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 23902. [D 20:42:59.204426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23903. [D 20:42:59.204439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23904. [D 20:42:59.204449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23905. [D 20:42:59.204460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23906. [D 20:42:59.204470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 23907. [D 20:42:59.204480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 23908. [D 20:42:59.204490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 23909. [D 20:42:59.204506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 23910. [D 20:42:59.204516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 23911. [D 20:42:59.204526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 23912. [D 20:42:59.204568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 23913. [D 20:42:59.204636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 23914. [D 20:42:59.204648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 23915. [D 20:42:59.204669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 23916. [D 20:42:59.204680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 23917. [D 20:42:59.204690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 23918. [D 20:42:59.204701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 23919. [D 20:42:59.204711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 23920. [D 20:42:59.204720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 23921. [D 20:42:59.204733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 23922. [D 20:42:59.204750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 23923. [D 20:42:59.204759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 23924. [D 20:42:59.204770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 23925. [D 20:42:59.204795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 23926. [D 20:42:59.204805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 23927. [D 20:42:59.204815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 23928. [D 20:42:59.204826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 23929. [D 20:42:59.204836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 23930. [D 20:42:59.204846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 23931. [D 20:42:59.204869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 23932. [D 20:42:59.204882] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 23933. [D 20:42:59.208483] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4734 [D 20:42:59.208553] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 28/70. [D 20:42:59.215982] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23933. [D 20:42:59.216002] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 29/70. [D 20:42:59.216015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 23933. [D 20:42:59.216026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 23934. [D 20:42:59.216041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 23935. [D 20:42:59.216051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 23936. [D 20:42:59.216062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 23937. [D 20:42:59.216072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 23938. [D 20:42:59.216082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 23939. [D 20:42:59.216097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 23940. [D 20:42:59.216108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 23941. [D 20:42:59.216130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 23942. [D 20:42:59.216140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 23943. [D 20:42:59.216156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 23944. [D 20:42:59.216165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 23945. [D 20:42:59.216190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 23946. [D 20:42:59.216201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 23947. [D 20:42:59.216211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 23948. [D 20:42:59.216227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 23949. [D 20:42:59.216236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 23950. [D 20:42:59.216246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 23951. [D 20:42:59.216275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 23952. [D 20:42:59.216287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 23953. [D 20:42:59.216297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 23954. [D 20:42:59.216307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 23955. [D 20:42:59.216318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 23956. [D 20:42:59.216342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 23957. [D 20:42:59.216353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 23958. [D 20:42:59.216363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 23959. [D 20:42:59.216373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 23960. [D 20:42:59.216397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 23961. [D 20:42:59.216407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 23962. [D 20:42:59.216422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 23963. [D 20:42:59.216433] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 23964. [D 20:42:59.216518] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.216545] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.216555] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:59.221995] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 23964. [D 20:42:59.222010] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 30/70. [D 20:42:59.224144] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.224157] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.224167] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:59.253830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.253845] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.253855] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:59.253887] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4741 [D 20:42:59.253898] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:42:59.253909] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 31/70. [D 20:42:59.256324] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4741 [D 20:42:59.256343] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 32/70. [D 20:42:59.256393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 23964. [D 20:42:59.256405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23965. [D 20:42:59.256415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23966. [D 20:42:59.256425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23967. [D 20:42:59.256443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23968. [D 20:42:59.256453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 23969. [D 20:42:59.256463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 23970. [D 20:42:59.256473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 23971. [D 20:42:59.256483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 23972. [D 20:42:59.256493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 23973. [D 20:42:59.256503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 23974. [D 20:42:59.256521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 23975. [D 20:42:59.256531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 23976. [D 20:42:59.256541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 23977. [D 20:42:59.256551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 23978. [D 20:42:59.256577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 23979. [D 20:42:59.256588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 23980. [D 20:42:59.256599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 23981. [D 20:42:59.256608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 23982. [D 20:42:59.256619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 23983. [D 20:42:59.256641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 23984. [D 20:42:59.256651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 23985. [D 20:42:59.256662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 23986. [D 20:42:59.256677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 23987. [D 20:42:59.256687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 23988. [D 20:42:59.256707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 23989. [D 20:42:59.256717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 23990. [D 20:42:59.256727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 23991. [D 20:42:59.256737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 23992. [D 20:42:59.256747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 23993. [D 20:42:59.256764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 23994. [D 20:42:59.256774] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 23995. [D 20:42:59.266204] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 23995. [D 20:42:59.266219] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 33/70. [D 20:42:59.268526] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.268540] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.268549] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:59.279267] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.279282] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.279292] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:59.279307] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4744 [D 20:42:59.279318] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:59.279327] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 34/70. [D 20:42:59.283468] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4744 [D 20:42:59.283539] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 35/70. [D 20:42:59.283693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 23995. [D 20:42:59.283709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 23996. [D 20:42:59.283720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 23997. [D 20:42:59.283731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 23998. [D 20:42:59.283741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 23999. [D 20:42:59.283751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 24000. [D 20:42:59.283761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 24001. [D 20:42:59.283776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 24002. [D 20:42:59.283786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 24003. [D 20:42:59.283796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 24004. [D 20:42:59.283806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 24005. [D 20:42:59.283823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 24006. [D 20:42:59.283834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 24007. [D 20:42:59.283844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 24008. [D 20:42:59.283854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 24009. [D 20:42:59.283864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 24010. [D 20:42:59.283882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 24011. [D 20:42:59.283892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 24012. [D 20:42:59.283901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 24013. [D 20:42:59.283912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 24014. [D 20:42:59.283922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 24015. [D 20:42:59.283932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 24016. [D 20:42:59.283964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 24017. [D 20:42:59.283973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 24018. [D 20:42:59.283984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 24019. [D 20:42:59.283999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 24020. [D 20:42:59.284009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 24021. [D 20:42:59.284031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 24022. [D 20:42:59.284043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 24023. [D 20:42:59.284053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 24024. [D 20:42:59.284063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 24025. [D 20:42:59.284073] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 24026. [D 20:42:59.287683] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.287698] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.287708] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.287743] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4747 [D 20:42:59.287754] element 0: offset: 0x2aaaab216bf0, size: 24 [D 20:42:59.287767] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 36/70. [D 20:42:59.289816] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 24026. [D 20:42:59.289832] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 37/70. [D 20:42:59.292142] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.292156] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.292165] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:59.294425] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4747 [D 20:42:59.294443] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 38/70. [D 20:42:59.294495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 24026. [D 20:42:59.294507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 24027. [D 20:42:59.294518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 24028. [D 20:42:59.294528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 24029. [D 20:42:59.294538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 24030. [D 20:42:59.294548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 24031. [D 20:42:59.294565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 24032. [D 20:42:59.294575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 24033. [D 20:42:59.294584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 24034. [D 20:42:59.294609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 24035. [D 20:42:59.294620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 24036. [D 20:42:59.294631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 24037. [D 20:42:59.294641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 24038. [D 20:42:59.294651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 24039. [D 20:42:59.294662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 24040. [D 20:42:59.294684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 24041. [D 20:42:59.294695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 24042. [D 20:42:59.294709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 24043. [D 20:42:59.294719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 24044. [D 20:42:59.294729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 24045. [D 20:42:59.294751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 24046. [D 20:42:59.294761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 24047. [D 20:42:59.294771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 24048. [D 20:42:59.294781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 24049. [D 20:42:59.294791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 24050. [D 20:42:59.294802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 24051. [D 20:42:59.294828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 24052. [D 20:42:59.294843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 24053. [D 20:42:59.294854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 24054. [D 20:42:59.294864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 24055. [D 20:42:59.294886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 24056. [D 20:42:59.294897] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 24057. [D 20:42:59.300372] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24057. [D 20:42:59.300388] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 39/70. [D 20:42:59.302642] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.302656] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.302666] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:59.357525] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.357540] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.357551] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:59.357567] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4750 [D 20:42:59.357580] element 0: offset: 0x2aaaab20fd40, size: 24 [D 20:42:59.357590] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 40/70. [D 20:42:59.359665] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4750 [D 20:42:59.359733] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 41/70. [D 20:42:59.359783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 24057. [D 20:42:59.359799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 24058. [D 20:42:59.359810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 24059. [D 20:42:59.359820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 24060. [D 20:42:59.359839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 24061. [D 20:42:59.359850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 24062. [D 20:42:59.359860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 24063. [D 20:42:59.359870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 24064. [D 20:42:59.359880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 24065. [D 20:42:59.359891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 24066. [D 20:42:59.359902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 24067. [D 20:42:59.359943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 24068. [D 20:42:59.359952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 24069. [D 20:42:59.359962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 24070. [D 20:42:59.359980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 24071. [D 20:42:59.359991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 24072. [D 20:42:59.360001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 24073. [D 20:42:59.360011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 24074. [D 20:42:59.360027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 24075. [D 20:42:59.360037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 24076. [D 20:42:59.360047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 24077. [D 20:42:59.360057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 24078. [D 20:42:59.360067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 24079. [D 20:42:59.360079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 24080. [D 20:42:59.360102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 24081. [D 20:42:59.360114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 24082. [D 20:42:59.360124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 24083. [D 20:42:59.360134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 24084. [D 20:42:59.360144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 24085. [D 20:42:59.360160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 24086. [D 20:42:59.360171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 24087. [D 20:42:59.360180] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 24088. [D 20:42:59.365668] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 24088. [D 20:42:59.365685] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 42/70. [D 20:42:59.367994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.368009] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.368019] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:59.375649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.375664] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.375674] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:59.375706] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4752 [D 20:42:59.375717] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:42:59.375728] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 43/70. [D 20:42:59.434562] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4752 [D 20:42:59.434635] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 44/70. [D 20:42:59.434688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 24088. [D 20:42:59.434703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 24089. [D 20:42:59.434715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 24090. [D 20:42:59.434725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 24091. [D 20:42:59.434738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 24092. [D 20:42:59.434754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 24093. [D 20:42:59.434764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 24094. [D 20:42:59.434774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 24095. [D 20:42:59.434790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 24096. [D 20:42:59.434800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 24097. [D 20:42:59.434809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 24098. [D 20:42:59.434865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 24099. [D 20:42:59.434878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 24100. [D 20:42:59.434900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 24101. [D 20:42:59.434912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 24102. [D 20:42:59.434922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 24103. [D 20:42:59.434932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 24104. [D 20:42:59.434943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 24105. [D 20:42:59.434952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 24106. [D 20:42:59.434986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 24107. [D 20:42:59.434997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 24108. [D 20:42:59.435007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 24109. [D 20:42:59.435017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 24110. [D 20:42:59.435027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 24111. [D 20:42:59.435037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 24112. [D 20:42:59.435070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 24113. [D 20:42:59.435080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 24114. [D 20:42:59.435090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 24115. [D 20:42:59.435101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 24116. [D 20:42:59.435124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 24117. [D 20:42:59.435134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 24118. [D 20:42:59.435144] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 24119. [D 20:42:59.440559] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24119. [D 20:42:59.440574] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 45/70. [D 20:42:59.442869] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.442884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.442895] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:59.487876] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.487891] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.487902] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:59.487934] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4756 [D 20:42:59.487945] element 0: offset: 0x2aaaab23d280, size: 24 [D 20:42:59.487956] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 46/70. [D 20:42:59.490117] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4756 [D 20:42:59.490169] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 47/70. [D 20:42:59.495316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 24119. [D 20:42:59.495379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 24120. [D 20:42:59.495391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 24121. [D 20:42:59.495402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 24122. [D 20:42:59.495412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 24123. [D 20:42:59.495422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 24124. [D 20:42:59.495432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 24125. [D 20:42:59.495443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 24126. [D 20:42:59.495453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 24127. [D 20:42:59.495463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 24128. [D 20:42:59.495473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 24129. [D 20:42:59.495488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 24130. [D 20:42:59.495498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 24131. [D 20:42:59.495508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 24132. [D 20:42:59.495518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 24133. [D 20:42:59.495559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 24134. [D 20:42:59.495570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 24135. [D 20:42:59.495580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 24136. [D 20:42:59.495607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 24137. [D 20:42:59.495618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 24138. [D 20:42:59.495629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 24139. [D 20:42:59.495639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 24140. [D 20:42:59.495655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 24141. [D 20:42:59.495679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 24142. [D 20:42:59.495691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 24143. [D 20:42:59.495701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 24144. [D 20:42:59.495713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 24145. [D 20:42:59.495728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 24146. [D 20:42:59.495738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 24147. [D 20:42:59.495748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 24148. [D 20:42:59.495775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 24149. [D 20:42:59.495785] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 24150. [D 20:42:59.500184] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.500200] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.500211] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.500246] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4759 [D 20:42:59.500257] element 0: offset: 0x2aaaab216bf0, size: 24 [D 20:42:59.500272] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 48/70. [D 20:42:59.507134] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 24150. [D 20:42:59.507149] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 49/70. [D 20:42:59.509555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.509569] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.509578] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:59.511592] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4759 [D 20:42:59.511611] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 50/70. [D 20:42:59.513801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 24150. [D 20:42:59.513850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 24151. [D 20:42:59.513862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 24152. [D 20:42:59.513873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 24153. [D 20:42:59.513884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 24154. [D 20:42:59.513895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 24155. [D 20:42:59.513904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 24156. [D 20:42:59.513915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 24157. [D 20:42:59.513925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 24158. [D 20:42:59.513935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 24159. [D 20:42:59.513944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 24160. [D 20:42:59.513961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 24161. [D 20:42:59.513970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 24162. [D 20:42:59.513980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 24163. [D 20:42:59.513991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 24164. [D 20:42:59.514001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 24165. [D 20:42:59.514030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 24166. [D 20:42:59.514040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 24167. [D 20:42:59.514050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 24168. [D 20:42:59.514061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 24169. [D 20:42:59.514085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 24170. [D 20:42:59.514101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 24171. [D 20:42:59.514112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 24172. [D 20:42:59.514122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 24173. [D 20:42:59.514132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 24174. [D 20:42:59.514155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 24175. [D 20:42:59.514166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 24176. [D 20:42:59.514177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 24177. [D 20:42:59.514187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 24178. [D 20:42:59.514216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 24179. [D 20:42:59.514227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 24180. [D 20:42:59.514237] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 24181. [D 20:42:59.525570] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24181. [D 20:42:59.525587] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 51/70. [D 20:42:59.525739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.525753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.525763] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:59.533283] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.533297] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.533307] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:59.533340] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4764 [D 20:42:59.533351] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:59.533366] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 52/70. [D 20:42:59.533385] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.533399] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.533407] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.533439] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4765 [D 20:42:59.533449] element 0: offset: 0x2aaaab20fd40, size: 24 [D 20:42:59.533459] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 53/70. [D 20:42:59.533492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.533504] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.533513] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:59.533527] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4768 [D 20:42:59.533538] element 0: offset: 0x2aaaab234060, size: 24 [D 20:42:59.533547] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 54/70. [D 20:42:59.536054] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.536069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.536079] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:59.536094] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4771 [D 20:42:59.536104] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:42:59.536115] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 55/70. [D 20:42:59.538138] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4764 [D 20:42:59.538158] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 56/70. [D 20:42:59.540650] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4768 [D 20:42:59.540681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 24181. [D 20:42:59.540749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 24182. [D 20:42:59.540760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 24183. [D 20:42:59.540771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 24184. [D 20:42:59.540785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 24185. [D 20:42:59.540844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 24186. [D 20:42:59.540854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 24187. [D 20:42:59.540864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 24188. [D 20:42:59.540875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 24189. [D 20:42:59.540885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 24190. [D 20:42:59.540906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 24191. [D 20:42:59.540923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 24192. [D 20:42:59.540932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 24193. [D 20:42:59.540943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 24194. [D 20:42:59.540958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 24195. [D 20:42:59.540968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 24196. [D 20:42:59.540978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 24197. [D 20:42:59.540994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 24198. [D 20:42:59.541021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 24199. [D 20:42:59.541042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 24200. [D 20:42:59.541057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 24201. [D 20:42:59.541067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 24202. [D 20:42:59.541077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 24203. [D 20:42:59.541092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 24204. [D 20:42:59.541116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 24205. [D 20:42:59.541129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 24206. [D 20:42:59.541139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 24207. [D 20:42:59.541149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 24208. [D 20:42:59.541165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 24209. [D 20:42:59.541190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 24210. [D 20:42:59.541202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 24211. [D 20:42:59.541211] openib_post_sr_rdmaw: ibv_post_send wr_id 64d750 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 24212. [D 20:42:59.541259] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 57/70. [D 20:42:59.545837] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4771 [D 20:42:59.545854] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 58/70. [D 20:42:59.552363] openib_check_cq: completed rdma wr_id 64d750, nic_wr_credit 24212. [D 20:42:59.552438] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 59/70. [D 20:42:59.552456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 24212. [D 20:42:59.552468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 24213. [D 20:42:59.552478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 24214. [D 20:42:59.552494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 24215. [D 20:42:59.552505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 24216. [D 20:42:59.552515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 24217. [D 20:42:59.552526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 24218. [D 20:42:59.552537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 24219. [D 20:42:59.552597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 24220. [D 20:42:59.552620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 24221. [D 20:42:59.552630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 24222. [D 20:42:59.552640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 24223. [D 20:42:59.552650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 24224. [D 20:42:59.552679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 24225. [D 20:42:59.552690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 24226. [D 20:42:59.552703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 24227. [D 20:42:59.552713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 24228. [D 20:42:59.552728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 24229. [D 20:42:59.552739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 24230. [D 20:42:59.552764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 24231. [D 20:42:59.552774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 24232. [D 20:42:59.552784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 24233. [D 20:42:59.552794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 24234. [D 20:42:59.552819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 24235. [D 20:42:59.552829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 24236. [D 20:42:59.552843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 24237. [D 20:42:59.552852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 24238. [D 20:42:59.552862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 24239. [D 20:42:59.552885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 24240. [D 20:42:59.552895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 24241. [D 20:42:59.552906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 24242. [D 20:42:59.552916] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 24243. [D 20:42:59.552929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 24244. [D 20:42:59.552959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 24245. [D 20:42:59.552972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 24246. [D 20:42:59.552985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 24247. [D 20:42:59.552995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 24248. [D 20:42:59.553005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 24249. [D 20:42:59.553027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 24250. [D 20:42:59.553037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 24251. [D 20:42:59.553048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 24252. [D 20:42:59.553058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 24253. [D 20:42:59.553068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 24254. [D 20:42:59.553090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 24255. [D 20:42:59.553102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 24256. [D 20:42:59.553112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 24257. [D 20:42:59.553122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 24258. [D 20:42:59.553132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 24259. [D 20:42:59.553143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 24260. [D 20:42:59.553165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 24261. [D 20:42:59.553175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 24262. [D 20:42:59.553191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 24263. [D 20:42:59.553201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 24264. [D 20:42:59.553211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 24265. [D 20:42:59.553234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 24266. [D 20:42:59.553244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 24267. [D 20:42:59.553259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 24268. [D 20:42:59.553270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 24269. [D 20:42:59.553280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 24270. [D 20:42:59.553303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 24271. [D 20:42:59.553313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 24272. [D 20:42:59.553323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 24273. [D 20:42:59.553337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 24274. [D 20:42:59.553347] openib_post_sr_rdmaw: ibv_post_send wr_id 622f70 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 24275. [D 20:42:59.553429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.553456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.553467] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:59.561727] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.561743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.561754] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:59.561787] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4774 [D 20:42:59.561798] element 0: offset: 0x2aaaab23d280, size: 24 [D 20:42:59.561810] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 60/70. [D 20:42:59.564230] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24275. [D 20:42:59.564247] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 0/70. [D 20:42:59.575962] openib_check_cq: completed rdma wr_id 622f70, nic_wr_credit 24274. [D 20:42:59.576002] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 1/70. [D 20:42:59.578240] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.578256] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.578266] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:59.578341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.578354] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.578363] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:59.580591] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4774 [D 20:42:59.580612] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 2/70. [D 20:42:59.580763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 24274. [D 20:42:59.580819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 24275. [D 20:42:59.580830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 24276. [D 20:42:59.580841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 24277. [D 20:42:59.580855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 24278. [D 20:42:59.580865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 24279. [D 20:42:59.580875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 24280. [D 20:42:59.580891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 24281. [D 20:42:59.580901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 24282. [D 20:42:59.580911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 24283. [D 20:42:59.580927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 24284. [D 20:42:59.580937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 24285. [D 20:42:59.580946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 24286. [D 20:42:59.580984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 24287. [D 20:42:59.580996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 24288. [D 20:42:59.581006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 24289. [D 20:42:59.581017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 24290. [D 20:42:59.581041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 24291. [D 20:42:59.581053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 24292. [D 20:42:59.581063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 24293. [D 20:42:59.581072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 24294. [D 20:42:59.581097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 24295. [D 20:42:59.581107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 24296. [D 20:42:59.581118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 24297. [D 20:42:59.581128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 24298. [D 20:42:59.581138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 24299. [D 20:42:59.581167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 24300. [D 20:42:59.581178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 24301. [D 20:42:59.581188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 24302. [D 20:42:59.581203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 24303. [D 20:42:59.581213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 24304. [D 20:42:59.581223] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 24305. [D 20:42:59.583720] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4765 [D 20:42:59.583739] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 3/70. [D 20:42:59.586728] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24305. [D 20:42:59.586750] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 4/70. [D 20:42:59.589082] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.589096] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.589106] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:59.591876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 24305. [D 20:42:59.591891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 24306. [D 20:42:59.591903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 24307. [D 20:42:59.591913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 24308. [D 20:42:59.591926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 24309. [D 20:42:59.591940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 24310. [D 20:42:59.591951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 24311. [D 20:42:59.591960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 24312. [D 20:42:59.591976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 24313. [D 20:42:59.591986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 24314. [D 20:42:59.591996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 24315. [D 20:42:59.592011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 24316. [D 20:42:59.592021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 24317. [D 20:42:59.592031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 24318. [D 20:42:59.592047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 24319. [D 20:42:59.592074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 24320. [D 20:42:59.592085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 24321. [D 20:42:59.592095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 24322. [D 20:42:59.592111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 24323. [D 20:42:59.592134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 24324. [D 20:42:59.592147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 24325. [D 20:42:59.592157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 24326. [D 20:42:59.592167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 24327. [D 20:42:59.592192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 24328. [D 20:42:59.592201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 24329. [D 20:42:59.592216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 24330. [D 20:42:59.592226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 24331. [D 20:42:59.592236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 24332. [D 20:42:59.592260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 24333. [D 20:42:59.592270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 24334. [D 20:42:59.592280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 24335. [D 20:42:59.592291] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 24336. [D 20:42:59.596967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.596982] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.596993] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.597027] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4778 [D 20:42:59.597038] element 0: offset: 0x2aaaab209380, size: 24 [D 20:42:59.597052] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 5/70. [D 20:42:59.597072] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.597082] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.597090] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:59.597108] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4780 [D 20:42:59.597118] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:42:59.597128] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 6/70. [D 20:42:59.603452] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 24336. [D 20:42:59.603466] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 7/70. [D 20:42:59.605790] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.605804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.605814] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:59.607944] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4778 [D 20:42:59.607964] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 8/70. [D 20:42:59.608702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 24336. [D 20:42:59.608763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 24337. [D 20:42:59.608775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 24338. [D 20:42:59.608786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 24339. [D 20:42:59.608800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 24340. [D 20:42:59.608810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 24341. [D 20:42:59.608822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 24342. [D 20:42:59.608836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 24343. [D 20:42:59.608846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 24344. [D 20:42:59.608856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 24345. [D 20:42:59.608872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 24346. [D 20:42:59.608881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 24347. [D 20:42:59.608891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 24348. [D 20:42:59.608928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 24349. [D 20:42:59.608939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 24350. [D 20:42:59.608949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 24351. [D 20:42:59.608959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 24352. [D 20:42:59.608989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 24353. [D 20:42:59.609012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 24354. [D 20:42:59.609030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 24355. [D 20:42:59.609040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 24356. [D 20:42:59.609049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 24357. [D 20:42:59.609059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 24358. [D 20:42:59.609068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 24359. [D 20:42:59.609078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 24360. [D 20:42:59.609087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 24361. [D 20:42:59.609097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 24362. [D 20:42:59.609106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 24363. [D 20:42:59.609116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 24364. [D 20:42:59.609125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 24365. [D 20:42:59.609135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 24366. [D 20:42:59.609144] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 24367. [D 20:42:59.611228] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4780 [D 20:42:59.611240] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 9/70. [D 20:42:59.619901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.619952] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.619963] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:59.620000] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4783 [D 20:42:59.620014] element 0: offset: 0x2aaaab234060, size: 24 [D 20:42:59.620028] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 10/70. [D 20:42:59.620050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.620060] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.620069] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:59.620084] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4786 [D 20:42:59.620114] element 0: offset: 0x2aaaab23d280, size: 24 [D 20:42:59.620124] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 11/70. [D 20:42:59.620451] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24367. [D 20:42:59.620467] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 12/70. [D 20:42:59.620546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 24367. [D 20:42:59.620560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 24368. [D 20:42:59.620571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 24369. [D 20:42:59.620581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 24370. [D 20:42:59.620592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 24371. [D 20:42:59.620602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 24372. [D 20:42:59.620612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 24373. [D 20:42:59.620638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 24374. [D 20:42:59.620648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 24375. [D 20:42:59.620660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 24376. [D 20:42:59.620675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 24377. [D 20:42:59.620685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 24378. [D 20:42:59.620694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 24379. [D 20:42:59.620710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 24380. [D 20:42:59.620731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 24381. [D 20:42:59.620741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 24382. [D 20:42:59.620752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 24383. [D 20:42:59.620762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 24384. [D 20:42:59.620773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 24385. [D 20:42:59.620783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 24386. [D 20:42:59.620793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 24387. [D 20:42:59.620803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 24388. [D 20:42:59.620833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 24389. [D 20:42:59.620843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 24390. [D 20:42:59.620855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 24391. [D 20:42:59.620865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 24392. [D 20:42:59.620878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 24393. [D 20:42:59.620892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 24394. [D 20:42:59.620903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 24395. [D 20:42:59.620912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 24396. [D 20:42:59.620945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 24397. [D 20:42:59.620955] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 24398. [D 20:42:59.623376] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.623390] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.623400] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:59.625593] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4786 [D 20:42:59.625650] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 13/70. [D 20:42:59.629742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.629783] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.629794] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:59.629827] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4789 [D 20:42:59.629838] element 0: offset: 0x2aaaab2300d0, size: 24 [D 20:42:59.629851] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 14/70. [D 20:42:59.632235] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 24398. [D 20:42:59.632251] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 15/70. [D 20:42:59.632275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 24398. [D 20:42:59.632288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 24399. [D 20:42:59.632298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 24400. [D 20:42:59.632309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 24401. [D 20:42:59.632320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 24402. [D 20:42:59.632330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 24403. [D 20:42:59.632340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 24404. [D 20:42:59.632350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 24405. [D 20:42:59.632360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 24406. [D 20:42:59.632370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 24407. [D 20:42:59.632388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 24408. [D 20:42:59.632398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 24409. [D 20:42:59.632408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 24410. [D 20:42:59.632425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 24411. [D 20:42:59.632435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 24412. [D 20:42:59.632445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 24413. [D 20:42:59.632506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 24414. [D 20:42:59.632517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 24415. [D 20:42:59.632527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 24416. [D 20:42:59.632537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 24417. [D 20:42:59.632547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 24418. [D 20:42:59.632557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 24419. [D 20:42:59.632647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 24420. [D 20:42:59.632661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 24421. [D 20:42:59.632671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 24422. [D 20:42:59.632685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 24423. [D 20:42:59.632696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 24424. [D 20:42:59.632706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 24425. [D 20:42:59.632730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 24426. [D 20:42:59.632740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 24427. [D 20:42:59.632750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 24428. [D 20:42:59.632760] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 24429. [D 20:42:59.632801] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.632812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.632838] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:59.635169] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4789 [D 20:42:59.635226] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 16/70. [D 20:42:59.641037] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24429. [D 20:42:59.641061] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 17/70. [D 20:42:59.641074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 24429. [D 20:42:59.641085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 24430. [D 20:42:59.641096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 24431. [D 20:42:59.641107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 24432. [D 20:42:59.641116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 24433. [D 20:42:59.641127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 24434. [D 20:42:59.641137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 24435. [D 20:42:59.641147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 24436. [D 20:42:59.641157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 24437. [D 20:42:59.641193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 24438. [D 20:42:59.641203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 24439. [D 20:42:59.641213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 24440. [D 20:42:59.641229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 24441. [D 20:42:59.641239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 24442. [D 20:42:59.641265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 24443. [D 20:42:59.641276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 24444. [D 20:42:59.641286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 24445. [D 20:42:59.641296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 24446. [D 20:42:59.641307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 24447. [D 20:42:59.641317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 24448. [D 20:42:59.641327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 24449. [D 20:42:59.641360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 24450. [D 20:42:59.641370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 24451. [D 20:42:59.641384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 24452. [D 20:42:59.641394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 24453. [D 20:42:59.641406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 24454. [D 20:42:59.641421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 24455. [D 20:42:59.641431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 24456. [D 20:42:59.641458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 24457. [D 20:42:59.641468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 24458. [D 20:42:59.641478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 24459. [D 20:42:59.641491] openib_post_sr_rdmaw: ibv_post_send wr_id 661d80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 24460. [D 20:42:59.643854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.643868] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.643878] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:59.643905] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4792 [D 20:42:59.643915] element 0: offset: 0x2aaaab216bf0, size: 24 [D 20:42:59.643927] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 18/70. [D 20:42:59.643949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.643958] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.643968] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:59.647035] openib_check_cq: completed rdma wr_id 661d80, nic_wr_credit 24460. [D 20:42:59.647087] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 19/70. [D 20:42:59.649360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.649377] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.649386] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:59.652091] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4792 [D 20:42:59.652145] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 20/70. [D 20:42:59.652197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 24460. [D 20:42:59.652229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 24461. [D 20:42:59.652240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 24462. [D 20:42:59.652251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 24463. [D 20:42:59.652261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 24464. [D 20:42:59.652279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 24465. [D 20:42:59.652290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 24466. [D 20:42:59.652300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 24467. [D 20:42:59.652309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 24468. [D 20:42:59.652320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 24469. [D 20:42:59.652330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 24470. [D 20:42:59.652355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 24471. [D 20:42:59.652365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 24472. [D 20:42:59.652381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 24473. [D 20:42:59.652391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 24474. [D 20:42:59.652401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 24475. [D 20:42:59.652417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 24476. [D 20:42:59.652428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 24477. [D 20:42:59.652454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 24478. [D 20:42:59.652464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 24479. [D 20:42:59.652474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 24480. [D 20:42:59.652489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 24481. [D 20:42:59.652499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 24482. [D 20:42:59.652509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 24483. [D 20:42:59.652540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 24484. [D 20:42:59.652551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 24485. [D 20:42:59.652561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 24486. [D 20:42:59.652571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 24487. [D 20:42:59.652587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 24488. [D 20:42:59.652617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 24489. [D 20:42:59.652627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 24490. [D 20:42:59.652637] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 24491. [D 20:42:59.657204] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4783 [D 20:42:59.657223] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 21/70. [D 20:42:59.658178] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24491. [D 20:42:59.658201] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 22/70. [D 20:42:59.658214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 24491. [D 20:42:59.658224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 24492. [D 20:42:59.658235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 24493. [D 20:42:59.658245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 24494. [D 20:42:59.658255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 24495. [D 20:42:59.658265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 24496. [D 20:42:59.658276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 24497. [D 20:42:59.658286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 24498. [D 20:42:59.658296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 24499. [D 20:42:59.658328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 24500. [D 20:42:59.658338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 24501. [D 20:42:59.658349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 24502. [D 20:42:59.658363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 24503. [D 20:42:59.658385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 24504. [D 20:42:59.658396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 24505. [D 20:42:59.658406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 24506. [D 20:42:59.658416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 24507. [D 20:42:59.658426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 24508. [D 20:42:59.658436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 24509. [D 20:42:59.658446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 24510. [D 20:42:59.658456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 24511. [D 20:42:59.658486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 24512. [D 20:42:59.658496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 24513. [D 20:42:59.658509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 24514. [D 20:42:59.658520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 24515. [D 20:42:59.658530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 24516. [D 20:42:59.658553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 24517. [D 20:42:59.658563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 24518. [D 20:42:59.658573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 24519. [D 20:42:59.658584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 24520. [D 20:42:59.658594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 24521. [D 20:42:59.658618] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 24522. [D 20:42:59.660860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.660875] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.660886] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:59.664079] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 24522. [D 20:42:59.664094] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 23/70. [D 20:42:59.665729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.665743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.665753] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:59.962531] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.962546] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.962558] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:59.962592] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4796 [D 20:42:59.962603] element 0: offset: 0x2aaaab20fd40, size: 24 [D 20:42:59.962615] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 24/70. [D 20:42:59.962634] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.962647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.962657] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:59.962671] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4799 [D 20:42:59.962681] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:42:59.962691] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 25/70. [D 20:42:59.962707] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.962716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.962728] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:59.962781] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4801 [D 20:42:59.962791] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:59.962802] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 26/70. [D 20:42:59.965314] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:59.965328] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.965336] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:59.965352] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4804 [D 20:42:59.965361] element 0: offset: 0x2aaaab209380, size: 24 [D 20:42:59.965371] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 27/70. [D 20:42:59.967540] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4799 [D 20:42:59.967576] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 28/70. [D 20:42:59.969558] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4801 [D 20:42:59.969574] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 29/70. [D 20:42:59.969611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 24522. [D 20:42:59.969677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 24523. [D 20:42:59.969688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 24524. [D 20:42:59.969699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 24525. [D 20:42:59.969714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 24526. [D 20:42:59.969724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 24527. [D 20:42:59.969733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 24528. [D 20:42:59.969744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 24529. [D 20:42:59.969765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 24530. [D 20:42:59.969775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 24531. [D 20:42:59.969785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 24532. [D 20:42:59.969824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 24533. [D 20:42:59.969835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 24534. [D 20:42:59.969845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 24535. [D 20:42:59.969855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 24536. [D 20:42:59.969880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 24537. [D 20:42:59.969890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 24538. [D 20:42:59.969904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 24539. [D 20:42:59.969914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 24540. [D 20:42:59.969924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 24541. [D 20:42:59.969953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 24542. [D 20:42:59.969964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 24543. [D 20:42:59.969975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 24544. [D 20:42:59.969985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 24545. [D 20:42:59.970014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 24546. [D 20:42:59.970025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 24547. [D 20:42:59.970038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 24548. [D 20:42:59.970048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 24549. [D 20:42:59.970058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 24550. [D 20:42:59.970081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 24551. [D 20:42:59.970090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 24552. [D 20:42:59.970101] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 24553. [D 20:42:59.970115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 24554. [D 20:42:59.970125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 24555. [D 20:42:59.970154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 24556. [D 20:42:59.970164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 24557. [D 20:42:59.970178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 24558. [D 20:42:59.970188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 24559. [D 20:42:59.970197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 24560. [D 20:42:59.970222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 24561. [D 20:42:59.970232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 24562. [D 20:42:59.970245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 24563. [D 20:42:59.970255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 24564. [D 20:42:59.970265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 24565. [D 20:42:59.970298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 24566. [D 20:42:59.970308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 24567. [D 20:42:59.970318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 24568. [D 20:42:59.970334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 24569. [D 20:42:59.970360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 24570. [D 20:42:59.970373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 24571. [D 20:42:59.970382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 24572. [D 20:42:59.970393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 24573. [D 20:42:59.970406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 24574. [D 20:42:59.970416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 24575. [D 20:42:59.970426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 24576. [D 20:42:59.970455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 24577. [D 20:42:59.970480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 24578. [D 20:42:59.970491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 24579. [D 20:42:59.970519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 24580. [D 20:42:59.970539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 24581. [D 20:42:59.970549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 24582. [D 20:42:59.970559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 24583. [D 20:42:59.970584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 24584. [D 20:42:59.970594] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 24585. [D 20:42:59.975124] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4804 [D 20:42:59.975143] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 30/70. [D 20:42:59.980233] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24585. [D 20:42:59.980302] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 31/70. [D 20:42:59.991731] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 24584. [D 20:42:59.991755] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 32/70. [D 20:42:59.991787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 24584. [D 20:42:59.991800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 24585. [D 20:42:59.991810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 24586. [D 20:42:59.991825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 24587. [D 20:42:59.991835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 24588. [D 20:42:59.991845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 24589. [D 20:42:59.991859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 24590. [D 20:42:59.991869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 24591. [D 20:42:59.991879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 24592. [D 20:42:59.991894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 24593. [D 20:42:59.991927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 24594. [D 20:42:59.991938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 24595. [D 20:42:59.991951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 24596. [D 20:42:59.991975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 24597. [D 20:42:59.991989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 24598. [D 20:42:59.991999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 24599. [D 20:42:59.992009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 24600. [D 20:42:59.992037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 24601. [D 20:42:59.992050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 24602. [D 20:42:59.992063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 24603. [D 20:42:59.992073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 24604. [D 20:42:59.992095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 24605. [D 20:42:59.992106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 24606. [D 20:42:59.992116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 24607. [D 20:42:59.992130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 24608. [D 20:42:59.992140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 24609. [D 20:42:59.992150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 24610. [D 20:42:59.992176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 24611. [D 20:42:59.992186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 24612. [D 20:42:59.992197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 24613. [D 20:42:59.992207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 24614. [D 20:42:59.992217] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 24615. [D 20:42:59.993785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.993800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.993810] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:59.993827] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:59.993839] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:59.993848] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:00.003596] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 24615. [D 20:43:00.003666] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 33/70. [D 20:43:00.005897] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.005913] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.005924] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:00.017222] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4796 [D 20:43:00.017251] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 34/70. [D 20:43:00.023150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 24615. [D 20:43:00.023179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 24616. [D 20:43:00.023190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 24617. [D 20:43:00.023200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 24618. [D 20:43:00.023217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 24619. [D 20:43:00.023228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 24620. [D 20:43:00.023238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 24621. [D 20:43:00.023249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 24622. [D 20:43:00.023259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 24623. [D 20:43:00.023269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 24624. [D 20:43:00.023279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 24625. [D 20:43:00.023295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 24626. [D 20:43:00.023325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 24627. [D 20:43:00.023336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 24628. [D 20:43:00.023346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 24629. [D 20:43:00.023369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 24630. [D 20:43:00.023381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 24631. [D 20:43:00.023390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 24632. [D 20:43:00.023405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 24633. [D 20:43:00.023415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 24634. [D 20:43:00.023425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 24635. [D 20:43:00.023447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 24636. [D 20:43:00.023457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 24637. [D 20:43:00.023468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 24638. [D 20:43:00.023479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 24639. [D 20:43:00.023488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 24640. [D 20:43:00.023499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 24641. [D 20:43:00.023524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 24642. [D 20:43:00.023534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 24643. [D 20:43:00.023544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 24644. [D 20:43:00.023559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 24645. [D 20:43:00.023569] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 24646. [D 20:43:00.028573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.028589] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.028600] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:00.028636] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4809 [D 20:43:00.028648] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:43:00.028661] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 35/70. [D 20:43:00.028686] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.028696] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.028706] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:00.028741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4811 [D 20:43:00.028752] element 0: offset: 0x2aaaab23d280, size: 24 [D 20:43:00.028763] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 36/70. [D 20:43:00.028779] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.028789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.028798] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:00.028812] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4813 [D 20:43:00.028825] element 0: offset: 0x2aaaab234060, size: 24 [D 20:43:00.028846] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 37/70. [D 20:43:00.029057] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24646. [D 20:43:00.029071] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 38/70. [D 20:43:00.029874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.029889] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.029899] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:00.033427] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4809 [D 20:43:00.033448] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 39/70. [D 20:43:00.034541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 24646. [D 20:43:00.034596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 24647. [D 20:43:00.034608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 24648. [D 20:43:00.034619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 24649. [D 20:43:00.034630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 24650. [D 20:43:00.034640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 24651. [D 20:43:00.034650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 24652. [D 20:43:00.034660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 24653. [D 20:43:00.034671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 24654. [D 20:43:00.034681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 24655. [D 20:43:00.034693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 24656. [D 20:43:00.034709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 24657. [D 20:43:00.034719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 24658. [D 20:43:00.034729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 24659. [D 20:43:00.034769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 24660. [D 20:43:00.034780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 24661. [D 20:43:00.034790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 24662. [D 20:43:00.034801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 24663. [D 20:43:00.034811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 24664. [D 20:43:00.034836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 24665. [D 20:43:00.034850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 24666. [D 20:43:00.034860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 24667. [D 20:43:00.034882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 24668. [D 20:43:00.034892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 24669. [D 20:43:00.034902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 24670. [D 20:43:00.034918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 24671. [D 20:43:00.034928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 24672. [D 20:43:00.034938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 24673. [D 20:43:00.034967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 24674. [D 20:43:00.034978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 24675. [D 20:43:00.034992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 24676. [D 20:43:00.035002] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 24677. [D 20:43:00.039449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.039465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.039476] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:00.039512] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4815 [D 20:43:00.039526] element 0: offset: 0x2aaaab216bf0, size: 24 [D 20:43:00.039540] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 40/70. [D 20:43:00.041716] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4811 [D 20:43:00.041737] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 41/70. [D 20:43:00.044137] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4813 [D 20:43:00.044154] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 42/70. [D 20:43:00.046232] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24677. [D 20:43:00.046296] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 43/70. [D 20:43:00.046314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 24677. [D 20:43:00.046326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 24678. [D 20:43:00.046336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 24679. [D 20:43:00.046346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 24680. [D 20:43:00.046360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 24681. [D 20:43:00.046370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 24682. [D 20:43:00.046380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 24683. [D 20:43:00.046395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 24684. [D 20:43:00.046405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 24685. [D 20:43:00.046415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 24686. [D 20:43:00.046430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 24687. [D 20:43:00.046440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 24688. [D 20:43:00.046450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 24689. [D 20:43:00.046485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 24690. [D 20:43:00.046495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 24691. [D 20:43:00.046505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 24692. [D 20:43:00.046515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 24693. [D 20:43:00.046545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 24694. [D 20:43:00.046556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 24695. [D 20:43:00.046569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 24696. [D 20:43:00.046578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 24697. [D 20:43:00.046601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 24698. [D 20:43:00.046611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 24699. [D 20:43:00.046627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 24700. [D 20:43:00.046638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 24701. [D 20:43:00.046649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 24702. [D 20:43:00.046659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 24703. [D 20:43:00.046685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 24704. [D 20:43:00.046695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 24705. [D 20:43:00.046706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 24706. [D 20:43:00.046716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 24707. [D 20:43:00.046726] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 24708. [D 20:43:00.046753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 24709. [D 20:43:00.046764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 24710. [D 20:43:00.046774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 24711. [D 20:43:00.046784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 24712. [D 20:43:00.046795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 24713. [D 20:43:00.046818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 24714. [D 20:43:00.046829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 24715. [D 20:43:00.046840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 24716. [D 20:43:00.046850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 24717. [D 20:43:00.046861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 24718. [D 20:43:00.046883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 24719. [D 20:43:00.046893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 24720. [D 20:43:00.046908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 24721. [D 20:43:00.046918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 24722. [D 20:43:00.046928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 24723. [D 20:43:00.046950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 24724. [D 20:43:00.046960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 24725. [D 20:43:00.046971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 24726. [D 20:43:00.046981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 24727. [D 20:43:00.046991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 24728. [D 20:43:00.047019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 24729. [D 20:43:00.047030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 24730. [D 20:43:00.047042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 24731. [D 20:43:00.047056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 24732. [D 20:43:00.047067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 24733. [D 20:43:00.047091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 24734. [D 20:43:00.047101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 24735. [D 20:43:00.047111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 24736. [D 20:43:00.047125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 24737. [D 20:43:00.047136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 24738. [D 20:43:00.047145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 24739. [D 20:43:00.047173] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 24740. [D 20:43:00.047236] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.047251] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.047261] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:00.055042] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4815 [D 20:43:00.055060] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 44/70. [D 20:43:00.058130] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 24740. [D 20:43:00.058199] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 45/70. [D 20:43:00.069393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.069410] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.069425] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:00.069464] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4819 [D 20:43:00.069477] element 0: offset: 0x2aaaab2300d0, size: 24 [D 20:43:00.069492] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 46/70. [D 20:43:00.069831] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 24739. [D 20:43:00.069846] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 47/70. [D 20:43:00.069864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 24739. [D 20:43:00.069878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 24740. [D 20:43:00.069890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 24741. [D 20:43:00.069901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 24742. [D 20:43:00.069914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 24743. [D 20:43:00.069927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 24744. [D 20:43:00.069939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 24745. [D 20:43:00.069951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 24746. [D 20:43:00.069963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 24747. [D 20:43:00.069975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 24748. [D 20:43:00.069988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 24749. [D 20:43:00.070000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 24750. [D 20:43:00.070013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 24751. [D 20:43:00.070025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 24752. [D 20:43:00.070037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 24753. [D 20:43:00.070050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 24754. [D 20:43:00.070062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 24755. [D 20:43:00.070075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 24756. [D 20:43:00.070087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 24757. [D 20:43:00.070099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 24758. [D 20:43:00.070112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 24759. [D 20:43:00.070124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 24760. [D 20:43:00.070136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 24761. [D 20:43:00.070149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 24762. [D 20:43:00.070162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 24763. [D 20:43:00.070174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 24764. [D 20:43:00.070186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 24765. [D 20:43:00.070198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 24766. [D 20:43:00.070211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 24767. [D 20:43:00.070223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 24768. [D 20:43:00.070233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 24769. [D 20:43:00.070244] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 24770. [D 20:43:00.072707] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.072722] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.072735] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:00.072754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.072769] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.072780] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:00.075156] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4819 [D 20:43:00.075175] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 48/70. [D 20:43:00.081735] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24770. [D 20:43:00.081806] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 49/70. [D 20:43:00.081826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 24770. [D 20:43:00.081839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 24771. [D 20:43:00.081852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 24772. [D 20:43:00.081865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 24773. [D 20:43:00.081878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 24774. [D 20:43:00.081890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 24775. [D 20:43:00.081903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 24776. [D 20:43:00.081915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 24777. [D 20:43:00.081928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 24778. [D 20:43:00.081940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 24779. [D 20:43:00.081953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 24780. [D 20:43:00.081966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 24781. [D 20:43:00.081978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 24782. [D 20:43:00.081991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 24783. [D 20:43:00.082004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 24784. [D 20:43:00.082016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 24785. [D 20:43:00.082029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 24786. [D 20:43:00.082042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 24787. [D 20:43:00.082054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 24788. [D 20:43:00.082066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 24789. [D 20:43:00.082079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 24790. [D 20:43:00.082091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 24791. [D 20:43:00.082104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 24792. [D 20:43:00.082117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 24793. [D 20:43:00.082129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 24794. [D 20:43:00.082142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 24795. [D 20:43:00.082155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 24796. [D 20:43:00.082167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 24797. [D 20:43:00.082180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 24798. [D 20:43:00.082193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 24799. [D 20:43:00.082203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 24800. [D 20:43:00.082214] openib_post_sr_rdmaw: ibv_post_send wr_id 6a6110 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 24801. [D 20:43:00.084513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.084529] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.084542] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:00.089754] openib_check_cq: completed rdma wr_id 6a6110, nic_wr_credit 24801. [D 20:43:00.089791] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 50/70. [D 20:43:00.089779] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.092090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.092099] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:00.092133] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4822 [D 20:43:00.092144] element 0: offset: 0x2aaaab208970, size: 24 [D 20:43:00.092158] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 51/70. [D 20:43:00.092182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.092196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.092205] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:00.092219] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.092229] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.092258] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:00.092274] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4824 [D 20:43:00.092296] element 0: offset: 0x2aaaab202b50, size: 24 [D 20:43:00.092307] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 52/70. [D 20:43:00.097382] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4824 [D 20:43:00.097449] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 53/70. [D 20:43:00.097522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 24801. [D 20:43:00.097597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 24802. [D 20:43:00.097609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 24803. [D 20:43:00.097620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 24804. [D 20:43:00.097631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 24805. [D 20:43:00.097641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 24806. [D 20:43:00.097651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 24807. [D 20:43:00.097661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 24808. [D 20:43:00.097671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 24809. [D 20:43:00.097681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 24810. [D 20:43:00.097691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 24811. [D 20:43:00.097706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 24812. [D 20:43:00.097716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 24813. [D 20:43:00.097726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 24814. [D 20:43:00.097735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 24815. [D 20:43:00.097752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 24816. [D 20:43:00.097809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 24817. [D 20:43:00.097825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 24818. [D 20:43:00.097836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 24819. [D 20:43:00.097845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 24820. [D 20:43:00.097856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 24821. [D 20:43:00.097866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 24822. [D 20:43:00.097876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 24823. [D 20:43:00.097886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 24824. [D 20:43:00.097903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 24825. [D 20:43:00.097913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 24826. [D 20:43:00.097923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 24827. [D 20:43:00.097962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 24828. [D 20:43:00.097975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 24829. [D 20:43:00.097985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 24830. [D 20:43:00.097995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 24831. [D 20:43:00.098021] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 24832. [D 20:43:00.100387] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4822 [D 20:43:00.100408] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 54/70. [D 20:43:00.103467] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24832. [D 20:43:00.103489] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 55/70. [D 20:43:00.103502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 24832. [D 20:43:00.103512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 24833. [D 20:43:00.103526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 24834. [D 20:43:00.103536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 24835. [D 20:43:00.103546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 24836. [D 20:43:00.103560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 24837. [D 20:43:00.103570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 24838. [D 20:43:00.103579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 24839. [D 20:43:00.103590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 24840. [D 20:43:00.103600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 24841. [D 20:43:00.103610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 24842. [D 20:43:00.103620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 24843. [D 20:43:00.103652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 24844. [D 20:43:00.103661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 24845. [D 20:43:00.103673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 24846. [D 20:43:00.103683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 24847. [D 20:43:00.103693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 24848. [D 20:43:00.103707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 24849. [D 20:43:00.103730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 24850. [D 20:43:00.103742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 24851. [D 20:43:00.103752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 24852. [D 20:43:00.103766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 24853. [D 20:43:00.103777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 24854. [D 20:43:00.103787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 24855. [D 20:43:00.103810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 24856. [D 20:43:00.103820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 24857. [D 20:43:00.103830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 24858. [D 20:43:00.103858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 24859. [D 20:43:00.103873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 24860. [D 20:43:00.103884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 24861. [D 20:43:00.103894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 24862. [D 20:43:00.103910] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 24863. [D 20:43:00.103982] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.103998] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.104009] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:00.109377] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 24863. [D 20:43:00.109391] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 56/70. [D 20:43:00.111575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.111588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.111598] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:00.137466] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.137481] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.137492] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:00.137548] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 4828 [D 20:43:00.137561] element 0: offset: 0x2aaaab2301b0, size: 104 [D 20:43:00.137573] openib_post_sr: 10.1.4.240:38258 bh 6 len 120 wr 57/70. [D 20:43:00.137773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.137786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.137796] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:00.213548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.213563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.213574] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:00.213597] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4831 [D 20:43:00.213608] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:00.213618] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 58/70. [D 20:43:00.215716] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4831 [D 20:43:00.215774] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 59/70. [D 20:43:00.215823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 24863. [D 20:43:00.215844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 24864. [D 20:43:00.215854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 24865. [D 20:43:00.215864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 24866. [D 20:43:00.215874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 24867. [D 20:43:00.215884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 24868. [D 20:43:00.215894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 24869. [D 20:43:00.215916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 24870. [D 20:43:00.215926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 24871. [D 20:43:00.215935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 24872. [D 20:43:00.215945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 24873. [D 20:43:00.215962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 24874. [D 20:43:00.215972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 24875. [D 20:43:00.215985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 24876. [D 20:43:00.216002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 24877. [D 20:43:00.216012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 24878. [D 20:43:00.216021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 24879. [D 20:43:00.216037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 24880. [D 20:43:00.216062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 24881. [D 20:43:00.216073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 24882. [D 20:43:00.216086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 24883. [D 20:43:00.216096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 24884. [D 20:43:00.216106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 24885. [D 20:43:00.216122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 24886. [D 20:43:00.216132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 24887. [D 20:43:00.216158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 24888. [D 20:43:00.216168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 24889. [D 20:43:00.216178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 24890. [D 20:43:00.216192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 24891. [D 20:43:00.216201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 24892. [D 20:43:00.216225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 24893. [D 20:43:00.216235] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 24894. [D 20:43:00.221696] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24894. [D 20:43:00.221710] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 60/70. [D 20:43:00.223976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.223992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.224002] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:00.405800] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.405814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.405825] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:00.405840] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4834 [D 20:43:00.405850] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:00.405860] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 0/70. [D 20:43:00.410272] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4834 [D 20:43:00.410293] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 1/70. [D 20:43:00.410452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 24894. [D 20:43:00.410515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 24895. [D 20:43:00.410527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 24896. [D 20:43:00.410538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 24897. [D 20:43:00.410552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 24898. [D 20:43:00.410562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 24899. [D 20:43:00.410572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 24900. [D 20:43:00.410586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 24901. [D 20:43:00.410596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 24902. [D 20:43:00.410606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 24903. [D 20:43:00.410616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 24904. [D 20:43:00.410640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 24905. [D 20:43:00.410651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 24906. [D 20:43:00.410672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 24907. [D 20:43:00.410682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 24908. [D 20:43:00.410696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 24909. [D 20:43:00.410717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 24910. [D 20:43:00.410731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 24911. [D 20:43:00.410741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 24912. [D 20:43:00.410754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 24913. [D 20:43:00.410769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 24914. [D 20:43:00.410779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 24915. [D 20:43:00.410804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 24916. [D 20:43:00.410814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 24917. [D 20:43:00.410824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 24918. [D 20:43:00.410837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 24919. [D 20:43:00.410847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 24920. [D 20:43:00.410871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 24921. [D 20:43:00.410881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 24922. [D 20:43:00.410891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 24923. [D 20:43:00.410905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 24924. [D 20:43:00.410915] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 24925. [D 20:43:00.422290] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24925. [D 20:43:00.422308] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 2/70. [D 20:43:00.424684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.424699] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.424710] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:00.455769] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.455784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.455795] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:00.455827] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4837 [D 20:43:00.455838] element 0: offset: 0x2aaaab20fd40, size: 24 [D 20:43:00.455850] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 3/70. [D 20:43:00.455870] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.455883] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.455892] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:00.455906] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4840 [D 20:43:00.455916] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:43:00.455925] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 4/70. [D 20:43:00.460522] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4837 [D 20:43:00.460582] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 5/70. [D 20:43:00.460602] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4840 [D 20:43:00.460613] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 6/70. [D 20:43:00.460725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 24925. [D 20:43:00.460791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 24926. [D 20:43:00.460803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 24927. [D 20:43:00.460813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 24928. [D 20:43:00.460834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 24929. [D 20:43:00.460843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 24930. [D 20:43:00.460854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 24931. [D 20:43:00.460865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 24932. [D 20:43:00.460874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 24933. [D 20:43:00.460885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 24934. [D 20:43:00.460895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 24935. [D 20:43:00.460905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 24936. [D 20:43:00.460949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 24937. [D 20:43:00.460960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 24938. [D 20:43:00.460971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 24939. [D 20:43:00.460990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 24940. [D 20:43:00.461000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 24941. [D 20:43:00.461011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 24942. [D 20:43:00.461021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 24943. [D 20:43:00.461031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 24944. [D 20:43:00.461047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 24945. [D 20:43:00.461057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 24946. [D 20:43:00.461078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 24947. [D 20:43:00.461088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 24948. [D 20:43:00.461097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 24949. [D 20:43:00.461107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 24950. [D 20:43:00.461118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 24951. [D 20:43:00.461130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 24952. [D 20:43:00.461140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 24953. [D 20:43:00.461150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 24954. [D 20:43:00.461160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 24955. [D 20:43:00.461170] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 24956. [D 20:43:00.461184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 24957. [D 20:43:00.461211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 24958. [D 20:43:00.461221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 24959. [D 20:43:00.461231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 24960. [D 20:43:00.461241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 24961. [D 20:43:00.461251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 24962. [D 20:43:00.461261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 24963. [D 20:43:00.461277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 24964. [D 20:43:00.461287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 24965. [D 20:43:00.461297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 24966. [D 20:43:00.461307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 24967. [D 20:43:00.461331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 24968. [D 20:43:00.461342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 24969. [D 20:43:00.461353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 24970. [D 20:43:00.461363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 24971. [D 20:43:00.461373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 24972. [D 20:43:00.461383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 24973. [D 20:43:00.461393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 24974. [D 20:43:00.461403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 24975. [D 20:43:00.461427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 24976. [D 20:43:00.461437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 24977. [D 20:43:00.461447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 24978. [D 20:43:00.461473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 24979. [D 20:43:00.461488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 24980. [D 20:43:00.461499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 24981. [D 20:43:00.461509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 24982. [D 20:43:00.461520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 24983. [D 20:43:00.461530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 24984. [D 20:43:00.461540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 24985. [D 20:43:00.461550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 24986. [D 20:43:00.461566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 24987. [D 20:43:00.461577] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 24988. [D 20:43:00.472419] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 24988. [D 20:43:00.472438] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 7/70. [D 20:43:00.480696] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 24987. [D 20:43:00.480711] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 8/70. [D 20:43:00.483017] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.483032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.483042] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:00.483059] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.483072] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.483081] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:00.496884] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.496899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.496909] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:00.496940] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4843 [D 20:43:00.496952] element 0: offset: 0x2aaaab23d280, size: 24 [D 20:43:00.496964] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 9/70. [D 20:43:00.496982] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.496998] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.497006] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:00.497021] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4846 [D 20:43:00.497031] element 0: offset: 0x2aaaab216bf0, size: 24 [D 20:43:00.497041] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 10/70. [D 20:43:00.502119] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4846 [D 20:43:00.502176] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 11/70. [D 20:43:00.502222] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4843 [D 20:43:00.502233] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 12/70. [D 20:43:00.502326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 24987. [D 20:43:00.502393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 24988. [D 20:43:00.502405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 24989. [D 20:43:00.502416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 24990. [D 20:43:00.502426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 24991. [D 20:43:00.502440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 24992. [D 20:43:00.502450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 24993. [D 20:43:00.502460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 24994. [D 20:43:00.502476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 24995. [D 20:43:00.502486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 24996. [D 20:43:00.502496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 24997. [D 20:43:00.502512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 24998. [D 20:43:00.502522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 24999. [D 20:43:00.502531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 25000. [D 20:43:00.502547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 25001. [D 20:43:00.502557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 25002. [D 20:43:00.502567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 25003. [D 20:43:00.502611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 25004. [D 20:43:00.502622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 25005. [D 20:43:00.502632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 25006. [D 20:43:00.502641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 25007. [D 20:43:00.502657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 25008. [D 20:43:00.502667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 25009. [D 20:43:00.502677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 25010. [D 20:43:00.502694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 25011. [D 20:43:00.502703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 25012. [D 20:43:00.502713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 25013. [D 20:43:00.502752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 25014. [D 20:43:00.502763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 25015. [D 20:43:00.502773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 25016. [D 20:43:00.502783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 25017. [D 20:43:00.502794] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 25018. [D 20:43:00.502808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 25019. [D 20:43:00.502824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 25020. [D 20:43:00.502834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 25021. [D 20:43:00.502844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 25022. [D 20:43:00.502871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 25023. [D 20:43:00.502881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 25024. [D 20:43:00.502891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 25025. [D 20:43:00.502901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 25026. [D 20:43:00.502917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 25027. [D 20:43:00.502927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 25028. [D 20:43:00.502937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 25029. [D 20:43:00.502947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 25030. [D 20:43:00.502958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 25031. [D 20:43:00.502968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 25032. [D 20:43:00.502984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 25033. [D 20:43:00.502994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 25034. [D 20:43:00.503004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 25035. [D 20:43:00.503014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 25036. [D 20:43:00.503045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 25037. [D 20:43:00.503055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 25038. [D 20:43:00.503068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 25039. [D 20:43:00.503077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 25040. [D 20:43:00.503087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 25041. [D 20:43:00.503100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 25042. [D 20:43:00.503110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 25043. [D 20:43:00.503120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 25044. [D 20:43:00.503151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 25045. [D 20:43:00.503162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 25046. [D 20:43:00.503172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 25047. [D 20:43:00.503182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 25048. [D 20:43:00.503198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 25049. [D 20:43:00.503208] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 25050. [D 20:43:00.513974] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 25050. [D 20:43:00.513992] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 13/70. [D 20:43:00.524492] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 25049. [D 20:43:00.524507] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 14/70. [D 20:43:00.526825] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.526840] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.526850] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:00.526867] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.526879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.526888] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:00.561650] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.561665] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.561676] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:00.561708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4849 [D 20:43:00.561719] element 0: offset: 0x2aaaab2300d0, size: 24 [D 20:43:00.561731] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 15/70. [D 20:43:00.566020] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4849 [D 20:43:00.566040] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 16/70. [D 20:43:00.567070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 25049. [D 20:43:00.567137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 25050. [D 20:43:00.567148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 25051. [D 20:43:00.567159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 25052. [D 20:43:00.567173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 25053. [D 20:43:00.567183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 25054. [D 20:43:00.567193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 25055. [D 20:43:00.567207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 25056. [D 20:43:00.567217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 25057. [D 20:43:00.567226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 25058. [D 20:43:00.567242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 25059. [D 20:43:00.567252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 25060. [D 20:43:00.567262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 25061. [D 20:43:00.567277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 25062. [D 20:43:00.567287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 25063. [D 20:43:00.567297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 25064. [D 20:43:00.567312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 25065. [D 20:43:00.567322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 25066. [D 20:43:00.567332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 25067. [D 20:43:00.567376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 25068. [D 20:43:00.567387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 25069. [D 20:43:00.567397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 25070. [D 20:43:00.567407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 25071. [D 20:43:00.567422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 25072. [D 20:43:00.567432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 25073. [D 20:43:00.567442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 25074. [D 20:43:00.567457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 25075. [D 20:43:00.567467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 25076. [D 20:43:00.567477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 25077. [D 20:43:00.567506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 25078. [D 20:43:00.567517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 25079. [D 20:43:00.567528] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 25080. [D 20:43:00.572133] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.572149] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.572159] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:00.572195] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4852 [D 20:43:00.572206] element 0: offset: 0x2aaaab208970, size: 24 [D 20:43:00.572220] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 17/70. [D 20:43:00.578620] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 25080. [D 20:43:00.578636] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 18/70. [D 20:43:00.580986] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.581000] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.581009] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:00.583385] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4852 [D 20:43:00.583438] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 19/70. [D 20:43:00.584357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 25080. [D 20:43:00.584377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 25081. [D 20:43:00.584387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 25082. [D 20:43:00.584398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 25083. [D 20:43:00.584408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 25084. [D 20:43:00.584422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 25085. [D 20:43:00.584432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 25086. [D 20:43:00.584442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 25087. [D 20:43:00.584458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 25088. [D 20:43:00.584468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 25089. [D 20:43:00.584478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 25090. [D 20:43:00.584487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 25091. [D 20:43:00.584513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 25092. [D 20:43:00.584523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 25093. [D 20:43:00.584533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 25094. [D 20:43:00.584547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 25095. [D 20:43:00.584557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 25096. [D 20:43:00.584567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 25097. [D 20:43:00.584583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 25098. [D 20:43:00.584593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 25099. [D 20:43:00.584603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 25100. [D 20:43:00.584627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 25101. [D 20:43:00.584637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 25102. [D 20:43:00.584661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 25103. [D 20:43:00.584671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 25104. [D 20:43:00.584681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 25105. [D 20:43:00.584691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 25106. [D 20:43:00.584702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 25107. [D 20:43:00.584724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 25108. [D 20:43:00.584734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 25109. [D 20:43:00.584750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 25110. [D 20:43:00.584760] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 25111. [D 20:43:00.590818] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.590832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.590842] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:00.590858] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4856 [D 20:43:00.590868] element 0: offset: 0x2aaaab202b50, size: 24 [D 20:43:00.590878] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 20/70. [D 20:43:00.590894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.590903] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.590912] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:00.590926] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4858 [D 20:43:00.590939] element 0: offset: 0x2aaaab222d50, size: 24 [D 20:43:00.590959] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 21/70. [D 20:43:00.596051] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 25111. [D 20:43:00.596067] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 22/70. [D 20:43:00.597869] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.597883] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.597892] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:00.600647] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4856 [D 20:43:00.600711] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 23/70. [D 20:43:00.602411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 25111. [D 20:43:00.602468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 25112. [D 20:43:00.602480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 25113. [D 20:43:00.602490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 25114. [D 20:43:00.602501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 25115. [D 20:43:00.602511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 25116. [D 20:43:00.602521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 25117. [D 20:43:00.602532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 25118. [D 20:43:00.602541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 25119. [D 20:43:00.602551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 25120. [D 20:43:00.602561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 25121. [D 20:43:00.602579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 25122. [D 20:43:00.602589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 25123. [D 20:43:00.602598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 25124. [D 20:43:00.602609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 25125. [D 20:43:00.602618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 25126. [D 20:43:00.602629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 25127. [D 20:43:00.602638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 25128. [D 20:43:00.602655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 25129. [D 20:43:00.602665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 25130. [D 20:43:00.602675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 25131. [D 20:43:00.602686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 25132. [D 20:43:00.602721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 25133. [D 20:43:00.602732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 25134. [D 20:43:00.602743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 25135. [D 20:43:00.602752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 25136. [D 20:43:00.602770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 25137. [D 20:43:00.602780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 25138. [D 20:43:00.602790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 25139. [D 20:43:00.602818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 25140. [D 20:43:00.602829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 25141. [D 20:43:00.602843] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 25142. [D 20:43:00.605386] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4858 [D 20:43:00.605407] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 24/70. [D 20:43:00.607786] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.607806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.607817] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:00.607854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4861 [D 20:43:00.607865] element 0: offset: 0x2aaaab232930, size: 24 [D 20:43:00.607879] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 25/70. [D 20:43:00.614189] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 25142. [D 20:43:00.614206] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 26/70. [D 20:43:00.614293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 25142. [D 20:43:00.614306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 25143. [D 20:43:00.614317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 25144. [D 20:43:00.614327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 25145. [D 20:43:00.614342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 25146. [D 20:43:00.614352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 25147. [D 20:43:00.614362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 25148. [D 20:43:00.614378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 25149. [D 20:43:00.614388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 25150. [D 20:43:00.614398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 25151. [D 20:43:00.614414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 25152. [D 20:43:00.614424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 25153. [D 20:43:00.614433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 25154. [D 20:43:00.614449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 25155. [D 20:43:00.614459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 25156. [D 20:43:00.614469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 25157. [D 20:43:00.614485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 25158. [D 20:43:00.614495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 25159. [D 20:43:00.614505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 25160. [D 20:43:00.614538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 25161. [D 20:43:00.614631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 25162. [D 20:43:00.614641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 25163. [D 20:43:00.614669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 25164. [D 20:43:00.614679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 25165. [D 20:43:00.614689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 25166. [D 20:43:00.614699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 25167. [D 20:43:00.614709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 25168. [D 20:43:00.614719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 25169. [D 20:43:00.614730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 25170. [D 20:43:00.614739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 25171. [D 20:43:00.614750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 25172. [D 20:43:00.614759] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 25173. [D 20:43:00.614613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.617087] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.617097] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:00.617114] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4861 [D 20:43:00.617165] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 27/70. [D 20:43:00.624785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.624802] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.624812] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:00.624828] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4864 [D 20:43:00.624842] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:00.624852] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 28/70. [D 20:43:00.625973] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 25173. [D 20:43:00.625988] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 29/70. [D 20:43:00.626008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 25173. [D 20:43:00.626022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 25174. [D 20:43:00.626034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 25175. [D 20:43:00.626045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 25176. [D 20:43:00.626057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 25177. [D 20:43:00.626071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 25178. [D 20:43:00.626081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 25179. [D 20:43:00.626091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 25180. [D 20:43:00.626101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 25181. [D 20:43:00.626117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 25182. [D 20:43:00.626127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 25183. [D 20:43:00.626136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 25184. [D 20:43:00.626162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 25185. [D 20:43:00.626172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 25186. [D 20:43:00.626182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 25187. [D 20:43:00.626193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 25188. [D 20:43:00.626203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 25189. [D 20:43:00.626213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 25190. [D 20:43:00.626223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 25191. [D 20:43:00.626233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 25192. [D 20:43:00.626260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 25193. [D 20:43:00.626270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 25194. [D 20:43:00.626280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 25195. [D 20:43:00.626308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 25196. [D 20:43:00.626319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 25197. [D 20:43:00.626331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 25198. [D 20:43:00.626341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 25199. [D 20:43:00.626401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 25200. [D 20:43:00.626414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 25201. [D 20:43:00.626424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 25202. [D 20:43:00.626434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 25203. [D 20:43:00.626456] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 25204. [D 20:43:00.626489] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.626502] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.626511] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:00.631120] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4864 [D 20:43:00.631139] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 30/70. [D 20:43:00.637023] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.637081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.637091] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:00.637128] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4867 [D 20:43:00.637143] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:00.637156] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 31/70. [D 20:43:00.637732] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 25204. [D 20:43:00.637748] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 32/70. [D 20:43:00.637762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 25204. [D 20:43:00.637773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 25205. [D 20:43:00.637787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 25206. [D 20:43:00.637797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 25207. [D 20:43:00.637808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 25208. [D 20:43:00.637823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 25209. [D 20:43:00.637833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 25210. [D 20:43:00.637843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 25211. [D 20:43:00.637854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 25212. [D 20:43:00.637881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 25213. [D 20:43:00.637891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 25214. [D 20:43:00.637906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 25215. [D 20:43:00.637916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 25216. [D 20:43:00.637926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 25217. [D 20:43:00.637956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 25218. [D 20:43:00.637966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 25219. [D 20:43:00.637977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 25220. [D 20:43:00.637987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 25221. [D 20:43:00.637998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 25222. [D 20:43:00.638009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 25223. [D 20:43:00.638018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 25224. [D 20:43:00.638057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 25225. [D 20:43:00.638070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 25226. [D 20:43:00.638080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 25227. [D 20:43:00.638103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 25228. [D 20:43:00.638113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 25229. [D 20:43:00.638123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 25230. [D 20:43:00.638134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 25231. [D 20:43:00.638144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 25232. [D 20:43:00.638154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 25233. [D 20:43:00.638175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 25234. [D 20:43:00.638186] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 25235. [D 20:43:00.638245] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.638259] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.638268] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:00.642847] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4867 [D 20:43:00.642904] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 33/70. [D 20:43:00.643639] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 25235. [D 20:43:00.643658] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 34/70. [D 20:43:00.643670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 25235. [D 20:43:00.643680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 25236. [D 20:43:00.643691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 25237. [D 20:43:00.643702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 25238. [D 20:43:00.643712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 25239. [D 20:43:00.643722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 25240. [D 20:43:00.643732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 25241. [D 20:43:00.643742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 25242. [D 20:43:00.643752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 25243. [D 20:43:00.643770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 25244. [D 20:43:00.643780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 25245. [D 20:43:00.643789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 25246. [D 20:43:00.643814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 25247. [D 20:43:00.643825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 25248. [D 20:43:00.643835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 25249. [D 20:43:00.643845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 25250. [D 20:43:00.643855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 25251. [D 20:43:00.643865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 25252. [D 20:43:00.643880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 25253. [D 20:43:00.643890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 25254. [D 20:43:00.643900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 25255. [D 20:43:00.643910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 25256. [D 20:43:00.643920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 25257. [D 20:43:00.643930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 25258. [D 20:43:00.643940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 25259. [D 20:43:00.643962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 25260. [D 20:43:00.643972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 25261. [D 20:43:00.643982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 25262. [D 20:43:00.643991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 25263. [D 20:43:00.644001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 25264. [D 20:43:00.644019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 25265. [D 20:43:00.644029] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 25266. [D 20:43:00.645830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.645844] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.645855] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:00.649645] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 25266. [D 20:43:00.649661] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 35/70. [D 20:43:00.651776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.651789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.651799] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:00.676899] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.676913] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.676924] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:00.676939] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4869 [D 20:43:00.676949] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:00.676959] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 36/70. [D 20:43:00.681144] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4869 [D 20:43:00.681163] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 37/70. [D 20:43:00.681225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 25266. [D 20:43:00.681290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 25267. [D 20:43:00.681302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 25268. [D 20:43:00.681352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 25269. [D 20:43:00.681363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 25270. [D 20:43:00.681373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 25271. [D 20:43:00.681383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 25272. [D 20:43:00.681394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 25273. [D 20:43:00.681404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 25274. [D 20:43:00.681414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 25275. [D 20:43:00.681429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 25276. [D 20:43:00.681439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 25277. [D 20:43:00.681449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 25278. [D 20:43:00.681459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 25279. [D 20:43:00.681470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 25280. [D 20:43:00.681480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 25281. [D 20:43:00.681490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 25282. [D 20:43:00.681500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 25283. [D 20:43:00.681510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 25284. [D 20:43:00.681520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 25285. [D 20:43:00.681530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 25286. [D 20:43:00.681540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 25287. [D 20:43:00.681550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 25288. [D 20:43:00.681560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 25289. [D 20:43:00.681570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 25290. [D 20:43:00.681580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 25291. [D 20:43:00.681607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 25292. [D 20:43:00.681617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 25293. [D 20:43:00.681627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 25294. [D 20:43:00.681644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 25295. [D 20:43:00.681653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 25296. [D 20:43:00.681663] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 25297. [D 20:43:00.687149] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 25297. [D 20:43:00.687166] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 38/70. [D 20:43:00.689433] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.689448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.689458] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:00.846585] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.846599] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.846610] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:00.846643] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4873 [D 20:43:00.846654] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:43:00.846666] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 39/70. [D 20:43:00.849049] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4873 [D 20:43:00.849104] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 40/70. [D 20:43:00.849234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 25297. [D 20:43:00.849253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 25298. [D 20:43:00.849264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 25299. [D 20:43:00.849274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 25300. [D 20:43:00.849284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 25301. [D 20:43:00.849295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 25302. [D 20:43:00.849305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 25303. [D 20:43:00.849315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 25304. [D 20:43:00.849330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 25305. [D 20:43:00.849340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 25306. [D 20:43:00.849350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 25307. [D 20:43:00.849361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 25308. [D 20:43:00.849372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 25309. [D 20:43:00.849381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 25310. [D 20:43:00.849398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 25311. [D 20:43:00.849408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 25312. [D 20:43:00.849418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 25313. [D 20:43:00.849428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 25314. [D 20:43:00.849465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 25315. [D 20:43:00.849476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 25316. [D 20:43:00.849486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 25317. [D 20:43:00.849495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 25318. [D 20:43:00.849512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 25319. [D 20:43:00.849521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 25320. [D 20:43:00.849531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 25321. [D 20:43:00.849547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 25322. [D 20:43:00.849557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 25323. [D 20:43:00.849567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 25324. [D 20:43:00.849594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 25325. [D 20:43:00.849604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 25326. [D 20:43:00.849614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 25327. [D 20:43:00.849630] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 25328. [D 20:43:00.860954] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 25328. [D 20:43:00.860969] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 41/70. [D 20:43:00.863284] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.863298] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.863308] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:00.875962] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.875977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.875987] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:00.876003] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4877 [D 20:43:00.876013] element 0: offset: 0x2aaaab20fd40, size: 24 [D 20:43:00.876023] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 42/70. [D 20:43:00.878036] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4877 [D 20:43:00.878055] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 43/70. [D 20:43:00.880383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 25328. [D 20:43:00.880438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 25329. [D 20:43:00.880450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 25330. [D 20:43:00.880461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 25331. [D 20:43:00.880476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 25332. [D 20:43:00.880486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 25333. [D 20:43:00.880496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 25334. [D 20:43:00.880509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 25335. [D 20:43:00.880519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 25336. [D 20:43:00.880529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 25337. [D 20:43:00.880545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 25338. [D 20:43:00.880554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 25339. [D 20:43:00.880564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 25340. [D 20:43:00.880580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 25341. [D 20:43:00.880590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 25342. [D 20:43:00.880600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 25343. [D 20:43:00.880638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 25344. [D 20:43:00.880649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 25345. [D 20:43:00.880659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 25346. [D 20:43:00.880669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 25347. [D 20:43:00.880685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 25348. [D 20:43:00.880695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 25349. [D 20:43:00.880704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 25350. [D 20:43:00.880720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 25351. [D 20:43:00.880730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 25352. [D 20:43:00.880739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 25353. [D 20:43:00.880750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 25354. [D 20:43:00.880760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 25355. [D 20:43:00.880772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 25356. [D 20:43:00.880793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 25357. [D 20:43:00.880802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 25358. [D 20:43:00.880812] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 25359. [D 20:43:00.880825] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.880843] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.880864] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:00.880903] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4880 [D 20:43:00.880914] element 0: offset: 0x2aaaab203330, size: 24 [D 20:43:00.885385] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 44/70. [D 20:43:00.885416] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.885427] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.885438] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:00.885452] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4881 [D 20:43:00.885466] element 0: offset: 0x2aaaab2300d0, size: 24 [D 20:43:00.885476] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 45/70. [D 20:43:00.885491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.885501] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.885525] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:00.885541] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4885 [D 20:43:00.885551] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:00.885565] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 46/70. [D 20:43:00.886316] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 25359. [D 20:43:00.886332] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 47/70. [D 20:43:00.888694] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.888709] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.888718] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:00.893387] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4881 [D 20:43:00.893443] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 48/70. [D 20:43:00.893484] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4880 [D 20:43:00.893495] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 49/70. [D 20:43:00.893589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 25359. [D 20:43:00.893643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 25360. [D 20:43:00.893655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 25361. [D 20:43:00.893667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 25362. [D 20:43:00.893677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 25363. [D 20:43:00.893693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 25364. [D 20:43:00.893703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 25365. [D 20:43:00.893713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 25366. [D 20:43:00.893729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 25367. [D 20:43:00.893739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 25368. [D 20:43:00.893806] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4885 [D 20:43:00.893797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 25369. [D 20:43:00.893845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 25370. [D 20:43:00.893889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 25371. [D 20:43:00.893901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 25372. [D 20:43:00.893911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 25373. [D 20:43:00.893921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 25374. [D 20:43:00.893936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 25375. [D 20:43:00.893957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 25376. [D 20:43:00.893967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 25377. [D 20:43:00.893988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 25378. [D 20:43:00.894002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 25379. [D 20:43:00.894012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 25380. [D 20:43:00.894022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 25381. [D 20:43:00.894038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 25382. [D 20:43:00.894048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 25383. [D 20:43:00.894058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 25384. [D 20:43:00.894085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 25385. [D 20:43:00.894095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 25386. [D 20:43:00.894105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 25387. [D 20:43:00.894130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 25388. [D 20:43:00.894140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 25389. [D 20:43:00.894155] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 25390. [D 20:43:00.894183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 25391. [D 20:43:00.894194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 25392. [D 20:43:00.894213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 25393. [D 20:43:00.894228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 25394. [D 20:43:00.894237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 25395. [D 20:43:00.894265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 25396. [D 20:43:00.894275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 25397. [D 20:43:00.894286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 25398. [D 20:43:00.894307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 25399. [D 20:43:00.894318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 25400. [D 20:43:00.894328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 25401. [D 20:43:00.894338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 25402. [D 20:43:00.894348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 25403. [D 20:43:00.894362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 25404. [D 20:43:00.894374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 25405. [D 20:43:00.894395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 25406. [D 20:43:00.894406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 25407. [D 20:43:00.894427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 25408. [D 20:43:00.894442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 25409. [D 20:43:00.894453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 25410. [D 20:43:00.894478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 25411. [D 20:43:00.894489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 25412. [D 20:43:00.894499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 25413. [D 20:43:00.894509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 25414. [D 20:43:00.894520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 25415. [D 20:43:00.894529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 25416. [D 20:43:00.894539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 25417. [D 20:43:00.894558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 25418. [D 20:43:00.894569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 25419. [D 20:43:00.894580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 25420. [D 20:43:00.894601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 25421. [D 20:43:00.894612] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 25422. [D 20:43:00.894644] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 50/70. [D 20:43:00.905239] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 25422. [D 20:43:00.905256] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 51/70. [D 20:43:00.916935] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 25421. [D 20:43:00.916950] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 52/70. [D 20:43:00.916978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 25421. [D 20:43:00.916991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 25422. [D 20:43:00.917001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 25423. [D 20:43:00.917012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 25424. [D 20:43:00.917022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 25425. [D 20:43:00.917032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 25426. [D 20:43:00.917042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 25427. [D 20:43:00.917053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 25428. [D 20:43:00.917063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 25429. [D 20:43:00.917076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 25430. [D 20:43:00.917102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 25431. [D 20:43:00.917111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 25432. [D 20:43:00.917121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 25433. [D 20:43:00.917132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 25434. [D 20:43:00.917153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 25435. [D 20:43:00.917164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 25436. [D 20:43:00.917186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 25437. [D 20:43:00.917197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 25438. [D 20:43:00.917212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 25439. [D 20:43:00.917222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 25440. [D 20:43:00.917232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 25441. [D 20:43:00.917258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 25442. [D 20:43:00.917268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 25443. [D 20:43:00.917282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 25444. [D 20:43:00.917292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 25445. [D 20:43:00.917302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 25446. [D 20:43:00.917326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 25447. [D 20:43:00.917336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 25448. [D 20:43:00.917357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 25449. [D 20:43:00.917368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 25450. [D 20:43:00.917395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 25451. [D 20:43:00.917405] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 25452. [D 20:43:00.919734] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.919749] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.919760] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:00.919777] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.919789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.919798] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:00.926848] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.926863] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.926874] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:00.926905] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4887 [D 20:43:00.926917] element 0: offset: 0x2aaaab234060, size: 24 [D 20:43:00.926928] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 53/70. [D 20:43:00.928809] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 25452. [D 20:43:00.928825] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 54/70. [D 20:43:00.931180] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.931194] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.931204] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:00.933408] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4887 [D 20:43:00.933466] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 55/70. [D 20:43:00.934630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 25452. [D 20:43:00.934647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 25453. [D 20:43:00.934658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 25454. [D 20:43:00.934669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 25455. [D 20:43:00.934680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 25456. [D 20:43:00.934690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 25457. [D 20:43:00.934700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 25458. [D 20:43:00.934709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 25459. [D 20:43:00.934727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 25460. [D 20:43:00.934737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 25461. [D 20:43:00.934747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 25462. [D 20:43:00.934758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 25463. [D 20:43:00.934767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 25464. [D 20:43:00.934777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 25465. [D 20:43:00.934787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 25466. [D 20:43:00.934818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 25467. [D 20:43:00.934829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 25468. [D 20:43:00.934841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 25469. [D 20:43:00.934851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 25470. [D 20:43:00.934860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 25471. [D 20:43:00.934886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 25472. [D 20:43:00.934896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 25473. [D 20:43:00.934909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 25474. [D 20:43:00.934918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 25475. [D 20:43:00.934931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 25476. [D 20:43:00.934957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 25477. [D 20:43:00.934967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 25478. [D 20:43:00.934981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 25479. [D 20:43:00.934991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 25480. [D 20:43:00.935015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 25481. [D 20:43:00.935029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 25482. [D 20:43:00.935039] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 25483. [D 20:43:00.946177] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 25483. [D 20:43:00.946194] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 56/70. [D 20:43:00.948532] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.948547] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.948557] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:00.954196] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.954210] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.954221] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:00.954251] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4893 [D 20:43:00.954262] element 0: offset: 0x2aaaab208970, size: 24 [D 20:43:00.954273] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 57/70. [D 20:43:00.954293] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.954308] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.954316] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:00.954330] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4895 [D 20:43:00.954340] element 0: offset: 0x2aaaab2086d0, size: 24 [D 20:43:00.954350] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 58/70. [D 20:43:00.954368] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.954378] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.954390] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:00.954424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4897 [D 20:43:00.954435] element 0: offset: 0x2aaaab202b50, size: 24 [D 20:43:00.954445] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 59/70. [D 20:43:00.956859] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:00.956874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.956883] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:00.956898] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4899 [D 20:43:00.956908] element 0: offset: 0x2aaaab222d50, size: 24 [D 20:43:00.956917] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 60/70. [D 20:43:00.961706] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4895 [D 20:43:00.961776] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 0/70. [D 20:43:00.961892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 25483. [D 20:43:00.961907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 25484. [D 20:43:00.961917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 25485. [D 20:43:00.961927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 25486. [D 20:43:00.961937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 25487. [D 20:43:00.961947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 25488. [D 20:43:00.961957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 25489. [D 20:43:00.961967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 25490. [D 20:43:00.961977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 25491. [D 20:43:00.961987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 25492. [D 20:43:00.961997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 25493. [D 20:43:00.962007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 25494. [D 20:43:00.962016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 25495. [D 20:43:00.962026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 25496. [D 20:43:00.962036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 25497. [D 20:43:00.962046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 25498. [D 20:43:00.962056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 25499. [D 20:43:00.962066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 25500. [D 20:43:00.962076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 25501. [D 20:43:00.962086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 25502. [D 20:43:00.962096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 25503. [D 20:43:00.962106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 25504. [D 20:43:00.962116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 25505. [D 20:43:00.962126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 25506. [D 20:43:00.962136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 25507. [D 20:43:00.962147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 25508. [D 20:43:00.962157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 25509. [D 20:43:00.962167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 25510. [D 20:43:00.962177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 25511. [D 20:43:00.962186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 25512. [D 20:43:00.962196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 25513. [D 20:43:00.962206] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 25514. [D 20:43:00.964440] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4893 [D 20:43:00.964458] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 1/70. [D 20:43:00.964471] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4897 [D 20:43:00.964482] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 2/70. [D 20:43:00.964516] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4899 [D 20:43:00.964528] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 3/70. [D 20:43:00.973538] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 25514. [D 20:43:00.973553] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 4/70. [D 20:43:00.973583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 25514. [D 20:43:00.973594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 25515. [D 20:43:00.973604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 25516. [D 20:43:00.973614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 25517. [D 20:43:00.973625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 25518. [D 20:43:00.973634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 25519. [D 20:43:00.973645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 25520. [D 20:43:00.973655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 25521. [D 20:43:00.973665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 25522. [D 20:43:00.973674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 25523. [D 20:43:00.973701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 25524. [D 20:43:00.973712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 25525. [D 20:43:00.973738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 25526. [D 20:43:00.973749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 25527. [D 20:43:00.973760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 25528. [D 20:43:00.973770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 25529. [D 20:43:00.973780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 25530. [D 20:43:00.973790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 25531. [D 20:43:00.973800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 25532. [D 20:43:00.973810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 25533. [D 20:43:00.973836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 25534. [D 20:43:00.973846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 25535. [D 20:43:00.973856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 25536. [D 20:43:00.973936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 25537. [D 20:43:00.973948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 25538. [D 20:43:00.973974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 25539. [D 20:43:00.973984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 25540. [D 20:43:00.973994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 25541. [D 20:43:00.974010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 25542. [D 20:43:00.974020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 25543. [D 20:43:00.974030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 25544. [D 20:43:00.974046] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 25545. [D 20:43:00.974072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 25546. [D 20:43:00.974085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 25547. [D 20:43:00.974095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 25548. [D 20:43:00.974107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 25549. [D 20:43:00.974122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 25550. [D 20:43:00.974132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 25551. [D 20:43:00.974142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 25552. [D 20:43:00.974152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 25553. [D 20:43:00.974162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 25554. [D 20:43:00.974171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 25555. [D 20:43:00.974182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 25556. [D 20:43:00.974207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 25557. [D 20:43:00.974217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 25558. [D 20:43:00.974228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 25559. [D 20:43:00.974238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 25560. [D 20:43:00.974248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 25561. [D 20:43:00.974258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 25562. [D 20:43:00.974275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 25563. [D 20:43:00.974285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 25564. [D 20:43:00.974295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 25565. [D 20:43:00.974305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 25566. [D 20:43:00.974315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 25567. [D 20:43:00.974341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 25568. [D 20:43:00.974356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 25569. [D 20:43:00.974366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 25570. [D 20:43:00.974376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 25571. [D 20:43:00.974392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 25572. [D 20:43:00.974414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 25573. [D 20:43:00.974429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 25574. [D 20:43:00.974438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 25575. [D 20:43:00.974448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 25576. [D 20:43:00.974462] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 25577. [D 20:43:00.974485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 25578. [D 20:43:00.974497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 25579. [D 20:43:00.974507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 25580. [D 20:43:00.974517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 25581. [D 20:43:00.974533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 25582. [D 20:43:00.974556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 25583. [E 20:43:00.974587] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 25584, block for 10 ms. [D 20:43:00.974626] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 25583. [D 20:43:00.974638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 25584. [E 20:43:00.974650] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 25585, block for 10 ms. [D 20:43:00.985359] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 25584. [D 20:43:00.985374] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 5/70. [D 20:43:00.985385] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 25583. [D 20:43:00.985396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 25584. [D 20:43:00.985410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 25585. [D 20:43:00.985422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 25586. [D 20:43:00.985432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 25587. [D 20:43:00.985442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 25588. [D 20:43:00.985453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 25589. [D 20:43:00.985463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 25590. [D 20:43:00.985477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 25591. [D 20:43:00.985488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 25592. [D 20:43:00.985498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 25593. [D 20:43:00.985508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 25594. [D 20:43:00.985538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 25595. [D 20:43:00.985549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 25596. [D 20:43:00.985561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 25597. [D 20:43:00.985571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 25598. [D 20:43:00.985586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 25599. [D 20:43:00.985597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 25600. [D 20:43:00.985607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 25601. [D 20:43:00.985618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 25602. [D 20:43:00.985628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 25603. [D 20:43:00.985652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 25604. [D 20:43:00.985668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 25605. [D 20:43:00.985678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 25606. [D 20:43:00.985688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 25607. [D 20:43:00.985711] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 25608. [D 20:43:00.985774] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:00.985789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:00.985799] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:00.997001] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 25608. [D 20:43:00.997017] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 6/70. [D 20:43:01.001510] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.001525] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.001536] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:01.007838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.007852] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.007861] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:01.007891] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4903 [D 20:43:01.007902] element 0: offset: 0x2aaaab22ff50, size: 24 [D 20:43:01.007914] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 7/70. [D 20:43:01.008028] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 25607. [D 20:43:01.008074] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 8/70. [D 20:43:01.008115] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.008131] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.008140] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:01.008191] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.008202] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.008211] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:01.010309] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4903 [D 20:43:01.010356] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 9/70. [D 20:43:01.014129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 25607. [D 20:43:01.014147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 25608. [D 20:43:01.014159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 25609. [D 20:43:01.014170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 25610. [D 20:43:01.014185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 25611. [D 20:43:01.014196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 25612. [D 20:43:01.014207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 25613. [D 20:43:01.014217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 25614. [D 20:43:01.014227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 25615. [D 20:43:01.014238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 25616. [D 20:43:01.014248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 25617. [D 20:43:01.014264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 25618. [D 20:43:01.014274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 25619. [D 20:43:01.014283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 25620. [D 20:43:01.014294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 25621. [D 20:43:01.014322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 25622. [D 20:43:01.014333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 25623. [D 20:43:01.014344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 25624. [D 20:43:01.014354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 25625. [D 20:43:01.014364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 25626. [D 20:43:01.014374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 25627. [D 20:43:01.014394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 25628. [D 20:43:01.014405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 25629. [D 20:43:01.014415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 25630. [D 20:43:01.014425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 25631. [D 20:43:01.014435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 25632. [D 20:43:01.014452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 25633. [D 20:43:01.014462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 25634. [D 20:43:01.014483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 25635. [D 20:43:01.014493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 25636. [D 20:43:01.014503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 25637. [D 20:43:01.014517] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 25638. [D 20:43:01.020061] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 25638. [D 20:43:01.020077] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 10/70. [D 20:43:01.021898] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.021913] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.021924] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.024433] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.024446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.024456] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.024487] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4907 [D 20:43:01.024498] element 0: offset: 0x2aaaab232930, size: 24 [D 20:43:01.024509] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 11/70. [D 20:43:01.024528] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.024543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.024552] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:01.024565] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4908 [D 20:43:01.024576] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:01.024586] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 12/70. [D 20:43:01.029502] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4908 [D 20:43:01.029577] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 13/70. [D 20:43:01.029604] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4907 [D 20:43:01.029624] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 14/70. [D 20:43:01.029660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 25638. [D 20:43:01.029678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 25639. [D 20:43:01.029689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 25640. [D 20:43:01.029706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 25641. [D 20:43:01.029718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 25642. [D 20:43:01.029728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 25643. [D 20:43:01.029738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 25644. [D 20:43:01.029748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 25645. [D 20:43:01.029758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 25646. [D 20:43:01.029768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 25647. [D 20:43:01.029813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 25648. [D 20:43:01.029823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 25649. [D 20:43:01.029833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 25650. [D 20:43:01.029844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 25651. [D 20:43:01.029853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 25652. [D 20:43:01.029920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 25653. [D 20:43:01.029930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 25654. [D 20:43:01.029944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 25655. [D 20:43:01.029954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 25656. [D 20:43:01.029965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 25657. [D 20:43:01.029992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 25658. [D 20:43:01.030002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 25659. [D 20:43:01.030014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 25660. [D 20:43:01.030024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 25661. [D 20:43:01.030034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 25662. [D 20:43:01.030047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 25663. [D 20:43:01.030071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 25664. [D 20:43:01.030081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 25665. [D 20:43:01.030096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 25666. [D 20:43:01.030106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 25667. [D 20:43:01.030116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 25668. [D 20:43:01.030145] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 25669. [D 20:43:01.030160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 25670. [D 20:43:01.030171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 25671. [D 20:43:01.030181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 25672. [D 20:43:01.030191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 25673. [D 20:43:01.030202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 25674. [D 20:43:01.030223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 25675. [D 20:43:01.030238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 25676. [D 20:43:01.030248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 25677. [D 20:43:01.030257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 25678. [D 20:43:01.030273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 25679. [D 20:43:01.030293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 25680. [D 20:43:01.030303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 25681. [D 20:43:01.030319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 25682. [D 20:43:01.030329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 25683. [D 20:43:01.030338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 25684. [D 20:43:01.030354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 25685. [D 20:43:01.030368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 25686. [D 20:43:01.030378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 25687. [D 20:43:01.030416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 25688. [D 20:43:01.030427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 25689. [D 20:43:01.030454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 25690. [D 20:43:01.030465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 25691. [D 20:43:01.030475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 25692. [D 20:43:01.030485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 25693. [D 20:43:01.030499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 25694. [D 20:43:01.030509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 25695. [D 20:43:01.030536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 25696. [D 20:43:01.030547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 25697. [D 20:43:01.030557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 25698. [D 20:43:01.030571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 25699. [D 20:43:01.030590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 25700. [D 20:43:01.030601] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 25701. [D 20:43:01.035543] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 25701. [D 20:43:01.035559] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 15/70. [D 20:43:01.041383] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 25700. [D 20:43:01.041397] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 16/70. [D 20:43:01.041901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.041916] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.041927] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:01.041944] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.041956] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.041965] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.117558] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.117573] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.117584] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.117615] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4912 [D 20:43:01.117626] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:01.117638] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 17/70. [D 20:43:01.121821] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4912 [D 20:43:01.121898] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 18/70. [D 20:43:01.122004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 25700. [D 20:43:01.122051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 25701. [D 20:43:01.122064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 25702. [D 20:43:01.122076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 25703. [D 20:43:01.122086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 25704. [D 20:43:01.122097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 25705. [D 20:43:01.122108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 25706. [D 20:43:01.122118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 25707. [D 20:43:01.122128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 25708. [D 20:43:01.122138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 25709. [D 20:43:01.122148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 25710. [D 20:43:01.122158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 25711. [D 20:43:01.122192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 25712. [D 20:43:01.122203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 25713. [D 20:43:01.122216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 25714. [D 20:43:01.122226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 25715. [D 20:43:01.122236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 25716. [D 20:43:01.122263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 25717. [D 20:43:01.122274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 25718. [D 20:43:01.122285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 25719. [D 20:43:01.122295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 25720. [D 20:43:01.122306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 25721. [D 20:43:01.122319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 25722. [D 20:43:01.122329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 25723. [D 20:43:01.122354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 25724. [D 20:43:01.122364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 25725. [D 20:43:01.122375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 25726. [D 20:43:01.122388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 25727. [D 20:43:01.122398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 25728. [D 20:43:01.122421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 25729. [D 20:43:01.122431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 25730. [D 20:43:01.122441] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 25731. [D 20:43:01.127963] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 25731. [D 20:43:01.127978] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 19/70. [D 20:43:01.130269] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.130284] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.130295] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.319231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.319246] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.319257] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.319288] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4915 [D 20:43:01.319299] element 0: offset: 0x2aaaab22ec60, size: 24 [D 20:43:01.319312] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 20/70. [D 20:43:01.321680] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4915 [D 20:43:01.321697] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 21/70. [D 20:43:01.321829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 25731. [D 20:43:01.321843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 25732. [D 20:43:01.321854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 25733. [D 20:43:01.321864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 25734. [D 20:43:01.321874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 25735. [D 20:43:01.321884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 25736. [D 20:43:01.321894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 25737. [D 20:43:01.321907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 25738. [D 20:43:01.321920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 25739. [D 20:43:01.321930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 25740. [D 20:43:01.321951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 25741. [D 20:43:01.321961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 25742. [D 20:43:01.321970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 25743. [D 20:43:01.321988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 25744. [D 20:43:01.321999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 25745. [D 20:43:01.322009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 25746. [D 20:43:01.322022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 25747. [D 20:43:01.322038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 25748. [D 20:43:01.322048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 25749. [D 20:43:01.322058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 25750. [D 20:43:01.322085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 25751. [D 20:43:01.322096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 25752. [D 20:43:01.322106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 25753. [D 20:43:01.322117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 25754. [D 20:43:01.322127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 25755. [D 20:43:01.322137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 25756. [D 20:43:01.322147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 25757. [D 20:43:01.322157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 25758. [D 20:43:01.322167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 25759. [D 20:43:01.322199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 25760. [D 20:43:01.322209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 25761. [D 20:43:01.322225] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 25762. [D 20:43:01.333616] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 25762. [D 20:43:01.333630] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 22/70. [D 20:43:01.333918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.333931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.333941] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.354060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.354075] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.354085] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.354101] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4920 [D 20:43:01.354111] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:01.354121] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 23/70. [D 20:43:01.354136] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.354147] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.354156] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:01.354169] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4921 [D 20:43:01.354179] element 0: offset: 0x2aaaab203330, size: 24 [D 20:43:01.354189] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 24/70. [D 20:43:01.354208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.354218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.354229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:01.354247] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4924 [D 20:43:01.354256] element 0: offset: 0x2aaaab2300d0, size: 24 [D 20:43:01.354267] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 25/70. [D 20:43:01.359464] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4920 [D 20:43:01.359531] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 26/70. [D 20:43:01.361551] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4924 [D 20:43:01.361577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 25762. [D 20:43:01.361647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 25763. [D 20:43:01.361658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 25764. [D 20:43:01.361669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 25765. [D 20:43:01.361683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 25766. [D 20:43:01.361693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 25767. [D 20:43:01.361703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 25768. [D 20:43:01.361717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 25769. [D 20:43:01.361727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 25770. [D 20:43:01.361737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 25771. [D 20:43:01.361753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 25772. [D 20:43:01.361763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 25773. [D 20:43:01.361773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 25774. [D 20:43:01.361789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 25775. [D 20:43:01.361799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 25776. [D 20:43:01.361809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 25777. [D 20:43:01.361819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 25778. [D 20:43:01.361835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 25779. [D 20:43:01.361845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 25780. [D 20:43:01.361906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 25781. [D 20:43:01.361922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 25782. [D 20:43:01.361932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 25783. [D 20:43:01.361942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 25784. [D 20:43:01.361952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 25785. [D 20:43:01.361962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 25786. [D 20:43:01.361972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 25787. [D 20:43:01.361983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 25788. [D 20:43:01.362006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 25789. [D 20:43:01.362034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 25790. [D 20:43:01.362045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 25791. [D 20:43:01.362055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 25792. [D 20:43:01.362065] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 25793. [D 20:43:01.362089] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 27/70. [D 20:43:01.362116] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4921 [D 20:43:01.362128] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 28/70. [D 20:43:01.365857] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.365875] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.365885] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:01.365926] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4927 [D 20:43:01.365938] element 0: offset: 0x2aaaab208970, size: 24 [D 20:43:01.365956] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 29/70. [D 20:43:01.373181] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 25793. [D 20:43:01.373196] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 30/70. [D 20:43:01.373218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 25793. [D 20:43:01.373230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 25794. [D 20:43:01.373240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 25795. [D 20:43:01.373250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 25796. [D 20:43:01.373265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 25797. [D 20:43:01.373275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 25798. [D 20:43:01.373284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 25799. [D 20:43:01.373295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 25800. [D 20:43:01.373305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 25801. [D 20:43:01.373315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 25802. [D 20:43:01.373325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 25803. [D 20:43:01.373341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 25804. [D 20:43:01.373351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 25805. [D 20:43:01.373361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 25806. [D 20:43:01.373377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 25807. [D 20:43:01.373387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 25808. [D 20:43:01.373397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 25809. [D 20:43:01.373413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 25810. [D 20:43:01.373423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 25811. [D 20:43:01.373432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 25812. [D 20:43:01.373471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 25813. [D 20:43:01.373482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 25814. [D 20:43:01.373492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 25815. [D 20:43:01.373502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 25816. [D 20:43:01.373518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 25817. [D 20:43:01.373527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 25818. [D 20:43:01.373537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 25819. [D 20:43:01.373553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 25820. [D 20:43:01.373563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 25821. [D 20:43:01.373573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 25822. [D 20:43:01.373603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 25823. [D 20:43:01.373671] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 25824. [D 20:43:01.373684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 25825. [D 20:43:01.373695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 25826. [D 20:43:01.373705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 25827. [D 20:43:01.373730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 25828. [D 20:43:01.373741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 25829. [D 20:43:01.373751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 25830. [D 20:43:01.373761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 25831. [D 20:43:01.373771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 25832. [D 20:43:01.373781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 25833. [D 20:43:01.373790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 25834. [D 20:43:01.373800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 25835. [D 20:43:01.373810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 25836. [D 20:43:01.373820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 25837. [D 20:43:01.373830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 25838. [D 20:43:01.373840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 25839. [D 20:43:01.373850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 25840. [D 20:43:01.373860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 25841. [D 20:43:01.373870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 25842. [D 20:43:01.373880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 25843. [D 20:43:01.373889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 25844. [D 20:43:01.373900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 25845. [D 20:43:01.373909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 25846. [D 20:43:01.373947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 25847. [D 20:43:01.373958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 25848. [D 20:43:01.373968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 25849. [D 20:43:01.373978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 25850. [D 20:43:01.373988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 25851. [D 20:43:01.373998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 25852. [D 20:43:01.374009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 25853. [D 20:43:01.374019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 25854. [D 20:43:01.374029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 25855. [D 20:43:01.374039] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 25856. [D 20:43:01.374086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.374097] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.374105] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:01.376428] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4927 [D 20:43:01.376478] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 31/70. [D 20:43:01.384985] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 25856. [D 20:43:01.385003] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 32/70. [D 20:43:01.396524] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 25855. [D 20:43:01.396538] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 33/70. [D 20:43:01.398949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.398962] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.398972] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:01.398986] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.398995] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.399005] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:01.402391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 25855. [D 20:43:01.402405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 25856. [D 20:43:01.402417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 25857. [D 20:43:01.402427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 25858. [D 20:43:01.402437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 25859. [D 20:43:01.402451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 25860. [D 20:43:01.402461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 25861. [D 20:43:01.402470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 25862. [D 20:43:01.402486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 25863. [D 20:43:01.402496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 25864. [D 20:43:01.402506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 25865. [D 20:43:01.402522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 25866. [D 20:43:01.402532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 25867. [D 20:43:01.402541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 25868. [D 20:43:01.402557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 25869. [D 20:43:01.402567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 25870. [D 20:43:01.402577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 25871. [D 20:43:01.402592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 25872. [D 20:43:01.402602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 25873. [D 20:43:01.402612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 25874. [D 20:43:01.402640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 25875. [D 20:43:01.402650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 25876. [D 20:43:01.402660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 25877. [D 20:43:01.402670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 25878. [D 20:43:01.402680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 25879. [D 20:43:01.402690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 25880. [D 20:43:01.402700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 25881. [D 20:43:01.402717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 25882. [D 20:43:01.402727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 25883. [D 20:43:01.402736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 25884. [D 20:43:01.402753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 25885. [D 20:43:01.402762] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 25886. [D 20:43:01.408297] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 25886. [D 20:43:01.408311] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 34/70. [D 20:43:01.410607] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.410620] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.410631] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.420752] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.420766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.420777] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.420792] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4932 [D 20:43:01.420802] element 0: offset: 0x2aaaab2086d0, size: 24 [D 20:43:01.420816] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 35/70. [D 20:43:01.423209] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.423223] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.423233] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:01.423247] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4933 [D 20:43:01.423258] element 0: offset: 0x2aaaab202b50, size: 24 [D 20:43:01.423268] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 36/70. [D 20:43:01.423282] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.423296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.423305] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:01.423319] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4936 [D 20:43:01.423329] element 0: offset: 0x2aaaab222d50, size: 24 [D 20:43:01.423338] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 37/70. [D 20:43:01.425359] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4932 [D 20:43:01.425379] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 38/70. [D 20:43:01.425498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 25886. [D 20:43:01.425562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 25887. [D 20:43:01.425572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 25888. [D 20:43:01.425583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 25889. [D 20:43:01.425593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 25890. [D 20:43:01.425603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 25891. [D 20:43:01.425612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 25892. [D 20:43:01.425622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 25893. [D 20:43:01.425632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 25894. [D 20:43:01.425642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 25895. [D 20:43:01.425652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 25896. [D 20:43:01.425662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 25897. [D 20:43:01.425672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 25898. [D 20:43:01.425681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 25899. [D 20:43:01.425691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 25900. [D 20:43:01.425701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 25901. [D 20:43:01.425711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 25902. [D 20:43:01.425721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 25903. [D 20:43:01.425731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 25904. [D 20:43:01.425741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 25905. [D 20:43:01.425750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 25906. [D 20:43:01.425760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 25907. [D 20:43:01.425770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 25908. [D 20:43:01.425780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 25909. [D 20:43:01.425790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 25910. [D 20:43:01.425800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 25911. [D 20:43:01.425810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 25912. [D 20:43:01.425820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 25913. [D 20:43:01.425830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 25914. [D 20:43:01.425839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 25915. [D 20:43:01.425850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 25916. [D 20:43:01.425861] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 25917. [D 20:43:01.428112] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4933 [D 20:43:01.428132] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 39/70. [D 20:43:01.429423] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4936 [D 20:43:01.429436] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 40/70. [D 20:43:01.437136] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 25917. [D 20:43:01.437154] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 41/70. [D 20:43:01.437171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 25917. [D 20:43:01.437181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 25918. [D 20:43:01.437192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 25919. [D 20:43:01.437202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 25920. [D 20:43:01.437212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 25921. [D 20:43:01.437222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 25922. [D 20:43:01.437233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 25923. [D 20:43:01.437243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 25924. [D 20:43:01.437258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 25925. [D 20:43:01.437268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 25926. [D 20:43:01.437278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 25927. [D 20:43:01.437288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 25928. [D 20:43:01.437304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 25929. [D 20:43:01.437314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 25930. [D 20:43:01.437324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 25931. [D 20:43:01.437335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 25932. [D 20:43:01.437345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 25933. [D 20:43:01.437355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 25934. [D 20:43:01.437369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 25935. [D 20:43:01.437380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 25936. [D 20:43:01.437390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 25937. [D 20:43:01.437399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 25938. [D 20:43:01.437441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 25939. [D 20:43:01.437452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 25940. [D 20:43:01.437462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 25941. [D 20:43:01.437473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 25942. [D 20:43:01.437482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 25943. [D 20:43:01.437492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 25944. [D 20:43:01.437502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 25945. [D 20:43:01.437519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 25946. [D 20:43:01.437529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 25947. [D 20:43:01.437554] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 25948. [D 20:43:01.437567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 25949. [D 20:43:01.437577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 25950. [D 20:43:01.437591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 25951. [D 20:43:01.437601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 25952. [D 20:43:01.437611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 25953. [D 20:43:01.437625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 25954. [D 20:43:01.437635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 25955. [D 20:43:01.437645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 25956. [D 20:43:01.437678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 25957. [D 20:43:01.437689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 25958. [D 20:43:01.437698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 25959. [D 20:43:01.437708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 25960. [D 20:43:01.437724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 25961. [D 20:43:01.437734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 25962. [D 20:43:01.437744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 25963. [D 20:43:01.437759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 25964. [D 20:43:01.437769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 25965. [D 20:43:01.437779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 25966. [D 20:43:01.437794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 25967. [D 20:43:01.437804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 25968. [D 20:43:01.437834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 25969. [D 20:43:01.437844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 25970. [D 20:43:01.437855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 25971. [D 20:43:01.437865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 25972. [D 20:43:01.437875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 25973. [D 20:43:01.437885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 25974. [D 20:43:01.437896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 25975. [D 20:43:01.437906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 25976. [D 20:43:01.437916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 25977. [D 20:43:01.437947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 25978. [D 20:43:01.437957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 25979. [D 20:43:01.437967] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 25980. [D 20:43:01.438014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.438026] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.438049] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:01.448911] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 25980. [D 20:43:01.448926] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 42/70. [D 20:43:01.459375] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 25979. [D 20:43:01.459389] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 43/70. [D 20:43:01.461646] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.461659] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.461669] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:01.461683] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.461692] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.461702] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.469617] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.469631] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.469642] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.469670] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4938 [D 20:43:01.469681] element 0: offset: 0x2aaaab232930, size: 24 [D 20:43:01.469691] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 44/70. [D 20:43:01.471768] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4938 [D 20:43:01.471787] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 45/70. [D 20:43:01.471835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 25979. [D 20:43:01.471846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 25980. [D 20:43:01.471856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 25981. [D 20:43:01.471866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 25982. [D 20:43:01.471876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 25983. [D 20:43:01.471887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 25984. [D 20:43:01.471900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 25985. [D 20:43:01.471909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 25986. [D 20:43:01.471919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 25987. [D 20:43:01.471930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 25988. [D 20:43:01.471942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 25989. [D 20:43:01.471952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 25990. [D 20:43:01.471962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 25991. [D 20:43:01.471972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 25992. [D 20:43:01.471982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 25993. [D 20:43:01.471992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 25994. [D 20:43:01.472001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 25995. [D 20:43:01.472012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 25996. [D 20:43:01.472029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 25997. [D 20:43:01.472039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 25998. [D 20:43:01.472049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 25999. [D 20:43:01.472059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 26000. [D 20:43:01.472070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 26001. [D 20:43:01.472081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 26002. [D 20:43:01.472091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 26003. [D 20:43:01.472101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 26004. [D 20:43:01.472110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 26005. [D 20:43:01.472121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 26006. [D 20:43:01.472132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 26007. [D 20:43:01.472142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 26008. [D 20:43:01.472152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 26009. [D 20:43:01.472162] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 26010. [D 20:43:01.477699] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 26010. [D 20:43:01.477713] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 46/70. [D 20:43:01.479976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.479989] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.480000] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.558570] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.558585] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.558596] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.558610] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4942 [D 20:43:01.558620] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:01.558633] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 47/70. [D 20:43:01.560689] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4942 [D 20:43:01.561037] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 48/70. [D 20:43:01.561087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 26010. [D 20:43:01.561101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 26011. [D 20:43:01.561112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 26012. [D 20:43:01.561122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 26013. [D 20:43:01.561132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 26014. [D 20:43:01.561142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 26015. [D 20:43:01.561152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 26016. [D 20:43:01.561175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 26017. [D 20:43:01.561185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 26018. [D 20:43:01.561195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 26019. [D 20:43:01.561205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 26020. [D 20:43:01.561216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 26021. [D 20:43:01.561235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 26022. [D 20:43:01.561245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 26023. [D 20:43:01.561273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 26024. [D 20:43:01.561283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 26025. [D 20:43:01.561304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 26026. [D 20:43:01.561315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 26027. [D 20:43:01.561336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 26028. [D 20:43:01.561346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 26029. [D 20:43:01.561357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 26030. [D 20:43:01.561367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 26031. [D 20:43:01.561377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 26032. [D 20:43:01.561387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 26033. [D 20:43:01.561411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 26034. [D 20:43:01.561422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 26035. [D 20:43:01.561435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 26036. [D 20:43:01.561446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 26037. [D 20:43:01.561455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 26038. [D 20:43:01.561471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 26039. [D 20:43:01.561494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 26040. [D 20:43:01.561505] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 26041. [D 20:43:01.566955] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 26041. [D 20:43:01.566968] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 49/70. [D 20:43:01.569262] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.569276] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.569285] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.757975] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.757993] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.758004] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.758019] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4946 [D 20:43:01.758030] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:01.758040] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 50/70. [D 20:43:01.758055] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.758066] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.758074] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:01.758088] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4948 [D 20:43:01.758098] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:01.758107] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 51/70. [D 20:43:01.763200] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4946 [D 20:43:01.763280] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 52/70. [D 20:43:01.763417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 26041. [D 20:43:01.763434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 26042. [D 20:43:01.763445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 26043. [D 20:43:01.763455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 26044. [D 20:43:01.763466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 26045. [D 20:43:01.763476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 26046. [D 20:43:01.763486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26047. [D 20:43:01.763495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 26048. [D 20:43:01.763505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 26049. [D 20:43:01.763515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 26050. [D 20:43:01.763525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 26051. [D 20:43:01.763541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 26052. [D 20:43:01.763550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 26053. [D 20:43:01.763560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 26054. [D 20:43:01.763570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 26055. [D 20:43:01.763588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 26056. [D 20:43:01.763598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 26057. [D 20:43:01.763650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 26058. [D 20:43:01.763662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 26059. [D 20:43:01.763673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 26060. [D 20:43:01.763682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 26061. [D 20:43:01.763693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 26062. [D 20:43:01.763718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 26063. [D 20:43:01.763728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 26064. [D 20:43:01.763739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 26065. [D 20:43:01.763749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 26066. [D 20:43:01.763759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 26067. [D 20:43:01.763769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 26068. [D 20:43:01.763779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 26069. [D 20:43:01.763803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 26070. [D 20:43:01.763814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 26071. [D 20:43:01.763823] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 26072. [D 20:43:01.766275] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4948 [D 20:43:01.766292] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 53/70. [D 20:43:01.773185] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 26072. [D 20:43:01.773201] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 54/70. [D 20:43:01.775527] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.775541] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.775552] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:01.776469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 26072. [D 20:43:01.776484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 26073. [D 20:43:01.776495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 26074. [D 20:43:01.776505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 26075. [D 20:43:01.776517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 26076. [D 20:43:01.776532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 26077. [D 20:43:01.776542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 26078. [D 20:43:01.776552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 26079. [D 20:43:01.776567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 26080. [D 20:43:01.776577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 26081. [D 20:43:01.776587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 26082. [D 20:43:01.776597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 26083. [D 20:43:01.776607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 26084. [D 20:43:01.776617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 26085. [D 20:43:01.776627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 26086. [D 20:43:01.776643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 26087. [D 20:43:01.776668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 26088. [D 20:43:01.776683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 26089. [D 20:43:01.776692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 26090. [D 20:43:01.776702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 26091. [D 20:43:01.776716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 26092. [D 20:43:01.776726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 26093. [D 20:43:01.776736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 26094. [D 20:43:01.776746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 26095. [D 20:43:01.776756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 26096. [D 20:43:01.776766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 26097. [D 20:43:01.776785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 26098. [D 20:43:01.776800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 26099. [D 20:43:01.776810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 26100. [D 20:43:01.776820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 26101. [D 20:43:01.776830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 26102. [D 20:43:01.776847] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 26103. [D 20:43:01.782485] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 26103. [D 20:43:01.782500] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 55/70. [D 20:43:01.784761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.784775] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.784784] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.789982] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.789996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.790007] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.790037] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4951 [D 20:43:01.790048] element 0: offset: 0x2aaaab222d50, size: 24 [D 20:43:01.792031] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 56/70. [D 20:43:01.794159] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4951 [D 20:43:01.794177] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 57/70. [D 20:43:01.794319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 26103. [D 20:43:01.794333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 26104. [D 20:43:01.794344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 26105. [D 20:43:01.794354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 26106. [D 20:43:01.794364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 26107. [D 20:43:01.794374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 26108. [D 20:43:01.794383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 26109. [D 20:43:01.794394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 26110. [D 20:43:01.794407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 26111. [D 20:43:01.794417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 26112. [D 20:43:01.794427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 26113. [D 20:43:01.794439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 26114. [D 20:43:01.794457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 26115. [D 20:43:01.794467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 26116. [D 20:43:01.794476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 26117. [D 20:43:01.794487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 26118. [D 20:43:01.794497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 26119. [D 20:43:01.794507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 26120. [D 20:43:01.794516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 26121. [D 20:43:01.794542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 26122. [D 20:43:01.794552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 26123. [D 20:43:01.794567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 26124. [D 20:43:01.794578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 26125. [D 20:43:01.794588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 26126. [D 20:43:01.794610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 26127. [D 20:43:01.794621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 26128. [D 20:43:01.794631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 26129. [D 20:43:01.794646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 26130. [D 20:43:01.794656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 26131. [D 20:43:01.794666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 26132. [D 20:43:01.794692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 26133. [D 20:43:01.794702] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 26134. [D 20:43:01.804629] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 26134. [D 20:43:01.804643] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 58/70. [D 20:43:01.806965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.806978] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.806989] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.823785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.823799] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.823810] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.823825] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4954 [D 20:43:01.823835] element 0: offset: 0x2aaaab236df0, size: 24 [D 20:43:01.823844] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 59/70. [D 20:43:01.824136] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.824149] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.824158] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:01.824173] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4957 [D 20:43:01.824186] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:01.824195] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 60/70. [D 20:43:01.829056] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4954 [D 20:43:01.829127] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 0/70. [D 20:43:01.829267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 26134. [D 20:43:01.829283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 26135. [D 20:43:01.829294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 26136. [D 20:43:01.829304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 26137. [D 20:43:01.829314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 26138. [D 20:43:01.829324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 26139. [D 20:43:01.829334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 26140. [D 20:43:01.829344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 26141. [D 20:43:01.829359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 26142. [D 20:43:01.829369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 26143. [D 20:43:01.829379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 26144. [D 20:43:01.829389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 26145. [D 20:43:01.829399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 26146. [D 20:43:01.829409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 26147. [D 20:43:01.829419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 26148. [D 20:43:01.829429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 26149. [D 20:43:01.829439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 26150. [D 20:43:01.829448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 26151. [D 20:43:01.829459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 26152. [D 20:43:01.829473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 26153. [D 20:43:01.829483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 26154. [D 20:43:01.829493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 26155. [D 20:43:01.829542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 26156. [D 20:43:01.829552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 26157. [D 20:43:01.829562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 26158. [D 20:43:01.829573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 26159. [D 20:43:01.829582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 26160. [D 20:43:01.829593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 26161. [D 20:43:01.829603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 26162. [D 20:43:01.829612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 26163. [D 20:43:01.829622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 26164. [D 20:43:01.829655] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 26165. [D 20:43:01.832297] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4957 [D 20:43:01.832315] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 1/70. [D 20:43:01.841044] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 26165. [D 20:43:01.841059] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 2/70. [D 20:43:01.841099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 26165. [D 20:43:01.841110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 26166. [D 20:43:01.841121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 26167. [D 20:43:01.841131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 26168. [D 20:43:01.841141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 26169. [D 20:43:01.841157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 26170. [D 20:43:01.841167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26171. [D 20:43:01.841176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 26172. [D 20:43:01.841192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 26173. [D 20:43:01.841202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 26174. [D 20:43:01.841212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 26175. [D 20:43:01.841222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 26176. [D 20:43:01.841232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 26177. [D 20:43:01.841241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 26178. [D 20:43:01.841251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 26179. [D 20:43:01.841268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 26180. [D 20:43:01.841278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 26181. [D 20:43:01.841288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 26182. [D 20:43:01.841298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 26183. [D 20:43:01.841308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 26184. [D 20:43:01.841320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 26185. [D 20:43:01.841330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 26186. [D 20:43:01.841340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 26187. [D 20:43:01.841350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 26188. [D 20:43:01.841360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 26189. [D 20:43:01.841370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 26190. [D 20:43:01.841380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 26191. [D 20:43:01.841389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 26192. [D 20:43:01.841409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 26193. [D 20:43:01.841419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 26194. [D 20:43:01.841428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 26195. [D 20:43:01.841439] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 26196. [D 20:43:01.843771] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.843786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.843796] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:01.851733] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 26196. [D 20:43:01.851747] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 3/70. [D 20:43:01.854014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.854027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.854038] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.868009] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.868023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.868034] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.868063] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4961 [D 20:43:01.868074] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:01.868084] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 4/70. [D 20:43:01.868103] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.868116] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.868125] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:01.868139] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4963 [D 20:43:01.868150] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:01.868160] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 5/70. [D 20:43:01.872524] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4961 [D 20:43:01.872596] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 6/70. [D 20:43:01.872735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 26196. [D 20:43:01.872752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 26197. [D 20:43:01.872763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 26198. [D 20:43:01.872773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 26199. [D 20:43:01.872784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 26200. [D 20:43:01.872794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 26201. [D 20:43:01.872803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 26202. [D 20:43:01.872816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 26203. [D 20:43:01.872832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 26204. [D 20:43:01.872842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 26205. [D 20:43:01.872852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 26206. [D 20:43:01.872862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 26207. [D 20:43:01.872872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 26208. [D 20:43:01.872882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 26209. [D 20:43:01.872949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 26210. [D 20:43:01.872959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 26211. [D 20:43:01.872969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 26212. [D 20:43:01.872991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 26213. [D 20:43:01.873001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 26214. [D 20:43:01.873018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 26215. [D 20:43:01.873028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 26216. [D 20:43:01.873038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 26217. [D 20:43:01.873048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 26218. [D 20:43:01.873058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 26219. [D 20:43:01.873068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 26220. [D 20:43:01.873078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 26221. [D 20:43:01.873104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 26222. [D 20:43:01.873115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 26223. [D 20:43:01.873125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 26224. [D 20:43:01.873135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 26225. [D 20:43:01.873150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 26226. [D 20:43:01.873172] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 26227. [D 20:43:01.876102] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4963 [D 20:43:01.876152] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 7/70. [D 20:43:01.884475] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 26227. [D 20:43:01.884492] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 8/70. [D 20:43:01.884518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 26227. [D 20:43:01.884530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 26228. [D 20:43:01.884540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 26229. [D 20:43:01.884550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 26230. [D 20:43:01.884564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 26231. [D 20:43:01.884573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 26232. [D 20:43:01.884583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26233. [D 20:43:01.884599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 26234. [D 20:43:01.884609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 26235. [D 20:43:01.884618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 26236. [D 20:43:01.884634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 26237. [D 20:43:01.884644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 26238. [D 20:43:01.884654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 26239. [D 20:43:01.884688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 26240. [D 20:43:01.884698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 26241. [D 20:43:01.884708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 26242. [D 20:43:01.884718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 26243. [D 20:43:01.884747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 26244. [D 20:43:01.884758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 26245. [D 20:43:01.884773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 26246. [D 20:43:01.884782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 26247. [D 20:43:01.884803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 26248. [D 20:43:01.884814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 26249. [D 20:43:01.884824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 26250. [D 20:43:01.884835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 26251. [D 20:43:01.884845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 26252. [D 20:43:01.884854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 26253. [D 20:43:01.884865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 26254. [D 20:43:01.884889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 26255. [D 20:43:01.884899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 26256. [D 20:43:01.884909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 26257. [D 20:43:01.884919] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 26258. [D 20:43:01.884996] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.885027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.885037] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:01.895369] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 26258. [D 20:43:01.895384] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 9/70. [D 20:43:01.897666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.897679] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.897689] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:01.911799] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.911814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.911825] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:01.911855] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4967 [D 20:43:01.911866] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:01.911876] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 10/70. [D 20:43:01.911896] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.911909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.911918] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:01.911932] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4969 [D 20:43:01.911943] element 0: offset: 0x2aaaab236df0, size: 24 [D 20:43:01.911953] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 11/70. [D 20:43:01.916679] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4967 [D 20:43:01.916751] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 12/70. [D 20:43:01.916884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 26258. [D 20:43:01.916901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 26259. [D 20:43:01.916912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 26260. [D 20:43:01.916922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 26261. [D 20:43:01.916932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 26262. [D 20:43:01.916942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 26263. [D 20:43:01.916996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 26264. [D 20:43:01.917005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 26265. [D 20:43:01.917015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 26266. [D 20:43:01.917041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 26267. [D 20:43:01.917051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 26268. [D 20:43:01.917065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 26269. [D 20:43:01.917075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 26270. [D 20:43:01.917085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 26271. [D 20:43:01.917112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 26272. [D 20:43:01.917122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 26273. [D 20:43:01.917135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 26274. [D 20:43:01.917145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 26275. [D 20:43:01.917154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 26276. [D 20:43:01.917182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 26277. [D 20:43:01.917192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 26278. [D 20:43:01.917209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 26279. [D 20:43:01.917219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 26280. [D 20:43:01.917229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 26281. [D 20:43:01.917239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 26282. [D 20:43:01.917249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 26283. [D 20:43:01.917259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 26284. [D 20:43:01.917280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 26285. [D 20:43:01.917290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 26286. [D 20:43:01.917299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 26287. [D 20:43:01.917323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 26288. [D 20:43:01.917334] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 26289. [D 20:43:01.920149] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4969 [D 20:43:01.920185] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 13/70. [D 20:43:01.923735] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.923751] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.923761] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:01.923795] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4971 [D 20:43:01.923806] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:01.923819] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 14/70. [D 20:43:01.928535] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 26289. [D 20:43:01.928551] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 15/70. [D 20:43:01.928587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 26289. [D 20:43:01.928599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 26290. [D 20:43:01.928609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 26291. [D 20:43:01.928620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 26292. [D 20:43:01.928630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 26293. [D 20:43:01.928646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 26294. [D 20:43:01.928656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26295. [D 20:43:01.928666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 26296. [D 20:43:01.928681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 26297. [D 20:43:01.928691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 26298. [D 20:43:01.928701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 26299. [D 20:43:01.928711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 26300. [D 20:43:01.928721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 26301. [D 20:43:01.928731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 26302. [D 20:43:01.928741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 26303. [D 20:43:01.928750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 26304. [D 20:43:01.928761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 26305. [D 20:43:01.928786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 26306. [D 20:43:01.928797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 26307. [D 20:43:01.928807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 26308. [D 20:43:01.928817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 26309. [D 20:43:01.928916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 26310. [D 20:43:01.928928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 26311. [D 20:43:01.928938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 26312. [D 20:43:01.928947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 26313. [D 20:43:01.928957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 26314. [D 20:43:01.928967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 26315. [D 20:43:01.928977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 26316. [D 20:43:01.928987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 26317. [D 20:43:01.928997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 26318. [D 20:43:01.929007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 26319. [D 20:43:01.929017] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 26320. [D 20:43:01.929065] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.929075] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.929084] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:01.931289] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4971 [D 20:43:01.931309] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 16/70. [D 20:43:01.937997] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.938012] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.938023] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:01.938037] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4975 [D 20:43:01.938047] element 0: offset: 0x2aaaab202ce0, size: 24 [D 20:43:01.938058] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 17/70. [D 20:43:01.939111] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 26320. [D 20:43:01.939125] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 18/70. [D 20:43:01.939171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 26320. [D 20:43:01.939184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 26321. [D 20:43:01.939195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 26322. [D 20:43:01.939205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 26323. [D 20:43:01.939215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 26324. [D 20:43:01.939225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 26325. [D 20:43:01.939247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 26326. [D 20:43:01.939257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 26327. [D 20:43:01.939267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 26328. [D 20:43:01.939276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 26329. [D 20:43:01.939286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 26330. [D 20:43:01.939315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 26331. [D 20:43:01.939325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 26332. [D 20:43:01.939335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 26333. [D 20:43:01.939345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 26334. [D 20:43:01.939355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 26335. [D 20:43:01.939365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 26336. [D 20:43:01.939375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 26337. [D 20:43:01.939385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 26338. [D 20:43:01.939395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 26339. [D 20:43:01.939405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 26340. [D 20:43:01.939415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 26341. [D 20:43:01.939425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 26342. [D 20:43:01.939450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 26343. [D 20:43:01.939461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 26344. [D 20:43:01.939471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 26345. [D 20:43:01.939514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 26346. [D 20:43:01.939525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 26347. [D 20:43:01.939535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 26348. [D 20:43:01.939546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 26349. [D 20:43:01.939556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 26350. [D 20:43:01.939586] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 26351. [D 20:43:01.939614] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.939624] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.939633] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:01.944229] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4975 [D 20:43:01.944301] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 19/70. [D 20:43:01.948728] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 26351. [D 20:43:01.948745] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 20/70. [D 20:43:01.948758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 26351. [D 20:43:01.948770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 26352. [D 20:43:01.948784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 26353. [D 20:43:01.948794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 26354. [D 20:43:01.948809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 26355. [D 20:43:01.948820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 26356. [D 20:43:01.948830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 26357. [D 20:43:01.948841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 26358. [D 20:43:01.948850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 26359. [D 20:43:01.948860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 26360. [D 20:43:01.948870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 26361. [D 20:43:01.948880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 26362. [D 20:43:01.948891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 26363. [D 20:43:01.948901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 26364. [D 20:43:01.948910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 26365. [D 20:43:01.948920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 26366. [D 20:43:01.948930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 26367. [D 20:43:01.948941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 26368. [D 20:43:01.948955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 26369. [D 20:43:01.948965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 26370. [D 20:43:01.948975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 26371. [D 20:43:01.948985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 26372. [D 20:43:01.949001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 26373. [D 20:43:01.949022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 26374. [D 20:43:01.949035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 26375. [D 20:43:01.949049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 26376. [D 20:43:01.949059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 26377. [D 20:43:01.949069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 26378. [D 20:43:01.949084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 26379. [D 20:43:01.949094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 26380. [D 20:43:01.949104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 26381. [D 20:43:01.949129] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 26382. [D 20:43:01.949181] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.949210] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.949221] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:01.955214] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 26382. [D 20:43:01.955228] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 21/70. [D 20:43:01.958953] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.958966] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.958977] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:01.959007] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4979 [D 20:43:01.959018] element 0: offset: 0x2aaaab232960, size: 24 [D 20:43:01.959028] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 22/70. [D 20:43:01.959051] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.959070] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.959079] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:01.959093] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4981 [D 20:43:01.959103] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:01.959116] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 23/70. [D 20:43:01.959132] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.959142] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.959150] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:01.959164] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:01.959175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.959194] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:01.959210] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4983 [D 20:43:01.959220] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:01.959233] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 24/70. [D 20:43:01.963992] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4981 [D 20:43:01.964078] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 25/70. [D 20:43:01.966290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 26382. [D 20:43:01.966308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 26383. [D 20:43:01.966320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 26384. [D 20:43:01.966330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 26385. [D 20:43:01.966340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 26386. [D 20:43:01.966357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 26387. [D 20:43:01.966366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 26388. [D 20:43:01.966376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 26389. [D 20:43:01.966392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 26390. [D 20:43:01.966402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 26391. [D 20:43:01.966412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 26392. [D 20:43:01.966428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 26393. [D 20:43:01.966438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 26394. [D 20:43:01.966488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 26395. [D 20:43:01.966499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 26396. [D 20:43:01.966509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 26397. [D 20:43:01.966519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 26398. [D 20:43:01.966530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 26399. [D 20:43:01.966541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 26400. [D 20:43:01.966550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 26401. [D 20:43:01.966566] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4979 [D 20:43:01.966585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 26402. [D 20:43:01.966595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 26403. [D 20:43:01.966628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 26404. [D 20:43:01.966638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 26405. [D 20:43:01.966649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 26406. [D 20:43:01.966659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 26407. [D 20:43:01.966669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 26408. [D 20:43:01.966694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 26409. [D 20:43:01.966704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 26410. [D 20:43:01.966714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 26411. [D 20:43:01.966724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 26412. [D 20:43:01.966734] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 26413. [D 20:43:01.966749] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 26/70. [D 20:43:01.966762] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4983 [D 20:43:01.966773] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 27/70. [D 20:43:01.976375] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 26413. [D 20:43:01.976391] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 28/70. [D 20:43:01.976403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 26413. [D 20:43:01.976413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 26414. [D 20:43:01.976429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 26415. [D 20:43:01.976440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 26416. [D 20:43:01.976450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 26417. [D 20:43:01.976460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 26418. [D 20:43:01.976470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26419. [D 20:43:01.976480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 26420. [D 20:43:01.976489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 26421. [D 20:43:01.976506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 26422. [D 20:43:01.976516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 26423. [D 20:43:01.976526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 26424. [D 20:43:01.976536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 26425. [D 20:43:01.976546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 26426. [D 20:43:01.976556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 26427. [D 20:43:01.976566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 26428. [D 20:43:01.976584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 26429. [D 20:43:01.976611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 26430. [D 20:43:01.976632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 26431. [D 20:43:01.976642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 26432. [D 20:43:01.976655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 26433. [D 20:43:01.976665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 26434. [D 20:43:01.976675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 26435. [D 20:43:01.976689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 26436. [D 20:43:01.976698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 26437. [D 20:43:01.976724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 26438. [D 20:43:01.976734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 26439. [D 20:43:01.976744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 26440. [D 20:43:01.976757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 26441. [D 20:43:01.976767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 26442. [D 20:43:01.976776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 26443. [D 20:43:01.976792] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 26444. [D 20:43:01.976819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 26445. [D 20:43:01.976828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 26446. [D 20:43:01.976839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 26447. [D 20:43:01.976849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 26448. [D 20:43:01.976859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 26449. [D 20:43:01.976869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 26450. [D 20:43:01.976886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 26451. [D 20:43:01.976896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 26452. [D 20:43:01.976906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 26453. [D 20:43:01.976915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 26454. [D 20:43:01.976933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 26455. [D 20:43:01.976942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 26456. [D 20:43:01.976952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 26457. [D 20:43:01.976962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 26458. [D 20:43:01.976972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 26459. [D 20:43:01.976983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 26460. [D 20:43:01.976993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 26461. [D 20:43:01.977002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 26462. [D 20:43:01.977013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 26463. [D 20:43:01.977022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 26464. [D 20:43:01.977032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 26465. [D 20:43:01.977042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 26466. [D 20:43:01.977067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 26467. [D 20:43:01.977077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 26468. [D 20:43:01.977087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 26469. [D 20:43:01.977100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 26470. [D 20:43:01.977110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 26471. [D 20:43:01.977120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 26472. [D 20:43:01.977148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 26473. [D 20:43:01.977158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 26474. [D 20:43:01.977170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 26475. [D 20:43:01.977180] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 26476. [D 20:43:01.977247] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.977261] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.977283] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:01.982278] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 26476. [D 20:43:01.982292] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 29/70. [D 20:43:01.988164] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 26475. [D 20:43:01.988177] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 30/70. [D 20:43:01.990438] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.990452] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.990462] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:01.990477] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:01.990486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:01.990495] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:02.099601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.099616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.099627] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:02.099658] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4987 [D 20:43:02.099669] element 0: offset: 0x2aaaab236df0, size: 24 [D 20:43:02.099679] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 31/70. [D 20:43:02.104233] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4987 [D 20:43:02.104304] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 32/70. [D 20:43:02.104366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 26475. [D 20:43:02.104383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 26476. [D 20:43:02.104394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 26477. [D 20:43:02.104404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 26478. [D 20:43:02.104413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 26479. [D 20:43:02.104424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 26480. [D 20:43:02.104434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 26481. [D 20:43:02.104482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 26482. [D 20:43:02.104492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 26483. [D 20:43:02.104502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 26484. [D 20:43:02.104512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 26485. [D 20:43:02.104527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 26486. [D 20:43:02.104537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 26487. [D 20:43:02.104560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 26488. [D 20:43:02.104570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 26489. [D 20:43:02.104580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 26490. [D 20:43:02.104591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 26491. [D 20:43:02.104615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 26492. [D 20:43:02.104625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 26493. [D 20:43:02.104636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 26494. [D 20:43:02.104646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 26495. [D 20:43:02.104656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 26496. [D 20:43:02.104679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 26497. [D 20:43:02.104689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 26498. [D 20:43:02.104703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 26499. [D 20:43:02.104712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 26500. [D 20:43:02.104722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 26501. [D 20:43:02.104749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 26502. [D 20:43:02.104760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 26503. [D 20:43:02.104770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 26504. [D 20:43:02.104780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 26505. [D 20:43:02.104790] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 26506. [D 20:43:02.110240] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 26506. [D 20:43:02.110257] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 33/70. [D 20:43:02.112563] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.112579] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.112588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:02.216532] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.216546] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.216557] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:02.216588] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4991 [D 20:43:02.216599] element 0: offset: 0x2aaaab202ce0, size: 24 [D 20:43:02.216612] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 34/70. [D 20:43:02.222721] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.222782] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.222791] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:02.222826] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4994 [D 20:43:02.222838] element 0: offset: 0x2aaaab203360, size: 24 [D 20:43:02.222851] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 35/70. [D 20:43:02.222872] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.222882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.222890] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:02.222907] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4995 [D 20:43:02.222917] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:02.222929] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 36/70. [D 20:43:02.226145] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.226199] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.226208] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:02.226239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 4999 [D 20:43:02.226250] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:02.226263] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 37/70. [D 20:43:02.230790] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 4994 [D 20:43:02.230836] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 38/70. [D 20:43:02.230853] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 4995 [D 20:43:02.230864] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 39/70. [D 20:43:02.231284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 26506. [D 20:43:02.231303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 26507. [D 20:43:02.231313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 26508. [D 20:43:02.231323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 26509. [D 20:43:02.231333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 26510. [D 20:43:02.231343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 26511. [D 20:43:02.231353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 26512. [D 20:43:02.231363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 26513. [D 20:43:02.231373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 26514. [D 20:43:02.231383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 26515. [D 20:43:02.231393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 26516. [D 20:43:02.231402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 26517. [D 20:43:02.231412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 26518. [D 20:43:02.231422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 26519. [D 20:43:02.231432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 26520. [D 20:43:02.231442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 26521. [D 20:43:02.231452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 26522. [D 20:43:02.231462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 26523. [D 20:43:02.231471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 26524. [D 20:43:02.231481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 26525. [D 20:43:02.231491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 26526. [D 20:43:02.231501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 26527. [D 20:43:02.231511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 26528. [D 20:43:02.231521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 26529. [D 20:43:02.231531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 26530. [D 20:43:02.231541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 26531. [D 20:43:02.231551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 26532. [D 20:43:02.231560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 26533. [D 20:43:02.231570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 26534. [D 20:43:02.231580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 26535. [D 20:43:02.231591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 26536. [D 20:43:02.231601] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 26537. [D 20:43:02.231615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 26538. [D 20:43:02.231625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 26539. [D 20:43:02.231635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 26540. [D 20:43:02.231645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 26541. [D 20:43:02.231655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 26542. [D 20:43:02.231665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 26543. [D 20:43:02.231675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 26544. [D 20:43:02.231684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 26545. [D 20:43:02.231694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 26546. [D 20:43:02.231704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 26547. [D 20:43:02.231714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 26548. [D 20:43:02.231723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 26549. [D 20:43:02.231733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 26550. [D 20:43:02.231743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 26551. [D 20:43:02.231753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 26552. [D 20:43:02.231762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 26553. [D 20:43:02.231772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 26554. [D 20:43:02.231782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 26555. [D 20:43:02.231792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 26556. [D 20:43:02.231802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 26557. [D 20:43:02.231812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 26558. [D 20:43:02.231822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 26559. [D 20:43:02.231831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 26560. [D 20:43:02.231841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 26561. [D 20:43:02.231851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 26562. [D 20:43:02.231861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 26563. [D 20:43:02.231870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 26564. [D 20:43:02.231881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 26565. [D 20:43:02.231891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 26566. [D 20:43:02.231901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 26567. [D 20:43:02.231911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 26568. [D 20:43:02.231921] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 26569. [D 20:43:02.234302] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 4999 [D 20:43:02.234319] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 40/70. [D 20:43:02.234331] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 4991 [D 20:43:02.234341] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 41/70. [D 20:43:02.242897] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 26569. [D 20:43:02.242911] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 42/70. [D 20:43:02.254632] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 26568. [D 20:43:02.254646] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 43/70. [D 20:43:02.254682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 26568. [D 20:43:02.254693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 26569. [D 20:43:02.254703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 26570. [D 20:43:02.254715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 26571. [D 20:43:02.254725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 26572. [D 20:43:02.254756] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.254791] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.254811] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:02.254841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 26573. [D 20:43:02.254853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 26574. [D 20:43:02.254878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 26575. [D 20:43:02.254891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 26576. [D 20:43:02.254901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 26577. [D 20:43:02.254911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 26578. [D 20:43:02.254924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 26579. [D 20:43:02.254934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 26580. [D 20:43:02.254959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 26581. [D 20:43:02.254969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 26582. [D 20:43:02.254991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 26583. [D 20:43:02.255008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 26584. [D 20:43:02.255019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 26585. [D 20:43:02.255029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 26586. [D 20:43:02.255051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 26587. [D 20:43:02.255066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 26588. [D 20:43:02.255086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 26589. [D 20:43:02.255111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 26590. [D 20:43:02.255121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 26591. [D 20:43:02.255135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 26592. [D 20:43:02.255145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 26593. [D 20:43:02.255155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 26594. [D 20:43:02.255170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 26595. [D 20:43:02.255195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 26596. [D 20:43:02.255206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 26597. [D 20:43:02.255216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 26598. [D 20:43:02.255226] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 26599. [D 20:43:02.255243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 26600. [D 20:43:02.255254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 26601. [D 20:43:02.255264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 26602. [D 20:43:02.255274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 26603. [D 20:43:02.255289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 26604. [D 20:43:02.255299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 26605. [D 20:43:02.255308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26606. [D 20:43:02.255318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 26607. [D 20:43:02.255329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 26608. [D 20:43:02.255339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 26609. [D 20:43:02.255366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 26610. [D 20:43:02.255376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 26611. [D 20:43:02.255391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 26612. [D 20:43:02.255402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 26613. [D 20:43:02.255426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 26614. [D 20:43:02.255437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 26615. [D 20:43:02.255446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 26616. [D 20:43:02.255457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 26617. [D 20:43:02.255468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 26618. [D 20:43:02.255477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 26619. [D 20:43:02.255492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 26620. [D 20:43:02.255516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 26621. [D 20:43:02.255525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 26622. [D 20:43:02.255541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 26623. [D 20:43:02.255562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 26624. [D 20:43:02.255585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 26625. [D 20:43:02.255594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 26626. [D 20:43:02.255604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 26627. [D 20:43:02.255626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 26628. [D 20:43:02.255636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 26629. [D 20:43:02.255646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 26630. [D 20:43:02.255656] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 26631. [D 20:43:02.255684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.255698] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.255707] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:02.264291] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 26631. [D 20:43:02.264306] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 44/70. [D 20:43:02.269835] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.269850] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.269859] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:02.269887] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5002 [D 20:43:02.269898] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:02.269914] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 45/70. [D 20:43:02.270158] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 26630. [D 20:43:02.270171] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 46/70. [D 20:43:02.272304] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.272317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.272326] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:02.272370] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.272383] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.272393] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:02.272407] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5004 [D 20:43:02.272420] element 0: offset: 0x2aaaab236e20, size: 24 [D 20:43:02.272430] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 47/70. [D 20:43:02.274671] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5002 [D 20:43:02.274741] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 48/70. [D 20:43:02.276928] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.276968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.276978] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:02.278525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 26630. [D 20:43:02.278585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 26631. [D 20:43:02.278596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 26632. [D 20:43:02.278607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 26633. [D 20:43:02.278617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 26634. [D 20:43:02.278627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 26635. [D 20:43:02.278637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 26636. [D 20:43:02.278648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 26637. [D 20:43:02.278658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 26638. [D 20:43:02.278668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 26639. [D 20:43:02.278678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 26640. [D 20:43:02.278696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 26641. [D 20:43:02.278705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 26642. [D 20:43:02.278715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 26643. [D 20:43:02.278725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 26644. [D 20:43:02.278736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 26645. [D 20:43:02.278746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 26646. [D 20:43:02.279305] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5004 [D 20:43:02.279314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 26647. [D 20:43:02.279342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 26648. [D 20:43:02.279352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 26649. [D 20:43:02.279362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 26650. [D 20:43:02.279372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 26651. [D 20:43:02.279382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 26652. [D 20:43:02.279392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 26653. [D 20:43:02.279402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 26654. [D 20:43:02.279419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 26655. [D 20:43:02.279429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 26656. [D 20:43:02.279438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 26657. [D 20:43:02.279449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 26658. [D 20:43:02.279459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 26659. [D 20:43:02.279469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 26660. [D 20:43:02.279511] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 26661. [D 20:43:02.279557] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 49/70. [D 20:43:02.289468] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.289486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.289497] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:02.289532] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5009 [D 20:43:02.289543] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:02.289558] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 50/70. [D 20:43:02.289578] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.289588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.289596] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:02.289614] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5011 [D 20:43:02.289623] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:02.289633] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 51/70. [D 20:43:02.290302] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 26661. [D 20:43:02.290317] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 52/70. [D 20:43:02.290348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 26661. [D 20:43:02.290359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 26662. [D 20:43:02.290369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 26663. [D 20:43:02.290381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 26664. [D 20:43:02.290391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 26665. [D 20:43:02.290401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 26666. [D 20:43:02.290414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 26667. [D 20:43:02.290424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 26668. [D 20:43:02.290434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 26669. [D 20:43:02.290487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 26670. [D 20:43:02.290497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 26671. [D 20:43:02.290507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 26672. [D 20:43:02.290517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 26673. [D 20:43:02.290528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 26674. [D 20:43:02.290538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 26675. [D 20:43:02.290548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 26676. [D 20:43:02.290558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 26677. [D 20:43:02.290568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 26678. [D 20:43:02.290578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 26679. [D 20:43:02.290595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 26680. [D 20:43:02.290605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 26681. [D 20:43:02.290614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 26682. [D 20:43:02.290642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 26683. [D 20:43:02.290652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 26684. [D 20:43:02.290662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 26685. [D 20:43:02.290673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 26686. [D 20:43:02.290682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 26687. [D 20:43:02.290693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 26688. [D 20:43:02.290704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 26689. [D 20:43:02.290713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 26690. [D 20:43:02.290723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 26691. [D 20:43:02.290755] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 26692. [D 20:43:02.293162] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.293176] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.293185] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:02.295785] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5009 [D 20:43:02.295835] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 53/70. [D 20:43:02.295851] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5011 [D 20:43:02.295861] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 54/70. [D 20:43:02.301909] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 26692. [D 20:43:02.301956] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 55/70. [D 20:43:02.304200] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.304214] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.304225] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:02.307404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 26692. [D 20:43:02.307419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 26693. [D 20:43:02.307431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 26694. [D 20:43:02.307441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 26695. [D 20:43:02.307451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 26696. [D 20:43:02.307464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 26697. [D 20:43:02.307474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 26698. [D 20:43:02.307484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 26699. [D 20:43:02.307500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 26700. [D 20:43:02.307510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 26701. [D 20:43:02.307520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 26702. [D 20:43:02.307536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 26703. [D 20:43:02.307546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 26704. [D 20:43:02.307556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 26705. [D 20:43:02.307565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 26706. [D 20:43:02.307581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 26707. [D 20:43:02.307591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 26708. [D 20:43:02.307601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 26709. [D 20:43:02.307612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 26710. [D 20:43:02.307621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 26711. [D 20:43:02.307631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 26712. [D 20:43:02.307668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 26713. [D 20:43:02.307678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 26714. [D 20:43:02.307692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 26715. [D 20:43:02.307702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 26716. [D 20:43:02.307711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 26717. [D 20:43:02.307726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 26718. [D 20:43:02.307736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 26719. [D 20:43:02.307745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 26720. [D 20:43:02.307777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 26721. [D 20:43:02.307788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 26722. [D 20:43:02.307798] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 26723. [D 20:43:02.307810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 26724. [D 20:43:02.307825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 26725. [D 20:43:02.307835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 26726. [D 20:43:02.307845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 26727. [D 20:43:02.307860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 26728. [D 20:43:02.307870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 26729. [D 20:43:02.307880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26730. [D 20:43:02.307895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 26731. [D 20:43:02.307905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 26732. [D 20:43:02.307915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 26733. [D 20:43:02.307943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 26734. [D 20:43:02.307954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 26735. [D 20:43:02.307964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 26736. [D 20:43:02.307974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 26737. [D 20:43:02.307984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 26738. [D 20:43:02.307994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 26739. [D 20:43:02.308004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 26740. [D 20:43:02.308014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 26741. [D 20:43:02.308024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 26742. [D 20:43:02.308040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 26743. [D 20:43:02.308050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 26744. [D 20:43:02.308059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 26745. [D 20:43:02.308087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 26746. [D 20:43:02.308097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 26747. [D 20:43:02.308111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 26748. [D 20:43:02.308121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 26749. [D 20:43:02.308131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 26750. [D 20:43:02.308145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 26751. [D 20:43:02.308155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 26752. [D 20:43:02.308164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 26753. [D 20:43:02.308195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 26754. [D 20:43:02.308207] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 26755. [D 20:43:02.318039] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.318055] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.318063] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:02.318096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5015 [D 20:43:02.318107] element 0: offset: 0x2aaaab203360, size: 24 [D 20:43:02.318119] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 56/70. [D 20:43:02.318141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.318151] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.318159] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:02.318174] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5016 [D 20:43:02.318330] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:02.318344] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 57/70. [D 20:43:02.319068] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 26755. [D 20:43:02.319082] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 58/70. [D 20:43:02.330362] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 26754. [D 20:43:02.330376] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 59/70. [D 20:43:02.332568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.332581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.332591] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:02.332668] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.332681] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.332689] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:02.335487] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5016 [D 20:43:02.335538] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 60/70. [D 20:43:02.335658] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5015 [D 20:43:02.335674] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 0/70. [D 20:43:02.336130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 26754. [D 20:43:02.336186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 26755. [D 20:43:02.336198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 26756. [D 20:43:02.336208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 26757. [D 20:43:02.336223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 26758. [D 20:43:02.336233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 26759. [D 20:43:02.336242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 26760. [D 20:43:02.336257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 26761. [D 20:43:02.336267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 26762. [D 20:43:02.336276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 26763. [D 20:43:02.336293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 26764. [D 20:43:02.336320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 26765. [D 20:43:02.336332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 26766. [D 20:43:02.336341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 26767. [D 20:43:02.336359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 26768. [D 20:43:02.336369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 26769. [D 20:43:02.336379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 26770. [D 20:43:02.336389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 26771. [D 20:43:02.336416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 26772. [D 20:43:02.336426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 26773. [D 20:43:02.336436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 26774. [D 20:43:02.336446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 26775. [D 20:43:02.336479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 26776. [D 20:43:02.336489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 26777. [D 20:43:02.336499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 26778. [D 20:43:02.336515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 26779. [D 20:43:02.336525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 26780. [D 20:43:02.336549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 26781. [D 20:43:02.336559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 26782. [D 20:43:02.336569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 26783. [D 20:43:02.336583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 26784. [D 20:43:02.336593] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 26785. [D 20:43:02.336607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 26786. [D 20:43:02.336630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 26787. [D 20:43:02.336640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 26788. [D 20:43:02.336670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 26789. [D 20:43:02.336680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 26790. [D 20:43:02.336690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 26791. [D 20:43:02.336714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 26792. [D 20:43:02.336724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 26793. [D 20:43:02.336734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 26794. [D 20:43:02.336744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 26795. [D 20:43:02.336754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 26796. [D 20:43:02.336766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 26797. [D 20:43:02.336783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 26798. [D 20:43:02.336806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 26799. [D 20:43:02.336821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 26800. [D 20:43:02.336830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 26801. [D 20:43:02.336840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 26802. [D 20:43:02.336866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 26803. [D 20:43:02.336877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 26804. [D 20:43:02.336891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 26805. [D 20:43:02.336901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 26806. [D 20:43:02.336910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 26807. [D 20:43:02.336926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 26808. [D 20:43:02.336936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 26809. [D 20:43:02.336946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 26810. [D 20:43:02.336961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 26811. [D 20:43:02.336971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 26812. [D 20:43:02.336997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 26813. [D 20:43:02.337007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 26814. [D 20:43:02.337016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 26815. [D 20:43:02.337030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 26816. [D 20:43:02.337053] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 26817. [D 20:43:02.344756] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 26817. [D 20:43:02.344773] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 1/70. [D 20:43:02.346059] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.346074] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.346084] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:02.346121] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5020 [D 20:43:02.346135] element 0: offset: 0x2aaaab232960, size: 24 [D 20:43:02.346147] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 2/70. [D 20:43:02.350606] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 26816. [D 20:43:02.350620] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 3/70. [D 20:43:02.352889] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.352902] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.352911] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:02.352971] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.352984] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.352993] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:02.355056] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5020 [D 20:43:02.355075] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 4/70. [D 20:43:02.355139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 26816. [D 20:43:02.355192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 26817. [D 20:43:02.355203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 26818. [D 20:43:02.355220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 26819. [D 20:43:02.355231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 26820. [D 20:43:02.355241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 26821. [D 20:43:02.355252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 26822. [D 20:43:02.355261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 26823. [D 20:43:02.355271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 26824. [D 20:43:02.355281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 26825. [D 20:43:02.355322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 26826. [D 20:43:02.355335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 26827. [D 20:43:02.355345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 26828. [D 20:43:02.355355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 26829. [D 20:43:02.355365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 26830. [D 20:43:02.355385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 26831. [D 20:43:02.355396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 26832. [D 20:43:02.355406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 26833. [D 20:43:02.355416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 26834. [D 20:43:02.355426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 26835. [D 20:43:02.355457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 26836. [D 20:43:02.355467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 26837. [D 20:43:02.355481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 26838. [D 20:43:02.355491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 26839. [D 20:43:02.355501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 26840. [D 20:43:02.355514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 26841. [D 20:43:02.355534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 26842. [D 20:43:02.355544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 26843. [D 20:43:02.355555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 26844. [D 20:43:02.355565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 26845. [D 20:43:02.355575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 26846. [D 20:43:02.355585] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 26847. [D 20:43:02.361102] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 26847. [D 20:43:02.361118] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 5/70. [D 20:43:02.363293] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.363308] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.363318] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:02.474414] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.474429] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.474440] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:02.474473] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5023 [D 20:43:02.474484] element 0: offset: 0x2aaaab220610, size: 24 [D 20:43:02.474496] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 6/70. [D 20:43:02.476944] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5023 [D 20:43:02.477000] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 7/70. [D 20:43:02.477048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 26847. [D 20:43:02.477065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 26848. [D 20:43:02.477075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 26849. [D 20:43:02.477085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 26850. [D 20:43:02.477095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 26851. [D 20:43:02.477105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 26852. [D 20:43:02.477115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26853. [D 20:43:02.477125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 26854. [D 20:43:02.477142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 26855. [D 20:43:02.477158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 26856. [D 20:43:02.477168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 26857. [D 20:43:02.477177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 26858. [D 20:43:02.477187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 26859. [D 20:43:02.477207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 26860. [D 20:43:02.477230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 26861. [D 20:43:02.477240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 26862. [D 20:43:02.477251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 26863. [D 20:43:02.477261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 26864. [D 20:43:02.477271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 26865. [D 20:43:02.477281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 26866. [D 20:43:02.477291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 26867. [D 20:43:02.477312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 26868. [D 20:43:02.477323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 26869. [D 20:43:02.477333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 26870. [D 20:43:02.477343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 26871. [D 20:43:02.477353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 26872. [D 20:43:02.477377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 26873. [D 20:43:02.477387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 26874. [D 20:43:02.477404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 26875. [D 20:43:02.477414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 26876. [D 20:43:02.477423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 26877. [D 20:43:02.477447] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 26878. [D 20:43:02.482922] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 26878. [D 20:43:02.482936] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 8/70. [D 20:43:02.485221] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.485234] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.485244] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:02.682113] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.682180] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.682190] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:02.682228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5027 [D 20:43:02.682242] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:02.683492] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 9/70. [D 20:43:02.683525] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.683539] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.683549] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:02.683565] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5028 [D 20:43:02.683576] element 0: offset: 0x2aaaab2081c0, size: 24 [D 20:43:02.683586] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 10/70. [D 20:43:02.689202] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.689218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.689227] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:02.689244] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5032 [D 20:43:02.689253] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:02.689263] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 11/70. [D 20:43:02.692282] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5027 [D 20:43:02.692335] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 12/70. [D 20:43:02.692421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.692471] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.692481] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:02.692513] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5035 [D 20:43:02.692524] element 0: offset: 0x2aaaab232960, size: 24 [D 20:43:02.692538] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 13/70. [D 20:43:02.692565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 26878. [D 20:43:02.692578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 26879. [D 20:43:02.692588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 26880. [D 20:43:02.692598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 26881. [D 20:43:02.692615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 26882. [D 20:43:02.692625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 26883. [D 20:43:02.692634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 26884. [D 20:43:02.692645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 26885. [D 20:43:02.692662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 26886. [D 20:43:02.692672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 26887. [D 20:43:02.692682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 26888. [D 20:43:02.692692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 26889. [D 20:43:02.692702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 26890. [D 20:43:02.692712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 26891. [D 20:43:02.692722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 26892. [D 20:43:02.692731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 26893. [D 20:43:02.692741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 26894. [D 20:43:02.692751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 26895. [D 20:43:02.692774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 26896. [D 20:43:02.692784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 26897. [D 20:43:02.692794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 26898. [D 20:43:02.692812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 26899. [D 20:43:02.692829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 26900. [D 20:43:02.692839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 26901. [D 20:43:02.692849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 26902. [D 20:43:02.692859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 26903. [D 20:43:02.692870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 26904. [D 20:43:02.692880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 26905. [D 20:43:02.692890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 26906. [D 20:43:02.692916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 26907. [D 20:43:02.692926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 26908. [D 20:43:02.692936] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 26909. [D 20:43:02.697923] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5028 [D 20:43:02.697994] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 14/70. [D 20:43:02.698055] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5032 [D 20:43:02.698068] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 15/70. [D 20:43:02.698103] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5035 [D 20:43:02.698115] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 16/70. [D 20:43:02.702195] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 26909. [D 20:43:02.702262] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 17/70. [D 20:43:02.702281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 26909. [D 20:43:02.702293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 26910. [D 20:43:02.702303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 26911. [D 20:43:02.702313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 26912. [D 20:43:02.702329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 26913. [D 20:43:02.702339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 26914. [D 20:43:02.702348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 26915. [D 20:43:02.702364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 26916. [D 20:43:02.702374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 26917. [D 20:43:02.702384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 26918. [D 20:43:02.702394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 26919. [D 20:43:02.702404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 26920. [D 20:43:02.702414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 26921. [D 20:43:02.702478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 26922. [D 20:43:02.702489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 26923. [D 20:43:02.702499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 26924. [D 20:43:02.702509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 26925. [D 20:43:02.702537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 26926. [D 20:43:02.702552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 26927. [D 20:43:02.702561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 26928. [D 20:43:02.702571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 26929. [D 20:43:02.702585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 26930. [D 20:43:02.702595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 26931. [D 20:43:02.702621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 26932. [D 20:43:02.702631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 26933. [D 20:43:02.702641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 26934. [D 20:43:02.702655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 26935. [D 20:43:02.702681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 26936. [D 20:43:02.702691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 26937. [D 20:43:02.702701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 26938. [D 20:43:02.702711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 26939. [D 20:43:02.702720] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 26940. [D 20:43:02.702734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 26941. [D 20:43:02.702750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 26942. [D 20:43:02.702774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 26943. [D 20:43:02.702784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 26944. [D 20:43:02.702807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 26945. [D 20:43:02.702817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 26946. [D 20:43:02.702827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 26947. [D 20:43:02.702837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 26948. [D 20:43:02.702847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 26949. [D 20:43:02.702857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 26950. [D 20:43:02.702870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 26951. [D 20:43:02.702880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 26952. [D 20:43:02.702908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 26953. [D 20:43:02.702918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 26954. [D 20:43:02.702928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 26955. [D 20:43:02.702938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 26956. [D 20:43:02.702948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 26957. [D 20:43:02.702966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 26958. [D 20:43:02.702976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 26959. [D 20:43:02.702986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 26960. [D 20:43:02.703009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 26961. [D 20:43:02.703020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 26962. [D 20:43:02.703029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 26963. [D 20:43:02.703056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 26964. [D 20:43:02.703066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 26965. [D 20:43:02.703076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 26966. [D 20:43:02.703086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 26967. [D 20:43:02.703107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 26968. [D 20:43:02.703122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 26969. [D 20:43:02.703132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 26970. [D 20:43:02.703142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 26971. [D 20:43:02.703157] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 26972. [D 20:43:02.703182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 26973. [D 20:43:02.703197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 26974. [D 20:43:02.703207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 26975. [D 20:43:02.703216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 26976. [D 20:43:02.703299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 26977. [D 20:43:02.703326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 26978. [E 20:43:02.703341] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 26979, block for 10 ms. [D 20:43:02.703371] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 26978. [D 20:43:02.703382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26979. [E 20:43:02.703393] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 26980, block for 10 ms. [D 20:43:02.710793] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26979. [E 20:43:02.710816] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 26980, block for 10 ms. [D 20:43:02.712121] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 26979. [D 20:43:02.712139] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 18/70. [D 20:43:02.712150] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 26978. [D 20:43:02.712161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 26979. [D 20:43:02.712171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 26980. [D 20:43:02.712182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 26981. [D 20:43:02.712192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 26982. [D 20:43:02.712202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 26983. [D 20:43:02.712212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 26984. [D 20:43:02.712222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 26985. [D 20:43:02.712232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 26986. [D 20:43:02.712248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 26987. [D 20:43:02.712257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 26988. [D 20:43:02.712267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 26989. [D 20:43:02.712290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 26990. [D 20:43:02.712301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 26991. [D 20:43:02.712333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 26992. [D 20:43:02.712345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 26993. [D 20:43:02.712355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 26994. [D 20:43:02.712366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 26995. [D 20:43:02.712376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 26996. [D 20:43:02.712392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 26997. [D 20:43:02.712401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 26998. [D 20:43:02.712411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 26999. [D 20:43:02.712427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 27000. [D 20:43:02.712456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 27001. [D 20:43:02.712466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 27002. [D 20:43:02.712476] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 27003. [D 20:43:02.712545] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.712560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.712570] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:02.716411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.716432] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.716443] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:02.716476] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5038 [D 20:43:02.716488] element 0: offset: 0x2aaaab203360, size: 24 [D 20:43:02.716500] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 19/70. [D 20:43:02.723807] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 27003. [D 20:43:02.723827] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 20/70. [D 20:43:02.726009] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.726024] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.726032] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:02.733622] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 27002. [D 20:43:02.733638] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 21/70. [D 20:43:02.734093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.734106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.734117] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:02.734178] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.734191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.734200] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:02.736154] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5038 [D 20:43:02.736210] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 22/70. [D 20:43:02.739287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 27002. [D 20:43:02.739306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 27003. [D 20:43:02.739318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 27004. [D 20:43:02.739329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 27005. [D 20:43:02.739341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 27006. [D 20:43:02.739356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 27007. [D 20:43:02.739366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 27008. [D 20:43:02.739375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 27009. [D 20:43:02.739392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 27010. [D 20:43:02.739401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 27011. [D 20:43:02.739411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 27012. [D 20:43:02.739427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 27013. [D 20:43:02.739437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 27014. [D 20:43:02.739447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 27015. [D 20:43:02.739463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 27016. [D 20:43:02.739473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 27017. [D 20:43:02.739483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 27018. [D 20:43:02.739528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 27019. [D 20:43:02.739538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 27020. [D 20:43:02.739548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 27021. [D 20:43:02.739558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 27022. [D 20:43:02.739569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 27023. [D 20:43:02.739579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 27024. [D 20:43:02.739594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 27025. [D 20:43:02.739604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 27026. [D 20:43:02.739614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 27027. [D 20:43:02.739624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 27028. [D 20:43:02.739640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 27029. [D 20:43:02.739650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 27030. [D 20:43:02.739660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 27031. [D 20:43:02.739689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 27032. [D 20:43:02.739699] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 27033. [D 20:43:02.739732] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.739743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.739752] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:02.739768] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5040 [D 20:43:02.739778] element 0: offset: 0x2aaaab22fdc0, size: 24 [D 20:43:02.739800] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 23/70. [D 20:43:02.750165] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.750179] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.750190] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:02.750205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5045 [D 20:43:02.750214] element 0: offset: 0x2aaaab22c0a0, size: 24 [D 20:43:02.750224] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 24/70. [D 20:43:02.750239] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.750252] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.750260] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:02.750274] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5047 [D 20:43:02.750284] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:02.750293] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 25/70. [D 20:43:02.750994] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 27033. [D 20:43:02.751007] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 26/70. [D 20:43:02.753387] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.753402] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.753410] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:02.757650] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5045 [D 20:43:02.757709] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 27/70. [D 20:43:02.757777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 27033. [D 20:43:02.757835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 27034. [D 20:43:02.757846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 27035. [D 20:43:02.757862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 27036. [D 20:43:02.757872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 27037. [D 20:43:02.757881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 27038. [D 20:43:02.757896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 27039. [D 20:43:02.757906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 27040. [D 20:43:02.757915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 27041. [D 20:43:02.757932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 27042. [D 20:43:02.757941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 27043. [D 20:43:02.757951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 27044. [D 20:43:02.757961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 27045. [D 20:43:02.757979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 27046. [D 20:43:02.757989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 27047. [D 20:43:02.757998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 27048. [D 20:43:02.758035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 27049. [D 20:43:02.758046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 27050. [D 20:43:02.758057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 27051. [D 20:43:02.758066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 27052. [D 20:43:02.758076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 27053. [D 20:43:02.758095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 27054. [D 20:43:02.758105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 27055. [D 20:43:02.758115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 27056. [D 20:43:02.758124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 27057. [D 20:43:02.758135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 27058. [D 20:43:02.758144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 27059. [D 20:43:02.758154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 27060. [D 20:43:02.758164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 27061. [D 20:43:02.758174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 27062. [D 20:43:02.758192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 27063. [D 20:43:02.758202] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 27064. [D 20:43:02.758292] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5040 [D 20:43:02.758312] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 28/70. [D 20:43:02.758366] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5047 [D 20:43:02.758379] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 29/70. [D 20:43:02.761830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.761849] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.761860] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:02.761895] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5050 [D 20:43:02.761906] element 0: offset: 0x2aaaab2081c0, size: 24 [D 20:43:02.761920] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 30/70. [D 20:43:02.768959] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 27064. [D 20:43:02.768975] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 31/70. [D 20:43:02.769003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 27064. [D 20:43:02.769016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 27065. [D 20:43:02.769026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 27066. [D 20:43:02.769043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 27067. [D 20:43:02.769054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 27068. [D 20:43:02.769064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 27069. [D 20:43:02.769077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 27070. [D 20:43:02.769087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 27071. [D 20:43:02.769096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 27072. [D 20:43:02.769129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 27073. [D 20:43:02.769140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 27074. [D 20:43:02.769150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 27075. [D 20:43:02.769160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 27076. [D 20:43:02.769176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 27077. [D 20:43:02.769186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 27078. [D 20:43:02.769210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 27079. [D 20:43:02.769220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 27080. [D 20:43:02.769230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 27081. [D 20:43:02.769260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 27082. [D 20:43:02.769271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 27083. [D 20:43:02.769282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 27084. [D 20:43:02.769292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 27085. [D 20:43:02.769302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 27086. [D 20:43:02.769313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 27087. [D 20:43:02.769323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 27088. [D 20:43:02.769409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 27089. [D 20:43:02.769421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 27090. [D 20:43:02.769431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 27091. [D 20:43:02.769442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 27092. [D 20:43:02.769452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 27093. [D 20:43:02.769462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 27094. [D 20:43:02.769488] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 27095. [D 20:43:02.769499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 27096. [D 20:43:02.769509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 27097. [D 20:43:02.769523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 27098. [D 20:43:02.769533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 27099. [D 20:43:02.769543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 27100. [D 20:43:02.769571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 27101. [D 20:43:02.769581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 27102. [D 20:43:02.769595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 27103. [D 20:43:02.769605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 27104. [D 20:43:02.769615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 27105. [D 20:43:02.769628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 27106. [D 20:43:02.769651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 27107. [D 20:43:02.769666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 27108. [D 20:43:02.769676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 27109. [D 20:43:02.769686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 27110. [D 20:43:02.769700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 27111. [D 20:43:02.769710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 27112. [D 20:43:02.769734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 27113. [D 20:43:02.769744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 27114. [D 20:43:02.769754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 27115. [D 20:43:02.769768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 27116. [D 20:43:02.769778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 27117. [D 20:43:02.769788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 27118. [D 20:43:02.769814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 27119. [D 20:43:02.769823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 27120. [D 20:43:02.769833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 27121. [D 20:43:02.769858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 27122. [D 20:43:02.769868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 27123. [D 20:43:02.771955] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5050 [D 20:43:02.771978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 27124. [D 20:43:02.772028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 27125. [D 20:43:02.772039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 27126. [D 20:43:02.772050] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 27127. [D 20:43:02.772090] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 32/70. [D 20:43:02.772128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.772143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.774477] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:02.780754] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 27127. [D 20:43:02.780772] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 33/70. [D 20:43:02.792525] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 27126. [D 20:43:02.792541] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 34/70. [D 20:43:02.792583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 27126. [D 20:43:02.792594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 27127. [D 20:43:02.792607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 27128. [D 20:43:02.792617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 27129. [D 20:43:02.792640] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.792656] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.792669] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:02.792701] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5053 [D 20:43:02.792711] element 0: offset: 0x2aaaab232960, size: 24 [D 20:43:02.792724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 27130. [D 20:43:02.792734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 27131. [D 20:43:02.792746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 27132. [D 20:43:02.792760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 27133. [D 20:43:02.792770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 27134. [D 20:43:02.792787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 27135. [D 20:43:02.792798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 27136. [D 20:43:02.792807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 27137. [D 20:43:02.792818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 27138. [D 20:43:02.792828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 27139. [D 20:43:02.792837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 27140. [D 20:43:02.792847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 27141. [D 20:43:02.792892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 27142. [D 20:43:02.792903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 27143. [D 20:43:02.792914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 27144. [D 20:43:02.792924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 27145. [D 20:43:02.792940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 27146. [D 20:43:02.792950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 27147. [D 20:43:02.792960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 27148. [D 20:43:02.792975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 27149. [D 20:43:02.792985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 27150. [D 20:43:02.792995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 27151. [D 20:43:02.793022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 27152. [D 20:43:02.793032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 27153. [D 20:43:02.793046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 27154. [D 20:43:02.793056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 27155. [D 20:43:02.793066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 27156. [D 20:43:02.793080] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 27157. [D 20:43:02.793096] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 35/70. [D 20:43:02.793120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.793129] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.793137] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:02.795398] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.795412] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.795422] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:02.798918] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 27157. [D 20:43:02.798933] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 36/70. [D 20:43:02.801214] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.801228] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.801238] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:02.803341] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5053 [D 20:43:02.803361] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 37/70. [D 20:43:02.804765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 27157. [D 20:43:02.804781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 27158. [D 20:43:02.804791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 27159. [D 20:43:02.804801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 27160. [D 20:43:02.804810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 27161. [D 20:43:02.804820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 27162. [D 20:43:02.804829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 27163. [D 20:43:02.804839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 27164. [D 20:43:02.804848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 27165. [D 20:43:02.804858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 27166. [D 20:43:02.804867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 27167. [D 20:43:02.804877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 27168. [D 20:43:02.804886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 27169. [D 20:43:02.804896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 27170. [D 20:43:02.804905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 27171. [D 20:43:02.804914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 27172. [D 20:43:02.804924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 27173. [D 20:43:02.804933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 27174. [D 20:43:02.804943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 27175. [D 20:43:02.804952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 27176. [D 20:43:02.804962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 27177. [D 20:43:02.804971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 27178. [D 20:43:02.804981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 27179. [D 20:43:02.804990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 27180. [D 20:43:02.804999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 27181. [D 20:43:02.805009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 27182. [D 20:43:02.805018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 27183. [D 20:43:02.805028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 27184. [D 20:43:02.805037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 27185. [D 20:43:02.805046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 27186. [D 20:43:02.805057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 27187. [D 20:43:02.805066] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 27188. [D 20:43:02.807427] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.807495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.807506] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:02.807541] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5056 [D 20:43:02.807552] element 0: offset: 0x2aaaab222d30, size: 24 [D 20:43:02.807567] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 38/70. [D 20:43:02.807601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.807611] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.807620] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:02.807635] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5059 [D 20:43:02.807644] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:02.807655] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 39/70. [D 20:43:02.810835] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 27188. [D 20:43:02.810853] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 40/70. [D 20:43:02.813054] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.813068] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.813076] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:02.815794] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5059 [D 20:43:02.815847] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 41/70. [D 20:43:02.816720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 27188. [D 20:43:02.816739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 27189. [D 20:43:02.816751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 27190. [D 20:43:02.816761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 27191. [D 20:43:02.816771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 27192. [D 20:43:02.816786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 27193. [D 20:43:02.816796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 27194. [D 20:43:02.816806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 27195. [D 20:43:02.816822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 27196. [D 20:43:02.816832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 27197. [D 20:43:02.816842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 27198. [D 20:43:02.816858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 27199. [D 20:43:02.816868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 27200. [D 20:43:02.816878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 27201. [D 20:43:02.816894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 27202. [D 20:43:02.816904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 27203. [D 20:43:02.816913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 27204. [D 20:43:02.816943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 27205. [D 20:43:02.816953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 27206. [D 20:43:02.816967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 27207. [D 20:43:02.816987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 27208. [D 20:43:02.816997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 27209. [D 20:43:02.817011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 27210. [D 20:43:02.817021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 27211. [D 20:43:02.817030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 27212. [D 20:43:02.817040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 27213. [D 20:43:02.817065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 27214. [D 20:43:02.817075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 27215. [D 20:43:02.817089] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5056 [D 20:43:02.817109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 27216. [D 20:43:02.817120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 27217. [D 20:43:02.817130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 27218. [D 20:43:02.817139] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 27219. [D 20:43:02.817163] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 42/70. [D 20:43:02.821601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.821617] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.821627] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:02.821660] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5062 [D 20:43:02.821671] element 0: offset: 0x2aaaab2031f0, size: 24 [D 20:43:02.821682] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 43/70. [D 20:43:02.828249] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 27219. [D 20:43:02.828264] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 44/70. [D 20:43:02.828292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 27219. [D 20:43:02.828305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 27220. [D 20:43:02.828315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 27221. [D 20:43:02.828325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 27222. [D 20:43:02.828336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 27223. [D 20:43:02.828346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 27224. [D 20:43:02.828356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 27225. [D 20:43:02.828366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 27226. [D 20:43:02.828375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 27227. [D 20:43:02.828385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 27228. [D 20:43:02.828401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 27229. [D 20:43:02.828411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 27230. [D 20:43:02.828420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 27231. [D 20:43:02.828430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 27232. [D 20:43:02.828462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 27233. [D 20:43:02.828473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 27234. [D 20:43:02.828484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 27235. [D 20:43:02.828494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 27236. [D 20:43:02.828504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 27237. [D 20:43:02.828514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 27238. [D 20:43:02.828523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 27239. [D 20:43:02.828533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 27240. [D 20:43:02.828567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 27241. [D 20:43:02.828580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 27242. [D 20:43:02.828592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 27243. [D 20:43:02.828602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 27244. [D 20:43:02.828612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 27245. [D 20:43:02.828625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 27246. [D 20:43:02.828635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 27247. [D 20:43:02.828645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 27248. [D 20:43:02.828660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 27249. [D 20:43:02.828670] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 27250. [D 20:43:02.831032] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.831046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.831056] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:02.833440] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5062 [D 20:43:02.833500] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 45/70. [D 20:43:02.840052] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 27250. [D 20:43:02.840068] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 46/70. [D 20:43:02.840082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 27250. [D 20:43:02.840093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 27251. [D 20:43:02.840104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 27252. [D 20:43:02.840114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 27253. [D 20:43:02.840124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 27254. [D 20:43:02.840134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 27255. [D 20:43:02.840145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 27256. [D 20:43:02.840155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 27257. [D 20:43:02.840170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 27258. [D 20:43:02.840180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 27259. [D 20:43:02.840190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 27260. [D 20:43:02.840200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 27261. [D 20:43:02.840210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 27262. [D 20:43:02.840220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 27263. [D 20:43:02.840230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 27264. [D 20:43:02.840239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 27265. [D 20:43:02.840250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 27266. [D 20:43:02.840269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 27267. [D 20:43:02.840279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 27268. [D 20:43:02.840289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 27269. [D 20:43:02.840300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 27270. [D 20:43:02.840309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 27271. [D 20:43:02.840319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 27272. [D 20:43:02.840329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 27273. [D 20:43:02.840339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 27274. [D 20:43:02.840349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 27275. [D 20:43:02.840379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 27276. [D 20:43:02.840389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 27277. [D 20:43:02.840399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 27278. [D 20:43:02.840409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 27279. [D 20:43:02.840433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 27280. [D 20:43:02.840447] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 27281. [D 20:43:02.840516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.840531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.840540] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:02.846558] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 27281. [D 20:43:02.846574] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 47/70. [D 20:43:02.848753] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.848766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.848776] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:02.859710] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.859724] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.859734] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:02.859765] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5065 [D 20:43:02.859776] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:02.859787] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 48/70. [D 20:43:02.864297] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5065 [D 20:43:02.864348] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 49/70. [D 20:43:02.864410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 27281. [D 20:43:02.864478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 27282. [D 20:43:02.864490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 27283. [D 20:43:02.864500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 27284. [D 20:43:02.864510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 27285. [D 20:43:02.864521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 27286. [D 20:43:02.864531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 27287. [D 20:43:02.864541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 27288. [D 20:43:02.864556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 27289. [D 20:43:02.864567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 27290. [D 20:43:02.864576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 27291. [D 20:43:02.864586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 27292. [D 20:43:02.864602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 27293. [D 20:43:02.864612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 27294. [D 20:43:02.864621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 27295. [D 20:43:02.864632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 27296. [D 20:43:02.864677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 27297. [D 20:43:02.864687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 27298. [D 20:43:02.864702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 27299. [D 20:43:02.864712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 27300. [D 20:43:02.864722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 27301. [D 20:43:02.864731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 27302. [D 20:43:02.864747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 27303. [D 20:43:02.864757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 27304. [D 20:43:02.864767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 27305. [D 20:43:02.864777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 27306. [D 20:43:02.864794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 27307. [D 20:43:02.864804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 27308. [D 20:43:02.864814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 27309. [D 20:43:02.864824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 27310. [D 20:43:02.864835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 27311. [D 20:43:02.864845] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 27312. [D 20:43:02.870438] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 27312. [D 20:43:02.870454] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 50/70. [D 20:43:02.872743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:02.872759] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.872769] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:02.995806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:02.995828] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:02.995839] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:02.995872] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5067 [D 20:43:02.995882] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:02.995894] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 51/70. [D 20:43:03.000197] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5067 [D 20:43:03.000255] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 52/70. [D 20:43:03.000304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 27312. [D 20:43:03.000323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 27313. [D 20:43:03.000336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 27314. [D 20:43:03.000346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 27315. [D 20:43:03.000356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 27316. [D 20:43:03.000366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 27317. [D 20:43:03.000376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 27318. [D 20:43:03.000386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 27319. [D 20:43:03.000396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 27320. [D 20:43:03.000414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 27321. [D 20:43:03.000424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 27322. [D 20:43:03.000434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 27323. [D 20:43:03.000444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 27324. [D 20:43:03.000467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 27325. [D 20:43:03.000491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 27326. [D 20:43:03.000506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 27327. [D 20:43:03.000516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 27328. [D 20:43:03.000526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 27329. [D 20:43:03.000542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 27330. [D 20:43:03.000552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 27331. [D 20:43:03.000562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 27332. [D 20:43:03.000571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 27333. [D 20:43:03.000628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 27334. [D 20:43:03.000639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 27335. [D 20:43:03.000649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 27336. [D 20:43:03.000660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 27337. [D 20:43:03.000669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 27338. [D 20:43:03.000691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 27339. [D 20:43:03.000701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 27340. [D 20:43:03.000710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 27341. [D 20:43:03.000725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 27342. [D 20:43:03.000744] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 27343. [D 20:43:03.006181] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 27343. [D 20:43:03.006196] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 53/70. [D 20:43:03.008479] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.008493] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.008502] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:03.109118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.109142] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.109153] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:03.109175] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5071 [D 20:43:03.109185] element 0: offset: 0x2aaaab22fdc0, size: 24 [D 20:43:03.109196] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 54/70. [D 20:43:03.111560] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5071 [D 20:43:03.111580] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 55/70. [D 20:43:03.111639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 27343. [D 20:43:03.111707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 27344. [D 20:43:03.111743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 27345. [D 20:43:03.111755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 27346. [D 20:43:03.111765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 27347. [D 20:43:03.111776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 27348. [D 20:43:03.111785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 27349. [D 20:43:03.111795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 27350. [D 20:43:03.111805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 27351. [D 20:43:03.111835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 27352. [D 20:43:03.111845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 27353. [D 20:43:03.111871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 27354. [D 20:43:03.111881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 27355. [D 20:43:03.111903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 27356. [D 20:43:03.111914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 27357. [D 20:43:03.111924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 27358. [D 20:43:03.111935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 27359. [D 20:43:03.111945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 27360. [D 20:43:03.111955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 27361. [D 20:43:03.111966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 27362. [D 20:43:03.111976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 27363. [D 20:43:03.111985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 27364. [D 20:43:03.112016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 27365. [D 20:43:03.112026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 27366. [D 20:43:03.112040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 27367. [D 20:43:03.112050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 27368. [D 20:43:03.112059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 27369. [D 20:43:03.112074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 27370. [D 20:43:03.112084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 27371. [D 20:43:03.112093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 27372. [D 20:43:03.112123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 27373. [D 20:43:03.112139] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 27374. [D 20:43:03.117664] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 27374. [D 20:43:03.117681] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 56/70. [D 20:43:03.119960] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.119975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.119986] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:03.173378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.173392] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.173403] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:03.173435] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5074 [D 20:43:03.173446] element 0: offset: 0x2aaaab22c0a0, size: 24 [D 20:43:03.173457] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 57/70. [D 20:43:03.173476] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.173491] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.173500] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.175808] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5077 [D 20:43:03.175819] element 0: offset: 0x2aaaab232960, size: 24 [D 20:43:03.175829] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 58/70. [D 20:43:03.178148] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5074 [D 20:43:03.178167] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 59/70. [D 20:43:03.178321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 27374. [D 20:43:03.178380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 27375. [D 20:43:03.178391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 27376. [D 20:43:03.178402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 27377. [D 20:43:03.178416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 27378. [D 20:43:03.178426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 27379. [D 20:43:03.178436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 27380. [D 20:43:03.178450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 27381. [D 20:43:03.178460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 27382. [D 20:43:03.178470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 27383. [D 20:43:03.178499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 27384. [D 20:43:03.178595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 27385. [D 20:43:03.178607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 27386. [D 20:43:03.178617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 27387. [D 20:43:03.178627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 27388. [D 20:43:03.178637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 27389. [D 20:43:03.178663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 27390. [D 20:43:03.178674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 27391. [D 20:43:03.178683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 27392. [D 20:43:03.178694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 27393. [D 20:43:03.178704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 27394. [D 20:43:03.178714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 27395. [D 20:43:03.178724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 27396. [D 20:43:03.178734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 27397. [D 20:43:03.178744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 27398. [D 20:43:03.178754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 27399. [D 20:43:03.178764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 27400. [D 20:43:03.178774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 27401. [D 20:43:03.178784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 27402. [D 20:43:03.178794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 27403. [D 20:43:03.178804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 27404. [D 20:43:03.178814] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 27405. [D 20:43:03.180848] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5077 [D 20:43:03.180900] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 60/70. [D 20:43:03.190004] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 27405. [D 20:43:03.190024] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 0/70. [D 20:43:03.190055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 27405. [D 20:43:03.190067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 27406. [D 20:43:03.190077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 27407. [D 20:43:03.190092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 27408. [D 20:43:03.190102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 27409. [D 20:43:03.190112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 27410. [D 20:43:03.190125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 27411. [D 20:43:03.190138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 27412. [D 20:43:03.190148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 27413. [D 20:43:03.190158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 27414. [D 20:43:03.190168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 27415. [D 20:43:03.190179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 27416. [D 20:43:03.190189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 27417. [D 20:43:03.190199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 27418. [D 20:43:03.190209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 27419. [D 20:43:03.190219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 27420. [D 20:43:03.190231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 27421. [D 20:43:03.190241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 27422. [D 20:43:03.190251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 27423. [D 20:43:03.190261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 27424. [D 20:43:03.190274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 27425. [D 20:43:03.190284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 27426. [D 20:43:03.190294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 27427. [D 20:43:03.190329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 27428. [D 20:43:03.190340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 27429. [D 20:43:03.190352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 27430. [D 20:43:03.190362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 27431. [D 20:43:03.190374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 27432. [D 20:43:03.190400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 27433. [D 20:43:03.190410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 27434. [D 20:43:03.190424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 27435. [D 20:43:03.190434] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 27436. [D 20:43:03.190494] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.190506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.190516] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.200742] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 27436. [D 20:43:03.200756] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 1/70. [D 20:43:03.202921] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.202935] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.202944] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.202973] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5079 [D 20:43:03.202984] element 0: offset: 0x2aaaab222d30, size: 24 [D 20:43:03.202996] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 2/70. [D 20:43:03.203013] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.203026] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.203035] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.207365] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5079 [D 20:43:03.207385] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 3/70. [D 20:43:03.207526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 27436. [D 20:43:03.207618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 27437. [D 20:43:03.207630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 27438. [D 20:43:03.207640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 27439. [D 20:43:03.207655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 27440. [D 20:43:03.207665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 27441. [D 20:43:03.207675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 27442. [D 20:43:03.207685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 27443. [D 20:43:03.207696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 27444. [D 20:43:03.207706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 27445. [D 20:43:03.207722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 27446. [D 20:43:03.207732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 27447. [D 20:43:03.207742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 27448. [D 20:43:03.207752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 27449. [D 20:43:03.207779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 27450. [D 20:43:03.207789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 27451. [D 20:43:03.207800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 27452. [D 20:43:03.207810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 27453. [D 20:43:03.207820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 27454. [D 20:43:03.207830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 27455. [D 20:43:03.207853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 27456. [D 20:43:03.207864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 27457. [D 20:43:03.207874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 27458. [D 20:43:03.207890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 27459. [D 20:43:03.207900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 27460. [D 20:43:03.207910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 27461. [D 20:43:03.207934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 27462. [D 20:43:03.207944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 27463. [D 20:43:03.207954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 27464. [D 20:43:03.207965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 27465. [D 20:43:03.207975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 27466. [D 20:43:03.207985] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 27467. [D 20:43:03.211714] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.211730] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.211740] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.211774] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5083 [D 20:43:03.211785] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:03.211801] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 4/70. [D 20:43:03.218415] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 27467. [D 20:43:03.218431] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 5/70. [D 20:43:03.220736] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.220750] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.220760] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.222809] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5083 [D 20:43:03.222828] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 6/70. [D 20:43:03.224203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 27467. [D 20:43:03.224254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 27468. [D 20:43:03.224266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 27469. [D 20:43:03.224276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 27470. [D 20:43:03.224291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 27471. [D 20:43:03.224301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 27472. [D 20:43:03.224311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 27473. [D 20:43:03.224325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 27474. [D 20:43:03.224335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 27475. [D 20:43:03.224345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 27476. [D 20:43:03.224360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 27477. [D 20:43:03.224387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 27478. [D 20:43:03.224409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 27479. [D 20:43:03.224420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 27480. [D 20:43:03.224431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 27481. [D 20:43:03.224442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 27482. [D 20:43:03.224457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 27483. [D 20:43:03.224479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 27484. [D 20:43:03.224490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 27485. [D 20:43:03.224516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 27486. [D 20:43:03.224527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 27487. [D 20:43:03.224537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 27488. [D 20:43:03.224555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 27489. [D 20:43:03.224570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 27490. [D 20:43:03.224591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 27491. [D 20:43:03.224601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 27492. [D 20:43:03.224612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 27493. [D 20:43:03.224622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 27494. [D 20:43:03.224644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 27495. [D 20:43:03.224654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 27496. [D 20:43:03.224664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 27497. [D 20:43:03.224678] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 27498. [D 20:43:03.229273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.229288] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.229299] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.229333] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5085 [D 20:43:03.229344] element 0: offset: 0x2aaaab202b90, size: 24 [D 20:43:03.229358] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 7/70. [D 20:43:03.235887] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 27498. [D 20:43:03.235902] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 8/70. [D 20:43:03.238202] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.238216] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.238224] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.240388] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5085 [D 20:43:03.240442] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 9/70. [D 20:43:03.241965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 27498. [D 20:43:03.241983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 27499. [D 20:43:03.241995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 27500. [D 20:43:03.242005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 27501. [D 20:43:03.242015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 27502. [D 20:43:03.242029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 27503. [D 20:43:03.242039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 27504. [D 20:43:03.242049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 27505. [D 20:43:03.242065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 27506. [D 20:43:03.242075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 27507. [D 20:43:03.242085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 27508. [D 20:43:03.242113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 27509. [D 20:43:03.242124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 27510. [D 20:43:03.242137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 27511. [D 20:43:03.242148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 27512. [D 20:43:03.242158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 27513. [D 20:43:03.242179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 27514. [D 20:43:03.242189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 27515. [D 20:43:03.242200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 27516. [D 20:43:03.242246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 27517. [D 20:43:03.242256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 27518. [D 20:43:03.242274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 27519. [D 20:43:03.242289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 27520. [D 20:43:03.242299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 27521. [D 20:43:03.242308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 27522. [D 20:43:03.242325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 27523. [D 20:43:03.242335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 27524. [D 20:43:03.242345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 27525. [D 20:43:03.242361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 27526. [D 20:43:03.242371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 27527. [D 20:43:03.242381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 27528. [D 20:43:03.242396] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 27529. [D 20:43:03.244655] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.244669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.244679] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.244693] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5089 [D 20:43:03.244704] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:03.244714] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 10/70. [D 20:43:03.253632] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 27529. [D 20:43:03.253647] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 11/70. [D 20:43:03.255967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.255981] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.255991] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.257995] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5089 [D 20:43:03.258015] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 12/70. [D 20:43:03.259570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 27529. [D 20:43:03.259620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 27530. [D 20:43:03.259632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 27531. [D 20:43:03.259642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 27532. [D 20:43:03.259657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 27533. [D 20:43:03.259667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 27534. [D 20:43:03.259676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 27535. [D 20:43:03.259692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 27536. [D 20:43:03.259702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 27537. [D 20:43:03.259712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 27538. [D 20:43:03.259728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 27539. [D 20:43:03.259761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 27540. [D 20:43:03.259771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 27541. [D 20:43:03.259781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 27542. [D 20:43:03.259794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 27543. [D 20:43:03.259846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 27544. [D 20:43:03.259872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 27545. [D 20:43:03.259884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 27546. [D 20:43:03.259894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 27547. [D 20:43:03.259904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 27548. [D 20:43:03.259918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 27549. [D 20:43:03.259928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 27550. [D 20:43:03.259952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 27551. [D 20:43:03.259962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 27552. [D 20:43:03.259973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 27553. [D 20:43:03.259987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 27554. [D 20:43:03.260010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 27555. [D 20:43:03.260024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 27556. [D 20:43:03.260034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 27557. [D 20:43:03.260047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 27558. [D 20:43:03.260070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 27559. [D 20:43:03.260080] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 27560. [D 20:43:03.264466] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.264481] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.264492] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.264529] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5091 [D 20:43:03.264541] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:03.264554] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 13/70. [D 20:43:03.270353] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.270367] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.270378] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:03.270393] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5095 [D 20:43:03.270403] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:03.270413] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 14/70. [D 20:43:03.271250] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 27560. [D 20:43:03.271264] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 15/70. [D 20:43:03.273644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.273658] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.273667] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:03.276476] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5095 [D 20:43:03.276530] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 16/70. [D 20:43:03.276547] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5091 [D 20:43:03.276558] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 17/70. [D 20:43:03.277237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 27560. [D 20:43:03.277283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 27561. [D 20:43:03.277295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 27562. [D 20:43:03.277306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 27563. [D 20:43:03.277316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 27564. [D 20:43:03.277326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 27565. [D 20:43:03.277336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 27566. [D 20:43:03.277346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 27567. [D 20:43:03.277356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 27568. [D 20:43:03.277366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 27569. [D 20:43:03.277375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 27570. [D 20:43:03.277431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 27571. [D 20:43:03.277442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 27572. [D 20:43:03.277452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 27573. [D 20:43:03.277475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 27574. [D 20:43:03.277485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 27575. [D 20:43:03.277496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 27576. [D 20:43:03.277506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 27577. [D 20:43:03.277516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 27578. [D 20:43:03.277526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 27579. [D 20:43:03.277551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 27580. [D 20:43:03.277561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 27581. [D 20:43:03.277577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 27582. [D 20:43:03.277587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 27583. [D 20:43:03.277597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 27584. [D 20:43:03.277607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 27585. [D 20:43:03.277624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 27586. [D 20:43:03.277634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 27587. [D 20:43:03.277660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 27588. [D 20:43:03.277670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 27589. [D 20:43:03.277680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 27590. [D 20:43:03.277695] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 27591. [D 20:43:03.277708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 27592. [D 20:43:03.277723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 27593. [D 20:43:03.277749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 27594. [D 20:43:03.277763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 27595. [D 20:43:03.277773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 27596. [D 20:43:03.277783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 27597. [D 20:43:03.277811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 27598. [D 20:43:03.277825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 27599. [D 20:43:03.277836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 27600. [D 20:43:03.277846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 27601. [D 20:43:03.277862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 27602. [D 20:43:03.277871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 27603. [D 20:43:03.277881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 27604. [D 20:43:03.277905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 27605. [D 20:43:03.277915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 27606. [D 20:43:03.277925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 27607. [D 20:43:03.277936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 27608. [D 20:43:03.277946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 27609. [D 20:43:03.277956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 27610. [D 20:43:03.277983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 27611. [D 20:43:03.277993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 27612. [D 20:43:03.278008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 27613. [D 20:43:03.278018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 27614. [D 20:43:03.278043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 27615. [D 20:43:03.278053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 27616. [D 20:43:03.278064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 27617. [D 20:43:03.278073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 27618. [D 20:43:03.278083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 27619. [D 20:43:03.278098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 27620. [D 20:43:03.278122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 27621. [D 20:43:03.278136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 27622. [D 20:43:03.278153] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 27623. [D 20:43:03.282148] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.282163] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.282173] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:03.282207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5098 [D 20:43:03.282218] element 0: offset: 0x2aaaab236e20, size: 24 [D 20:43:03.282233] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 18/70. [D 20:43:03.288055] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 27623. [D 20:43:03.288070] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 19/70. [D 20:43:03.293890] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 27622. [D 20:43:03.293904] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 20/70. [D 20:43:03.296177] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.296190] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.296200] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:03.296257] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.296269] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.296279] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.298325] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5098 [D 20:43:03.298344] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 21/70. [D 20:43:03.298406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 27622. [D 20:43:03.298457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 27623. [D 20:43:03.298468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 27624. [D 20:43:03.298488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 27625. [D 20:43:03.298500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 27626. [D 20:43:03.298509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 27627. [D 20:43:03.298520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 27628. [D 20:43:03.298530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 27629. [D 20:43:03.298540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 27630. [D 20:43:03.298550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 27631. [D 20:43:03.298589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 27632. [D 20:43:03.298599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 27633. [D 20:43:03.298609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 27634. [D 20:43:03.298625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 27635. [D 20:43:03.298634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 27636. [D 20:43:03.298645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 27637. [D 20:43:03.298674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 27638. [D 20:43:03.298689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 27639. [D 20:43:03.298699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 27640. [D 20:43:03.298709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 27641. [D 20:43:03.298742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 27642. [D 20:43:03.298753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 27643. [D 20:43:03.298763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 27644. [D 20:43:03.298773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 27645. [D 20:43:03.298789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 27646. [D 20:43:03.298799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 27647. [D 20:43:03.298823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 27648. [D 20:43:03.298833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 27649. [D 20:43:03.298843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 27650. [D 20:43:03.298858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 27651. [D 20:43:03.298867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 27652. [D 20:43:03.298878] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 27653. [D 20:43:03.304311] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 27653. [D 20:43:03.304327] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 22/70. [D 20:43:03.306524] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.306540] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.306550] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:03.417662] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.417677] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.417688] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:03.417720] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5101 [D 20:43:03.417731] element 0: offset: 0x2aaaab22c0a0, size: 24 [D 20:43:03.417743] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 23/70. [D 20:43:03.422265] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5101 [D 20:43:03.422318] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 24/70. [D 20:43:03.422367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 27653. [D 20:43:03.422383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 27654. [D 20:43:03.422396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 27655. [D 20:43:03.422406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 27656. [D 20:43:03.422416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 27657. [D 20:43:03.422426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 27658. [D 20:43:03.422436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 27659. [D 20:43:03.422446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 27660. [D 20:43:03.422457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 27661. [D 20:43:03.422474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 27662. [D 20:43:03.422485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 27663. [D 20:43:03.422494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 27664. [D 20:43:03.422504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 27665. [D 20:43:03.422524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 27666. [D 20:43:03.422534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 27667. [D 20:43:03.422543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 27668. [D 20:43:03.422554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 27669. [D 20:43:03.422565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 27670. [D 20:43:03.422575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 27671. [D 20:43:03.422585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 27672. [D 20:43:03.422602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 27673. [D 20:43:03.422612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 27674. [D 20:43:03.422622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 27675. [D 20:43:03.422632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 27676. [D 20:43:03.422642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 27677. [D 20:43:03.422652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 27678. [D 20:43:03.422662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 27679. [D 20:43:03.422686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 27680. [D 20:43:03.422696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 27681. [D 20:43:03.422706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 27682. [D 20:43:03.422717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 27683. [D 20:43:03.422729] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 27684. [D 20:43:03.428238] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 27684. [D 20:43:03.428252] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 25/70. [D 20:43:03.430167] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.430180] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.430189] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:03.564989] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.565004] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.565015] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:03.565030] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5103 [D 20:43:03.565041] element 0: offset: 0x2aaaab209330, size: 24 [D 20:43:03.565051] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 26/70. [D 20:43:03.567069] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5103 [D 20:43:03.567089] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 27/70. [D 20:43:03.567263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 27684. [D 20:43:03.567324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 27685. [D 20:43:03.567336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 27686. [D 20:43:03.567347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 27687. [D 20:43:03.567361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 27688. [D 20:43:03.567371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 27689. [D 20:43:03.567381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 27690. [D 20:43:03.567395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 27691. [D 20:43:03.567404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 27692. [D 20:43:03.567414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 27693. [D 20:43:03.567430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 27694. [D 20:43:03.567440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 27695. [D 20:43:03.567450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 27696. [D 20:43:03.567465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 27697. [D 20:43:03.567494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 27698. [D 20:43:03.567507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 27699. [D 20:43:03.567517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 27700. [D 20:43:03.567527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 27701. [D 20:43:03.567540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 27702. [D 20:43:03.567564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 27703. [D 20:43:03.567576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 27704. [D 20:43:03.567586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 27705. [D 20:43:03.567599] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.567626] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.567637] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.567672] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5107 [D 20:43:03.567683] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:03.567695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 27706. [D 20:43:03.567724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 27707. [D 20:43:03.567736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 27708. [D 20:43:03.567746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 27709. [D 20:43:03.567757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 27710. [D 20:43:03.567768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 27711. [D 20:43:03.567778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 27712. [D 20:43:03.567788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 27713. [D 20:43:03.567798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 27714. [D 20:43:03.567808] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 27715. [D 20:43:03.567825] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 28/70. [D 20:43:03.579094] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 27715. [D 20:43:03.579112] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 29/70. [D 20:43:03.581499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.581513] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.581522] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.583738] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5107 [D 20:43:03.583793] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 30/70. [D 20:43:03.585792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 27715. [D 20:43:03.585810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 27716. [D 20:43:03.585822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 27717. [D 20:43:03.585832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 27718. [D 20:43:03.585842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 27719. [D 20:43:03.585852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 27720. [D 20:43:03.585863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 27721. [D 20:43:03.585873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 27722. [D 20:43:03.585883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 27723. [D 20:43:03.585901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 27724. [D 20:43:03.585911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 27725. [D 20:43:03.585921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 27726. [D 20:43:03.585931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 27727. [D 20:43:03.585941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 27728. [D 20:43:03.585951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 27729. [D 20:43:03.585961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 27730. [D 20:43:03.585988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 27731. [D 20:43:03.585998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 27732. [D 20:43:03.586008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 27733. [D 20:43:03.586019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 27734. [D 20:43:03.586028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 27735. [D 20:43:03.586053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 27736. [D 20:43:03.586064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 27737. [D 20:43:03.586079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 27738. [D 20:43:03.586090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 27739. [D 20:43:03.586100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 27740. [D 20:43:03.586110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 27741. [D 20:43:03.586120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 27742. [D 20:43:03.586130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 27743. [D 20:43:03.586139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 27744. [D 20:43:03.586175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 27745. [D 20:43:03.586186] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 27746. [D 20:43:03.596499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.596513] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.596524] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.596539] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5111 [D 20:43:03.596549] element 0: offset: 0x2aaaab202b90, size: 24 [D 20:43:03.596560] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 31/70. [D 20:43:03.596578] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.596589] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.596598] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:03.596613] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5113 [D 20:43:03.596623] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:03.596632] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 32/70. [D 20:43:03.597485] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 27746. [D 20:43:03.597499] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 33/70. [D 20:43:03.598222] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.598236] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.598245] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:03.600623] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5111 [D 20:43:03.600689] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 34/70. [D 20:43:03.602169] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5113 [D 20:43:03.603338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 27746. [D 20:43:03.603388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 27747. [D 20:43:03.603400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 27748. [D 20:43:03.603410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 27749. [D 20:43:03.603421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 27750. [D 20:43:03.603431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 27751. [D 20:43:03.603441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 27752. [D 20:43:03.603452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 27753. [D 20:43:03.603461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 27754. [D 20:43:03.603471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 27755. [D 20:43:03.603481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 27756. [D 20:43:03.603499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 27757. [D 20:43:03.603509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 27758. [D 20:43:03.603518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 27759. [D 20:43:03.603546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 27760. [D 20:43:03.603557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 27761. [D 20:43:03.603567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 27762. [D 20:43:03.603577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 27763. [D 20:43:03.603587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 27764. [D 20:43:03.603597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 27765. [D 20:43:03.603621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 27766. [D 20:43:03.603631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 27767. [D 20:43:03.603641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 27768. [D 20:43:03.603651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 27769. [D 20:43:03.603661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 27770. [D 20:43:03.603671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 27771. [D 20:43:03.603688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 27772. [D 20:43:03.603699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 27773. [D 20:43:03.603724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 27774. [D 20:43:03.603734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 27775. [D 20:43:03.603744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 27776. [D 20:43:03.603760] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 27777. [D 20:43:03.606070] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 35/70. [D 20:43:03.610077] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 27777. [D 20:43:03.610093] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 36/70. [D 20:43:03.610144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 27777. [D 20:43:03.610157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 27778. [D 20:43:03.610168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 27779. [D 20:43:03.610183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 27780. [D 20:43:03.610193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 27781. [D 20:43:03.610207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 27782. [D 20:43:03.610217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 27783. [D 20:43:03.610226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 27784. [D 20:43:03.610242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 27785. [D 20:43:03.610252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 27786. [D 20:43:03.610262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 27787. [D 20:43:03.610278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 27788. [D 20:43:03.610288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 27789. [D 20:43:03.610298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 27790. [D 20:43:03.610313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 27791. [D 20:43:03.610323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 27792. [D 20:43:03.610333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 27793. [D 20:43:03.610367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 27794. [D 20:43:03.610396] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.610416] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.610426] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:03.610473] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5115 [D 20:43:03.610487] element 0: offset: 0x2aaaab236e20, size: 24 [D 20:43:03.610499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 27795. [D 20:43:03.610509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 27796. [D 20:43:03.610519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 27797. [D 20:43:03.610530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 27798. [D 20:43:03.610539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 27799. [D 20:43:03.610556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 27800. [D 20:43:03.610565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 27801. [D 20:43:03.610575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 27802. [D 20:43:03.610591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 27803. [D 20:43:03.610601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 27804. [D 20:43:03.610611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 27805. [D 20:43:03.610626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 27806. [D 20:43:03.610636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 27807. [D 20:43:03.610646] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 27808. [D 20:43:03.610685] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 37/70. [D 20:43:03.610740] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.610753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.610762] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:03.613619] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.613632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.613641] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:03.613656] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5119 [D 20:43:03.613666] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:03.613676] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 38/70. [D 20:43:03.621852] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 27808. [D 20:43:03.621867] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 39/70. [D 20:43:03.624247] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.624261] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.624270] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:03.626666] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5115 [D 20:43:03.626742] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 40/70. [D 20:43:03.626806] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5119 [D 20:43:03.626821] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 41/70. [D 20:43:03.626888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 27808. [D 20:43:03.626904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 27809. [D 20:43:03.626915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 27810. [D 20:43:03.626925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 27811. [D 20:43:03.626935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 27812. [D 20:43:03.626946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 27813. [D 20:43:03.626956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 27814. [D 20:43:03.626992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 27815. [D 20:43:03.627001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 27816. [D 20:43:03.627014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 27817. [D 20:43:03.627024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 27818. [D 20:43:03.627034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 27819. [D 20:43:03.627048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 27820. [D 20:43:03.627057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 27821. [D 20:43:03.627067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 27822. [D 20:43:03.627083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 27823. [D 20:43:03.627093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 27824. [D 20:43:03.627103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 27825. [D 20:43:03.627133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 27826. [D 20:43:03.627143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 27827. [D 20:43:03.627155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 27828. [D 20:43:03.627165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 27829. [D 20:43:03.627175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 27830. [D 20:43:03.627188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 27831. [D 20:43:03.627198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 27832. [D 20:43:03.627208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 27833. [D 20:43:03.627243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 27834. [D 20:43:03.627253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 27835. [D 20:43:03.627263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 27836. [D 20:43:03.627274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 27837. [D 20:43:03.627284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 27838. [D 20:43:03.627294] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 27839. [D 20:43:03.627307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 27840. [D 20:43:03.627317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 27841. [D 20:43:03.627357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 27842. [D 20:43:03.627369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 27843. [D 20:43:03.627378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 27844. [D 20:43:03.627391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 27845. [D 20:43:03.627408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 27846. [D 20:43:03.627417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 27847. [D 20:43:03.627427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 27848. [D 20:43:03.627443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 27849. [D 20:43:03.627453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 27850. [D 20:43:03.627463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 27851. [D 20:43:03.627473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 27852. [D 20:43:03.627490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 27853. [D 20:43:03.627500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 27854. [D 20:43:03.627510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 27855. [D 20:43:03.627520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 27856. [D 20:43:03.627531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 27857. [D 20:43:03.627541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 27858. [D 20:43:03.627568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 27859. [D 20:43:03.627578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 27860. [D 20:43:03.627588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 27861. [D 20:43:03.627598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 27862. [D 20:43:03.627608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 27863. [D 20:43:03.627623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 27864. [D 20:43:03.627648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 27865. [D 20:43:03.627657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 27866. [D 20:43:03.627673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 27867. [D 20:43:03.627683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 27868. [D 20:43:03.627693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 27869. [D 20:43:03.627709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 27870. [D 20:43:03.627719] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 27871. [D 20:43:03.632840] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 27871. [D 20:43:03.632855] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 42/70. [D 20:43:03.639014] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 27870. [D 20:43:03.639027] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 43/70. [D 20:43:03.643305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.643320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.643330] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.643347] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.643360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.643368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:03.643388] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.643398] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.643407] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:03.643439] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5123 [D 20:43:03.643450] element 0: offset: 0x2aaaab22c0a0, size: 24 [D 20:43:03.643461] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 44/70. [D 20:43:03.643497] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.643507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.643516] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.643534] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5125 [D 20:43:03.643562] element 0: offset: 0x2aaaab2032b0, size: 24 [D 20:43:03.643572] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 45/70. [D 20:43:03.648822] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5125 [D 20:43:03.648894] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 46/70. [D 20:43:03.648921] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5123 [D 20:43:03.648933] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 47/70. [D 20:43:03.649036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 27870. [D 20:43:03.649053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 27871. [D 20:43:03.649064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 27872. [D 20:43:03.649074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 27873. [D 20:43:03.649085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 27874. [D 20:43:03.649094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 27875. [D 20:43:03.649104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 27876. [D 20:43:03.649114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 27877. [D 20:43:03.649124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 27878. [D 20:43:03.649133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 27879. [D 20:43:03.649144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 27880. [D 20:43:03.649160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 27881. [D 20:43:03.649169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 27882. [D 20:43:03.649179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 27883. [D 20:43:03.649189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 27884. [D 20:43:03.649199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 27885. [D 20:43:03.649253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 27886. [D 20:43:03.649266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 27887. [D 20:43:03.649276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 27888. [D 20:43:03.649286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 27889. [D 20:43:03.649296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 27890. [D 20:43:03.649306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 27891. [D 20:43:03.649316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 27892. [D 20:43:03.649331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 27893. [D 20:43:03.649341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 27894. [D 20:43:03.649350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 27895. [D 20:43:03.649371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 27896. [D 20:43:03.649381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 27897. [D 20:43:03.649391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 27898. [D 20:43:03.649400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 27899. [D 20:43:03.649417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 27900. [D 20:43:03.649427] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22fdc0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 27901. [D 20:43:03.649453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 27902. [D 20:43:03.649465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 27903. [D 20:43:03.649475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 27904. [D 20:43:03.649499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 27905. [D 20:43:03.649509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 27906. [D 20:43:03.649519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 27907. [D 20:43:03.649533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 27908. [D 20:43:03.649543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 27909. [D 20:43:03.649553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 27910. [D 20:43:03.649563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 27911. [D 20:43:03.649587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 27912. [D 20:43:03.649602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 27913. [D 20:43:03.649613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 27914. [D 20:43:03.649622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 27915. [D 20:43:03.649632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 27916. [D 20:43:03.649642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 27917. [D 20:43:03.649652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 27918. [D 20:43:03.649661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 27919. [D 20:43:03.649695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 27920. [D 20:43:03.649705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 27921. [D 20:43:03.649727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 27922. [D 20:43:03.649740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 27923. [D 20:43:03.649749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 27924. [D 20:43:03.649759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 27925. [D 20:43:03.649775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 27926. [D 20:43:03.649785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 27927. [D 20:43:03.649807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 27928. [D 20:43:03.649818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 27929. [D 20:43:03.649828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 27930. [D 20:43:03.649838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 27931. [D 20:43:03.649847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 27932. [D 20:43:03.649857] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab234070 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 27933. [D 20:43:03.656267] openib_check_cq: completed rdma wr_id 2aaaab22fdc0, nic_wr_credit 27933. [D 20:43:03.656283] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 48/70. [D 20:43:03.662157] openib_check_cq: completed rdma wr_id 2aaaab234070, nic_wr_credit 27932. [D 20:43:03.662171] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 49/70. [D 20:43:03.664459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.664474] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.664483] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.664501] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.664512] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.664521] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:03.667439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.667453] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.667463] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:03.667492] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5128 [D 20:43:03.667503] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:03.667514] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 50/70. [D 20:43:03.667533] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.667545] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.667554] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.667582] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5131 [D 20:43:03.667597] element 0: offset: 0x2aaaab202b90, size: 24 [D 20:43:03.667607] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 51/70. [D 20:43:03.672646] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5131 [D 20:43:03.672717] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 52/70. [D 20:43:03.672739] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5128 [D 20:43:03.672751] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 53/70. [D 20:43:03.672855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 27932. [D 20:43:03.672872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 27933. [D 20:43:03.672884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 27934. [D 20:43:03.672935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 27935. [D 20:43:03.672946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 27936. [D 20:43:03.672956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 27937. [D 20:43:03.672966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 27938. [D 20:43:03.672976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 27939. [D 20:43:03.672986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 27940. [D 20:43:03.673002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 27941. [D 20:43:03.673012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 27942. [D 20:43:03.673022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 27943. [D 20:43:03.673032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 27944. [D 20:43:03.673054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 27945. [D 20:43:03.673065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 27946. [D 20:43:03.673084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 27947. [D 20:43:03.673094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 27948. [D 20:43:03.673104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 27949. [D 20:43:03.673114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 27950. [D 20:43:03.673129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 27951. [D 20:43:03.673139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 27952. [D 20:43:03.673149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 27953. [D 20:43:03.673158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 27954. [D 20:43:03.673187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 27955. [D 20:43:03.673197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 27956. [D 20:43:03.673207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 27957. [D 20:43:03.673217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 27958. [D 20:43:03.673227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 27959. [D 20:43:03.673253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 27960. [D 20:43:03.673264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 27961. [D 20:43:03.673276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 27962. [D 20:43:03.673291] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22ead0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 27963. [D 20:43:03.673304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 27964. [D 20:43:03.673314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 27965. [D 20:43:03.673324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 27966. [D 20:43:03.673339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 27967. [D 20:43:03.673349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 27968. [D 20:43:03.673358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 27969. [D 20:43:03.673369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 27970. [D 20:43:03.673378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 27971. [D 20:43:03.673388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 27972. [D 20:43:03.673414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 27973. [D 20:43:03.673424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 27974. [D 20:43:03.673434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 27975. [D 20:43:03.673450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 27976. [D 20:43:03.673459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 27977. [D 20:43:03.673469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 27978. [D 20:43:03.673496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 27979. [D 20:43:03.673506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 27980. [D 20:43:03.673516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 27981. [D 20:43:03.673527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 27982. [D 20:43:03.673537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 27983. [D 20:43:03.673547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 27984. [D 20:43:03.673571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 27985. [D 20:43:03.673587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 27986. [D 20:43:03.673597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 27987. [D 20:43:03.673607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 27988. [D 20:43:03.673617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 27989. [D 20:43:03.673640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 27990. [D 20:43:03.673650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 27991. [D 20:43:03.673664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 27992. [D 20:43:03.673674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 27993. [D 20:43:03.673684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 27994. [D 20:43:03.673706] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22fdc0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 27995. [D 20:43:03.679891] openib_check_cq: completed rdma wr_id 2aaaab22ead0, nic_wr_credit 27995. [D 20:43:03.679909] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 54/70. [D 20:43:03.685771] openib_check_cq: completed rdma wr_id 2aaaab22fdc0, nic_wr_credit 27994. [D 20:43:03.685784] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 55/70. [D 20:43:03.686213] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.686228] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.686238] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.686256] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.686268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.686276] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:03.691682] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.691696] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.691706] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:03.691736] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5135 [D 20:43:03.691747] element 0: offset: 0x2aaaab22c0a0, size: 24 [D 20:43:03.691757] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 56/70. [D 20:43:03.691776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.691789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.691797] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.691827] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5137 [D 20:43:03.691841] element 0: offset: 0x2aaaab2032b0, size: 24 [D 20:43:03.691851] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 57/70. [D 20:43:03.696951] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5137 [D 20:43:03.697024] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 58/70. [D 20:43:03.697167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 27994. [D 20:43:03.697184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 27995. [D 20:43:03.697196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 27996. [D 20:43:03.697206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 27997. [D 20:43:03.697226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 27998. [D 20:43:03.697235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 27999. [D 20:43:03.697245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 28000. [D 20:43:03.697262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 28001. [D 20:43:03.697271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 28002. [D 20:43:03.697281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 28003. [D 20:43:03.697291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 28004. [D 20:43:03.697334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 28005. [D 20:43:03.697346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 28006. [D 20:43:03.697356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 28007. [D 20:43:03.697379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 28008. [D 20:43:03.697389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 28009. [D 20:43:03.697400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 28010. [D 20:43:03.697413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 28011. [D 20:43:03.697423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 28012. [D 20:43:03.697433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 28013. [D 20:43:03.697462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 28014. [D 20:43:03.697472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 28015. [D 20:43:03.697484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 28016. [D 20:43:03.697494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 28017. [D 20:43:03.697504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 28018. [D 20:43:03.697531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 28019. [D 20:43:03.697541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 28020. [D 20:43:03.697555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 28021. [D 20:43:03.697569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 28022. [D 20:43:03.697591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 28023. [D 20:43:03.697601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 28024. [D 20:43:03.697617] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22ead0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 28025. [D 20:43:03.699928] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5135 [D 20:43:03.699943] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 59/70. [D 20:43:03.704236] openib_check_cq: completed rdma wr_id 2aaaab22ead0, nic_wr_credit 28025. [D 20:43:03.704250] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 60/70. [D 20:43:03.706212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.706227] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.706237] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.710912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 28025. [D 20:43:03.710927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 28026. [D 20:43:03.710939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 28027. [D 20:43:03.710949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 28028. [D 20:43:03.710959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 28029. [D 20:43:03.710974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 28030. [D 20:43:03.710983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 28031. [D 20:43:03.710993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 28032. [D 20:43:03.711009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 28033. [D 20:43:03.711019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 28034. [D 20:43:03.711028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 28035. [D 20:43:03.711044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 28036. [D 20:43:03.711053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 28037. [D 20:43:03.711063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 28038. [D 20:43:03.711094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 28039. [D 20:43:03.711105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 28040. [D 20:43:03.711115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 28041. [D 20:43:03.711125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 28042. [D 20:43:03.711135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 28043. [D 20:43:03.711159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 28044. [D 20:43:03.711169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 28045. [D 20:43:03.711179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 28046. [D 20:43:03.711189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 28047. [D 20:43:03.711198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 28048. [D 20:43:03.711224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 28049. [D 20:43:03.711234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 28050. [D 20:43:03.711245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 28051. [D 20:43:03.711254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 28052. [D 20:43:03.711264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 28053. [D 20:43:03.711286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 28054. [D 20:43:03.711296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 28055. [D 20:43:03.711305] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233ea0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 28056. [D 20:43:03.721245] openib_check_cq: completed rdma wr_id 2aaaab233ea0, nic_wr_credit 28056. [D 20:43:03.721259] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 0/70. [D 20:43:03.723595] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.723608] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.723618] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.723649] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5140 [D 20:43:03.723660] element 0: offset: 0x2aaaab202b90, size: 24 [D 20:43:03.723670] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 1/70. [D 20:43:03.723691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.723704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.723713] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:03.728025] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5140 [D 20:43:03.728091] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 2/70. [D 20:43:03.728152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 28056. [D 20:43:03.728168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 28057. [D 20:43:03.728179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 28058. [D 20:43:03.728189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 28059. [D 20:43:03.728200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 28060. [D 20:43:03.728210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 28061. [D 20:43:03.728220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28062. [D 20:43:03.728268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28063. [D 20:43:03.728280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28064. [D 20:43:03.728290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 28065. [D 20:43:03.728300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 28066. [D 20:43:03.728310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 28067. [D 20:43:03.728336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 28068. [D 20:43:03.728351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 28069. [D 20:43:03.728360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 28070. [D 20:43:03.728383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 28071. [D 20:43:03.728394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 28072. [D 20:43:03.728404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 28073. [D 20:43:03.728419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 28074. [D 20:43:03.728429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 28075. [D 20:43:03.728439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 28076. [D 20:43:03.728469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 28077. [D 20:43:03.728484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 28078. [D 20:43:03.728494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 28079. [D 20:43:03.728504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 28080. [D 20:43:03.728537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 28081. [D 20:43:03.728548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 28082. [D 20:43:03.728559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 28083. [D 20:43:03.728569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 28084. [D 20:43:03.728598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 28085. [D 20:43:03.728608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 28086. [D 20:43:03.728623] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab236f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 28087. [D 20:43:03.734033] openib_check_cq: completed rdma wr_id 2aaaab236f20, nic_wr_credit 28087. [D 20:43:03.734048] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 3/70. [D 20:43:03.736334] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.736349] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.736360] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:03.847694] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.847709] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.847720] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:03.847751] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5142 [D 20:43:03.847762] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:03.847775] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 4/70. [D 20:43:03.850187] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5142 [D 20:43:03.850206] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 5/70. [D 20:43:03.850258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 28087. [D 20:43:03.850270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 28088. [D 20:43:03.850279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 28089. [D 20:43:03.850289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 28090. [D 20:43:03.850303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 28091. [D 20:43:03.850322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 28092. [D 20:43:03.850332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 28093. [D 20:43:03.850342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 28094. [D 20:43:03.850352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 28095. [D 20:43:03.850363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 28096. [D 20:43:03.850373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 28097. [D 20:43:03.850383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 28098. [D 20:43:03.850401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 28099. [D 20:43:03.850411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 28100. [D 20:43:03.850421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 28101. [D 20:43:03.850431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 28102. [D 20:43:03.850457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 28103. [D 20:43:03.850468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 28104. [D 20:43:03.850479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 28105. [D 20:43:03.850488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 28106. [D 20:43:03.850499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 28107. [D 20:43:03.850521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 28108. [D 20:43:03.850531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 28109. [D 20:43:03.850546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 28110. [D 20:43:03.850556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 28111. [D 20:43:03.850566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 28112. [D 20:43:03.850597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 28113. [D 20:43:03.850609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 28114. [D 20:43:03.850619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 28115. [D 20:43:03.850629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 28116. [D 20:43:03.850639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 28117. [D 20:43:03.850662] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23f910 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 28118. [D 20:43:03.856172] openib_check_cq: completed rdma wr_id 2aaaab23f910, nic_wr_credit 28118. [D 20:43:03.856185] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 6/70. [D 20:43:03.858212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:03.858225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.858235] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:03.992315] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.992330] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.992340] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:03.992355] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5147 [D 20:43:03.992365] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:03.992376] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 7/70. [D 20:43:03.992390] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:03.992402] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:03.992410] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:03.992423] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5149 [D 20:43:03.992433] element 0: offset: 0x2aaaab2032b0, size: 24 [D 20:43:03.992443] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 8/70. [D 20:43:03.994524] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5147 [D 20:43:03.994593] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 9/70. [D 20:43:03.996580] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5149 [D 20:43:03.996597] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 10/70. [D 20:43:03.999215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 28118. [D 20:43:03.999232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 28119. [D 20:43:03.999244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 28120. [D 20:43:03.999254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 28121. [D 20:43:03.999264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 28122. [D 20:43:03.999280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 28123. [D 20:43:03.999289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 28124. [D 20:43:03.999299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 28125. [D 20:43:03.999315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 28126. [D 20:43:03.999325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 28127. [D 20:43:03.999335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 28128. [D 20:43:03.999351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 28129. [D 20:43:03.999361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 28130. [D 20:43:03.999370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 28131. [D 20:43:03.999387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 28132. [D 20:43:03.999396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 28133. [D 20:43:03.999406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 28134. [D 20:43:03.999416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 28135. [D 20:43:03.999447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 28136. [D 20:43:03.999457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 28137. [D 20:43:03.999471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 28138. [D 20:43:03.999481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 28139. [D 20:43:03.999503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 28140. [D 20:43:03.999514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 28141. [D 20:43:03.999524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 28142. [D 20:43:03.999538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 28143. [D 20:43:03.999548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 28144. [D 20:43:03.999558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 28145. [D 20:43:03.999590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 28146. [D 20:43:03.999600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 28147. [D 20:43:03.999611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 28148. [D 20:43:03.999621] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230220 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 28149. [D 20:43:03.999634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 28150. [D 20:43:03.999658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 28151. [D 20:43:03.999668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 28152. [D 20:43:03.999678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 28153. [D 20:43:03.999688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 28154. [D 20:43:03.999698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 28155. [D 20:43:03.999708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 28156. [D 20:43:03.999718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 28157. [D 20:43:03.999727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 28158. [D 20:43:03.999759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 28159. [D 20:43:03.999769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 28160. [D 20:43:03.999781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 28161. [D 20:43:03.999790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 28162. [D 20:43:03.999800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 28163. [D 20:43:03.999825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 28164. [D 20:43:03.999835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 28165. [D 20:43:03.999845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 28166. [D 20:43:03.999855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 28167. [D 20:43:03.999865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 28168. [D 20:43:03.999874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 28169. [D 20:43:03.999899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 28170. [D 20:43:03.999909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 28171. [D 20:43:03.999919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 28172. [D 20:43:03.999930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 28173. [D 20:43:03.999940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 28174. [D 20:43:03.999961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 28175. [D 20:43:03.999971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 28176. [D 20:43:03.999981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 28177. [D 20:43:03.999996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 28178. [D 20:43:04.000006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 28179. [D 20:43:04.000016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 28180. [D 20:43:04.000040] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab203aa0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 28181. [D 20:43:04.007048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.007063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.007074] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:04.007106] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5152 [D 20:43:04.007118] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:04.007128] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 11/70. [D 20:43:04.007178] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.007191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.007201] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:04.007215] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5154 [D 20:43:04.007228] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:04.007237] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 12/70. [D 20:43:04.010880] openib_check_cq: completed rdma wr_id 2aaaab230220, nic_wr_credit 28181. [D 20:43:04.010896] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 13/70. [D 20:43:04.022322] openib_check_cq: completed rdma wr_id 2aaaab203aa0, nic_wr_credit 28180. [D 20:43:04.022336] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 14/70. [D 20:43:04.024702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.024715] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.024725] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:04.024784] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.024798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.024806] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:04.027206] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5152 [D 20:43:04.027266] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 15/70. [D 20:43:04.028115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 28180. [D 20:43:04.028133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 28181. [D 20:43:04.028144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 28182. [D 20:43:04.028155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 28183. [D 20:43:04.028167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 28184. [D 20:43:04.028182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 28185. [D 20:43:04.028192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28186. [D 20:43:04.028202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28187. [D 20:43:04.028219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28188. [D 20:43:04.028229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 28189. [D 20:43:04.028238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 28190. [D 20:43:04.028255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 28191. [D 20:43:04.028264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 28192. [D 20:43:04.028274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 28193. [D 20:43:04.028290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 28194. [D 20:43:04.028300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 28195. [D 20:43:04.028310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 28196. [D 20:43:04.028343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 28197. [D 20:43:04.028353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 28198. [D 20:43:04.028364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 28199. [D 20:43:04.028373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 28200. [D 20:43:04.028402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 28201. [D 20:43:04.028413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 28202. [D 20:43:04.028426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 28203. [D 20:43:04.028436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 28204. [D 20:43:04.028446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 28205. [D 20:43:04.028459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 28206. [D 20:43:04.028469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 28207. [D 20:43:04.028479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 28208. [D 20:43:04.028489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 28209. [D 20:43:04.028514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 28210. [D 20:43:04.028524] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2085f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 28211. [D 20:43:04.030848] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5154 [D 20:43:04.030864] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 16/70. [D 20:43:04.039074] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.039090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.039101] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:04.039133] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5159 [D 20:43:04.039144] element 0: offset: 0x2aaaab2088a0, size: 24 [D 20:43:04.039155] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 17/70. [D 20:43:04.039175] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.039185] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.039193] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:04.039221] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5161 [D 20:43:04.039232] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:04.039255] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 18/70. [D 20:43:04.039821] openib_check_cq: completed rdma wr_id 2aaaab2085f0, nic_wr_credit 28211. [D 20:43:04.039836] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 19/70. [D 20:43:04.039869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 28211. [D 20:43:04.039881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 28212. [D 20:43:04.042319] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5159 [D 20:43:04.042390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 28213. [D 20:43:04.042448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 28214. [D 20:43:04.042459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 28215. [D 20:43:04.042469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 28216. [D 20:43:04.042479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 28217. [D 20:43:04.042489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 28218. [D 20:43:04.042499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 28219. [D 20:43:04.042514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 28220. [D 20:43:04.042524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 28221. [D 20:43:04.042534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 28222. [D 20:43:04.042607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 28223. [D 20:43:04.042620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 28224. [D 20:43:04.042630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 28225. [D 20:43:04.042640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 28226. [D 20:43:04.042650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 28227. [D 20:43:04.042660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 28228. [D 20:43:04.042684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 28229. [D 20:43:04.042694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 28230. [D 20:43:04.042704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 28231. [D 20:43:04.042719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 28232. [D 20:43:04.042729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 28233. [D 20:43:04.042739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 28234. [D 20:43:04.042773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 28235. [D 20:43:04.042784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 28236. [D 20:43:04.042805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 28237. [D 20:43:04.042820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 28238. [D 20:43:04.042830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 28239. [D 20:43:04.042840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 28240. [D 20:43:04.042854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 28241. [D 20:43:04.042878] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22bfe0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 28242. [D 20:43:04.042916] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 20/70. [D 20:43:04.042946] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5161 [D 20:43:04.042958] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 21/70. [D 20:43:04.042970] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.042996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.043006] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:04.051534] openib_check_cq: completed rdma wr_id 2aaaab22bfe0, nic_wr_credit 28242. [D 20:43:04.051551] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 22/70. [D 20:43:04.053785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.053798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.053807] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:04.055195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 28242. [D 20:43:04.055209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 28243. [D 20:43:04.055221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 28244. [D 20:43:04.055231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 28245. [D 20:43:04.055241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 28246. [D 20:43:04.055254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 28247. [D 20:43:04.055264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 28248. [D 20:43:04.055274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 28249. [D 20:43:04.055284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 28250. [D 20:43:04.055294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 28251. [D 20:43:04.055304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 28252. [D 20:43:04.055314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 28253. [D 20:43:04.055331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 28254. [D 20:43:04.055341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 28255. [D 20:43:04.055351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 28256. [D 20:43:04.055377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 28257. [D 20:43:04.055387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 28258. [D 20:43:04.055398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 28259. [D 20:43:04.055408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 28260. [D 20:43:04.055417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 28261. [D 20:43:04.055428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 28262. [D 20:43:04.055451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 28263. [D 20:43:04.055462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 28264. [D 20:43:04.055472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 28265. [D 20:43:04.055482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 28266. [D 20:43:04.055510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 28267. [D 20:43:04.055521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 28268. [D 20:43:04.055536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 28269. [D 20:43:04.055547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 28270. [D 20:43:04.055557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 28271. [D 20:43:04.055579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 28272. [D 20:43:04.055590] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab203ac0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 28273. [D 20:43:04.055601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 28274. [D 20:43:04.055614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 28275. [D 20:43:04.055624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 28276. [D 20:43:04.055634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 28277. [D 20:43:04.055658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 28278. [D 20:43:04.055668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 28279. [D 20:43:04.055678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 28280. [D 20:43:04.055688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 28281. [D 20:43:04.055698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 28282. [D 20:43:04.055712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 28283. [D 20:43:04.055735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 28284. [D 20:43:04.055745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 28285. [D 20:43:04.055759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 28286. [D 20:43:04.055769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 28287. [D 20:43:04.055778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 28288. [D 20:43:04.055801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 28289. [D 20:43:04.055810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 28290. [D 20:43:04.055821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 28291. [D 20:43:04.055831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 28292. [D 20:43:04.055841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 28293. [D 20:43:04.055852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 28294. [D 20:43:04.055875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 28295. [D 20:43:04.055890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 28296. [D 20:43:04.055900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 28297. [D 20:43:04.055910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 28298. [D 20:43:04.055921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 28299. [D 20:43:04.055944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 28300. [D 20:43:04.055954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 28301. [D 20:43:04.055967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 28302. [D 20:43:04.055977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 28303. [D 20:43:04.055987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 28304. [D 20:43:04.056009] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22ead0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 28305. [D 20:43:04.065497] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.065511] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.065521] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:04.065552] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5165 [D 20:43:04.065563] element 0: offset: 0x2aaaab22bea0, size: 24 [D 20:43:04.065574] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 23/70. [D 20:43:04.065594] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.065604] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.065613] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:04.065627] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5166 [D 20:43:04.065639] element 0: offset: 0x2aaaab22c0a0, size: 24 [D 20:43:04.065648] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 24/70. [D 20:43:04.066875] openib_check_cq: completed rdma wr_id 2aaaab203ac0, nic_wr_credit 28305. [D 20:43:04.066890] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 25/70. [D 20:43:04.078439] openib_check_cq: completed rdma wr_id 2aaaab22ead0, nic_wr_credit 28304. [D 20:43:04.078452] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 26/70. [D 20:43:04.080783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.080796] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.080806] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:04.080877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.080888] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.080896] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:04.083686] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5166 [D 20:43:04.083744] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 27/70. [D 20:43:04.084215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 28304. [D 20:43:04.084233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 28305. [D 20:43:04.084244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 28306. [D 20:43:04.084254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 28307. [D 20:43:04.084269] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5165 [D 20:43:04.084317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 28308. [D 20:43:04.084328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 28309. [D 20:43:04.084338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 28310. [D 20:43:04.084354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 28311. [D 20:43:04.084363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 28312. [D 20:43:04.084373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 28313. [D 20:43:04.084389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 28314. [D 20:43:04.084399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 28315. [D 20:43:04.084408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 28316. [D 20:43:04.084425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 28317. [D 20:43:04.084434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 28318. [D 20:43:04.084444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 28319. [D 20:43:04.084477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 28320. [D 20:43:04.084488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 28321. [D 20:43:04.084498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 28322. [D 20:43:04.084509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 28323. [D 20:43:04.084518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 28324. [D 20:43:04.084542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 28325. [D 20:43:04.084552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 28326. [D 20:43:04.084562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 28327. [D 20:43:04.084576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 28328. [D 20:43:04.084586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 28329. [D 20:43:04.084596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 28330. [D 20:43:04.084619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 28331. [D 20:43:04.084629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 28332. [D 20:43:04.084639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 28333. [D 20:43:04.084650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 28334. [D 20:43:04.084666] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 28335. [D 20:43:04.084701] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 28/70. [D 20:43:04.095211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.095227] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.095238] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:04.095271] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5171 [D 20:43:04.095282] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:04.095293] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 29/70. [D 20:43:04.095312] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.095324] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.095333] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:04.095347] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5173 [D 20:43:04.095358] element 0: offset: 0x2aaaab20fe00, size: 24 [D 20:43:04.095367] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 30/70. [D 20:43:04.095902] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 28335. [D 20:43:04.095917] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 31/70. [D 20:43:04.095947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 28335. [D 20:43:04.095959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 28336. [D 20:43:04.095969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 28337. [D 20:43:04.095983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 28338. [D 20:43:04.095993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 28339. [D 20:43:04.096002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 28340. [D 20:43:04.096018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28341. [D 20:43:04.096042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28342. [D 20:43:04.096055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28343. [D 20:43:04.096065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 28344. [D 20:43:04.096075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 28345. [D 20:43:04.096103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 28346. [D 20:43:04.096114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 28347. [D 20:43:04.096124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 28348. [D 20:43:04.096134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 28349. [D 20:43:04.096145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 28350. [D 20:43:04.096155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 28351. [D 20:43:04.096165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 28352. [D 20:43:04.096174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 28353. [D 20:43:04.096185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 28354. [D 20:43:04.096194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 28355. [D 20:43:04.096205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 28356. [D 20:43:04.096219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 28357. [D 20:43:04.096242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 28358. [D 20:43:04.096252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 28359. [D 20:43:04.096263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 28360. [D 20:43:04.096273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 28361. [D 20:43:04.096282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 28362. [D 20:43:04.096300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 28363. [D 20:43:04.096309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 28364. [D 20:43:04.096319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 28365. [D 20:43:04.096330] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 28366. [D 20:43:04.098772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.098786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.098795] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:04.101309] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5171 [D 20:43:04.101375] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 32/70. [D 20:43:04.101420] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5173 [D 20:43:04.101434] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 33/70. [D 20:43:04.107669] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 28366. [D 20:43:04.107686] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 34/70. [D 20:43:04.107704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 28366. [D 20:43:04.107716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 28367. [D 20:43:04.107729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 28368. [D 20:43:04.107739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 28369. [D 20:43:04.107755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 28370. [D 20:43:04.107767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 28371. [D 20:43:04.107776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 28372. [D 20:43:04.107787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 28373. [D 20:43:04.107797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 28374. [D 20:43:04.107806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 28375. [D 20:43:04.107816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 28376. [D 20:43:04.107834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 28377. [D 20:43:04.107844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 28378. [D 20:43:04.107853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 28379. [D 20:43:04.107864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 28380. [D 20:43:04.107874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 28381. [D 20:43:04.107883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 28382. [D 20:43:04.107893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 28383. [D 20:43:04.107930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 28384. [D 20:43:04.107940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 28385. [D 20:43:04.107951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 28386. [D 20:43:04.107960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 28387. [D 20:43:04.107989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 28388. [D 20:43:04.107999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 28389. [D 20:43:04.108009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 28390. [D 20:43:04.108023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 28391. [D 20:43:04.108033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 28392. [D 20:43:04.108043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 28393. [D 20:43:04.108053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 28394. [D 20:43:04.108068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 28395. [D 20:43:04.108078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 28396. [D 20:43:04.108102] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 28397. [D 20:43:04.108115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 28398. [D 20:43:04.108125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 28399. [D 20:43:04.108139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 28400. [D 20:43:04.108149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 28401. [D 20:43:04.108159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 28402. [D 20:43:04.108175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 28403. [D 20:43:04.108184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 28404. [D 20:43:04.108194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 28405. [D 20:43:04.108205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 28406. [D 20:43:04.108215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 28407. [D 20:43:04.108229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 28408. [D 20:43:04.108242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 28409. [D 20:43:04.108252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 28410. [D 20:43:04.108262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 28411. [D 20:43:04.108272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 28412. [D 20:43:04.108283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 28413. [D 20:43:04.108293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 28414. [D 20:43:04.108319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 28415. [D 20:43:04.108330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 28416. [D 20:43:04.108339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 28417. [D 20:43:04.108350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 28418. [D 20:43:04.108360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 28419. [D 20:43:04.108370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 28420. [D 20:43:04.108380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 28421. [D 20:43:04.108407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 28422. [D 20:43:04.108417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 28423. [D 20:43:04.108427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 28424. [D 20:43:04.108437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 28425. [D 20:43:04.108447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 28426. [D 20:43:04.108471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 28427. [D 20:43:04.108485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 28428. [D 20:43:04.108495] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 28429. [D 20:43:04.108556] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.108571] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.108581] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:04.113649] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 28429. [D 20:43:04.113699] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 35/70. [D 20:43:04.120337] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 28428. [D 20:43:04.120354] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 36/70. [D 20:43:04.123529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.123543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.123552] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:04.123566] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.123576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.123585] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.123605] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.123616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.123624] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.123655] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5176 [D 20:43:04.123684] element 0: offset: 0x2aaaab2088a0, size: 24 [D 20:43:04.123697] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 37/70. [D 20:43:04.123716] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.123730] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.123739] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:04.123753] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5179 [D 20:43:04.123764] element 0: offset: 0x2aaaab209330, size: 24 [D 20:43:04.123774] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 38/70. [D 20:43:04.128703] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5179 [D 20:43:04.128774] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 39/70. [D 20:43:04.128797] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5176 [D 20:43:04.128817] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 40/70. [D 20:43:04.128852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 28428. [D 20:43:04.128865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 28429. [D 20:43:04.128876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 28430. [D 20:43:04.128886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 28431. [D 20:43:04.128896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 28432. [D 20:43:04.128915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 28433. [D 20:43:04.128925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28434. [D 20:43:04.128935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28435. [D 20:43:04.128944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28436. [D 20:43:04.128961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 28437. [D 20:43:04.128972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 28438. [D 20:43:04.129021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 28439. [D 20:43:04.129032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 28440. [D 20:43:04.129043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 28441. [D 20:43:04.129052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 28442. [D 20:43:04.129062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 28443. [D 20:43:04.129073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 28444. [D 20:43:04.129083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 28445. [D 20:43:04.129109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 28446. [D 20:43:04.129119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 28447. [D 20:43:04.129129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 28448. [D 20:43:04.129144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 28449. [D 20:43:04.129167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 28450. [D 20:43:04.129180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 28451. [D 20:43:04.129190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 28452. [D 20:43:04.129199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 28453. [D 20:43:04.129227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 28454. [D 20:43:04.129237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 28455. [D 20:43:04.129248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 28456. [D 20:43:04.129258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 28457. [D 20:43:04.129268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 28458. [D 20:43:04.129293] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 28459. [D 20:43:04.129308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 28460. [D 20:43:04.129319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 28461. [D 20:43:04.129328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 28462. [D 20:43:04.129338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 28463. [D 20:43:04.129353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 28464. [D 20:43:04.129363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 28465. [D 20:43:04.129373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 28466. [D 20:43:04.129403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 28467. [D 20:43:04.129458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 28468. [D 20:43:04.129470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 28469. [D 20:43:04.129480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 28470. [D 20:43:04.129503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 28471. [D 20:43:04.129513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 28472. [D 20:43:04.129524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 28473. [D 20:43:04.129534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 28474. [D 20:43:04.129544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 28475. [D 20:43:04.129554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 28476. [D 20:43:04.129564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 28477. [D 20:43:04.129586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 28478. [D 20:43:04.129602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 28479. [D 20:43:04.129612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 28480. [D 20:43:04.129622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 28481. [D 20:43:04.129638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 28482. [D 20:43:04.129661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 28483. [D 20:43:04.129675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 28484. [D 20:43:04.129685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 28485. [D 20:43:04.129695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 28486. [D 20:43:04.129720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 28487. [D 20:43:04.129730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 28488. [D 20:43:04.129743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 28489. [D 20:43:04.129752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 28490. [D 20:43:04.129762] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 28491. [D 20:43:04.134800] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 28491. [D 20:43:04.134848] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 41/70. [D 20:43:04.140689] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 28490. [D 20:43:04.140707] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 42/70. [D 20:43:04.142986] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.143001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.143011] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:04.143028] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.143040] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.143048] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.433963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.433979] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.433990] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.434021] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5183 [D 20:43:04.434031] element 0: offset: 0x2aaaab222d30, size: 24 [D 20:43:04.434041] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 43/70. [D 20:43:04.434060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.434074] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.434084] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:04.434098] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5185 [D 20:43:04.434109] element 0: offset: 0x2aaaab23d070, size: 24 [D 20:43:04.434118] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 44/70. [D 20:43:04.437139] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5185 [D 20:43:04.439356] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 45/70. [D 20:43:04.439382] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5183 [D 20:43:04.439400] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 46/70. [D 20:43:04.440263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 28490. [D 20:43:04.440279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 28491. [D 20:43:04.440290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 28492. [D 20:43:04.440300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 28493. [D 20:43:04.440318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 28494. [D 20:43:04.440330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 28495. [D 20:43:04.440339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 28496. [D 20:43:04.440350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 28497. [D 20:43:04.440360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 28498. [D 20:43:04.440369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 28499. [D 20:43:04.440379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 28500. [D 20:43:04.440397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 28501. [D 20:43:04.440407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 28502. [D 20:43:04.440432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 28503. [D 20:43:04.440442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 28504. [D 20:43:04.440452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 28505. [D 20:43:04.440462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 28506. [D 20:43:04.440479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 28507. [D 20:43:04.440504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 28508. [D 20:43:04.440517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 28509. [D 20:43:04.440527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 28510. [D 20:43:04.440550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 28511. [D 20:43:04.440560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 28512. [D 20:43:04.440569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 28513. [D 20:43:04.440580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 28514. [D 20:43:04.440589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 28515. [D 20:43:04.440599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 28516. [D 20:43:04.440609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 28517. [D 20:43:04.440632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 28518. [D 20:43:04.440642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 28519. [D 20:43:04.440657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 28520. [D 20:43:04.440668] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 28521. [D 20:43:04.440681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 28522. [D 20:43:04.440697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 28523. [D 20:43:04.440707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 28524. [D 20:43:04.440720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 28525. [D 20:43:04.440750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 28526. [D 20:43:04.440761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 28527. [D 20:43:04.440771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 28528. [D 20:43:04.440781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 28529. [D 20:43:04.440791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 28530. [D 20:43:04.440802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 28531. [D 20:43:04.440812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 28532. [D 20:43:04.440827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 28533. [D 20:43:04.440851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 28534. [D 20:43:04.440860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 28535. [D 20:43:04.440876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 28536. [D 20:43:04.440886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 28537. [D 20:43:04.440896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 28538. [D 20:43:04.440920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 28539. [D 20:43:04.440929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 28540. [D 20:43:04.440940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 28541. [D 20:43:04.440950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 28542. [D 20:43:04.440960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 28543. [D 20:43:04.440971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 28544. [D 20:43:04.440980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 28545. [D 20:43:04.440990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 28546. [D 20:43:04.441000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 28547. [D 20:43:04.441011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 28548. [D 20:43:04.441021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 28549. [D 20:43:04.441031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 28550. [D 20:43:04.441051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 28551. [D 20:43:04.441061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 28552. [D 20:43:04.441071] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 28553. [D 20:43:04.445265] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.445280] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.445291] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:04.445324] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5187 [D 20:43:04.445335] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:04.445348] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 47/70. [D 20:43:04.451909] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 28553. [D 20:43:04.451924] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 48/70. [D 20:43:04.463492] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 28552. [D 20:43:04.463506] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 49/70. [D 20:43:04.465859] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.465872] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.465882] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:04.465933] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.465945] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.465955] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:04.467991] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5187 [D 20:43:04.468049] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 50/70. [D 20:43:04.468193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 28552. [D 20:43:04.468210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 28553. [D 20:43:04.468220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 28554. [D 20:43:04.468231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 28555. [D 20:43:04.468246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 28556. [D 20:43:04.468257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 28557. [D 20:43:04.468267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 28558. [D 20:43:04.468277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 28559. [D 20:43:04.468287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 28560. [D 20:43:04.468297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 28561. [D 20:43:04.468307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 28562. [D 20:43:04.468323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 28563. [D 20:43:04.468333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 28564. [D 20:43:04.468343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 28565. [D 20:43:04.468353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 28566. [D 20:43:04.468364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 28567. [D 20:43:04.468374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 28568. [D 20:43:04.468407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 28569. [D 20:43:04.468417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 28570. [D 20:43:04.468427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 28571. [D 20:43:04.468451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 28572. [D 20:43:04.468461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 28573. [D 20:43:04.468471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 28574. [D 20:43:04.468482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 28575. [D 20:43:04.468492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 28576. [D 20:43:04.468502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 28577. [D 20:43:04.468512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 28578. [D 20:43:04.468536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 28579. [D 20:43:04.468551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 28580. [D 20:43:04.468561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 28581. [D 20:43:04.468570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 28582. [D 20:43:04.468581] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 28583. [D 20:43:04.480126] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 28583. [D 20:43:04.480141] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 51/70. [D 20:43:04.482467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.482482] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.482492] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.494220] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.494234] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.494245] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.494277] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5190 [D 20:43:04.494288] element 0: offset: 0x2aaaab202c90, size: 24 [D 20:43:04.494299] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 52/70. [D 20:43:04.496667] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5190 [D 20:43:04.496684] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 53/70. [D 20:43:04.496820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 28583. [D 20:43:04.496835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 28584. [D 20:43:04.496845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 28585. [D 20:43:04.496855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 28586. [D 20:43:04.496866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 28587. [D 20:43:04.496876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 28588. [D 20:43:04.496905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 28589. [D 20:43:04.496916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 28590. [D 20:43:04.496926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 28591. [D 20:43:04.496937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 28592. [D 20:43:04.496946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 28593. [D 20:43:04.496956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 28594. [D 20:43:04.496966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 28595. [D 20:43:04.496984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 28596. [D 20:43:04.496993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 28597. [D 20:43:04.497003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 28598. [D 20:43:04.497026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 28599. [D 20:43:04.497037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 28600. [D 20:43:04.497047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 28601. [D 20:43:04.497057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 28602. [D 20:43:04.497079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 28603. [D 20:43:04.497090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 28604. [D 20:43:04.497105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 28605. [D 20:43:04.497115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 28606. [D 20:43:04.497137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 28607. [D 20:43:04.497147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 28608. [D 20:43:04.497157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 28609. [D 20:43:04.497173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 28610. [D 20:43:04.497183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 28611. [D 20:43:04.497193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 28612. [D 20:43:04.497209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 28613. [D 20:43:04.497219] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 28614. [D 20:43:04.507208] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 28614. [D 20:43:04.507222] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 54/70. [D 20:43:04.509492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.509505] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.509515] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.517876] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.517890] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.517901] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.517917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5193 [D 20:43:04.517927] element 0: offset: 0x2aaaab2088a0, size: 24 [D 20:43:04.517937] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 55/70. [D 20:43:04.522091] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5193 [D 20:43:04.522159] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 56/70. [D 20:43:04.522320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 28614. [D 20:43:04.522336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 28615. [D 20:43:04.522348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 28616. [D 20:43:04.522358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 28617. [D 20:43:04.522373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 28618. [D 20:43:04.522384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 28619. [D 20:43:04.522394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 28620. [D 20:43:04.522404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 28621. [D 20:43:04.522414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 28622. [D 20:43:04.522424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 28623. [D 20:43:04.522434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 28624. [D 20:43:04.522445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 28625. [D 20:43:04.522454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 28626. [D 20:43:04.522464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 28627. [D 20:43:04.522474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 28628. [D 20:43:04.522492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 28629. [D 20:43:04.522502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 28630. [D 20:43:04.522532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 28631. [D 20:43:04.522542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 28632. [D 20:43:04.522552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 28633. [D 20:43:04.522576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 28634. [D 20:43:04.522586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 28635. [D 20:43:04.522597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 28636. [D 20:43:04.522607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 28637. [D 20:43:04.522618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 28638. [D 20:43:04.522640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 28639. [D 20:43:04.522650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 28640. [D 20:43:04.522664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 28641. [D 20:43:04.522674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 28642. [D 20:43:04.522683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 28643. [D 20:43:04.522707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 28644. [D 20:43:04.522717] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 28645. [D 20:43:04.530917] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 28645. [D 20:43:04.530934] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 57/70. [D 20:43:04.533223] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.533237] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.533247] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.538292] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.538306] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.538316] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.538347] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5196 [D 20:43:04.538358] element 0: offset: 0x2aaaab22fef0, size: 24 [D 20:43:04.538369] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 58/70. [D 20:43:04.542919] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5196 [D 20:43:04.542935] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 59/70. [D 20:43:04.543065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 28645. [D 20:43:04.543080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 28646. [D 20:43:04.543091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 28647. [D 20:43:04.543101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 28648. [D 20:43:04.543126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 28649. [D 20:43:04.543136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 28650. [D 20:43:04.543146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 28651. [D 20:43:04.543156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 28652. [D 20:43:04.543166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 28653. [D 20:43:04.543180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 28654. [D 20:43:04.543190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 28655. [D 20:43:04.543200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 28656. [D 20:43:04.543210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 28657. [D 20:43:04.543220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 28658. [D 20:43:04.543230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 28659. [D 20:43:04.543239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 28660. [D 20:43:04.543266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 28661. [D 20:43:04.543276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 28662. [D 20:43:04.543286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 28663. [D 20:43:04.543296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 28664. [D 20:43:04.543313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 28665. [D 20:43:04.543323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 28666. [D 20:43:04.543332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 28667. [D 20:43:04.543343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 28668. [D 20:43:04.543353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 28669. [D 20:43:04.543363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 28670. [D 20:43:04.543373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 28671. [D 20:43:04.543388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 28672. [D 20:43:04.543414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 28673. [D 20:43:04.543425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 28674. [D 20:43:04.543434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 28675. [D 20:43:04.543444] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 28676. [D 20:43:04.552634] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 28676. [D 20:43:04.552648] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 60/70. [D 20:43:04.554937] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.554950] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.554961] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.594689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.594703] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.594714] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.594729] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5200 [D 20:43:04.594739] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:04.594749] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 0/70. [D 20:43:04.599023] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5200 [D 20:43:04.599092] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 1/70. [D 20:43:04.599247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 28676. [D 20:43:04.599263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 28677. [D 20:43:04.599274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 28678. [D 20:43:04.599284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 28679. [D 20:43:04.599295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 28680. [D 20:43:04.599304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 28681. [D 20:43:04.599314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28682. [D 20:43:04.599324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28683. [D 20:43:04.599339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28684. [D 20:43:04.599349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 28685. [D 20:43:04.599359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 28686. [D 20:43:04.599375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 28687. [D 20:43:04.599385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 28688. [D 20:43:04.599395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 28689. [D 20:43:04.599426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 28690. [D 20:43:04.599436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 28691. [D 20:43:04.599448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 28692. [D 20:43:04.599458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 28693. [D 20:43:04.599468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 28694. [D 20:43:04.599496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 28695. [D 20:43:04.599506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 28696. [D 20:43:04.599520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 28697. [D 20:43:04.599530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 28698. [D 20:43:04.599539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 28699. [D 20:43:04.599553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 28700. [D 20:43:04.599577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 28701. [D 20:43:04.599588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 28702. [D 20:43:04.599598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 28703. [D 20:43:04.599613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 28704. [D 20:43:04.599623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 28705. [D 20:43:04.599648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 28706. [D 20:43:04.599658] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 28707. [D 20:43:04.607626] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 28707. [D 20:43:04.607641] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 2/70. [D 20:43:04.609927] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.609942] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.609951] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.616605] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.616619] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.616630] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.616660] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5205 [D 20:43:04.616671] element 0: offset: 0x2aaaab202c90, size: 24 [D 20:43:04.616684] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 3/70. [D 20:43:04.616703] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.616716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.616725] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:04.616739] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5207 [D 20:43:04.616754] element 0: offset: 0x2aaaab2088a0, size: 24 [D 20:43:04.616764] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 4/70. [D 20:43:04.616780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.616789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.616798] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:04.616815] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5209 [D 20:43:04.616825] element 0: offset: 0x2aaaab22fef0, size: 24 [D 20:43:04.616837] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 5/70. [D 20:43:04.622002] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5207 [D 20:43:04.622078] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 6/70. [D 20:43:04.622104] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5205 [D 20:43:04.622116] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 7/70. [D 20:43:04.622213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 28707. [D 20:43:04.622230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 28708. [D 20:43:04.622240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 28709. [D 20:43:04.622251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 28710. [D 20:43:04.622261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 28711. [D 20:43:04.622271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 28712. [D 20:43:04.622336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 28713. [D 20:43:04.622346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 28714. [D 20:43:04.622356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 28715. [D 20:43:04.622367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 28716. [D 20:43:04.622377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 28717. [D 20:43:04.622387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 28718. [D 20:43:04.622397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 28719. [D 20:43:04.622407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 28720. [D 20:43:04.622417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 28721. [D 20:43:04.622435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 28722. [D 20:43:04.622445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 28723. [D 20:43:04.622454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 28724. [D 20:43:04.622484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 28725. [D 20:43:04.622493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 28726. [D 20:43:04.622508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 28727. [D 20:43:04.622518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 28728. [D 20:43:04.622528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 28729. [D 20:43:04.622556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 28730. [D 20:43:04.622567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 28731. [D 20:43:04.622578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 28732. [D 20:43:04.622588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 28733. [D 20:43:04.622598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 28734. [D 20:43:04.622611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 28735. [D 20:43:04.622621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 28736. [D 20:43:04.622631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 28737. [D 20:43:04.622661] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 28738. [D 20:43:04.622675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 28739. [D 20:43:04.622686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 28740. [D 20:43:04.622698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 28741. [D 20:43:04.622708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 28742. [D 20:43:04.622720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 28743. [D 20:43:04.622735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 28744. [D 20:43:04.622745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 28745. [D 20:43:04.622754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 28746. [D 20:43:04.622786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 28747. [D 20:43:04.622797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 28748. [D 20:43:04.622807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 28749. [D 20:43:04.622817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 28750. [D 20:43:04.622833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 28751. [D 20:43:04.622843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 28752. [D 20:43:04.622853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 28753. [D 20:43:04.622869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 28754. [D 20:43:04.622896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 28755. [D 20:43:04.622909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 28756. [D 20:43:04.622919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 28757. [D 20:43:04.622929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 28758. [D 20:43:04.622942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 28759. [D 20:43:04.622952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 28760. [D 20:43:04.622962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 28761. [D 20:43:04.622992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 28762. [D 20:43:04.623026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 28763. [D 20:43:04.623078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 28764. [D 20:43:04.623089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 28765. [D 20:43:04.623098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 28766. [D 20:43:04.623108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 28767. [D 20:43:04.623118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 28768. [D 20:43:04.623128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 28769. [D 20:43:04.623137] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 28770. [D 20:43:04.624857] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5209 [D 20:43:04.624907] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 8/70. [D 20:43:04.633818] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 28770. [D 20:43:04.633839] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 9/70. [D 20:43:04.639667] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 28769. [D 20:43:04.639689] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 10/70. [D 20:43:04.639702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 28769. [D 20:43:04.639713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 28770. [D 20:43:04.639727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 28771. [D 20:43:04.639737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 28772. [D 20:43:04.639753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 28773. [D 20:43:04.639764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 28774. [D 20:43:04.639773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28775. [D 20:43:04.639784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28776. [D 20:43:04.639794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28777. [D 20:43:04.639803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 28778. [D 20:43:04.639813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 28779. [D 20:43:04.639848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 28780. [D 20:43:04.639858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 28781. [D 20:43:04.639869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 28782. [D 20:43:04.639879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 28783. [D 20:43:04.639895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 28784. [D 20:43:04.639905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 28785. [D 20:43:04.639915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 28786. [D 20:43:04.639945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 28787. [D 20:43:04.639955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 28788. [D 20:43:04.639981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 28789. [D 20:43:04.639996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 28790. [D 20:43:04.640007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 28791. [D 20:43:04.640017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 28792. [D 20:43:04.640033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 28793. [D 20:43:04.640052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 28794. [D 20:43:04.640063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 28795. [D 20:43:04.640079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 28796. [D 20:43:04.640089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 28797. [D 20:43:04.640098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 28798. [D 20:43:04.640123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 28799. [D 20:43:04.640133] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 28800. [D 20:43:04.640192] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.640207] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.640217] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:04.642387] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.642400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.642411] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:04.645758] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 28800. [D 20:43:04.645772] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 11/70. [D 20:43:04.646302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.646314] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.646325] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.646345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.646355] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.646363] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.646395] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5212 [D 20:43:04.646408] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:04.646419] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 12/70. [D 20:43:04.650902] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5212 [D 20:43:04.650918] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 13/70. [D 20:43:04.650968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 28800. [D 20:43:04.650980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 28801. [D 20:43:04.650990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 28802. [D 20:43:04.650999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 28803. [D 20:43:04.651009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 28804. [D 20:43:04.651028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 28805. [D 20:43:04.651038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 28806. [D 20:43:04.651047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 28807. [D 20:43:04.651057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 28808. [D 20:43:04.651073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 28809. [D 20:43:04.651084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 28810. [D 20:43:04.651094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 28811. [D 20:43:04.651104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 28812. [D 20:43:04.651114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 28813. [D 20:43:04.651125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 28814. [D 20:43:04.651134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 28815. [D 20:43:04.651144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 28816. [D 20:43:04.651171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 28817. [D 20:43:04.651180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 28818. [D 20:43:04.651190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 28819. [D 20:43:04.651204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 28820. [D 20:43:04.651213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 28821. [D 20:43:04.651223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 28822. [D 20:43:04.651252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 28823. [D 20:43:04.651262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 28824. [D 20:43:04.651274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 28825. [D 20:43:04.651284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 28826. [D 20:43:04.651294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 28827. [D 20:43:04.651320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 28828. [D 20:43:04.651330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 28829. [D 20:43:04.651343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 28830. [D 20:43:04.651353] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 28831. [D 20:43:04.656841] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 28831. [D 20:43:04.656854] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 14/70. [D 20:43:04.659107] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.659120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.659131] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.689285] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.689299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.689310] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.689324] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5214 [D 20:43:04.689334] element 0: offset: 0x2aaaab22bed0, size: 24 [D 20:43:04.689345] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 15/70. [D 20:43:04.693610] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5214 [D 20:43:04.693678] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 16/70. [D 20:43:04.693731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 28831. [D 20:43:04.693747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 28832. [D 20:43:04.693758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 28833. [D 20:43:04.693768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 28834. [D 20:43:04.693779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 28835. [D 20:43:04.693788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 28836. [D 20:43:04.693798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 28837. [D 20:43:04.693846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 28838. [D 20:43:04.693858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 28839. [D 20:43:04.693868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 28840. [D 20:43:04.693878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 28841. [D 20:43:04.693892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 28842. [D 20:43:04.693913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 28843. [D 20:43:04.693924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 28844. [D 20:43:04.693934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 28845. [D 20:43:04.693944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 28846. [D 20:43:04.693967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 28847. [D 20:43:04.693978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 28848. [D 20:43:04.693988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 28849. [D 20:43:04.694002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 28850. [D 20:43:04.694012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 28851. [D 20:43:04.694021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 28852. [D 20:43:04.694045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 28853. [D 20:43:04.694055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 28854. [D 20:43:04.694065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 28855. [D 20:43:04.694076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 28856. [D 20:43:04.694085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 28857. [D 20:43:04.694112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 28858. [D 20:43:04.694123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 28859. [D 20:43:04.694133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 28860. [D 20:43:04.694156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 28861. [D 20:43:04.694171] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 28862. [D 20:43:04.699606] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 28862. [D 20:43:04.699621] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 17/70. [D 20:43:04.701895] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.701909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.701919] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.917852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.917868] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.917879] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.917910] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5219 [D 20:43:04.917921] element 0: offset: 0x2aaaab222d30, size: 24 [D 20:43:04.917931] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 18/70. [D 20:43:04.917950] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.917960] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.917969] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:04.917983] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5221 [D 20:43:04.917993] element 0: offset: 0x2aaaab2081a0, size: 24 [D 20:43:04.918003] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 19/70. [D 20:43:04.921197] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5219 [D 20:43:04.921251] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 20/70. [D 20:43:04.921276] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5221 [D 20:43:04.921288] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 21/70. [D 20:43:04.921394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 28862. [D 20:43:04.921458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 28863. [D 20:43:04.921470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 28864. [D 20:43:04.921480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 28865. [D 20:43:04.921491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 28866. [D 20:43:04.921500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 28867. [D 20:43:04.921510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 28868. [D 20:43:04.921529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 28869. [D 20:43:04.921539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 28870. [D 20:43:04.921549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 28871. [D 20:43:04.921559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 28872. [D 20:43:04.921570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 28873. [D 20:43:04.921580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 28874. [D 20:43:04.921590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 28875. [D 20:43:04.921600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 28876. [D 20:43:04.921618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 28877. [D 20:43:04.921628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 28878. [D 20:43:04.921638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 28879. [D 20:43:04.921648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 28880. [D 20:43:04.921658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 28881. [D 20:43:04.921669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 28882. [D 20:43:04.921679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 28883. [D 20:43:04.921689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 28884. [D 20:43:04.921700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 28885. [D 20:43:04.921709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 28886. [D 20:43:04.921719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 28887. [D 20:43:04.921729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 28888. [D 20:43:04.921785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 28889. [D 20:43:04.921796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 28890. [D 20:43:04.921806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 28891. [D 20:43:04.921829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 28892. [D 20:43:04.921839] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 28893. [D 20:43:04.921853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 28894. [D 20:43:04.921863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 28895. [D 20:43:04.921873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 28896. [D 20:43:04.921883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 28897. [D 20:43:04.921909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 28898. [D 20:43:04.921919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 28899. [D 20:43:04.921929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28900. [D 20:43:04.921939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28901. [D 20:43:04.921949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28902. [D 20:43:04.921973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 28903. [D 20:43:04.921983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 28904. [D 20:43:04.921998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 28905. [D 20:43:04.922008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 28906. [D 20:43:04.922018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 28907. [D 20:43:04.922040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 28908. [D 20:43:04.922050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 28909. [D 20:43:04.922060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 28910. [D 20:43:04.922070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 28911. [D 20:43:04.922080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 28912. [D 20:43:04.922095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 28913. [D 20:43:04.922119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 28914. [D 20:43:04.922130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 28915. [D 20:43:04.922140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 28916. [D 20:43:04.922150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 28917. [D 20:43:04.922162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 28918. [D 20:43:04.922187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 28919. [D 20:43:04.922197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 28920. [D 20:43:04.922207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 28921. [D 20:43:04.922217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 28922. [D 20:43:04.922227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 28923. [D 20:43:04.922238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 28924. [D 20:43:04.922249] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 28925. [D 20:43:04.932525] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 28925. [D 20:43:04.932545] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 22/70. [D 20:43:04.938452] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 28924. [D 20:43:04.938467] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 23/70. [D 20:43:04.940738] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.940752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.940762] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:04.940779] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.940790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.940798] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:04.944996] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.945010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.945021] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:04.945052] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5225 [D 20:43:04.945064] element 0: offset: 0x2aaaab202c90, size: 24 [D 20:43:04.945075] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 24/70. [D 20:43:04.945094] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.945105] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.945113] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:04.945127] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5226 [D 20:43:04.945138] element 0: offset: 0x2aaaab2088a0, size: 24 [D 20:43:04.945148] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 25/70. [D 20:43:04.950359] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5226 [D 20:43:04.950415] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 26/70. [D 20:43:04.950560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 28924. [D 20:43:04.950621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 28925. [D 20:43:04.950632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 28926. [D 20:43:04.950650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 28927. [D 20:43:04.950660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 28928. [D 20:43:04.950670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 28929. [D 20:43:04.950681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 28930. [D 20:43:04.950691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 28931. [D 20:43:04.950701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 28932. [D 20:43:04.950710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 28933. [D 20:43:04.950728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 28934. [D 20:43:04.950738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 28935. [D 20:43:04.950748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 28936. [D 20:43:04.950759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 28937. [D 20:43:04.950794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 28938. [D 20:43:04.950805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 28939. [D 20:43:04.950815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 28940. [D 20:43:04.950824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 28941. [D 20:43:04.950835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 28942. [D 20:43:04.950867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 28943. [D 20:43:04.950879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 28944. [D 20:43:04.950889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 28945. [D 20:43:04.950899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 28946. [D 20:43:04.950926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 28947. [D 20:43:04.950936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 28948. [D 20:43:04.950951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 28949. [D 20:43:04.950961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 28950. [D 20:43:04.950971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 28951. [D 20:43:04.950981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 28952. [D 20:43:04.951005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 28953. [D 20:43:04.951015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 28954. [D 20:43:04.951030] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 28955. [D 20:43:04.953326] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5225 [D 20:43:04.953346] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 27/70. [D 20:43:04.959986] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 28955. [D 20:43:04.960007] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 28/70. [D 20:43:04.962323] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.962342] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.962350] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:04.963441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 28955. [D 20:43:04.963456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 28956. [D 20:43:04.963467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 28957. [D 20:43:04.963477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 28958. [D 20:43:04.963487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 28959. [D 20:43:04.963500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 28960. [D 20:43:04.963510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 28961. [D 20:43:04.963520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 28962. [D 20:43:04.963536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 28963. [D 20:43:04.963546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 28964. [D 20:43:04.963556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 28965. [D 20:43:04.963571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 28966. [D 20:43:04.963581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 28967. [D 20:43:04.963591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 28968. [D 20:43:04.963622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 28969. [D 20:43:04.963632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 28970. [D 20:43:04.963642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 28971. [D 20:43:04.963658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 28972. [D 20:43:04.963668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 28973. [D 20:43:04.963678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 28974. [D 20:43:04.963688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 28975. [D 20:43:04.963698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 28976. [D 20:43:04.963709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 28977. [D 20:43:04.963719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 28978. [D 20:43:04.963729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 28979. [D 20:43:04.963739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 28980. [D 20:43:04.963749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 28981. [D 20:43:04.963761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 28982. [D 20:43:04.963771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 28983. [D 20:43:04.963780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 28984. [D 20:43:04.963806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 28985. [D 20:43:04.963815] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 28986. [D 20:43:04.970341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.970355] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.970366] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:04.970397] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5231 [D 20:43:04.970407] element 0: offset: 0x2aaaab22bed0, size: 24 [D 20:43:04.970420] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 29/70. [D 20:43:04.970439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.970451] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.970459] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:04.970474] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5233 [D 20:43:04.970485] element 0: offset: 0x2aaaab222d30, size: 24 [D 20:43:04.970495] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 30/70. [D 20:43:04.975080] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 28986. [D 20:43:04.975094] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 31/70. [D 20:43:04.977449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.977463] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.977471] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:04.980137] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5233 [D 20:43:04.980188] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 32/70. [D 20:43:04.980340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 28986. [D 20:43:04.980355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 28987. [D 20:43:04.980365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 28988. [D 20:43:04.980375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 28989. [D 20:43:04.980386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 28990. [D 20:43:04.980396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 28991. [D 20:43:04.980406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 28992. [D 20:43:04.980416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 28993. [D 20:43:04.980426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 28994. [D 20:43:04.980436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 28995. [D 20:43:04.980445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 28996. [D 20:43:04.980455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 28997. [D 20:43:04.980465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 28998. [D 20:43:04.980475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 28999. [D 20:43:04.980485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 29000. [D 20:43:04.980495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 29001. [D 20:43:04.980506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 29002. [D 20:43:04.980516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 29003. [D 20:43:04.980540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 29004. [D 20:43:04.980581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 29005. [D 20:43:04.980591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 29006. [D 20:43:04.980602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 29007. [D 20:43:04.980612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 29008. [D 20:43:04.980622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 29009. [D 20:43:04.980632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 29010. [D 20:43:04.980642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 29011. [D 20:43:04.980651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 29012. [D 20:43:04.980661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 29013. [D 20:43:04.980671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 29014. [D 20:43:04.980681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 29015. [D 20:43:04.980691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 29016. [D 20:43:04.980707] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 29017. [D 20:43:04.982938] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5231 [D 20:43:04.982954] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 33/70. [D 20:43:04.987047] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 29017. [D 20:43:04.987062] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 34/70. [D 20:43:04.987393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 29017. [D 20:43:04.987406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 29018. [D 20:43:04.987417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 29019. [D 20:43:04.987427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 29020. [D 20:43:04.987438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 29021. [D 20:43:04.987448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 29022. [D 20:43:04.987458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 29023. [D 20:43:04.987504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 29024. [D 20:43:04.987515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 29025. [D 20:43:04.987525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 29026. [D 20:43:04.987536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 29027. [D 20:43:04.987547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 29028. [D 20:43:04.987556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 29029. [D 20:43:04.987567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 29030. [D 20:43:04.987578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 29031. [D 20:43:04.987588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 29032. [D 20:43:04.987598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 29033. [D 20:43:04.987613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 29034. [D 20:43:04.987623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 29035. [D 20:43:04.987633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 29036. [D 20:43:04.987696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 29037. [D 20:43:04.987707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 29038. [D 20:43:04.987717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 29039. [D 20:43:04.987727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 29040. [D 20:43:04.987738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 29041. [D 20:43:04.987748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 29042. [D 20:43:04.987759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 29043. [D 20:43:04.987768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 29044. [D 20:43:04.987778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 29045. [D 20:43:04.987808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 29046. [D 20:43:04.987818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 29047. [D 20:43:04.987828] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 29048. [D 20:43:04.987488] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:04.990000] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.990011] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:04.995350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.995365] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.995380] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:04.995414] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5237 [D 20:43:04.995427] element 0: offset: 0x2aaaab2088a0, size: 24 [D 20:43:04.995441] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 35/70. [D 20:43:04.995462] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:04.995474] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:04.995485] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:04.995502] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5238 [D 20:43:04.995514] element 0: offset: 0x2aaaab222d30, size: 24 [D 20:43:04.995526] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 36/70. [D 20:43:04.999078] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 29048. [D 20:43:04.999094] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 37/70. [D 20:43:05.001493] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.001509] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.001518] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:05.004202] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5238 [D 20:43:05.004262] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 38/70. [D 20:43:05.004424] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5237 [D 20:43:05.004441] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 39/70. [D 20:43:05.005541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 29048. [D 20:43:05.005559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 29049. [D 20:43:05.005574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 29050. [D 20:43:05.005587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 29051. [D 20:43:05.005600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 29052. [D 20:43:05.005612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 29053. [D 20:43:05.005625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 29054. [D 20:43:05.005637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 29055. [D 20:43:05.005649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 29056. [D 20:43:05.005660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 29057. [D 20:43:05.005674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 29058. [D 20:43:05.005686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 29059. [D 20:43:05.005699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 29060. [D 20:43:05.005711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 29061. [D 20:43:05.005723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 29062. [D 20:43:05.005736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 29063. [D 20:43:05.005748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 29064. [D 20:43:05.005760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 29065. [D 20:43:05.005773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 29066. [D 20:43:05.005785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 29067. [D 20:43:05.005797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 29068. [D 20:43:05.005809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 29069. [D 20:43:05.005822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 29070. [D 20:43:05.005834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 29071. [D 20:43:05.005847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 29072. [D 20:43:05.005859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 29073. [D 20:43:05.005871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 29074. [D 20:43:05.005884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 29075. [D 20:43:05.005896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 29076. [D 20:43:05.005909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 29077. [D 20:43:05.005922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 29078. [D 20:43:05.005932] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 29079. [D 20:43:05.005945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 29080. [D 20:43:05.005955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 29081. [D 20:43:05.005965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 29082. [D 20:43:05.005975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 29083. [D 20:43:05.005985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 29084. [D 20:43:05.005995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 29085. [D 20:43:05.006005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 29086. [D 20:43:05.006014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 29087. [D 20:43:05.006025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 29088. [D 20:43:05.006034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 29089. [D 20:43:05.006044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 29090. [D 20:43:05.006054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 29091. [D 20:43:05.006064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 29092. [D 20:43:05.006074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 29093. [D 20:43:05.006084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 29094. [D 20:43:05.006094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 29095. [D 20:43:05.006103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 29096. [D 20:43:05.006113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 29097. [D 20:43:05.006123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 29098. [D 20:43:05.006133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 29099. [D 20:43:05.006143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 29100. [D 20:43:05.006153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 29101. [D 20:43:05.006163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 29102. [D 20:43:05.006173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 29103. [D 20:43:05.006183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 29104. [D 20:43:05.006192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 29105. [D 20:43:05.006202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 29106. [D 20:43:05.006212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 29107. [D 20:43:05.006223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 29108. [D 20:43:05.006233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 29109. [D 20:43:05.006243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 29110. [D 20:43:05.006253] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 29111. [D 20:43:05.014353] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.014370] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.014383] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:05.014418] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5243 [D 20:43:05.014429] element 0: offset: 0x2aaaab202c90, size: 24 [D 20:43:05.014440] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 40/70. [D 20:43:05.014461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.014474] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.014482] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:05.014497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5245 [D 20:43:05.014512] element 0: offset: 0x2aaaab211240, size: 24 [D 20:43:05.014522] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 41/70. [D 20:43:05.017418] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 29111. [D 20:43:05.017432] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 42/70. [D 20:43:05.028944] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 29110. [D 20:43:05.028957] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 43/70. [D 20:43:05.031302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.031316] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.031326] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:05.031409] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.031422] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.031431] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:05.034066] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5245 [D 20:43:05.034124] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 44/70. [D 20:43:05.036389] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5243 [D 20:43:05.036408] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 45/70. [D 20:43:05.039813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 29110. [D 20:43:05.039830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 29111. [D 20:43:05.039842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 29112. [D 20:43:05.039852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 29113. [D 20:43:05.039865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 29114. [D 20:43:05.039880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 29115. [D 20:43:05.039890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 29116. [D 20:43:05.039900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 29117. [D 20:43:05.039915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 29118. [D 20:43:05.039926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 29119. [D 20:43:05.039936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 29120. [D 20:43:05.039967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 29121. [D 20:43:05.039983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 29122. [D 20:43:05.039993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 29123. [D 20:43:05.040003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 29124. [D 20:43:05.040020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 29125. [D 20:43:05.040029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 29126. [D 20:43:05.040040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 29127. [D 20:43:05.040064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 29128. [D 20:43:05.040074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 29129. [D 20:43:05.040085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 29130. [D 20:43:05.040110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 29131. [D 20:43:05.040119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 29132. [D 20:43:05.040129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 29133. [D 20:43:05.040143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 29134. [D 20:43:05.040153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 29135. [D 20:43:05.040163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 29136. [D 20:43:05.040179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 29137. [D 20:43:05.040189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 29138. [D 20:43:05.040199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 29139. [D 20:43:05.040223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 29140. [D 20:43:05.040233] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 29141. [D 20:43:05.040246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 29142. [D 20:43:05.040256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 29143. [D 20:43:05.040280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 29144. [D 20:43:05.040290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 29145. [D 20:43:05.040300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 29146. [D 20:43:05.040315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 29147. [D 20:43:05.040325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 29148. [D 20:43:05.040351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 29149. [D 20:43:05.040361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 29150. [D 20:43:05.040376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 29151. [D 20:43:05.040400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 29152. [D 20:43:05.040411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 29153. [D 20:43:05.040421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 29154. [D 20:43:05.040430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 29155. [D 20:43:05.040441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 29156. [D 20:43:05.040452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 29157. [D 20:43:05.040462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 29158. [D 20:43:05.040477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 29159. [D 20:43:05.040487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 29160. [D 20:43:05.040496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 29161. [D 20:43:05.040506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 29162. [D 20:43:05.040516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 29163. [D 20:43:05.040527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 29164. [D 20:43:05.040536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 29165. [D 20:43:05.040559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 29166. [D 20:43:05.040569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 29167. [D 20:43:05.040593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 29168. [D 20:43:05.040606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 29169. [D 20:43:05.040616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 29170. [D 20:43:05.040626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 29171. [D 20:43:05.040642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 29172. [D 20:43:05.040652] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 29173. [D 20:43:05.044880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.044895] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.044906] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:05.044940] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5248 [D 20:43:05.044951] element 0: offset: 0x2aaaab2032e0, size: 24 [D 20:43:05.044964] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 46/70. [D 20:43:05.044988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.044998] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.045022] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:05.045038] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5251 [D 20:43:05.045048] element 0: offset: 0x2aaaab22bed0, size: 24 [D 20:43:05.045058] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 47/70. [D 20:43:05.049367] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 29173. [D 20:43:05.049382] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 48/70. [D 20:43:05.055200] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 29172. [D 20:43:05.055214] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 49/70. [D 20:43:05.057483] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.057496] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.057506] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:05.057587] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.057601] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.057623] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:05.060588] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5251 [D 20:43:05.060639] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 50/70. [D 20:43:05.060724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 29172. [D 20:43:05.060739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 29173. [D 20:43:05.060750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 29174. [D 20:43:05.060760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 29175. [D 20:43:05.060770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 29176. [D 20:43:05.060780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 29177. [D 20:43:05.060790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 29178. [D 20:43:05.060800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 29179. [D 20:43:05.060810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 29180. [D 20:43:05.060821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 29181. [D 20:43:05.060839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 29182. [D 20:43:05.060850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 29183. [D 20:43:05.060891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 29184. [D 20:43:05.060901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 29185. [D 20:43:05.060916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 29186. [D 20:43:05.060925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 29187. [D 20:43:05.060935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 29188. [D 20:43:05.060945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 29189. [D 20:43:05.060955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 29190. [D 20:43:05.060965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 29191. [D 20:43:05.060975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 29192. [D 20:43:05.060985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 29193. [D 20:43:05.060995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 29194. [D 20:43:05.061005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 29195. [D 20:43:05.061015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 29196. [D 20:43:05.061048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 29197. [D 20:43:05.061058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 29198. [D 20:43:05.061068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 29199. [D 20:43:05.061078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 29200. [D 20:43:05.061098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 29201. [D 20:43:05.061144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 29202. [D 20:43:05.061154] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 29203. [D 20:43:05.063364] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5248 [D 20:43:05.063381] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 51/70. [D 20:43:05.066682] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 29203. [D 20:43:05.066697] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 52/70. [D 20:43:05.066709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 29203. [D 20:43:05.066720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 29204. [D 20:43:05.066730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 29205. [D 20:43:05.066742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 29206. [D 20:43:05.066752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 29207. [D 20:43:05.066763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 29208. [D 20:43:05.066773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 29209. [D 20:43:05.066783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 29210. [D 20:43:05.066799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 29211. [D 20:43:05.066825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 29212. [D 20:43:05.066836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 29213. [D 20:43:05.066847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 29214. [D 20:43:05.066857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 29215. [D 20:43:05.066867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 29216. [D 20:43:05.066877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 29217. [D 20:43:05.066887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 29218. [D 20:43:05.066897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 29219. [D 20:43:05.066927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 29220. [D 20:43:05.066938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 29221. [D 20:43:05.066950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 29222. [D 20:43:05.066977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 29223. [D 20:43:05.066987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 29224. [D 20:43:05.066997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 29225. [D 20:43:05.067013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 29226. [D 20:43:05.067023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 29227. [D 20:43:05.067048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 29228. [D 20:43:05.067058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 29229. [D 20:43:05.067068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 29230. [D 20:43:05.067084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 29231. [D 20:43:05.067108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 29232. [D 20:43:05.067122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 29233. [D 20:43:05.067132] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 29234. [D 20:43:05.067201] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.067216] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.067240] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:05.072576] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 29234. [D 20:43:05.072590] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 53/70. [D 20:43:05.074858] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.074871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.074882] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:05.336956] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.336971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.336981] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:05.337012] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5255 [D 20:43:05.337023] element 0: offset: 0x2aaaab222d30, size: 24 [D 20:43:05.337038] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 54/70. [D 20:43:05.337057] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.337069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.337078] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:05.337092] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5257 [D 20:43:05.337102] element 0: offset: 0x2aaaab2088a0, size: 24 [D 20:43:05.337112] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 55/70. [D 20:43:05.341563] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5257 [D 20:43:05.342371] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 56/70. [D 20:43:05.342397] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5255 [D 20:43:05.342409] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 57/70. [D 20:43:05.342517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 29234. [D 20:43:05.342538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 29235. [D 20:43:05.342549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 29236. [D 20:43:05.342576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 29237. [D 20:43:05.342586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 29238. [D 20:43:05.342596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 29239. [D 20:43:05.342613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 29240. [D 20:43:05.342623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 29241. [D 20:43:05.342633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 29242. [D 20:43:05.342650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 29243. [D 20:43:05.342660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 29244. [D 20:43:05.342670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 29245. [D 20:43:05.342697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 29246. [D 20:43:05.342707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 29247. [D 20:43:05.342718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 29248. [D 20:43:05.342733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 29249. [D 20:43:05.342743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 29250. [D 20:43:05.342753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 29251. [D 20:43:05.342768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 29252. [D 20:43:05.342778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 29253. [D 20:43:05.342805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 29254. [D 20:43:05.342815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 29255. [D 20:43:05.342829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 29256. [D 20:43:05.342840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 29257. [D 20:43:05.342866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 29258. [D 20:43:05.342876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 29259. [D 20:43:05.342886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 29260. [D 20:43:05.342900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 29261. [D 20:43:05.342927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 29262. [D 20:43:05.342938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 29263. [D 20:43:05.342949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 29264. [D 20:43:05.342959] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 29265. [D 20:43:05.342973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 29266. [D 20:43:05.342983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 29267. [D 20:43:05.343003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 29268. [D 20:43:05.343013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 29269. [D 20:43:05.343023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 29270. [D 20:43:05.343033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 29271. [D 20:43:05.343043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 29272. [D 20:43:05.343075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 29273. [D 20:43:05.343086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 29274. [D 20:43:05.343101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 29275. [D 20:43:05.343111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 29276. [D 20:43:05.343121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 29277. [D 20:43:05.343136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 29278. [D 20:43:05.343146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 29279. [D 20:43:05.343156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 29280. [D 20:43:05.343185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 29281. [D 20:43:05.343196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 29282. [D 20:43:05.343207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 29283. [D 20:43:05.343217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 29284. [D 20:43:05.343233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 29285. [D 20:43:05.343243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 29286. [D 20:43:05.343253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 29287. [D 20:43:05.343269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 29288. [D 20:43:05.343279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 29289. [D 20:43:05.343289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 29290. [D 20:43:05.343314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 29291. [D 20:43:05.343336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 29292. [D 20:43:05.343347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 29293. [D 20:43:05.343357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 29294. [D 20:43:05.343370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 29295. [D 20:43:05.343380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 29296. [D 20:43:05.343390] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 29297. [D 20:43:05.349634] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 29297. [D 20:43:05.349649] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 58/70. [D 20:43:05.360403] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 29296. [D 20:43:05.360419] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 59/70. [D 20:43:05.362777] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.362792] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.362802] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:05.362835] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5261 [D 20:43:05.362846] element 0: offset: 0x2aaaab2032e0, size: 24 [D 20:43:05.362859] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 60/70. [D 20:43:05.362879] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.362890] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.362898] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:05.362913] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5262 [D 20:43:05.362923] element 0: offset: 0x2aaaab22bed0, size: 24 [D 20:43:05.362932] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 0/70. [D 20:43:05.362983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.362996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.363005] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:05.363022] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.363033] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.363042] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:05.368198] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5262 [D 20:43:05.368267] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 1/70. [D 20:43:05.370379] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5261 [D 20:43:05.370396] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 2/70. [D 20:43:05.373948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 29296. [D 20:43:05.373964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 29297. [D 20:43:05.373975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 29298. [D 20:43:05.373985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 29299. [D 20:43:05.373997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 29300. [D 20:43:05.374012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 29301. [D 20:43:05.374022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 29302. [D 20:43:05.374032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 29303. [D 20:43:05.374048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 29304. [D 20:43:05.374058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 29305. [D 20:43:05.374067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 29306. [D 20:43:05.374102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 29307. [D 20:43:05.374113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 29308. [D 20:43:05.374122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 29309. [D 20:43:05.374132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 29310. [D 20:43:05.374148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 29311. [D 20:43:05.374158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 29312. [D 20:43:05.374168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 29313. [D 20:43:05.374197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 29314. [D 20:43:05.374207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 29315. [D 20:43:05.374217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 29316. [D 20:43:05.374232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 29317. [D 20:43:05.374242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 29318. [D 20:43:05.374265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 29319. [D 20:43:05.374275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 29320. [D 20:43:05.374284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 29321. [D 20:43:05.374300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 29322. [D 20:43:05.374310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 29323. [D 20:43:05.374337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 29324. [D 20:43:05.374346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 29325. [D 20:43:05.374356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 29326. [D 20:43:05.374372] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 29327. [D 20:43:05.374385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 29328. [D 20:43:05.374395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 29329. [D 20:43:05.374405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 29330. [D 20:43:05.374431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 29331. [D 20:43:05.374441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 29332. [D 20:43:05.374454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 29333. [D 20:43:05.374469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 29334. [D 20:43:05.374478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 29335. [D 20:43:05.374488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 29336. [D 20:43:05.374503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 29337. [D 20:43:05.374514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 29338. [D 20:43:05.374523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 29339. [D 20:43:05.374539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 29340. [D 20:43:05.374549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 29341. [D 20:43:05.374576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 29342. [D 20:43:05.374586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 29343. [D 20:43:05.374596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 29344. [D 20:43:05.374611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 29345. [D 20:43:05.374621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 29346. [D 20:43:05.374645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 29347. [D 20:43:05.374655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 29348. [D 20:43:05.374665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 29349. [D 20:43:05.374692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 29350. [D 20:43:05.374702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 29351. [D 20:43:05.374715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 29352. [D 20:43:05.374725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 29353. [D 20:43:05.374735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 29354. [D 20:43:05.374748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 29355. [D 20:43:05.374758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 29356. [D 20:43:05.374782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 29357. [D 20:43:05.374792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 29358. [D 20:43:05.374802] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 29359. [D 20:43:05.379147] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.379162] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.379173] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:05.379206] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5267 [D 20:43:05.379217] element 0: offset: 0x2aaaab202c90, size: 24 [D 20:43:05.379231] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 3/70. [D 20:43:05.379250] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.379261] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.379269] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:05.379302] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5269 [D 20:43:05.379315] element 0: offset: 0x2aaaab220710, size: 24 [D 20:43:05.379324] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 4/70. [D 20:43:05.385796] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 29359. [D 20:43:05.385812] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 5/70. [D 20:43:05.391681] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 29358. [D 20:43:05.391695] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 6/70. [D 20:43:05.393985] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.393998] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.394008] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:05.394079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.394092] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.394101] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:05.396879] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5269 [D 20:43:05.396946] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 7/70. [D 20:43:05.399163] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5267 [D 20:43:05.399180] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 8/70. [D 20:43:05.402708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 29358. [D 20:43:05.402725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 29359. [D 20:43:05.402737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 29360. [D 20:43:05.402748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 29361. [D 20:43:05.402760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 29362. [D 20:43:05.402775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 29363. [D 20:43:05.402785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 29364. [D 20:43:05.402794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 29365. [D 20:43:05.402810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 29366. [D 20:43:05.402820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 29367. [D 20:43:05.402830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 29368. [D 20:43:05.402846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 29369. [D 20:43:05.402856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 29370. [D 20:43:05.402865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 29371. [D 20:43:05.402881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 29372. [D 20:43:05.402891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 29373. [D 20:43:05.402918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 29374. [D 20:43:05.402930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 29375. [D 20:43:05.402940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 29376. [D 20:43:05.402954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 29377. [D 20:43:05.402963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 29378. [D 20:43:05.402988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 29379. [D 20:43:05.402998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 29380. [D 20:43:05.403012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 29381. [D 20:43:05.403024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 29382. [D 20:43:05.403033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 29383. [D 20:43:05.403043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 29384. [D 20:43:05.403053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 29385. [D 20:43:05.403063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 29386. [D 20:43:05.403073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 29387. [D 20:43:05.403086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 29388. [D 20:43:05.403109] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 29389. [D 20:43:05.403122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 29390. [D 20:43:05.403140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 29391. [D 20:43:05.403150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 29392. [D 20:43:05.403159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 29393. [D 20:43:05.403170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 29394. [D 20:43:05.403180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 29395. [D 20:43:05.403190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 29396. [D 20:43:05.403205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 29397. [D 20:43:05.403215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 29398. [D 20:43:05.403225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 29399. [D 20:43:05.403235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 29400. [D 20:43:05.403272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 29401. [D 20:43:05.403282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 29402. [D 20:43:05.403292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 29403. [D 20:43:05.403308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 29404. [D 20:43:05.403318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 29405. [D 20:43:05.403328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 29406. [D 20:43:05.403343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 29407. [D 20:43:05.403353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 29408. [D 20:43:05.403363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 29409. [D 20:43:05.403395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 29410. [D 20:43:05.403406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 29411. [D 20:43:05.403416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 29412. [D 20:43:05.403426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 29413. [D 20:43:05.403442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 29414. [D 20:43:05.403452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 29415. [D 20:43:05.403461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 29416. [D 20:43:05.403472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 29417. [D 20:43:05.403482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 29418. [D 20:43:05.403491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 29419. [D 20:43:05.403518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 29420. [D 20:43:05.403528] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 29421. [D 20:43:05.407696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.407712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.407722] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:05.407756] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5272 [D 20:43:05.407767] element 0: offset: 0x2aaaab222d30, size: 24 [D 20:43:05.407779] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 9/70. [D 20:43:05.407803] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.407812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.407821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:05.407838] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5275 [D 20:43:05.407848] element 0: offset: 0x2aaaab2088a0, size: 24 [D 20:43:05.407861] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 10/70. [D 20:43:05.414517] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 29421. [D 20:43:05.414533] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 11/70. [D 20:43:05.420397] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 29420. [D 20:43:05.420410] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 12/70. [D 20:43:05.422674] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.422688] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.422698] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:05.422779] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.422792] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.422800] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:05.425537] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5275 [D 20:43:05.425597] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 13/70. [D 20:43:05.426306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 29420. [D 20:43:05.426325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 29421. [D 20:43:05.426336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 29422. [D 20:43:05.426346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 29423. [D 20:43:05.426356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 29424. [D 20:43:05.426371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 29425. [D 20:43:05.426392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 29426. [D 20:43:05.426401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 29427. [D 20:43:05.426411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 29428. [D 20:43:05.426421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 29429. [D 20:43:05.426431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 29430. [D 20:43:05.426441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 29431. [D 20:43:05.426451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 29432. [D 20:43:05.426468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 29433. [D 20:43:05.426482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 29434. [D 20:43:05.426492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 29435. [D 20:43:05.426502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 29436. [D 20:43:05.426512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 29437. [D 20:43:05.426533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 29438. [D 20:43:05.426542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 29439. [D 20:43:05.426552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 29440. [D 20:43:05.426567] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5272 [D 20:43:05.426586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 29441. [D 20:43:05.426622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 29442. [D 20:43:05.426642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 29443. [D 20:43:05.426652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 29444. [D 20:43:05.426662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 29445. [D 20:43:05.426678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 29446. [D 20:43:05.426688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 29447. [D 20:43:05.426698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 29448. [D 20:43:05.426727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 29449. [D 20:43:05.426737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 29450. [D 20:43:05.426749] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 29451. [D 20:43:05.426765] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 14/70. [D 20:43:05.437906] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.437921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.437933] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:05.437966] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5279 [D 20:43:05.437977] element 0: offset: 0x2aaaab2032e0, size: 24 [D 20:43:05.437988] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 15/70. [D 20:43:05.438008] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.438018] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.438026] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:05.438041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5281 [D 20:43:05.438056] element 0: offset: 0x2aaaab220710, size: 24 [D 20:43:05.438065] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 16/70. [D 20:43:05.438095] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 29451. [D 20:43:05.438106] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 17/70. [D 20:43:05.438182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 29451. [D 20:43:05.438197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 29452. [D 20:43:05.438207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 29453. [D 20:43:05.438229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 29454. [D 20:43:05.438239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 29455. [D 20:43:05.438249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 29456. [D 20:43:05.438259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 29457. [D 20:43:05.438269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 29458. [D 20:43:05.438279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 29459. [D 20:43:05.438290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 29460. [D 20:43:05.438300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 29461. [D 20:43:05.438310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 29462. [D 20:43:05.438321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 29463. [D 20:43:05.438331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 29464. [D 20:43:05.438341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 29465. [D 20:43:05.438351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 29466. [D 20:43:05.438361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 29467. [D 20:43:05.440567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 29468. [D 20:43:05.440568] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5279 [D 20:43:05.440610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 29469. [D 20:43:05.440669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 29470. [D 20:43:05.440684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 29471. [D 20:43:05.440694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 29472. [D 20:43:05.440705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 29473. [D 20:43:05.440717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 29474. [D 20:43:05.440727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 29475. [D 20:43:05.440742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 29476. [D 20:43:05.440753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 29477. [D 20:43:05.440763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 29478. [D 20:43:05.440773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 29479. [D 20:43:05.440784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 29480. [D 20:43:05.440794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 29481. [D 20:43:05.440803] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 29482. [D 20:43:05.440845] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 18/70. [D 20:43:05.440881] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.440904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.440914] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:05.444860] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5281 [D 20:43:05.444911] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 19/70. [D 20:43:05.449836] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 29482. [D 20:43:05.449856] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 20/70. [D 20:43:05.449870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 29482. [D 20:43:05.449880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 29483. [D 20:43:05.449891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 29484. [D 20:43:05.449901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 29485. [D 20:43:05.449911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 29486. [D 20:43:05.449921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 29487. [D 20:43:05.449931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 29488. [D 20:43:05.449941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 29489. [D 20:43:05.449951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 29490. [D 20:43:05.449968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 29491. [D 20:43:05.449977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 29492. [D 20:43:05.449987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 29493. [D 20:43:05.449998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 29494. [D 20:43:05.450008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 29495. [D 20:43:05.450018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 29496. [D 20:43:05.450028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 29497. [D 20:43:05.450044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 29498. [D 20:43:05.450054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 29499. [D 20:43:05.450064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 29500. [D 20:43:05.450096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 29501. [D 20:43:05.450107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 29502. [D 20:43:05.450122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 29503. [D 20:43:05.450132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 29504. [D 20:43:05.450142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 29505. [D 20:43:05.450155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 29506. [D 20:43:05.450171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 29507. [D 20:43:05.450181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 29508. [D 20:43:05.450201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 29509. [D 20:43:05.450211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 29510. [D 20:43:05.450221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 29511. [D 20:43:05.450231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 29512. [D 20:43:05.450241] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 29513. [D 20:43:05.450259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 29514. [D 20:43:05.450269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 29515. [D 20:43:05.450279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 29516. [D 20:43:05.450295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 29517. [D 20:43:05.450305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 29518. [D 20:43:05.450314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 29519. [D 20:43:05.450330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 29520. [D 20:43:05.450339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 29521. [D 20:43:05.450349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 29522. [D 20:43:05.450387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 29523. [D 20:43:05.450397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 29524. [D 20:43:05.450408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 29525. [D 20:43:05.450418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 29526. [D 20:43:05.450428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 29527. [D 20:43:05.450438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 29528. [D 20:43:05.450449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 29529. [D 20:43:05.450459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 29530. [D 20:43:05.450468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 29531. [D 20:43:05.450486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 29532. [D 20:43:05.450495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 29533. [D 20:43:05.450505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 29534. [D 20:43:05.450533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 29535. [D 20:43:05.450543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 29536. [D 20:43:05.450557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 29537. [D 20:43:05.450568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 29538. [D 20:43:05.450578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 29539. [D 20:43:05.450588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 29540. [D 20:43:05.450598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 29541. [D 20:43:05.450608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 29542. [D 20:43:05.450617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 29543. [D 20:43:05.450648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 29544. [D 20:43:05.450658] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 29545. [D 20:43:05.450691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.450702] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.450711] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:05.455833] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 29545. [D 20:43:05.455847] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 21/70. [D 20:43:05.462354] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 29544. [D 20:43:05.462370] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 22/70. [D 20:43:05.465868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.465882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.465892] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:05.465905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.465915] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.465924] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:05.465942] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.465951] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.465960] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:05.465989] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5285 [D 20:43:05.466003] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:05.466014] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 23/70. [D 20:43:05.466031] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.466040] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.466049] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:05.466081] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5286 [D 20:43:05.466093] element 0: offset: 0x2aaaab202c90, size: 24 [D 20:43:05.466105] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 24/70. [D 20:43:05.471165] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5286 [D 20:43:05.471223] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 25/70. [D 20:43:05.471362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 29544. [D 20:43:05.471427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 29545. [D 20:43:05.471438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 29546. [D 20:43:05.471448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 29547. [D 20:43:05.471458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 29548. [D 20:43:05.471468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 29549. [D 20:43:05.471478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 29550. [D 20:43:05.471493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 29551. [D 20:43:05.471503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 29552. [D 20:43:05.471512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 29553. [D 20:43:05.471529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 29554. [D 20:43:05.471539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 29555. [D 20:43:05.471549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 29556. [D 20:43:05.471559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 29557. [D 20:43:05.471569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 29558. [D 20:43:05.471579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 29559. [D 20:43:05.471589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 29560. [D 20:43:05.471599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 29561. [D 20:43:05.471609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 29562. [D 20:43:05.471619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 29563. [D 20:43:05.471629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 29564. [D 20:43:05.471639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 29565. [D 20:43:05.471649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 29566. [D 20:43:05.471658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 29567. [D 20:43:05.471668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 29568. [D 20:43:05.471679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 29569. [D 20:43:05.471729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 29570. [D 20:43:05.471741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 29571. [D 20:43:05.471750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 29572. [D 20:43:05.471760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 29573. [D 20:43:05.471774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 29574. [D 20:43:05.471784] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 29575. [D 20:43:05.471862] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5285 [D 20:43:05.471882] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 26/70. [D 20:43:05.479349] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 29575. [D 20:43:05.479369] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 27/70. [D 20:43:05.479381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 29575. [D 20:43:05.479392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 29576. [D 20:43:05.479402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 29577. [D 20:43:05.479412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 29578. [D 20:43:05.479422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 29579. [D 20:43:05.479432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 29580. [D 20:43:05.479442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 29581. [D 20:43:05.479452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 29582. [D 20:43:05.479462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 29583. [D 20:43:05.479480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 29584. [D 20:43:05.479490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 29585. [D 20:43:05.479499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 29586. [D 20:43:05.479525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 29587. [D 20:43:05.479536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 29588. [D 20:43:05.479546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 29589. [D 20:43:05.479556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 29590. [D 20:43:05.479566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 29591. [D 20:43:05.479577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 29592. [D 20:43:05.479601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 29593. [D 20:43:05.479613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 29594. [D 20:43:05.479623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 29595. [D 20:43:05.479633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 29596. [D 20:43:05.479643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 29597. [D 20:43:05.479653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 29598. [D 20:43:05.479663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 29599. [D 20:43:05.479673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 29600. [D 20:43:05.479696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 29601. [D 20:43:05.479707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 29602. [D 20:43:05.479716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 29603. [D 20:43:05.479727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 29604. [D 20:43:05.479750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 29605. [D 20:43:05.479761] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 29606. [D 20:43:05.482092] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.482107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.482118] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:05.485250] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 29606. [D 20:43:05.485264] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 28/70. [D 20:43:05.486391] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.486405] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.486415] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:05.797469] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.797485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.797496] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:05.797528] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5290 [D 20:43:05.797539] element 0: offset: 0x2aaaab22bed0, size: 24 [D 20:43:05.797550] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 29/70. [D 20:43:05.799722] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5290 [D 20:43:05.799742] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 30/70. [D 20:43:05.803512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 29606. [D 20:43:05.803574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 29607. [D 20:43:05.803586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 29608. [D 20:43:05.803596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 29609. [D 20:43:05.803607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 29610. [D 20:43:05.803617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 29611. [D 20:43:05.803627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 29612. [D 20:43:05.803637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 29613. [D 20:43:05.803647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 29614. [D 20:43:05.803657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 29615. [D 20:43:05.803667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 29616. [D 20:43:05.803684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 29617. [D 20:43:05.803693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 29618. [D 20:43:05.803703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 29619. [D 20:43:05.803713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 29620. [D 20:43:05.803739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 29621. [D 20:43:05.803748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 29622. [D 20:43:05.803758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 29623. [D 20:43:05.803768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 29624. [D 20:43:05.803778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 29625. [D 20:43:05.803788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 29626. [D 20:43:05.803816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 29627. [D 20:43:05.803826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 29628. [D 20:43:05.803836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 29629. [D 20:43:05.803850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 29630. [D 20:43:05.803860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 29631. [D 20:43:05.803870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 29632. [D 20:43:05.803885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 29633. [D 20:43:05.803895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 29634. [D 20:43:05.803921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 29635. [D 20:43:05.803931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 29636. [D 20:43:05.803941] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 29637. [D 20:43:05.809547] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 29637. [D 20:43:05.809563] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 31/70. [D 20:43:05.811917] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.811932] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.811942] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:05.814182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.814196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.814205] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:05.814236] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5292 [D 20:43:05.814247] element 0: offset: 0x2aaaab220710, size: 24 [D 20:43:05.814258] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 32/70. [D 20:43:05.816612] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5292 [D 20:43:05.816666] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 33/70. [D 20:43:05.833918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 29637. [D 20:43:05.833936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 29638. [D 20:43:05.833949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 29639. [D 20:43:05.833959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 29640. [D 20:43:05.833969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 29641. [D 20:43:05.833986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 29642. [D 20:43:05.833996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 29643. [D 20:43:05.834006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 29644. [D 20:43:05.834022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 29645. [D 20:43:05.834032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 29646. [D 20:43:05.834042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 29647. [D 20:43:05.834058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 29648. [D 20:43:05.834067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 29649. [D 20:43:05.834077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 29650. [D 20:43:05.834110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 29651. [D 20:43:05.834121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 29652. [D 20:43:05.834131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 29653. [D 20:43:05.834141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 29654. [D 20:43:05.834152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 29655. [D 20:43:05.834174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 29656. [D 20:43:05.834185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 29657. [D 20:43:05.834195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 29658. [D 20:43:05.834205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 29659. [D 20:43:05.834215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 29660. [D 20:43:05.834238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 29661. [D 20:43:05.834247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 29662. [D 20:43:05.834262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 29663. [D 20:43:05.834273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 29664. [D 20:43:05.834283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 29665. [D 20:43:05.834307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 29666. [D 20:43:05.834317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 29667. [D 20:43:05.834330] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 29668. [D 20:43:05.845548] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 29668. [D 20:43:05.845562] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 34/70. [D 20:43:05.846433] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.846446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.846456] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:05.916645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.916659] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.916670] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:05.916685] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5296 [D 20:43:05.916695] element 0: offset: 0x2aaaab2032e0, size: 24 [D 20:43:05.916706] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 35/70. [D 20:43:05.918761] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5296 [D 20:43:05.918781] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 36/70. [D 20:43:05.918833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 29668. [D 20:43:05.918897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 29669. [D 20:43:05.918909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 29670. [D 20:43:05.918925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 29671. [D 20:43:05.918937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 29672. [D 20:43:05.918946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 29673. [D 20:43:05.918962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 29674. [D 20:43:05.918973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 29675. [D 20:43:05.918982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 29676. [D 20:43:05.918998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 29677. [D 20:43:05.919008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 29678. [D 20:43:05.919018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 29679. [D 20:43:05.919059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 29680. [D 20:43:05.919070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 29681. [D 20:43:05.919079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 29682. [D 20:43:05.919089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 29683. [D 20:43:05.919100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 29684. [D 20:43:05.919109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 29685. [D 20:43:05.919120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 29686. [D 20:43:05.919130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 29687. [D 20:43:05.919154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 29688. [D 20:43:05.919171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 29689. [D 20:43:05.919181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 29690. [D 20:43:05.919190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 29691. [D 20:43:05.919201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 29692. [D 20:43:05.919211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 29693. [D 20:43:05.919221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 29694. [D 20:43:05.919230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 29695. [D 20:43:05.919264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 29696. [D 20:43:05.919277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 29697. [D 20:43:05.919290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 29698. [D 20:43:05.919300] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 29699. [D 20:43:05.928153] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 29699. [D 20:43:05.928169] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 37/70. [D 20:43:05.930511] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.930526] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.930537] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:05.941983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.941997] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.942007] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:05.942039] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5300 [D 20:43:05.942050] element 0: offset: 0x2aaaab22bed0, size: 24 [D 20:43:05.942061] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 38/70. [D 20:43:05.942080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.942096] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.942104] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:05.944389] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5302 [D 20:43:05.944400] element 0: offset: 0x2aaaab220710, size: 24 [D 20:43:05.944409] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 39/70. [D 20:43:05.946809] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5300 [D 20:43:05.946867] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 40/70. [D 20:43:05.948842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 29699. [D 20:43:05.948907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 29700. [D 20:43:05.948919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 29701. [D 20:43:05.948929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 29702. [D 20:43:05.948940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 29703. [D 20:43:05.948950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 29704. [D 20:43:05.948959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 29705. [D 20:43:05.948970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 29706. [D 20:43:05.948987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 29707. [D 20:43:05.948997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 29708. [D 20:43:05.949006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 29709. [D 20:43:05.949055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 29710. [D 20:43:05.949066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 29711. [D 20:43:05.949076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 29712. [D 20:43:05.949100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 29713. [D 20:43:05.949110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 29714. [D 20:43:05.949120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 29715. [D 20:43:05.949131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 29716. [D 20:43:05.949141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 29717. [D 20:43:05.949151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 29718. [D 20:43:05.949177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 29719. [D 20:43:05.949188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 29720. [D 20:43:05.949199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 29721. [D 20:43:05.949208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 29722. [D 20:43:05.949219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 29723. [D 20:43:05.949229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 29724. [D 20:43:05.949252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 29725. [D 20:43:05.949266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 29726. [D 20:43:05.949276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 29727. [D 20:43:05.949286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 29728. [D 20:43:05.949308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 29729. [D 20:43:05.949318] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 29730. [D 20:43:05.951643] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5302 [D 20:43:05.951664] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 41/70. [D 20:43:05.960525] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 29730. [D 20:43:05.960544] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 42/70. [D 20:43:05.960566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 29730. [D 20:43:05.960578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 29731. [D 20:43:05.960588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 29732. [D 20:43:05.960598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 29733. [D 20:43:05.960609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 29734. [D 20:43:05.960618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 29735. [D 20:43:05.960628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 29736. [D 20:43:05.960638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 29737. [D 20:43:05.960655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 29738. [D 20:43:05.960664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 29739. [D 20:43:05.960674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 29740. [D 20:43:05.960685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 29741. [D 20:43:05.960711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 29742. [D 20:43:05.960721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 29743. [D 20:43:05.960731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 29744. [D 20:43:05.960741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 29745. [D 20:43:05.960751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 29746. [D 20:43:05.960775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 29747. [D 20:43:05.960786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 29748. [D 20:43:05.960797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 29749. [D 20:43:05.960807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 29750. [D 20:43:05.960817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 29751. [D 20:43:05.960844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 29752. [D 20:43:05.960855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 29753. [D 20:43:05.960865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 29754. [D 20:43:05.960875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 29755. [D 20:43:05.960886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 29756. [D 20:43:05.960909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 29757. [D 20:43:05.960925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 29758. [D 20:43:05.960935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 29759. [D 20:43:05.960945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 29760. [D 20:43:05.960955] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 29761. [D 20:43:05.961024] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.961053] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.961062] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:05.968779] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 29761. [D 20:43:05.968793] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 43/70. [D 20:43:05.971059] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.971073] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.971083] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:05.977301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.977314] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.977325] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:05.977355] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5306 [D 20:43:05.977366] element 0: offset: 0x2aaaab2032e0, size: 24 [D 20:43:05.977377] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 44/70. [D 20:43:05.977395] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.977411] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.977419] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:05.977433] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5308 [D 20:43:05.977444] element 0: offset: 0x2aaaab220710, size: 24 [D 20:43:05.977453] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 45/70. [D 20:43:05.980030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:05.980045] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.980054] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:05.980069] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5311 [D 20:43:05.980079] element 0: offset: 0x2aaaab22bed0, size: 24 [D 20:43:05.980089] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 46/70. [D 20:43:05.982334] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5306 [D 20:43:05.982392] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 47/70. [D 20:43:05.982536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 29761. [D 20:43:05.982579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 29762. [D 20:43:05.982590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 29763. [D 20:43:05.982601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 29764. [D 20:43:05.982610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 29765. [D 20:43:05.982620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 29766. [D 20:43:05.982630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 29767. [D 20:43:05.982640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 29768. [D 20:43:05.982650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 29769. [D 20:43:05.982671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 29770. [D 20:43:05.982681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 29771. [D 20:43:05.982691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 29772. [D 20:43:05.982701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 29773. [D 20:43:05.982710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 29774. [D 20:43:05.982720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 29775. [D 20:43:05.982730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 29776. [D 20:43:05.982740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 29777. [D 20:43:05.982750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 29778. [D 20:43:05.982760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 29779. [D 20:43:05.982770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 29780. [D 20:43:05.982780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 29781. [D 20:43:05.982790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 29782. [D 20:43:05.982800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 29783. [D 20:43:05.982809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 29784. [D 20:43:05.982819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 29785. [D 20:43:05.982829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 29786. [D 20:43:05.982839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 29787. [D 20:43:05.982849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 29788. [D 20:43:05.982859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 29789. [D 20:43:05.982869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 29790. [D 20:43:05.982879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 29791. [D 20:43:05.982889] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 29792. [D 20:43:05.984817] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5311 [D 20:43:05.984869] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 48/70. [D 20:43:05.984893] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5308 [D 20:43:05.984904] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 49/70. [D 20:43:05.994184] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 29792. [D 20:43:05.994204] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 50/70. [D 20:43:05.994229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 29792. [D 20:43:05.994241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 29793. [D 20:43:05.994251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 29794. [D 20:43:05.994260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 29795. [D 20:43:05.994275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 29796. [D 20:43:05.994285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 29797. [D 20:43:05.994295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 29798. [D 20:43:05.994310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 29799. [D 20:43:05.994320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 29800. [D 20:43:05.994330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 29801. [D 20:43:05.994340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 29802. [D 20:43:05.994350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 29803. [D 20:43:05.994360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 29804. [D 20:43:05.994369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 29805. [D 20:43:05.994387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 29806. [D 20:43:05.994397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 29807. [D 20:43:05.994407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 29808. [D 20:43:05.994417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 29809. [D 20:43:05.994428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 29810. [D 20:43:05.994437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 29811. [D 20:43:05.994471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 29812. [D 20:43:05.994482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 29813. [D 20:43:05.994492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 29814. [D 20:43:05.994507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 29815. [D 20:43:05.994518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 29816. [D 20:43:05.994528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 29817. [D 20:43:05.994538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 29818. [D 20:43:05.994548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 29819. [D 20:43:05.994557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 29820. [D 20:43:05.994567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 29821. [D 20:43:05.994604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 29822. [D 20:43:05.994615] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 29823. [D 20:43:05.994626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 29824. [D 20:43:05.994636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 29825. [D 20:43:05.994650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 29826. [D 20:43:05.994660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 29827. [D 20:43:05.994670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 29828. [D 20:43:05.994685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 29829. [D 20:43:05.994694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 29830. [D 20:43:05.994704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 29831. [D 20:43:05.994733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 29832. [D 20:43:05.994742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 29833. [D 20:43:05.994757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 29834. [D 20:43:05.994766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 29835. [D 20:43:05.994777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 29836. [D 20:43:05.994791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 29837. [D 20:43:05.994801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 29838. [D 20:43:05.994811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 29839. [D 20:43:05.994826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 29840. [D 20:43:05.994836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 29841. [D 20:43:05.994846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 29842. [D 20:43:05.994877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 29843. [D 20:43:05.994887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 29844. [D 20:43:05.994897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 29845. [D 20:43:05.994907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 29846. [D 20:43:05.994923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 29847. [D 20:43:05.994933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 29848. [D 20:43:05.994942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 29849. [D 20:43:05.994958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 29850. [D 20:43:05.994968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 29851. [D 20:43:05.994978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 29852. [D 20:43:05.995007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 29853. [D 20:43:05.995017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 29854. [D 20:43:05.995029] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 29855. [D 20:43:05.995073] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:05.995087] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:05.995097] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:06.005993] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 29855. [D 20:43:06.006008] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 51/70. [D 20:43:06.008261] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.008275] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.008285] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:06.008311] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5313 [D 20:43:06.008322] element 0: offset: 0x2aaaab203460, size: 24 [D 20:43:06.008333] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 52/70. [D 20:43:06.016647] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 29854. [D 20:43:06.016661] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 53/70. [D 20:43:06.018941] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.018955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.018965] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:06.019003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.019014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.019023] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:06.021007] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5313 [D 20:43:06.021028] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 54/70. [D 20:43:06.021141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 29854. [D 20:43:06.021196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 29855. [D 20:43:06.021208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 29856. [D 20:43:06.021219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 29857. [D 20:43:06.021233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 29858. [D 20:43:06.021243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 29859. [D 20:43:06.021253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 29860. [D 20:43:06.021266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 29861. [D 20:43:06.021277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 29862. [D 20:43:06.021286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 29863. [D 20:43:06.021302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 29864. [D 20:43:06.021311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 29865. [D 20:43:06.021351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 29866. [D 20:43:06.021364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 29867. [D 20:43:06.021375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 29868. [D 20:43:06.021398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 29869. [D 20:43:06.021408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 29870. [D 20:43:06.021418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 29871. [D 20:43:06.021428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 29872. [D 20:43:06.021439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 29873. [D 20:43:06.021458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 29874. [D 20:43:06.021475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 29875. [D 20:43:06.021485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 29876. [D 20:43:06.021494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 29877. [D 20:43:06.021517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 29878. [D 20:43:06.021528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 29879. [D 20:43:06.021538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 29880. [D 20:43:06.021548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 29881. [D 20:43:06.021563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 29882. [D 20:43:06.021572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 29883. [D 20:43:06.021582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 29884. [D 20:43:06.021607] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 29885. [D 20:43:06.032812] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 29885. [D 20:43:06.032828] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 55/70. [D 20:43:06.035120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.035135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.035146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:06.040335] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.040349] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.040360] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:06.040390] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5319 [D 20:43:06.040401] element 0: offset: 0x2aaaab23f8c0, size: 24 [D 20:43:06.040413] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 56/70. [D 20:43:06.040432] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.040448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.040456] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:06.040471] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5321 [D 20:43:06.040480] element 0: offset: 0x2aaaab220710, size: 24 [D 20:43:06.040489] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 57/70. [D 20:43:06.040508] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.040535] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.040544] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:06.040559] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5323 [D 20:43:06.040568] element 0: offset: 0x2aaaab222b60, size: 24 [D 20:43:06.040578] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 58/70. [D 20:43:06.043078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.043092] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.043101] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:06.043115] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5325 [D 20:43:06.043125] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:06.043135] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 59/70. [D 20:43:06.048087] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5321 [D 20:43:06.048183] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 60/70. [D 20:43:06.048203] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5323 [D 20:43:06.048214] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 0/70. [D 20:43:06.048323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 29885. [D 20:43:06.048337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 29886. [D 20:43:06.048347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 29887. [D 20:43:06.048357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 29888. [D 20:43:06.048367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 29889. [D 20:43:06.048377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 29890. [D 20:43:06.048387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 29891. [D 20:43:06.048396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 29892. [D 20:43:06.048406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 29893. [D 20:43:06.048416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 29894. [D 20:43:06.048426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 29895. [D 20:43:06.048436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 29896. [D 20:43:06.048445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 29897. [D 20:43:06.048455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 29898. [D 20:43:06.048465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 29899. [D 20:43:06.048475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 29900. [D 20:43:06.048485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 29901. [D 20:43:06.048495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 29902. [D 20:43:06.048505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 29903. [D 20:43:06.048514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 29904. [D 20:43:06.048524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 29905. [D 20:43:06.048534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 29906. [D 20:43:06.048544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 29907. [D 20:43:06.048554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 29908. [D 20:43:06.048564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 29909. [D 20:43:06.048573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 29910. [D 20:43:06.048583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 29911. [D 20:43:06.048594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 29912. [D 20:43:06.048604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 29913. [D 20:43:06.048614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 29914. [D 20:43:06.048623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 29915. [D 20:43:06.048633] openib_post_sr_rdmaw: ibv_post_send wr_id 662500 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 29916. [D 20:43:06.048646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 29917. [D 20:43:06.048656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 29918. [D 20:43:06.048666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 29919. [D 20:43:06.048676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 29920. [D 20:43:06.048685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 29921. [D 20:43:06.048695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 29922. [D 20:43:06.048705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 29923. [D 20:43:06.048715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 29924. [D 20:43:06.048725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 29925. [D 20:43:06.048734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 29926. [D 20:43:06.048744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 29927. [D 20:43:06.048754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 29928. [D 20:43:06.048764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 29929. [D 20:43:06.048773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 29930. [D 20:43:06.048783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 29931. [D 20:43:06.048793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 29932. [D 20:43:06.048803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 29933. [D 20:43:06.048813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 29934. [D 20:43:06.048822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 29935. [D 20:43:06.048832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 29936. [D 20:43:06.048842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 29937. [D 20:43:06.048852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 29938. [D 20:43:06.048861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 29939. [D 20:43:06.048871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 29940. [D 20:43:06.048881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 29941. [D 20:43:06.048891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 29942. [D 20:43:06.048901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 29943. [D 20:43:06.048911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 29944. [D 20:43:06.048920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 29945. [D 20:43:06.048930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 29946. [D 20:43:06.048940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 29947. [D 20:43:06.048950] openib_post_sr_rdmaw: ibv_post_send wr_id 61fa10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 29948. [D 20:43:06.050465] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5319 [D 20:43:06.050479] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 1/70. [D 20:43:06.051387] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5325 [D 20:43:06.051402] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 2/70. [D 20:43:06.059970] openib_check_cq: completed rdma wr_id 662500, nic_wr_credit 29948. [D 20:43:06.059986] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 3/70. [D 20:43:06.069119] openib_check_cq: completed rdma wr_id 61fa10, nic_wr_credit 29947. [D 20:43:06.069133] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 4/70. [D 20:43:06.069146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 29947. [D 20:43:06.069156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 29948. [D 20:43:06.069167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 29949. [D 20:43:06.069177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 29950. [D 20:43:06.069187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 29951. [D 20:43:06.069197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 29952. [D 20:43:06.069208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 29953. [D 20:43:06.069217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 29954. [D 20:43:06.069227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 29955. [D 20:43:06.069245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 29956. [D 20:43:06.069254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 29957. [D 20:43:06.069264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 29958. [D 20:43:06.069274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 29959. [D 20:43:06.069284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 29960. [D 20:43:06.069293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 29961. [D 20:43:06.069304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 29962. [D 20:43:06.069316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 29963. [D 20:43:06.069326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 29964. [D 20:43:06.069335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 29965. [D 20:43:06.069360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 29966. [D 20:43:06.069370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 29967. [D 20:43:06.069380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 29968. [D 20:43:06.069396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 29969. [D 20:43:06.069406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 29970. [D 20:43:06.069416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 29971. [D 20:43:06.069426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 29972. [D 20:43:06.069454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 29973. [D 20:43:06.069464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 29974. [D 20:43:06.069479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 29975. [D 20:43:06.069488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 29976. [D 20:43:06.069498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 29977. [D 20:43:06.069513] openib_post_sr_rdmaw: ibv_post_send wr_id 64dc20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 29978. [D 20:43:06.069524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 29979. [D 20:43:06.069547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 29980. [D 20:43:06.069558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 29981. [D 20:43:06.069568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 29982. [D 20:43:06.069581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 29983. [D 20:43:06.069591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 29984. [D 20:43:06.069600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 29985. [D 20:43:06.069610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 29986. [D 20:43:06.069627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 29987. [D 20:43:06.069637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 29988. [D 20:43:06.069647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 29989. [D 20:43:06.069657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 29990. [D 20:43:06.069673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 29991. [D 20:43:06.069683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 29992. [D 20:43:06.069693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 29993. [D 20:43:06.069710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 29994. [D 20:43:06.069720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 29995. [D 20:43:06.069729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 29996. [D 20:43:06.069744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 29997. [D 20:43:06.069754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 29998. [D 20:43:06.069764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 29999. [D 20:43:06.069788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 30000. [D 20:43:06.069800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 30001. [D 20:43:06.069809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 30002. [D 20:43:06.069820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 30003. [D 20:43:06.069829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 30004. [D 20:43:06.069840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 30005. [D 20:43:06.069850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 30006. [D 20:43:06.069860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 30007. [D 20:43:06.069870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 30008. [D 20:43:06.069898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 30009. [D 20:43:06.069908] openib_post_sr_rdmaw: ibv_post_send wr_id 661d80 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 30010. [D 20:43:06.069961] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.069975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.069985] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:06.072245] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.072258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.072269] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:06.075034] openib_check_cq: completed rdma wr_id 64dc20, nic_wr_credit 30010. [D 20:43:06.075048] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 5/70. [D 20:43:06.079679] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.079693] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.079703] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:06.079734] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5329 [D 20:43:06.079744] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:06.079755] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 6/70. [D 20:43:06.080916] openib_check_cq: completed rdma wr_id 661d80, nic_wr_credit 30009. [D 20:43:06.080929] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 7/70. [D 20:43:06.083229] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.083242] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.083253] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:06.083305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.083318] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.083327] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:06.085696] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5329 [D 20:43:06.085760] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 8/70. [D 20:43:06.085817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 30009. [D 20:43:06.085833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 30010. [D 20:43:06.085844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 30011. [D 20:43:06.085854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 30012. [D 20:43:06.085890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 30013. [D 20:43:06.085904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 30014. [D 20:43:06.085914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 30015. [D 20:43:06.085924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 30016. [D 20:43:06.085934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 30017. [D 20:43:06.085943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 30018. [D 20:43:06.085969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 30019. [D 20:43:06.085979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 30020. [D 20:43:06.085988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 30021. [D 20:43:06.086004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 30022. [D 20:43:06.086033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 30023. [D 20:43:06.086046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 30024. [D 20:43:06.086056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 30025. [D 20:43:06.086066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 30026. [D 20:43:06.086079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 30027. [D 20:43:06.086089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 30028. [D 20:43:06.086099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 30029. [D 20:43:06.086124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 30030. [D 20:43:06.086134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 30031. [D 20:43:06.086161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 30032. [D 20:43:06.086173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 30033. [D 20:43:06.086187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 30034. [D 20:43:06.086196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 30035. [D 20:43:06.086206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 30036. [D 20:43:06.086220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 30037. [D 20:43:06.086243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 30038. [D 20:43:06.086257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 30039. [D 20:43:06.086267] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 30040. [D 20:43:06.091772] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 30040. [D 20:43:06.091786] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 9/70. [D 20:43:06.093941] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.093955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.093965] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:06.252848] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.252863] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.252874] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:06.252904] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5334 [D 20:43:06.252915] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:06.252926] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 10/70. [D 20:43:06.252945] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.252958] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.252967] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:06.252981] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5336 [D 20:43:06.252991] element 0: offset: 0x2aaaab220710, size: 24 [D 20:43:06.253001] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 11/70. [D 20:43:06.253017] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.253049] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.253059] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:06.253085] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5337 [D 20:43:06.253094] element 0: offset: 0x2aaaab2340f0, size: 24 [D 20:43:06.253104] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 12/70. [D 20:43:06.257968] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5336 [D 20:43:06.258041] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 13/70. [D 20:43:06.258102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 30040. [D 20:43:06.258116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30041. [D 20:43:06.258127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30042. [D 20:43:06.258137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30043. [D 20:43:06.258147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30044. [D 20:43:06.258157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30045. [D 20:43:06.258167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30046. [D 20:43:06.258176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30047. [D 20:43:06.258186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30048. [D 20:43:06.258196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30049. [D 20:43:06.258206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30050. [D 20:43:06.258215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30051. [D 20:43:06.258225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30052. [D 20:43:06.258235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30053. [D 20:43:06.258245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30054. [D 20:43:06.258255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30055. [D 20:43:06.258265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30056. [D 20:43:06.258274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30057. [D 20:43:06.258284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30058. [D 20:43:06.258294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30059. [D 20:43:06.258304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30060. [D 20:43:06.258313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30061. [D 20:43:06.258323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30062. [D 20:43:06.258333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30063. [D 20:43:06.258343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30064. [D 20:43:06.258353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30065. [D 20:43:06.258362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30066. [D 20:43:06.258372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30067. [D 20:43:06.258382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30068. [D 20:43:06.258393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30069. [D 20:43:06.258403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30070. [D 20:43:06.258413] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30071. [D 20:43:06.262336] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5334 [D 20:43:06.262352] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 14/70. [D 20:43:06.262385] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.262398] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.262407] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:06.262440] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5341 [D 20:43:06.262452] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:06.262462] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 15/70. [D 20:43:06.262504] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5337 [D 20:43:06.262516] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 16/70. [D 20:43:06.263994] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 30071. [D 20:43:06.264011] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 17/70. [D 20:43:06.264023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 30071. [D 20:43:06.264033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 30072. [D 20:43:06.264044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 30073. [D 20:43:06.264054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 30074. [D 20:43:06.264064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 30075. [D 20:43:06.264080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 30076. [D 20:43:06.264089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 30077. [D 20:43:06.264099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 30078. [D 20:43:06.264109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 30079. [D 20:43:06.264126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 30080. [D 20:43:06.264136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 30081. [D 20:43:06.264146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 30082. [D 20:43:06.264155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 30083. [D 20:43:06.264165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 30084. [D 20:43:06.264175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 30085. [D 20:43:06.264185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 30086. [D 20:43:06.264194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 30087. [D 20:43:06.264204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 30088. [D 20:43:06.264214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 30089. [D 20:43:06.264224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 30090. [D 20:43:06.264234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 30091. [D 20:43:06.264251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 30092. [D 20:43:06.264261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 30093. [D 20:43:06.264270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 30094. [D 20:43:06.264299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 30095. [D 20:43:06.264310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 30096. [D 20:43:06.264324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 30097. [D 20:43:06.264334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 30098. [D 20:43:06.264343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 30099. [D 20:43:06.264372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 30100. [D 20:43:06.264387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 30101. [D 20:43:06.264397] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 30102. [D 20:43:06.264408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 30103. [D 20:43:06.264438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 30104. [D 20:43:06.264448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 30105. [D 20:43:06.264458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 30106. [D 20:43:06.264467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 30107. [D 20:43:06.264477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 30108. [D 20:43:06.264502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 30109. [D 20:43:06.264512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 30110. [D 20:43:06.264521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 30111. [D 20:43:06.264537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 30112. [D 20:43:06.264546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 30113. [D 20:43:06.264556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 30114. [D 20:43:06.264581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 30115. [D 20:43:06.264591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 30116. [D 20:43:06.264600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 30117. [D 20:43:06.264610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 30118. [D 20:43:06.264621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 30119. [D 20:43:06.264631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 30120. [D 20:43:06.264654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 30121. [D 20:43:06.264664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 30122. [D 20:43:06.264674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 30123. [D 20:43:06.264690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 30124. [D 20:43:06.264699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 30125. [D 20:43:06.264709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 30126. [D 20:43:06.264736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 30127. [D 20:43:06.264747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 30128. [D 20:43:06.264760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 30129. [D 20:43:06.264770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 30130. [D 20:43:06.264780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 30131. [D 20:43:06.264805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 30132. [D 20:43:06.264815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 30133. [D 20:43:06.264826] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 30134. [D 20:43:06.264880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.264893] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.264903] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:06.269244] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5341 [D 20:43:06.269309] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 18/70. [D 20:43:06.275522] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 30134. [D 20:43:06.275539] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 19/70. [D 20:43:06.287182] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 30133. [D 20:43:06.287196] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 20/70. [D 20:43:06.287227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 30133. [D 20:43:06.287239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 30134. [D 20:43:06.287250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 30135. [D 20:43:06.287264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 30136. [D 20:43:06.287274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 30137. [D 20:43:06.287287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 30138. [D 20:43:06.287301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 30139. [D 20:43:06.287311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 30140. [D 20:43:06.287321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 30141. [D 20:43:06.287336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 30142. [D 20:43:06.287346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 30143. [D 20:43:06.287376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 30144. [D 20:43:06.287386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 30145. [D 20:43:06.287396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 30146. [D 20:43:06.287420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 30147. [D 20:43:06.287434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 30148. [D 20:43:06.287444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 30149. [D 20:43:06.287453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 30150. [D 20:43:06.287480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 30151. [D 20:43:06.287491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 30152. [D 20:43:06.287502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 30153. [D 20:43:06.287512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 30154. [D 20:43:06.287522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 30155. [D 20:43:06.287547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 30156. [D 20:43:06.287557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 30157. [D 20:43:06.287567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 30158. [D 20:43:06.287578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 30159. [D 20:43:06.287587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 30160. [D 20:43:06.287611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 30161. [D 20:43:06.287621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 30162. [D 20:43:06.287631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 30163. [D 20:43:06.287641] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 30164. [D 20:43:06.289965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.289979] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.289989] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:06.290006] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.290018] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.290027] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:06.298497] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.298512] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.298523] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:06.298554] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5344 [D 20:43:06.298565] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:06.298577] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 21/70. [D 20:43:06.299060] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 30164. [D 20:43:06.299074] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 22/70. [D 20:43:06.301331] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.301345] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.301354] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:06.303567] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5344 [D 20:43:06.303579] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 23/70. [D 20:43:06.304915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 30164. [D 20:43:06.304930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 30165. [D 20:43:06.304941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 30166. [D 20:43:06.304951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 30167. [D 20:43:06.304966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 30168. [D 20:43:06.304977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 30169. [D 20:43:06.304987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 30170. [D 20:43:06.304997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 30171. [D 20:43:06.305007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 30172. [D 20:43:06.305017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 30173. [D 20:43:06.305027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 30174. [D 20:43:06.305037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 30175. [D 20:43:06.305056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 30176. [D 20:43:06.305066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 30177. [D 20:43:06.305076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 30178. [D 20:43:06.305086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 30179. [D 20:43:06.305097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 30180. [D 20:43:06.305107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 30181. [D 20:43:06.305135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 30182. [D 20:43:06.305145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 30183. [D 20:43:06.305155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 30184. [D 20:43:06.305170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 30185. [D 20:43:06.305193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 30186. [D 20:43:06.305206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 30187. [D 20:43:06.305216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 30188. [D 20:43:06.305226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 30189. [D 20:43:06.305240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 30190. [D 20:43:06.305249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 30191. [D 20:43:06.305259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 30192. [D 20:43:06.305283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 30193. [D 20:43:06.305293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 30194. [D 20:43:06.305314] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 30195. [D 20:43:06.312158] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 30195. [D 20:43:06.312172] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 24/70. [D 20:43:06.314517] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.314530] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.314541] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:06.318052] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.318065] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.318075] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:06.318089] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5348 [D 20:43:06.318099] element 0: offset: 0x2aaaab202cc0, size: 24 [D 20:43:06.318109] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 25/70. [D 20:43:06.320124] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5348 [D 20:43:06.320192] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 26/70. [D 20:43:06.322699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 30195. [D 20:43:06.322716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30196. [D 20:43:06.322727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30197. [D 20:43:06.322738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30198. [D 20:43:06.322748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30199. [D 20:43:06.322762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30200. [D 20:43:06.322771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30201. [D 20:43:06.322781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30202. [D 20:43:06.322797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30203. [D 20:43:06.322806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30204. [D 20:43:06.322816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30205. [D 20:43:06.322832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30206. [D 20:43:06.322841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30207. [D 20:43:06.322851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30208. [D 20:43:06.322866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30209. [D 20:43:06.322890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30210. [D 20:43:06.322915] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.322933] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.322945] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:06.322990] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5350 [D 20:43:06.323004] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:06.323016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30211. [D 20:43:06.323026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30212. [D 20:43:06.323037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30213. [D 20:43:06.323047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30214. [D 20:43:06.323057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30215. [D 20:43:06.323073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30216. [D 20:43:06.323101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30217. [D 20:43:06.323112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30218. [D 20:43:06.323121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30219. [D 20:43:06.323131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30220. [D 20:43:06.323142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30221. [D 20:43:06.323152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30222. [D 20:43:06.323175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30223. [D 20:43:06.323185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30224. [D 20:43:06.323195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30225. [D 20:43:06.323206] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30226. [D 20:43:06.323236] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 27/70. [D 20:43:06.325640] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.325654] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.325664] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:06.325680] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5353 [D 20:43:06.325690] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:06.325699] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 28/70. [D 20:43:06.325715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.325725] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.325733] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:06.325746] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5356 [D 20:43:06.325756] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:06.325766] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 29/70. [D 20:43:06.332184] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 30226. [D 20:43:06.332199] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 30/70. [D 20:43:06.334647] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.334661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.334669] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:06.337514] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5353 [D 20:43:06.337572] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 31/70. [D 20:43:06.339873] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5350 [D 20:43:06.339891] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 32/70. [D 20:43:06.339921] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5356 [D 20:43:06.339933] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 33/70. [D 20:43:06.340393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 30226. [D 20:43:06.340409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 30227. [D 20:43:06.340420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 30228. [D 20:43:06.340430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 30229. [D 20:43:06.340440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 30230. [D 20:43:06.340454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 30231. [D 20:43:06.340463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 30232. [D 20:43:06.340473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 30233. [D 20:43:06.340489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 30234. [D 20:43:06.340499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 30235. [D 20:43:06.340509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 30236. [D 20:43:06.340519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 30237. [D 20:43:06.340535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 30238. [D 20:43:06.340545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 30239. [D 20:43:06.340555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 30240. [D 20:43:06.340565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 30241. [D 20:43:06.340575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 30242. [D 20:43:06.340585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 30243. [D 20:43:06.340613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 30244. [D 20:43:06.340623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 30245. [D 20:43:06.340633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 30246. [D 20:43:06.340646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 30247. [D 20:43:06.340656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 30248. [D 20:43:06.340666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 30249. [D 20:43:06.340694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 30250. [D 20:43:06.340704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 30251. [D 20:43:06.340717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 30252. [D 20:43:06.340727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 30253. [D 20:43:06.340737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 30254. [D 20:43:06.340764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 30255. [D 20:43:06.340774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 30256. [D 20:43:06.340785] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 30257. [D 20:43:06.340798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 30258. [D 20:43:06.340808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 30259. [D 20:43:06.340834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 30260. [D 20:43:06.340848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 30261. [D 20:43:06.340858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 30262. [D 20:43:06.340868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 30263. [D 20:43:06.340895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 30264. [D 20:43:06.340906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 30265. [D 20:43:06.340920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 30266. [D 20:43:06.340929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 30267. [D 20:43:06.340939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 30268. [D 20:43:06.340953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 30269. [D 20:43:06.340963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 30270. [D 20:43:06.340973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 30271. [D 20:43:06.341002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 30272. [D 20:43:06.341018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 30273. [D 20:43:06.341028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 30274. [D 20:43:06.341037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 30275. [D 20:43:06.341067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 30276. [D 20:43:06.341078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 30277. [D 20:43:06.341090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 30278. [D 20:43:06.341100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 30279. [D 20:43:06.341110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 30280. [D 20:43:06.341123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 30281. [D 20:43:06.341133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 30282. [D 20:43:06.341143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 30283. [D 20:43:06.341172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 30284. [D 20:43:06.341183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 30285. [D 20:43:06.341194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 30286. [D 20:43:06.341204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 30287. [D 20:43:06.341214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 30288. [D 20:43:06.341238] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 30289. [D 20:43:06.341250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 30290. [D 20:43:06.341261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 30291. [D 20:43:06.341270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 30292. [D 20:43:06.341281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 30293. [D 20:43:06.341291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 30294. [D 20:43:06.341300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 30295. [D 20:43:06.341310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 30296. [E 20:43:06.341324] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 30297, block for 10 ms. [D 20:43:06.342982] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 30296. [E 20:43:06.342997] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 30297, block for 10 ms. [D 20:43:06.352158] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 30296. [D 20:43:06.352173] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 34/70. [D 20:43:06.352184] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 30295. [D 20:43:06.352194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 30296. [D 20:43:06.352207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 30297. [D 20:43:06.352221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 30298. [D 20:43:06.352231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 30299. [D 20:43:06.352241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 30300. [D 20:43:06.352255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 30301. [D 20:43:06.352265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 30302. [D 20:43:06.352275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 30303. [D 20:43:06.352291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 30304. [D 20:43:06.352300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 30305. [D 20:43:06.352310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 30306. [D 20:43:06.352325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 30307. [D 20:43:06.352335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 30308. [D 20:43:06.352345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 30309. [D 20:43:06.352379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 30310. [D 20:43:06.352389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 30311. [D 20:43:06.352399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 30312. [D 20:43:06.352409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 30313. [D 20:43:06.352439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 30314. [D 20:43:06.352450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 30315. [D 20:43:06.352460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 30316. [D 20:43:06.352470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 30317. [D 20:43:06.352486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 30318. [D 20:43:06.352496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 30319. [D 20:43:06.352506] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 30320. [D 20:43:06.354934] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.354950] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.354960] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:06.354994] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5359 [D 20:43:06.355005] element 0: offset: 0x2aaaab222b60, size: 24 [D 20:43:06.355018] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 35/70. [D 20:43:06.363807] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 30320. [D 20:43:06.363821] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 36/70. [D 20:43:06.367319] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.367333] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.367343] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:06.369694] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 30319. [D 20:43:06.369708] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 37/70. [D 20:43:06.372004] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.372017] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.372027] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:06.372088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.372100] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.372110] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:06.374528] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5359 [D 20:43:06.374586] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 38/70. [D 20:43:06.381218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 30319. [D 20:43:06.381234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30320. [D 20:43:06.381246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30321. [D 20:43:06.381257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30322. [D 20:43:06.381267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30323. [D 20:43:06.381277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30324. [D 20:43:06.381287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30325. [D 20:43:06.381302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30326. [D 20:43:06.381312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30327. [D 20:43:06.381322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30328. [D 20:43:06.381332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30329. [D 20:43:06.381348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30330. [D 20:43:06.381376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30331. [D 20:43:06.381391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30332. [D 20:43:06.381400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30333. [D 20:43:06.381423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30334. [D 20:43:06.381434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30335. [D 20:43:06.381444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30336. [D 20:43:06.381455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30337. [D 20:43:06.381465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30338. [D 20:43:06.381475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30339. [D 20:43:06.381504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30340. [D 20:43:06.381515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30341. [D 20:43:06.381529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30342. [D 20:43:06.381539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30343. [D 20:43:06.381549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30344. [D 20:43:06.381563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30345. [D 20:43:06.381573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30346. [D 20:43:06.381582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30347. [D 20:43:06.381592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30348. [D 20:43:06.381610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30349. [D 20:43:06.381619] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30350. [D 20:43:06.386540] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.386555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.386566] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:06.386598] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5364 [D 20:43:06.386610] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:06.386621] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 39/70. [D 20:43:06.386645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.386655] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.386664] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:06.386678] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5365 [D 20:43:06.386688] element 0: offset: 0x2aaaab2340f0, size: 24 [D 20:43:06.386697] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 40/70. [D 20:43:06.386715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.386745] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.386754] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:06.386772] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5368 [D 20:43:06.386781] element 0: offset: 0x2aaaab202cc0, size: 24 [D 20:43:06.386809] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 41/70. [D 20:43:06.387110] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 30350. [D 20:43:06.387125] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 42/70. [D 20:43:06.389513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.389528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.389536] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:06.392388] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5365 [D 20:43:06.392443] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 43/70. [D 20:43:06.393336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 30350. [D 20:43:06.393351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 30351. [D 20:43:06.393361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 30352. [D 20:43:06.393371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 30353. [D 20:43:06.393381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 30354. [D 20:43:06.393391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 30355. [D 20:43:06.393401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 30356. [D 20:43:06.393411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 30357. [D 20:43:06.393421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 30358. [D 20:43:06.393431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 30359. [D 20:43:06.393441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 30360. [D 20:43:06.393451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 30361. [D 20:43:06.393460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 30362. [D 20:43:06.393470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 30363. [D 20:43:06.393480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 30364. [D 20:43:06.393490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 30365. [D 20:43:06.393500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 30366. [D 20:43:06.393510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 30367. [D 20:43:06.393520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 30368. [D 20:43:06.393529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 30369. [D 20:43:06.393539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 30370. [D 20:43:06.393549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 30371. [D 20:43:06.393559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 30372. [D 20:43:06.393569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 30373. [D 20:43:06.393579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 30374. [D 20:43:06.393589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 30375. [D 20:43:06.393598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 30376. [D 20:43:06.393610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 30377. [D 20:43:06.393620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 30378. [D 20:43:06.393630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 30379. [D 20:43:06.393640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 30380. [D 20:43:06.393650] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 30381. [D 20:43:06.395919] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5364 [D 20:43:06.395942] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 44/70. [D 20:43:06.398203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.398218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.398229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:06.398263] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5371 [D 20:43:06.398274] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:06.398287] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 45/70. [D 20:43:06.398323] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5368 [D 20:43:06.398337] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 46/70. [D 20:43:06.399216] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 30381. [D 20:43:06.399231] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 47/70. [D 20:43:06.399243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 30381. [D 20:43:06.399254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 30382. [D 20:43:06.399264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 30383. [D 20:43:06.399275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 30384. [D 20:43:06.399285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 30385. [D 20:43:06.399295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 30386. [D 20:43:06.399305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 30387. [D 20:43:06.399315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 30388. [D 20:43:06.399325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 30389. [D 20:43:06.399341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 30390. [D 20:43:06.399351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 30391. [D 20:43:06.399361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 30392. [D 20:43:06.399386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 30393. [D 20:43:06.399397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 30394. [D 20:43:06.399407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 30395. [D 20:43:06.399418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 30396. [D 20:43:06.399428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 30397. [D 20:43:06.399438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 30398. [D 20:43:06.399448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 30399. [D 20:43:06.399472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 30400. [D 20:43:06.399482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 30401. [D 20:43:06.399493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 30402. [D 20:43:06.399503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 30403. [D 20:43:06.399513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 30404. [D 20:43:06.399528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 30405. [D 20:43:06.399550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 30406. [D 20:43:06.399561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 30407. [D 20:43:06.399572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 30408. [D 20:43:06.399582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 30409. [D 20:43:06.399592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 30410. [D 20:43:06.399601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 30411. [D 20:43:06.399621] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 30412. [D 20:43:06.399633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 30413. [D 20:43:06.399644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 30414. [D 20:43:06.399654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 30415. [D 20:43:06.399669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 30416. [D 20:43:06.399679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 30417. [D 20:43:06.399689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 30418. [D 20:43:06.399699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 30419. [D 20:43:06.399722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 30420. [D 20:43:06.399733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 30421. [D 20:43:06.399747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 30422. [D 20:43:06.399758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 30423. [D 20:43:06.399768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 30424. [D 20:43:06.399778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 30425. [D 20:43:06.399788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 30426. [D 20:43:06.399799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 30427. [D 20:43:06.399809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 30428. [D 20:43:06.399819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 30429. [D 20:43:06.399829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 30430. [D 20:43:06.399848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 30431. [D 20:43:06.399872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 30432. [D 20:43:06.399883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 30433. [D 20:43:06.399894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 30434. [D 20:43:06.399904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 30435. [D 20:43:06.399914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 30436. [D 20:43:06.399923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 30437. [D 20:43:06.399933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 30438. [D 20:43:06.399943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 30439. [D 20:43:06.399960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 30440. [D 20:43:06.399970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 30441. [D 20:43:06.399980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 30442. [D 20:43:06.399990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 30443. [D 20:43:06.400000] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 30444. [D 20:43:06.400050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.400061] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.400071] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:06.404702] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5371 [D 20:43:06.404719] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 48/70. [D 20:43:06.405110] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 30444. [D 20:43:06.405125] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 49/70. [D 20:43:06.410986] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 30443. [D 20:43:06.411000] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 50/70. [D 20:43:06.411012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 30443. [D 20:43:06.411023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30444. [D 20:43:06.411033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30445. [D 20:43:06.411043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30446. [D 20:43:06.411053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30447. [D 20:43:06.411068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30448. [D 20:43:06.411078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30449. [D 20:43:06.411088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30450. [D 20:43:06.411098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30451. [D 20:43:06.411108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30452. [D 20:43:06.411126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30453. [D 20:43:06.411136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30454. [D 20:43:06.411161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30455. [D 20:43:06.411171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30456. [D 20:43:06.411181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30457. [D 20:43:06.411191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30458. [D 20:43:06.411201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30459. [D 20:43:06.411211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30460. [D 20:43:06.411221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30461. [D 20:43:06.411253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30462. [D 20:43:06.411264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30463. [D 20:43:06.411276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30464. [D 20:43:06.411285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30465. [D 20:43:06.411295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30466. [D 20:43:06.411319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30467. [D 20:43:06.411328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30468. [D 20:43:06.411339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30469. [D 20:43:06.411349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30470. [D 20:43:06.411359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30471. [D 20:43:06.411382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30472. [D 20:43:06.411392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30473. [D 20:43:06.411403] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30474. [D 20:43:06.411431] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.411455] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.411468] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:06.413678] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.413691] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.413701] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:06.416953] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 30474. [D 20:43:06.416967] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 51/70. [D 20:43:06.418501] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.418515] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.418525] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:06.706815] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.706830] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.706841] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:06.706856] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5375 [D 20:43:06.706866] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:06.706875] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 52/70. [D 20:43:06.706891] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.706906] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.706915] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:06.706931] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5376 [D 20:43:06.706955] element 0: offset: 0x2aaaab220710, size: 24 [D 20:43:06.706974] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 53/70. [D 20:43:06.712229] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5376 [D 20:43:06.712298] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 54/70. [D 20:43:06.712320] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5375 [D 20:43:06.712343] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 55/70. [D 20:43:06.712380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 30474. [D 20:43:06.712396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 30475. [D 20:43:06.712412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 30476. [D 20:43:06.712422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 30477. [D 20:43:06.712431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 30478. [D 20:43:06.712448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 30479. [D 20:43:06.712458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 30480. [D 20:43:06.712468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 30481. [D 20:43:06.712484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 30482. [D 20:43:06.712494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 30483. [D 20:43:06.712503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 30484. [D 20:43:06.712534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 30485. [D 20:43:06.712545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 30486. [D 20:43:06.712576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 30487. [D 20:43:06.712587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 30488. [D 20:43:06.712597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 30489. [D 20:43:06.712607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 30490. [D 20:43:06.712629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 30491. [D 20:43:06.712639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 30492. [D 20:43:06.712649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 30493. [D 20:43:06.712659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 30494. [D 20:43:06.712681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 30495. [D 20:43:06.712700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 30496. [D 20:43:06.712714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 30497. [D 20:43:06.712723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 30498. [D 20:43:06.712733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 30499. [D 20:43:06.712759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 30500. [D 20:43:06.712769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 30501. [D 20:43:06.712782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 30502. [D 20:43:06.712792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 30503. [D 20:43:06.712802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 30504. [D 20:43:06.712815] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 30505. [D 20:43:06.712847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 30506. [D 20:43:06.712857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 30507. [D 20:43:06.712868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 30508. [D 20:43:06.712880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 30509. [D 20:43:06.712895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 30510. [D 20:43:06.712904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 30511. [D 20:43:06.712914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 30512. [D 20:43:06.712943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 30513. [D 20:43:06.712953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 30514. [D 20:43:06.712965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 30515. [D 20:43:06.712983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 30516. [D 20:43:06.713006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 30517. [D 20:43:06.713016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 30518. [D 20:43:06.713027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 30519. [D 20:43:06.713037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 30520. [D 20:43:06.713046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 30521. [D 20:43:06.713075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 30522. [D 20:43:06.713087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 30523. [D 20:43:06.713097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 30524. [D 20:43:06.713118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 30525. [D 20:43:06.713128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 30526. [D 20:43:06.713139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 30527. [D 20:43:06.713149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 30528. [D 20:43:06.713177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 30529. [D 20:43:06.713187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 30530. [D 20:43:06.713197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 30531. [D 20:43:06.713249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 30532. [D 20:43:06.713260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 30533. [D 20:43:06.713270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 30534. [D 20:43:06.713280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 30535. [D 20:43:06.713291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 30536. [D 20:43:06.713301] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 30537. [D 20:43:06.715730] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.715744] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.715755] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:06.715789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5380 [D 20:43:06.715800] element 0: offset: 0x2aaaab222b60, size: 24 [D 20:43:06.715813] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 56/70. [D 20:43:06.719512] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 30537. [D 20:43:06.719561] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 57/70. [D 20:43:06.731142] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 30536. [D 20:43:06.731161] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 58/70. [D 20:43:06.733493] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.733506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.733516] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:06.733568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.733581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.733590] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:06.735628] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5380 [D 20:43:06.735686] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 59/70. [D 20:43:06.735804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 30536. [D 20:43:06.735842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30537. [D 20:43:06.735853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30538. [D 20:43:06.735863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30539. [D 20:43:06.735873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30540. [D 20:43:06.735887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30541. [D 20:43:06.735897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30542. [D 20:43:06.735906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30543. [D 20:43:06.735922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30544. [D 20:43:06.735932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30545. [D 20:43:06.735941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30546. [D 20:43:06.735957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30547. [D 20:43:06.735967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30548. [D 20:43:06.735976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30549. [D 20:43:06.735992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30550. [D 20:43:06.736002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30551. [D 20:43:06.736011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30552. [D 20:43:06.736047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30553. [D 20:43:06.736060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30554. [D 20:43:06.736070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30555. [D 20:43:06.736085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30556. [D 20:43:06.736114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30557. [D 20:43:06.736127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30558. [D 20:43:06.736137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30559. [D 20:43:06.736147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30560. [D 20:43:06.736160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30561. [D 20:43:06.736170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30562. [D 20:43:06.736179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30563. [D 20:43:06.736195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30564. [D 20:43:06.736205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30565. [D 20:43:06.736215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30566. [D 20:43:06.736224] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30567. [D 20:43:06.747590] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 30567. [D 20:43:06.747605] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 60/70. [D 20:43:06.749939] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.749954] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.749963] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:06.756855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.756869] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.756880] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:06.756910] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5382 [D 20:43:06.756920] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:06.756930] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 0/70. [D 20:43:06.757261] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.757275] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.757284] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:06.757298] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5386 [D 20:43:06.757308] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:06.757318] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 1/70. [D 20:43:06.761268] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5382 [D 20:43:06.761283] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 2/70. [D 20:43:06.761295] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5386 [D 20:43:06.761306] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 3/70. [D 20:43:06.761336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 30567. [D 20:43:06.761358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 30568. [D 20:43:06.761368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 30569. [D 20:43:06.761379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 30570. [D 20:43:06.761389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 30571. [D 20:43:06.761398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 30572. [D 20:43:06.761408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 30573. [D 20:43:06.761418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 30574. [D 20:43:06.761428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 30575. [D 20:43:06.761438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 30576. [D 20:43:06.761448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 30577. [D 20:43:06.761458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 30578. [D 20:43:06.761482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 30579. [D 20:43:06.761492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 30580. [D 20:43:06.761501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 30581. [D 20:43:06.761511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 30582. [D 20:43:06.761525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 30583. [D 20:43:06.761545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 30584. [D 20:43:06.761555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 30585. [D 20:43:06.761565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 30586. [D 20:43:06.761575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 30587. [D 20:43:06.761593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 30588. [D 20:43:06.761604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 30589. [D 20:43:06.761614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 30590. [D 20:43:06.761624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 30591. [D 20:43:06.761657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 30592. [D 20:43:06.761666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 30593. [D 20:43:06.761679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 30594. [D 20:43:06.761688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 30595. [D 20:43:06.761698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 30596. [D 20:43:06.761726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 30597. [D 20:43:06.761741] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 30598. [D 20:43:06.761753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 30599. [D 20:43:06.761763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30600. [D 20:43:06.761791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30601. [D 20:43:06.761802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30602. [D 20:43:06.761813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30603. [D 20:43:06.761823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30604. [D 20:43:06.761833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30605. [D 20:43:06.761854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30606. [D 20:43:06.761864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30607. [D 20:43:06.761874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30608. [D 20:43:06.761885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30609. [D 20:43:06.761895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30610. [D 20:43:06.761905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30611. [D 20:43:06.761928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30612. [D 20:43:06.761942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30613. [D 20:43:06.761958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30614. [D 20:43:06.761968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30615. [D 20:43:06.761978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30616. [D 20:43:06.761987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30617. [D 20:43:06.761997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30618. [D 20:43:06.762011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30619. [D 20:43:06.762031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30620. [D 20:43:06.762041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30621. [D 20:43:06.762051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30622. [D 20:43:06.762074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30623. [D 20:43:06.762084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30624. [D 20:43:06.762094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30625. [D 20:43:06.762110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30626. [D 20:43:06.762119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30627. [D 20:43:06.762129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30628. [D 20:43:06.762145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30629. [D 20:43:06.762155] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30630. [D 20:43:06.770209] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 30630. [D 20:43:06.770223] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 4/70. [D 20:43:06.781724] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 30629. [D 20:43:06.781738] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 5/70. [D 20:43:06.784082] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.784096] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.784106] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:06.784118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.784128] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.784137] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:06.798541] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.798555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.798566] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:06.798581] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5388 [D 20:43:06.798591] element 0: offset: 0x2aaaab202cc0, size: 24 [D 20:43:06.798601] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 6/70. [D 20:43:06.802933] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5388 [D 20:43:06.802949] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 7/70. [D 20:43:06.803002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 30629. [D 20:43:06.803015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 30630. [D 20:43:06.803025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 30631. [D 20:43:06.803034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 30632. [D 20:43:06.803044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 30633. [D 20:43:06.803054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 30634. [D 20:43:06.803064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 30635. [D 20:43:06.803074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 30636. [D 20:43:06.803097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 30637. [D 20:43:06.803107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 30638. [D 20:43:06.803116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 30639. [D 20:43:06.803126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 30640. [D 20:43:06.803144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 30641. [D 20:43:06.803154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 30642. [D 20:43:06.803164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 30643. [D 20:43:06.803174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 30644. [D 20:43:06.803184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 30645. [D 20:43:06.803194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 30646. [D 20:43:06.803204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 30647. [D 20:43:06.803221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 30648. [D 20:43:06.803231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 30649. [D 20:43:06.803241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 30650. [D 20:43:06.803251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 30651. [D 20:43:06.803261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 30652. [D 20:43:06.803271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 30653. [D 20:43:06.803281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 30654. [D 20:43:06.803304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 30655. [D 20:43:06.803314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 30656. [D 20:43:06.803324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 30657. [D 20:43:06.803340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 30658. [D 20:43:06.803350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 30659. [D 20:43:06.803359] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 30660. [D 20:43:06.813482] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 30660. [D 20:43:06.813496] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 8/70. [D 20:43:06.815846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.815859] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.815869] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:06.836731] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.836745] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.836755] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:06.836770] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5392 [D 20:43:06.836780] element 0: offset: 0x2aaaab222b60, size: 24 [D 20:43:06.836789] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 9/70. [D 20:43:06.838810] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5392 [D 20:43:06.839035] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 10/70. [D 20:43:06.839175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 30660. [D 20:43:06.839189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30661. [D 20:43:06.839200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30662. [D 20:43:06.839210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30663. [D 20:43:06.839225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30664. [D 20:43:06.839235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30665. [D 20:43:06.839244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30666. [D 20:43:06.839254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30667. [D 20:43:06.839271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30668. [D 20:43:06.839281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30669. [D 20:43:06.839291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30670. [D 20:43:06.839301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30671. [D 20:43:06.839324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30672. [D 20:43:06.839339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30673. [D 20:43:06.839349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30674. [D 20:43:06.839359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30675. [D 20:43:06.839374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30676. [D 20:43:06.839384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30677. [D 20:43:06.839406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30678. [D 20:43:06.839421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30679. [D 20:43:06.839431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30680. [D 20:43:06.839440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30681. [D 20:43:06.839456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30682. [D 20:43:06.839466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30683. [D 20:43:06.839475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30684. [D 20:43:06.839499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30685. [D 20:43:06.839509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30686. [D 20:43:06.839519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30687. [D 20:43:06.839530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30688. [D 20:43:06.839551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30689. [D 20:43:06.839561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30690. [D 20:43:06.839575] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30691. [D 20:43:06.849843] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 30691. [D 20:43:06.849856] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 11/70. [D 20:43:06.852150] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.852163] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.852173] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:06.860994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.861007] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.861018] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:06.861032] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5395 [D 20:43:06.861042] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:06.861052] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 12/70. [D 20:43:06.863152] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5395 [D 20:43:06.863171] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 13/70. [D 20:43:06.863222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 30691. [D 20:43:06.863232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30692. [D 20:43:06.863242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30693. [D 20:43:06.863252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30694. [D 20:43:06.863262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30695. [D 20:43:06.863282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30696. [D 20:43:06.863291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30697. [D 20:43:06.863301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30698. [D 20:43:06.863316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30699. [D 20:43:06.863326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30700. [D 20:43:06.863336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30701. [D 20:43:06.863345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30702. [D 20:43:06.863363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30703. [D 20:43:06.863373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30704. [D 20:43:06.863397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30705. [D 20:43:06.863411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30706. [D 20:43:06.863421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30707. [D 20:43:06.863439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30708. [D 20:43:06.863449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30709. [D 20:43:06.863459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30710. [D 20:43:06.863469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30711. [D 20:43:06.863479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30712. [D 20:43:06.863497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30713. [D 20:43:06.863506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30714. [D 20:43:06.863534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30715. [D 20:43:06.863544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30716. [D 20:43:06.863554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30717. [D 20:43:06.863569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30718. [D 20:43:06.863579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30719. [D 20:43:06.863589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30720. [D 20:43:06.863604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30721. [D 20:43:06.863631] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30722. [D 20:43:06.873016] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 30722. [D 20:43:06.873030] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 14/70. [D 20:43:06.874549] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.874563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.874573] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:06.883406] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.883419] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.883430] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:06.883444] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5398 [D 20:43:06.883454] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:06.883464] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 15/70. [D 20:43:06.883762] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.883776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.883785] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:06.883798] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5401 [D 20:43:06.883808] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:06.883817] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 16/70. [D 20:43:06.885637] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5398 [D 20:43:06.885693] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 17/70. [D 20:43:06.885745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 30722. [D 20:43:06.885761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 30723. [D 20:43:06.885771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 30724. [D 20:43:06.885781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 30725. [D 20:43:06.885791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 30726. [D 20:43:06.885800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 30727. [D 20:43:06.885810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 30728. [D 20:43:06.885826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 30729. [D 20:43:06.885836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 30730. [D 20:43:06.885845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 30731. [D 20:43:06.885856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 30732. [D 20:43:06.885880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 30733. [D 20:43:06.885890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 30734. [D 20:43:06.885900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 30735. [D 20:43:06.885910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 30736. [D 20:43:06.885919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 30737. [D 20:43:06.885935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 30738. [D 20:43:06.885958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 30739. [D 20:43:06.885972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 30740. [D 20:43:06.885982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 30741. [D 20:43:06.885992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 30742. [D 20:43:06.886005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 30743. [D 20:43:06.886015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 30744. [D 20:43:06.886040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 30745. [D 20:43:06.886051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 30746. [D 20:43:06.886060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 30747. [D 20:43:06.886075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 30748. [D 20:43:06.886085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 30749. [D 20:43:06.886095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 30750. [D 20:43:06.886118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 30751. [D 20:43:06.886127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 30752. [D 20:43:06.886137] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 30753. [D 20:43:06.888499] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5401 [D 20:43:06.888553] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 18/70. [D 20:43:06.894835] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 30753. [D 20:43:06.894852] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 19/70. [D 20:43:06.894890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 30753. [D 20:43:06.894901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30754. [D 20:43:06.894912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30755. [D 20:43:06.894922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30756. [D 20:43:06.894932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30757. [D 20:43:06.894942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30758. [D 20:43:06.894952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30759. [D 20:43:06.894977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30760. [D 20:43:06.894990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30761. [D 20:43:06.894999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30762. [D 20:43:06.895009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30763. [D 20:43:06.895025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30764. [D 20:43:06.895047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30765. [D 20:43:06.895061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30766. [D 20:43:06.895071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30767. [D 20:43:06.895080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30768. [D 20:43:06.895095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30769. [D 20:43:06.895114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30770. [D 20:43:06.895125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30771. [D 20:43:06.895141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30772. [D 20:43:06.895151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30773. [D 20:43:06.895160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30774. [D 20:43:06.895176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30775. [D 20:43:06.895200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30776. [D 20:43:06.895216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30777. [D 20:43:06.895226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30778. [D 20:43:06.895236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30779. [D 20:43:06.895248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30780. [D 20:43:06.895276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30781. [D 20:43:06.895286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30782. [D 20:43:06.895300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30783. [D 20:43:06.895310] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30784. [D 20:43:06.895348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.895361] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.895370] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:06.906611] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 30784. [D 20:43:06.906625] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 20/70. [D 20:43:06.908831] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.908844] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.908853] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:06.925629] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.925644] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.925655] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:06.925672] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5406 [D 20:43:06.925685] element 0: offset: 0x2aaaab222b60, size: 24 [D 20:43:06.925695] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 21/70. [D 20:43:06.928045] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.928059] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.928067] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:06.928081] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5408 [D 20:43:06.928090] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:06.928100] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 22/70. [D 20:43:06.928115] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.928123] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.928136] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:06.928149] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5410 [D 20:43:06.928159] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:06.928168] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 23/70. [D 20:43:06.930514] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5406 [D 20:43:06.930576] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 24/70. [D 20:43:06.930625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 30784. [D 20:43:06.930641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 30785. [D 20:43:06.930651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 30786. [D 20:43:06.930661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 30787. [D 20:43:06.930671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 30788. [D 20:43:06.930681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 30789. [D 20:43:06.930691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 30790. [D 20:43:06.930701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 30791. [D 20:43:06.930710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 30792. [D 20:43:06.930720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 30793. [D 20:43:06.930730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 30794. [D 20:43:06.930740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 30795. [D 20:43:06.930749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 30796. [D 20:43:06.930759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 30797. [D 20:43:06.930769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 30798. [D 20:43:06.930779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 30799. [D 20:43:06.930789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 30800. [D 20:43:06.930798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 30801. [D 20:43:06.930808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 30802. [D 20:43:06.930818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 30803. [D 20:43:06.930828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 30804. [D 20:43:06.930838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 30805. [D 20:43:06.930847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 30806. [D 20:43:06.930857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 30807. [D 20:43:06.930867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 30808. [D 20:43:06.930877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 30809. [D 20:43:06.930887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 30810. [D 20:43:06.930896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 30811. [D 20:43:06.930906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 30812. [D 20:43:06.930917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 30813. [D 20:43:06.930927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 30814. [D 20:43:06.930936] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 30815. [D 20:43:06.934730] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5410 [D 20:43:06.934745] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 25/70. [D 20:43:06.935105] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5408 [D 20:43:06.935120] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 26/70. [D 20:43:06.939603] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 30815. [D 20:43:06.939617] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 27/70. [D 20:43:06.939658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 30815. [D 20:43:06.939669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 30816. [D 20:43:06.939680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 30817. [D 20:43:06.939689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 30818. [D 20:43:06.939699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 30819. [D 20:43:06.939714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 30820. [D 20:43:06.939723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 30821. [D 20:43:06.939749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 30822. [D 20:43:06.939759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 30823. [D 20:43:06.939768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 30824. [D 20:43:06.939782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 30825. [D 20:43:06.939809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 30826. [D 20:43:06.939822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 30827. [D 20:43:06.939832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 30828. [D 20:43:06.939842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 30829. [D 20:43:06.939855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 30830. [D 20:43:06.939877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 30831. [D 20:43:06.939890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 30832. [D 20:43:06.939900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 30833. [D 20:43:06.939910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 30834. [D 20:43:06.939923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 30835. [D 20:43:06.939933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 30836. [D 20:43:06.939955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 30837. [D 20:43:06.939965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 30838. [D 20:43:06.939975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 30839. [D 20:43:06.939991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 30840. [D 20:43:06.940000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 30841. [D 20:43:06.940010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 30842. [D 20:43:06.940020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 30843. [D 20:43:06.940030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 30844. [D 20:43:06.940040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 30845. [D 20:43:06.940053] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 30846. [D 20:43:06.940077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 30847. [D 20:43:06.940088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30848. [D 20:43:06.940099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30849. [D 20:43:06.940108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30850. [D 20:43:06.940118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30851. [D 20:43:06.940136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30852. [D 20:43:06.940145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30853. [D 20:43:06.940155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30854. [D 20:43:06.940165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30855. [D 20:43:06.940175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30856. [D 20:43:06.940185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30857. [D 20:43:06.940195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30858. [D 20:43:06.940219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30859. [D 20:43:06.940229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30860. [D 20:43:06.940239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30861. [D 20:43:06.940249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30862. [D 20:43:06.940258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30863. [D 20:43:06.940273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30864. [D 20:43:06.940283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30865. [D 20:43:06.940293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30866. [D 20:43:06.940303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30867. [D 20:43:06.940334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30868. [D 20:43:06.940344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30869. [D 20:43:06.940357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30870. [D 20:43:06.940367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30871. [D 20:43:06.940376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30872. [D 20:43:06.940390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30873. [D 20:43:06.940400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30874. [D 20:43:06.940421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30875. [D 20:43:06.940432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30876. [D 20:43:06.940442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30877. [D 20:43:06.940452] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30878. [D 20:43:06.940489] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.940501] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.940509] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:06.948027] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:06.948041] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.948051] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:06.948065] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5412 [D 20:43:06.948077] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:06.948089] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 28/70. [D 20:43:06.951428] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 30878. [D 20:43:06.951441] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 29/70. [D 20:43:06.957534] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 30877. [D 20:43:06.957548] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 30/70. [D 20:43:06.959820] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.959833] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.959843] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:06.959875] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.959886] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.959895] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:06.962147] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5412 [D 20:43:06.962205] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 31/70. [D 20:43:06.962263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 30877. [D 20:43:06.962279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 30878. [D 20:43:06.962290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 30879. [D 20:43:06.962300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 30880. [D 20:43:06.962323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 30881. [D 20:43:06.962334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 30882. [D 20:43:06.962344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 30883. [D 20:43:06.962354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 30884. [D 20:43:06.962364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 30885. [D 20:43:06.962374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 30886. [D 20:43:06.962384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 30887. [D 20:43:06.962426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 30888. [D 20:43:06.962436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 30889. [D 20:43:06.962447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 30890. [D 20:43:06.962457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 30891. [D 20:43:06.962467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 30892. [D 20:43:06.962481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 30893. [D 20:43:06.962502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 30894. [D 20:43:06.962513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 30895. [D 20:43:06.962523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 30896. [D 20:43:06.962533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 30897. [D 20:43:06.962543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 30898. [D 20:43:06.962577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 30899. [D 20:43:06.962588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 30900. [D 20:43:06.962602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 30901. [D 20:43:06.962613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 30902. [D 20:43:06.962622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 30903. [D 20:43:06.962632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 30904. [D 20:43:06.962655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 30905. [D 20:43:06.962665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 30906. [D 20:43:06.962675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 30907. [D 20:43:06.962689] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 30908. [D 20:43:06.968133] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 30908. [D 20:43:06.968148] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 32/70. [D 20:43:06.970298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:06.970312] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:06.970322] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:07.150584] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.150600] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.150610] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:07.150641] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5418 [D 20:43:07.150652] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:07.152887] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 33/70. [D 20:43:07.152911] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.152921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.152929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:07.152946] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5420 [D 20:43:07.152955] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:07.152971] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 34/70. [D 20:43:07.152986] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.152996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.153005] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:07.153035] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5422 [D 20:43:07.153045] element 0: offset: 0x2aaaab222b60, size: 24 [D 20:43:07.153056] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 35/70. [D 20:43:07.158609] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5420 [D 20:43:07.158685] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 36/70. [D 20:43:07.158767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 30908. [D 20:43:07.158782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 30909. [D 20:43:07.158793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 30910. [D 20:43:07.158803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 30911. [D 20:43:07.158813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 30912. [D 20:43:07.158822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 30913. [D 20:43:07.158832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 30914. [D 20:43:07.158842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 30915. [D 20:43:07.158852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 30916. [D 20:43:07.158862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 30917. [D 20:43:07.158872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 30918. [D 20:43:07.158882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 30919. [D 20:43:07.158891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 30920. [D 20:43:07.158901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 30921. [D 20:43:07.158911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 30922. [D 20:43:07.158921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 30923. [D 20:43:07.158930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 30924. [D 20:43:07.158940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 30925. [D 20:43:07.158950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 30926. [D 20:43:07.158960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 30927. [D 20:43:07.158970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 30928. [D 20:43:07.158980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 30929. [D 20:43:07.158989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 30930. [D 20:43:07.158999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 30931. [D 20:43:07.159009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 30932. [D 20:43:07.159019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 30933. [D 20:43:07.159029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 30934. [D 20:43:07.159038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 30935. [D 20:43:07.159048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 30936. [D 20:43:07.159059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 30937. [D 20:43:07.159069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 30938. [D 20:43:07.159079] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 30939. [D 20:43:07.163244] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5418 [D 20:43:07.163260] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 37/70. [D 20:43:07.163295] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.163307] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.163316] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:07.163352] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5424 [D 20:43:07.163363] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:07.163373] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 38/70. [D 20:43:07.163409] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5422 [D 20:43:07.163421] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 39/70. [D 20:43:07.166766] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 30939. [D 20:43:07.166782] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 40/70. [D 20:43:07.166817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 30939. [D 20:43:07.166828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 30940. [D 20:43:07.166839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 30941. [D 20:43:07.166849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 30942. [D 20:43:07.166859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 30943. [D 20:43:07.166869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 30944. [D 20:43:07.166880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 30945. [D 20:43:07.166889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 30946. [D 20:43:07.166899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 30947. [D 20:43:07.166915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 30948. [D 20:43:07.166924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 30949. [D 20:43:07.166934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 30950. [D 20:43:07.166963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 30951. [D 20:43:07.166973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 30952. [D 20:43:07.166983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 30953. [D 20:43:07.166994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 30954. [D 20:43:07.167003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 30955. [D 20:43:07.167014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 30956. [D 20:43:07.167024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 30957. [D 20:43:07.167033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 30958. [D 20:43:07.167061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 30959. [D 20:43:07.167071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 30960. [D 20:43:07.167081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 30961. [D 20:43:07.167096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 30962. [D 20:43:07.167106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 30963. [D 20:43:07.167127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 30964. [D 20:43:07.167138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 30965. [D 20:43:07.167148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 30966. [D 20:43:07.167158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 30967. [D 20:43:07.167169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 30968. [D 20:43:07.167179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 30969. [D 20:43:07.167189] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 30970. [D 20:43:07.167213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 30971. [D 20:43:07.167224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 30972. [D 20:43:07.167234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 30973. [D 20:43:07.167253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 30974. [D 20:43:07.167263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 30975. [D 20:43:07.167278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 30976. [D 20:43:07.167288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 30977. [D 20:43:07.167297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 30978. [D 20:43:07.167308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 30979. [D 20:43:07.167332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 30980. [D 20:43:07.167342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 30981. [D 20:43:07.167353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 30982. [D 20:43:07.167362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 30983. [D 20:43:07.167372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 30984. [D 20:43:07.167388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 30985. [D 20:43:07.167410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 30986. [D 20:43:07.167420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 30987. [D 20:43:07.167430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 30988. [D 20:43:07.167440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 30989. [D 20:43:07.167450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 30990. [D 20:43:07.167460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 30991. [D 20:43:07.167470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 30992. [D 20:43:07.167495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 30993. [D 20:43:07.167505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 30994. [D 20:43:07.167515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 30995. [D 20:43:07.167530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 30996. [D 20:43:07.167540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 30997. [D 20:43:07.167549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 30998. [D 20:43:07.167578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 30999. [D 20:43:07.167588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 31000. [D 20:43:07.167599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 31001. [D 20:43:07.167609] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 31002. [D 20:43:07.170035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.170049] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.170059] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:07.172398] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5424 [D 20:43:07.172457] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 41/70. [D 20:43:07.178599] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 31002. [D 20:43:07.178616] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 42/70. [D 20:43:07.190212] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 31001. [D 20:43:07.190227] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 43/70. [D 20:43:07.191560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 31001. [D 20:43:07.191574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 31002. [D 20:43:07.191586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 31003. [D 20:43:07.191596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 31004. [D 20:43:07.191606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 31005. [D 20:43:07.191617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 31006. [D 20:43:07.191626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 31007. [D 20:43:07.191636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 31008. [D 20:43:07.191646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 31009. [D 20:43:07.191663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 31010. [D 20:43:07.191673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 31011. [D 20:43:07.191683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 31012. [D 20:43:07.191693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 31013. [D 20:43:07.191703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 31014. [D 20:43:07.191712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 31015. [D 20:43:07.191722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 31016. [D 20:43:07.191755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 31017. [D 20:43:07.191766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 31018. [D 20:43:07.191776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 31019. [D 20:43:07.191786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 31020. [D 20:43:07.191797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 31021. [D 20:43:07.191807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 31022. [D 20:43:07.191817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 31023. [D 20:43:07.191843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 31024. [D 20:43:07.191853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 31025. [D 20:43:07.191901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.191922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.191932] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:07.191948] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.191958] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.191966] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:07.192002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 31026. [D 20:43:07.192013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 31027. [D 20:43:07.192023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 31028. [D 20:43:07.192033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 31029. [D 20:43:07.192060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 31030. [D 20:43:07.192070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 31031. [D 20:43:07.192080] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 31032. [D 20:43:07.202063] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.202077] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.202087] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:07.202118] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5429 [D 20:43:07.202129] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:07.202139] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 44/70. [D 20:43:07.202158] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.202170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.202179] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:07.202192] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5431 [D 20:43:07.202202] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:07.202212] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 45/70. [D 20:43:07.203358] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 31032. [D 20:43:07.203372] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 46/70. [D 20:43:07.205766] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.205780] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.205789] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:07.208105] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5431 [D 20:43:07.208157] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 47/70. [D 20:43:07.208190] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5429 [D 20:43:07.208208] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 48/70. [D 20:43:07.210708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 31032. [D 20:43:07.210725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 31033. [D 20:43:07.210736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 31034. [D 20:43:07.210747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 31035. [D 20:43:07.210757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 31036. [D 20:43:07.210770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 31037. [D 20:43:07.210780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 31038. [D 20:43:07.210790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 31039. [D 20:43:07.210806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 31040. [D 20:43:07.210815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 31041. [D 20:43:07.210825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 31042. [D 20:43:07.210841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 31043. [D 20:43:07.210851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 31044. [D 20:43:07.210860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 31045. [D 20:43:07.210871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 31046. [D 20:43:07.210900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 31047. [D 20:43:07.210910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 31048. [D 20:43:07.210926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 31049. [D 20:43:07.210936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 31050. [D 20:43:07.210945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 31051. [D 20:43:07.210975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 31052. [D 20:43:07.210985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 31053. [D 20:43:07.210997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 31054. [D 20:43:07.211007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 31055. [D 20:43:07.211017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 31056. [D 20:43:07.211031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 31057. [D 20:43:07.211054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 31058. [D 20:43:07.211066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 31059. [D 20:43:07.211075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 31060. [D 20:43:07.211086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 31061. [D 20:43:07.211099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 31062. [D 20:43:07.211108] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 31063. [D 20:43:07.211134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 31064. [D 20:43:07.211145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 31065. [D 20:43:07.211155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 31066. [D 20:43:07.211181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 31067. [D 20:43:07.211192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 31068. [D 20:43:07.211202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 31069. [D 20:43:07.211212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 31070. [D 20:43:07.211223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 31071. [D 20:43:07.211233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 31072. [D 20:43:07.211243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 31073. [D 20:43:07.211275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 31074. [D 20:43:07.211286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 31075. [D 20:43:07.211296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 31076. [D 20:43:07.211320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 31077. [D 20:43:07.211330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 31078. [D 20:43:07.211343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 31079. [D 20:43:07.211353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 31080. [D 20:43:07.211363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 31081. [D 20:43:07.211379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 31082. [D 20:43:07.211398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 31083. [D 20:43:07.211408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 31084. [D 20:43:07.211425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 31085. [D 20:43:07.211434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 31086. [D 20:43:07.211444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 31087. [D 20:43:07.211459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 31088. [D 20:43:07.211482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 31089. [D 20:43:07.211495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 31090. [D 20:43:07.211505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 31091. [D 20:43:07.211515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 31092. [D 20:43:07.211528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 31093. [D 20:43:07.211538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 31094. [D 20:43:07.211565] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 31095. [D 20:43:07.221573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.221588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.221600] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:07.221633] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5434 [D 20:43:07.221644] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:07.221654] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 49/70. [D 20:43:07.221675] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.221685] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.221694] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:07.221708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5437 [D 20:43:07.221719] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:07.221728] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 50/70. [D 20:43:07.222407] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 31095. [D 20:43:07.222421] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 51/70. [D 20:43:07.233955] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 31094. [D 20:43:07.233970] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 52/70. [D 20:43:07.236310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.236323] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.236333] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:07.236412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.236425] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.236433] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:07.238730] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5434 [D 20:43:07.238798] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 53/70. [D 20:43:07.239413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 31094. [D 20:43:07.239429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 31095. [D 20:43:07.239440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 31096. [D 20:43:07.239451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 31097. [D 20:43:07.239461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 31098. [D 20:43:07.239474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 31099. [D 20:43:07.239484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 31100. [D 20:43:07.239494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 31101. [D 20:43:07.239510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 31102. [D 20:43:07.239519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 31103. [D 20:43:07.239529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 31104. [D 20:43:07.239545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 31105. [D 20:43:07.239555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 31106. [D 20:43:07.239564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 31107. [D 20:43:07.239581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 31108. [D 20:43:07.239591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 31109. [D 20:43:07.239600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 31110. [D 20:43:07.239616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 31111. [D 20:43:07.239626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 31112. [D 20:43:07.239635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 31113. [D 20:43:07.239667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 31114. [D 20:43:07.239685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 31115. [D 20:43:07.239695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 31116. [D 20:43:07.239705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 31117. [D 20:43:07.239720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 31118. [D 20:43:07.239730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 31119. [D 20:43:07.239740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 31120. [D 20:43:07.239749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 31121. [D 20:43:07.239767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 31122. [D 20:43:07.239777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 31123. [D 20:43:07.239787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 31124. [D 20:43:07.239796] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 31125. [D 20:43:07.242163] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5437 [D 20:43:07.242179] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 54/70. [D 20:43:07.250421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.250437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.250447] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:07.250480] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5441 [D 20:43:07.250491] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:07.250502] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 55/70. [D 20:43:07.250522] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.250533] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.250541] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:07.250555] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5443 [D 20:43:07.250565] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:07.250574] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 56/70. [D 20:43:07.251117] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 31125. [D 20:43:07.251131] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 57/70. [D 20:43:07.251162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 31125. [D 20:43:07.251174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 31126. [D 20:43:07.251184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 31127. [D 20:43:07.251198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 31128. [D 20:43:07.251207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 31129. [D 20:43:07.251218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 31130. [D 20:43:07.251231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 31131. [D 20:43:07.251240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 31132. [D 20:43:07.251250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 31133. [D 20:43:07.251281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 31134. [D 20:43:07.251292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 31135. [D 20:43:07.251302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 31136. [D 20:43:07.251312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 31137. [D 20:43:07.251322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 31138. [D 20:43:07.251333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 31139. [D 20:43:07.251343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 31140. [D 20:43:07.251352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 31141. [D 20:43:07.251377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 31142. [D 20:43:07.251387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 31143. [D 20:43:07.251396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 31144. [D 20:43:07.251416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 31145. [D 20:43:07.251426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 31146. [D 20:43:07.251437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 31147. [D 20:43:07.251446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 31148. [D 20:43:07.251456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 31149. [D 20:43:07.251577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 31150. [D 20:43:07.251589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 31151. [D 20:43:07.251599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 31152. [D 20:43:07.251609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 31153. [D 20:43:07.251618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 31154. [D 20:43:07.251628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 31155. [D 20:43:07.251638] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 31156. [D 20:43:07.251677] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.251687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.251696] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:07.255973] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5443 [D 20:43:07.255990] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 58/70. [D 20:43:07.256002] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5441 [D 20:43:07.256013] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 59/70. [D 20:43:07.262832] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 31156. [D 20:43:07.262847] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 60/70. [D 20:43:07.262897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 31156. [D 20:43:07.262911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 31157. [D 20:43:07.262921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 31158. [D 20:43:07.262931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 31159. [D 20:43:07.262942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 31160. [D 20:43:07.262952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 31161. [D 20:43:07.262962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 31162. [D 20:43:07.262971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 31163. [D 20:43:07.262987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 31164. [D 20:43:07.262997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 31165. [D 20:43:07.263007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 31166. [D 20:43:07.263017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 31167. [D 20:43:07.263027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 31168. [D 20:43:07.263037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 31169. [D 20:43:07.263047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 31170. [D 20:43:07.263057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 31171. [D 20:43:07.263067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 31172. [D 20:43:07.263077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 31173. [D 20:43:07.263087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 31174. [D 20:43:07.263097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 31175. [D 20:43:07.263107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 31176. [D 20:43:07.263117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 31177. [D 20:43:07.263127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 31178. [D 20:43:07.263137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 31179. [D 20:43:07.263172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 31180. [D 20:43:07.263182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 31181. [D 20:43:07.263192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 31182. [D 20:43:07.263202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 31183. [D 20:43:07.263218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 31184. [D 20:43:07.263241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 31185. [D 20:43:07.263255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 31186. [D 20:43:07.263265] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 31187. [D 20:43:07.263276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 31188. [D 20:43:07.263289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 31189. [D 20:43:07.263299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 31190. [D 20:43:07.263309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 31191. [D 20:43:07.263337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 31192. [D 20:43:07.263348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 31193. [D 20:43:07.263358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 31194. [D 20:43:07.263368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 31195. [D 20:43:07.263377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 31196. [D 20:43:07.263401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 31197. [D 20:43:07.263412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 31198. [D 20:43:07.263429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.263446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.263455] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:07.263504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 31199. [D 20:43:07.263515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 31200. [D 20:43:07.263529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 31201. [D 20:43:07.263557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 31202. [D 20:43:07.263567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 31203. [D 20:43:07.263577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 31204. [D 20:43:07.263593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 31205. [D 20:43:07.263603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 31206. [D 20:43:07.263613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 31207. [D 20:43:07.263629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 31208. [D 20:43:07.263638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 31209. [D 20:43:07.263648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 31210. [D 20:43:07.263673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 31211. [D 20:43:07.263683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 31212. [D 20:43:07.263693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 31213. [D 20:43:07.263704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 31214. [D 20:43:07.263713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 31215. [D 20:43:07.263724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 31216. [D 20:43:07.263747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 31217. [D 20:43:07.263758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 31218. [D 20:43:07.263771] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 31219. [D 20:43:07.268832] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 31219. [D 20:43:07.268882] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 0/70. [D 20:43:07.275592] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 31218. [D 20:43:07.275610] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 1/70. [D 20:43:07.278544] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.278557] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.278567] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:07.278582] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.278591] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.278604] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:07.278618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.278627] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.278636] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:07.278651] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5446 [D 20:43:07.278660] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:07.278674] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 2/70. [D 20:43:07.278689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.278699] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.278707] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:07.278720] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5449 [D 20:43:07.278734] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:07.278764] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 3/70. [D 20:43:07.283453] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5446 [D 20:43:07.283530] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 4/70. [D 20:43:07.283676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 31218. [D 20:43:07.283707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 31219. [D 20:43:07.283760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 31220. [D 20:43:07.283772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 31221. [D 20:43:07.283782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 31222. [D 20:43:07.283794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 31223. [D 20:43:07.283810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 31224. [D 20:43:07.283834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 31225. [D 20:43:07.283849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 31226. [D 20:43:07.283858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 31227. [D 20:43:07.283868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 31228. [D 20:43:07.283882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 31229. [D 20:43:07.283892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 31230. [D 20:43:07.283901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 31231. [D 20:43:07.283918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 31232. [D 20:43:07.283950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 31233. [D 20:43:07.283960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 31234. [D 20:43:07.283970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 31235. [D 20:43:07.284025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 31236. [D 20:43:07.284038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 31237. [D 20:43:07.284048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 31238. [D 20:43:07.284062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 31239. [D 20:43:07.284071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 31240. [D 20:43:07.284081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 31241. [D 20:43:07.284096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 31242. [D 20:43:07.284105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 31243. [D 20:43:07.284115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 31244. [D 20:43:07.284146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 31245. [D 20:43:07.284156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 31246. [D 20:43:07.284167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 31247. [D 20:43:07.284191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 31248. [D 20:43:07.284201] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 31249. [D 20:43:07.286482] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5449 [D 20:43:07.286498] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 5/70. [D 20:43:07.292359] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 31249. [D 20:43:07.292374] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 6/70. [D 20:43:07.294628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 31249. [D 20:43:07.294642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 31250. [D 20:43:07.294654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 31251. [D 20:43:07.294664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 31252. [D 20:43:07.294700] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.294720] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.294730] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:07.294750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 31253. [D 20:43:07.294761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 31254. [D 20:43:07.294771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 31255. [D 20:43:07.294804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 31256. [D 20:43:07.294814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 31257. [D 20:43:07.294823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 31258. [D 20:43:07.294838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 31259. [D 20:43:07.294849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 31260. [D 20:43:07.294858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 31261. [D 20:43:07.294874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 31262. [D 20:43:07.294884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 31263. [D 20:43:07.294894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 31264. [D 20:43:07.294919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 31265. [D 20:43:07.294928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 31266. [D 20:43:07.294943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 31267. [D 20:43:07.294952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 31268. [D 20:43:07.294963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 31269. [D 20:43:07.294990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 31270. [D 20:43:07.295000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 31271. [D 20:43:07.295013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 31272. [D 20:43:07.295022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 31273. [D 20:43:07.295032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 31274. [D 20:43:07.295057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 31275. [D 20:43:07.295067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 31276. [D 20:43:07.295080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 31277. [D 20:43:07.295090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 31278. [D 20:43:07.295102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 31279. [D 20:43:07.295125] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 31280. [D 20:43:07.304919] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 31280. [D 20:43:07.304933] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 7/70. [D 20:43:07.306594] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.306608] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.306618] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:07.306648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5453 [D 20:43:07.306659] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:07.306670] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 8/70. [D 20:43:07.306688] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.306697] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.306708] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:07.306722] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5455 [D 20:43:07.306732] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:07.306742] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 9/70. [D 20:43:07.306774] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.306784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.306796] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:07.311906] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5455 [D 20:43:07.311977] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 10/70. [D 20:43:07.312004] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5453 [D 20:43:07.312023] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 11/70. [D 20:43:07.312059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 31280. [D 20:43:07.312073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 31281. [D 20:43:07.312083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 31282. [D 20:43:07.312093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 31283. [D 20:43:07.312110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 31284. [D 20:43:07.312120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 31285. [D 20:43:07.312130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 31286. [D 20:43:07.312140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 31287. [D 20:43:07.312192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 31288. [D 20:43:07.312203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 31289. [D 20:43:07.312213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 31290. [D 20:43:07.312223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 31291. [D 20:43:07.312232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 31292. [D 20:43:07.312242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 31293. [D 20:43:07.312253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 31294. [D 20:43:07.312267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 31295. [D 20:43:07.312277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 31296. [D 20:43:07.312287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 31297. [D 20:43:07.312296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 31298. [D 20:43:07.312307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 31299. [D 20:43:07.312320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 31300. [D 20:43:07.312329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 31301. [D 20:43:07.312339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 31302. [D 20:43:07.312349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 31303. [D 20:43:07.312362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 31304. [D 20:43:07.312372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 31305. [D 20:43:07.312381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 31306. [D 20:43:07.312391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 31307. [D 20:43:07.312401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 31308. [D 20:43:07.312412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 31309. [D 20:43:07.312422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 31310. [D 20:43:07.312448] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 31311. [D 20:43:07.312463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 31312. [D 20:43:07.312473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 31313. [D 20:43:07.312484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 31314. [D 20:43:07.312494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 31315. [D 20:43:07.312504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 31316. [D 20:43:07.312514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 31317. [D 20:43:07.312524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 31318. [D 20:43:07.312534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 31319. [D 20:43:07.312544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 31320. [D 20:43:07.312553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 31321. [D 20:43:07.312573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 31322. [D 20:43:07.312582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 31323. [D 20:43:07.312609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 31324. [D 20:43:07.312620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 31325. [D 20:43:07.312629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 31326. [D 20:43:07.312645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 31327. [D 20:43:07.312655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 31328. [D 20:43:07.312665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 31329. [D 20:43:07.312681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 31330. [D 20:43:07.312691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 31331. [D 20:43:07.312701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 31332. [D 20:43:07.312710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 31333. [D 20:43:07.312728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 31334. [D 20:43:07.312738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 31335. [D 20:43:07.312762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 31336. [D 20:43:07.312774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 31337. [D 20:43:07.312783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 31338. [D 20:43:07.312794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 31339. [D 20:43:07.312804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 31340. [D 20:43:07.312814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 31341. [D 20:43:07.312824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 31342. [D 20:43:07.312853] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 31343. [D 20:43:07.318012] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 31343. [D 20:43:07.318026] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 12/70. [D 20:43:07.323903] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 31342. [D 20:43:07.323917] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 13/70. [D 20:43:07.326200] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.326215] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.326225] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:07.326242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.326254] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.326262] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:07.609136] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.609151] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.609162] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:07.609192] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5457 [D 20:43:07.609203] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:07.609214] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 14/70. [D 20:43:07.611304] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5457 [D 20:43:07.611357] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 15/70. [D 20:43:07.611361] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.611420] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.611434] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:07.611469] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5461 [D 20:43:07.611480] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:07.611494] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 16/70. [D 20:43:07.611572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 31342. [D 20:43:07.611588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 31343. [D 20:43:07.611612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 31344. [D 20:43:07.611623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 31345. [D 20:43:07.611644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 31346. [D 20:43:07.611655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 31347. [D 20:43:07.611665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 31348. [D 20:43:07.611675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 31349. [D 20:43:07.611693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 31350. [D 20:43:07.611703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 31351. [D 20:43:07.611713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 31352. [D 20:43:07.611739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 31353. [D 20:43:07.611755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 31354. [D 20:43:07.611776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 31355. [D 20:43:07.611786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 31356. [D 20:43:07.611796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 31357. [D 20:43:07.611806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 31358. [D 20:43:07.611828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 31359. [D 20:43:07.611838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 31360. [D 20:43:07.611848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 31361. [D 20:43:07.611873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 31362. [D 20:43:07.611884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 31363. [D 20:43:07.611903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 31364. [D 20:43:07.611913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 31365. [D 20:43:07.611924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 31366. [D 20:43:07.611934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 31367. [D 20:43:07.611943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 31368. [D 20:43:07.611953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 31369. [D 20:43:07.611964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 31370. [D 20:43:07.611973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 31371. [D 20:43:07.611983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 31372. [D 20:43:07.612007] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 31373. [D 20:43:07.614100] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5461 [D 20:43:07.614155] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 17/70. [D 20:43:07.617562] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 31373. [D 20:43:07.617581] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 18/70. [D 20:43:07.617600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 31373. [D 20:43:07.617610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 31374. [D 20:43:07.617624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 31375. [D 20:43:07.617634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 31376. [D 20:43:07.617646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 31377. [D 20:43:07.617661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 31378. [D 20:43:07.617671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 31379. [D 20:43:07.617681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 31380. [D 20:43:07.617697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 31381. [D 20:43:07.617707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 31382. [D 20:43:07.617717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 31383. [D 20:43:07.617733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 31384. [D 20:43:07.617742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 31385. [D 20:43:07.617752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 31386. [D 20:43:07.617780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 31387. [D 20:43:07.617791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 31388. [D 20:43:07.617805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 31389. [D 20:43:07.617815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 31390. [D 20:43:07.617825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 31391. [D 20:43:07.617852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 31392. [D 20:43:07.617862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 31393. [D 20:43:07.617874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 31394. [D 20:43:07.617888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 31395. [D 20:43:07.617898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 31396. [D 20:43:07.617920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 31397. [D 20:43:07.617935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 31398. [D 20:43:07.617944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 31399. [D 20:43:07.617954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 31400. [D 20:43:07.617970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 31401. [D 20:43:07.617980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 31402. [D 20:43:07.617989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 31403. [D 20:43:07.618016] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 31404. [D 20:43:07.620326] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.620340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.620351] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:07.629257] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 31404. [D 20:43:07.629274] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 19/70. [D 20:43:07.630620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.630633] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.630643] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:07.639796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.639811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.639821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:07.639835] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5464 [D 20:43:07.639846] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:07.639856] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 20/70. [D 20:43:07.642252] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5464 [D 20:43:07.642272] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 21/70. [D 20:43:07.647923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 31404. [D 20:43:07.647985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 31405. [D 20:43:07.647998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 31406. [D 20:43:07.648008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 31407. [D 20:43:07.648019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 31408. [D 20:43:07.648029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 31409. [D 20:43:07.648039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 31410. [D 20:43:07.648049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 31411. [D 20:43:07.648059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 31412. [D 20:43:07.648069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 31413. [D 20:43:07.648079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 31414. [D 20:43:07.648096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 31415. [D 20:43:07.648105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 31416. [D 20:43:07.648115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 31417. [D 20:43:07.648125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 31418. [D 20:43:07.648136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 31419. [D 20:43:07.648146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 31420. [D 20:43:07.648155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 31421. [D 20:43:07.648166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 31422. [D 20:43:07.648180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 31423. [D 20:43:07.648190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 31424. [D 20:43:07.648199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 31425. [D 20:43:07.648209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 31426. [D 20:43:07.648227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 31427. [D 20:43:07.648254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 31428. [D 20:43:07.648267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 31429. [D 20:43:07.648277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 31430. [D 20:43:07.648287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 31431. [D 20:43:07.648300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 31432. [D 20:43:07.648310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 31433. [D 20:43:07.648319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 31434. [D 20:43:07.648335] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 31435. [D 20:43:07.654004] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 31435. [D 20:43:07.654020] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 22/70. [D 20:43:07.656301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.656317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.656327] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:07.662627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.662642] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.662653] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:07.662684] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5467 [D 20:43:07.662695] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:07.664387] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 23/70. [D 20:43:07.664411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.664421] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.664430] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:07.664446] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5470 [D 20:43:07.664456] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:07.664469] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 24/70. [D 20:43:07.668967] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5467 [D 20:43:07.669027] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 25/70. [D 20:43:07.669047] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5470 [D 20:43:07.669058] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 26/70. [D 20:43:07.670754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 31435. [D 20:43:07.670814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 31436. [D 20:43:07.670825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 31437. [D 20:43:07.670835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 31438. [D 20:43:07.670845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 31439. [D 20:43:07.670856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 31440. [D 20:43:07.670866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 31441. [D 20:43:07.670876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 31442. [D 20:43:07.670886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 31443. [D 20:43:07.670896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 31444. [D 20:43:07.670906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 31445. [D 20:43:07.670915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 31446. [D 20:43:07.670925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 31447. [D 20:43:07.670935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 31448. [D 20:43:07.670945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 31449. [D 20:43:07.670955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 31450. [D 20:43:07.670965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 31451. [D 20:43:07.670975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 31452. [D 20:43:07.670985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 31453. [D 20:43:07.670994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 31454. [D 20:43:07.671004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 31455. [D 20:43:07.671034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 31456. [D 20:43:07.671044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 31457. [D 20:43:07.671055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 31458. [D 20:43:07.671065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 31459. [D 20:43:07.671075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 31460. [D 20:43:07.671085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 31461. [D 20:43:07.671111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 31462. [D 20:43:07.671121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 31463. [D 20:43:07.671130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 31464. [D 20:43:07.671146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 31465. [D 20:43:07.671167] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 31466. [D 20:43:07.671182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 31467. [D 20:43:07.671192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 31468. [D 20:43:07.671201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 31469. [D 20:43:07.671212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 31470. [D 20:43:07.671221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 31471. [D 20:43:07.671231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 31472. [D 20:43:07.671241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 31473. [D 20:43:07.671276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 31474. [D 20:43:07.671286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 31475. [D 20:43:07.671296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 31476. [D 20:43:07.671310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 31477. [D 20:43:07.671320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 31478. [D 20:43:07.671339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 31479. [D 20:43:07.671356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 31480. [D 20:43:07.671366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 31481. [D 20:43:07.671376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 31482. [D 20:43:07.671386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 31483. [D 20:43:07.671402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 31484. [D 20:43:07.671426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 31485. [D 20:43:07.671437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 31486. [D 20:43:07.671447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 31487. [D 20:43:07.671457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 31488. [D 20:43:07.671467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 31489. [D 20:43:07.671477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 31490. [D 20:43:07.671487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 31491. [D 20:43:07.671497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 31492. [D 20:43:07.671534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 31493. [D 20:43:07.671556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 31494. [D 20:43:07.671566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 31495. [D 20:43:07.671576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 31496. [D 20:43:07.671586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 31497. [D 20:43:07.671596] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 31498. [D 20:43:07.675754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.675769] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.675780] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:07.675813] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5473 [D 20:43:07.675824] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:07.675839] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 27/70. [D 20:43:07.682496] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 31498. [D 20:43:07.682512] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 28/70. [D 20:43:07.694017] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 31497. [D 20:43:07.694031] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 29/70. [D 20:43:07.696346] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.696359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.696369] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:07.696417] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.696427] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.696436] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:07.698577] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5473 [D 20:43:07.698641] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 30/70. [D 20:43:07.700354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 31497. [D 20:43:07.700371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 31498. [D 20:43:07.700383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 31499. [D 20:43:07.700393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 31500. [D 20:43:07.700408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 31501. [D 20:43:07.700419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 31502. [D 20:43:07.700429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 31503. [D 20:43:07.700439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 31504. [D 20:43:07.700450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 31505. [D 20:43:07.700459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 31506. [D 20:43:07.700469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 31507. [D 20:43:07.700493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 31508. [D 20:43:07.700503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 31509. [D 20:43:07.700513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 31510. [D 20:43:07.700528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 31511. [D 20:43:07.700537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 31512. [D 20:43:07.700547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 31513. [D 20:43:07.700571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 31514. [D 20:43:07.700581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 31515. [D 20:43:07.700591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 31516. [D 20:43:07.700601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 31517. [D 20:43:07.700611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 31518. [D 20:43:07.700621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 31519. [D 20:43:07.700646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 31520. [D 20:43:07.700656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 31521. [D 20:43:07.700666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 31522. [D 20:43:07.700677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 31523. [D 20:43:07.700687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 31524. [D 20:43:07.700697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 31525. [D 20:43:07.700707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 31526. [D 20:43:07.700730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 31527. [D 20:43:07.700740] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 31528. [D 20:43:07.711489] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.711503] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.711514] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:07.711528] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5476 [D 20:43:07.711538] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:07.711549] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 31/70. [D 20:43:07.711564] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.711576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.711584] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:07.711598] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5479 [D 20:43:07.711607] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:07.711617] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 32/70. [D 20:43:07.712085] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 31528. [D 20:43:07.712099] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 33/70. [D 20:43:07.714412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.714425] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.714434] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:07.717234] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5479 [D 20:43:07.717286] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 34/70. [D 20:43:07.717303] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5476 [D 20:43:07.717314] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 35/70. [D 20:43:07.717951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 31528. [D 20:43:07.717998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 31529. [D 20:43:07.718008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 31530. [D 20:43:07.718018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 31531. [D 20:43:07.718029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 31532. [D 20:43:07.718039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 31533. [D 20:43:07.718048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 31534. [D 20:43:07.718058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 31535. [D 20:43:07.718074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 31536. [D 20:43:07.718084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 31537. [D 20:43:07.718093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 31538. [D 20:43:07.718133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 31539. [D 20:43:07.718143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 31540. [D 20:43:07.718153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 31541. [D 20:43:07.718162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 31542. [D 20:43:07.718215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 31543. [D 20:43:07.718229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 31544. [D 20:43:07.718239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 31545. [D 20:43:07.718249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 31546. [D 20:43:07.718262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 31547. [D 20:43:07.718272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 31548. [D 20:43:07.718281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 31549. [D 20:43:07.718298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 31550. [D 20:43:07.718307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 31551. [D 20:43:07.718317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 31552. [D 20:43:07.718343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 31553. [D 20:43:07.718353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 31554. [D 20:43:07.718376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 31555. [D 20:43:07.718386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 31556. [D 20:43:07.718401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 31557. [D 20:43:07.718410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 31558. [D 20:43:07.718420] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 31559. [D 20:43:07.718453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 31560. [D 20:43:07.718469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 31561. [D 20:43:07.718479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 31562. [D 20:43:07.718489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 31563. [D 20:43:07.718517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 31564. [D 20:43:07.718528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 31565. [D 20:43:07.718537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 31566. [D 20:43:07.718548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 31567. [D 20:43:07.718558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 31568. [D 20:43:07.718578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 31569. [D 20:43:07.718589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 31570. [D 20:43:07.718600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 31571. [D 20:43:07.718609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 31572. [D 20:43:07.718626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 31573. [D 20:43:07.718636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 31574. [D 20:43:07.718645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 31575. [D 20:43:07.718675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 31576. [D 20:43:07.718685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 31577. [D 20:43:07.718694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 31578. [D 20:43:07.718709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 31579. [D 20:43:07.718719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 31580. [D 20:43:07.718728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 31581. [D 20:43:07.718744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 31582. [D 20:43:07.718754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 31583. [D 20:43:07.718763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 31584. [D 20:43:07.718779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 31585. [D 20:43:07.718808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 31586. [D 20:43:07.718818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 31587. [D 20:43:07.718828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 31588. [D 20:43:07.718843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 31589. [D 20:43:07.718866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 31590. [D 20:43:07.718876] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 31591. [D 20:43:07.722997] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.723013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.723023] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:07.723058] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5482 [D 20:43:07.723069] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:07.723084] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 36/70. [D 20:43:07.729653] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 31591. [D 20:43:07.729668] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 37/70. [D 20:43:07.741173] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 31590. [D 20:43:07.741188] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 38/70. [D 20:43:07.743502] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.743515] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.743526] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:07.743585] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.743598] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.743607] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:07.745621] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5482 [D 20:43:07.745641] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 39/70. [D 20:43:07.747386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 31590. [D 20:43:07.747437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 31591. [D 20:43:07.747448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 31592. [D 20:43:07.747459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 31593. [D 20:43:07.747474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 31594. [D 20:43:07.747484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 31595. [D 20:43:07.747494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 31596. [D 20:43:07.747508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 31597. [D 20:43:07.747518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 31598. [D 20:43:07.747527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 31599. [D 20:43:07.747543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 31600. [D 20:43:07.747553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 31601. [D 20:43:07.747563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 31602. [D 20:43:07.747578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 31603. [D 20:43:07.747588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 31604. [D 20:43:07.747598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 31605. [D 20:43:07.747641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 31606. [D 20:43:07.747654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 31607. [D 20:43:07.747664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 31608. [D 20:43:07.747692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 31609. [D 20:43:07.747703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 31610. [D 20:43:07.747714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 31611. [D 20:43:07.747724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 31612. [D 20:43:07.747734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 31613. [D 20:43:07.747744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 31614. [D 20:43:07.747755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 31615. [D 20:43:07.747765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 31616. [D 20:43:07.747777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 31617. [D 20:43:07.747804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 31618. [D 20:43:07.747814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 31619. [D 20:43:07.747824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 31620. [D 20:43:07.747834] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 31621. [D 20:43:07.755905] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 31621. [D 20:43:07.755922] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 40/70. [D 20:43:07.758190] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.758205] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.758215] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:07.758249] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5484 [D 20:43:07.758260] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:07.758273] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 41/70. [D 20:43:07.758305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.758316] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.758325] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:07.762709] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5484 [D 20:43:07.762766] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 42/70. [D 20:43:07.762819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 31621. [D 20:43:07.762837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 31622. [D 20:43:07.762847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 31623. [D 20:43:07.762857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 31624. [D 20:43:07.762867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 31625. [D 20:43:07.762877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 31626. [D 20:43:07.762889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 31627. [D 20:43:07.762912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 31628. [D 20:43:07.762922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 31629. [D 20:43:07.762931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 31630. [D 20:43:07.762941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 31631. [D 20:43:07.762951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 31632. [D 20:43:07.762982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 31633. [D 20:43:07.762991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 31634. [D 20:43:07.763002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 31635. [D 20:43:07.763012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 31636. [D 20:43:07.763022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 31637. [D 20:43:07.763033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 31638. [D 20:43:07.763043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 31639. [D 20:43:07.763053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 31640. [D 20:43:07.763063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 31641. [D 20:43:07.763081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 31642. [D 20:43:07.763091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 31643. [D 20:43:07.763101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 31644. [D 20:43:07.763111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 31645. [D 20:43:07.763121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 31646. [D 20:43:07.763130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 31647. [D 20:43:07.763165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 31648. [D 20:43:07.763176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 31649. [D 20:43:07.763186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 31650. [D 20:43:07.763196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 31651. [D 20:43:07.763206] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 31652. [D 20:43:07.768702] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 31652. [D 20:43:07.768716] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 43/70. [D 20:43:07.770961] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.770974] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.770984] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:07.778963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.778977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.778987] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:07.779002] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5488 [D 20:43:07.779012] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:07.779022] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 44/70. [D 20:43:07.783264] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5488 [D 20:43:07.783282] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 45/70. [D 20:43:07.783343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 31652. [D 20:43:07.783405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 31653. [D 20:43:07.783416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 31654. [D 20:43:07.783461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 31655. [D 20:43:07.783474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 31656. [D 20:43:07.783485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 31657. [D 20:43:07.783495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 31658. [D 20:43:07.783506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 31659. [D 20:43:07.783516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 31660. [D 20:43:07.783526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 31661. [D 20:43:07.783542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 31662. [D 20:43:07.783568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 31663. [D 20:43:07.783579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 31664. [D 20:43:07.783589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 31665. [D 20:43:07.783599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 31666. [D 20:43:07.783610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 31667. [D 20:43:07.783633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 31668. [D 20:43:07.783648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 31669. [D 20:43:07.783659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 31670. [D 20:43:07.783669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 31671. [D 20:43:07.783680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 31672. [D 20:43:07.783690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 31673. [D 20:43:07.783700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 31674. [D 20:43:07.783709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 31675. [D 20:43:07.783719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 31676. [D 20:43:07.783739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 31677. [D 20:43:07.783748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 31678. [D 20:43:07.783780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 31679. [D 20:43:07.783791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 31680. [D 20:43:07.783801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 31681. [D 20:43:07.783811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 31682. [D 20:43:07.783821] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 31683. [D 20:43:07.789258] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 31683. [D 20:43:07.789274] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 46/70. [D 20:43:07.790655] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.790670] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.790681] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:07.881605] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:07.881620] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.881631] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:07.881663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5491 [D 20:43:07.881674] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:07.881691] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 47/70. [D 20:43:07.886228] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5491 [D 20:43:07.886283] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 48/70. [D 20:43:07.886332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 31683. [D 20:43:07.886349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 31684. [D 20:43:07.886362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 31685. [D 20:43:07.886372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 31686. [D 20:43:07.886382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 31687. [D 20:43:07.886392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 31688. [D 20:43:07.886402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 31689. [D 20:43:07.886412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 31690. [D 20:43:07.886428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 31691. [D 20:43:07.886444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 31692. [D 20:43:07.886455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 31693. [D 20:43:07.886464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 31694. [D 20:43:07.886474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 31695. [D 20:43:07.886494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 31696. [D 20:43:07.886517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 31697. [D 20:43:07.886527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 31698. [D 20:43:07.886538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 31699. [D 20:43:07.886548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 31700. [D 20:43:07.886558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 31701. [D 20:43:07.886568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 31702. [D 20:43:07.886580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 31703. [D 20:43:07.886590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 31704. [D 20:43:07.886600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 31705. [D 20:43:07.886622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 31706. [D 20:43:07.886636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 31707. [D 20:43:07.886646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 31708. [D 20:43:07.886656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 31709. [D 20:43:07.886666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 31710. [D 20:43:07.886676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 31711. [D 20:43:07.886686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 31712. [D 20:43:07.886696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 31713. [D 20:43:07.886718] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 31714. [D 20:43:07.892203] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 31714. [D 20:43:07.892218] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 49/70. [D 20:43:07.894430] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:07.894443] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:07.894453] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:08.069723] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.069738] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.069750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:08.069765] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5495 [D 20:43:08.069775] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:08.069784] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 50/70. [D 20:43:08.069801] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.069815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.069824] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:08.069838] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5497 [D 20:43:08.069847] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:08.069857] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 51/70. [D 20:43:08.075047] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5497 [D 20:43:08.075102] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 52/70. [D 20:43:08.075140] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5495 [D 20:43:08.075152] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 53/70. [D 20:43:08.075249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 31714. [D 20:43:08.075311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 31715. [D 20:43:08.075323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 31716. [D 20:43:08.075334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 31717. [D 20:43:08.075349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 31718. [D 20:43:08.075359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 31719. [D 20:43:08.075369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 31720. [D 20:43:08.075422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 31721. [D 20:43:08.075446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 31722. [D 20:43:08.075467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 31723. [D 20:43:08.075478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 31724. [D 20:43:08.075493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 31725. [D 20:43:08.075503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 31726. [D 20:43:08.075512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 31727. [D 20:43:08.075526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 31728. [D 20:43:08.075550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 31729. [D 20:43:08.075565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 31730. [D 20:43:08.075575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 31731. [D 20:43:08.075598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 31732. [D 20:43:08.075618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 31733. [D 20:43:08.075632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 31734. [D 20:43:08.075642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 31735. [D 20:43:08.075655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 31736. [D 20:43:08.075670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 31737. [D 20:43:08.075680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 31738. [D 20:43:08.075689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 31739. [D 20:43:08.075705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 31740. [D 20:43:08.075715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 31741. [D 20:43:08.075743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 31742. [D 20:43:08.075758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 31743. [D 20:43:08.075768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 31744. [D 20:43:08.075778] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 31745. [D 20:43:08.075792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 31746. [D 20:43:08.075802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 31747. [D 20:43:08.075812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 31748. [D 20:43:08.075822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 31749. [D 20:43:08.075834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 31750. [D 20:43:08.075843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 31751. [D 20:43:08.075853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 31752. [D 20:43:08.075883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 31753. [D 20:43:08.075893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 31754. [D 20:43:08.075907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 31755. [D 20:43:08.075917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 31756. [D 20:43:08.075927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 31757. [D 20:43:08.075941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 31758. [D 20:43:08.075951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 31759. [D 20:43:08.075961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 31760. [D 20:43:08.075992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 31761. [D 20:43:08.076003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 31762. [D 20:43:08.076014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 31763. [D 20:43:08.076024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 31764. [D 20:43:08.076039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 31765. [D 20:43:08.076049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 31766. [D 20:43:08.076059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 31767. [D 20:43:08.076075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 31768. [D 20:43:08.076085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 31769. [D 20:43:08.076095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 31770. [D 20:43:08.076122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 31771. [D 20:43:08.076132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 31772. [D 20:43:08.076145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 31773. [D 20:43:08.076155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 31774. [D 20:43:08.076164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 31775. [D 20:43:08.076181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 31776. [D 20:43:08.076191] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 31777. [D 20:43:08.086917] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 31777. [D 20:43:08.086933] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 54/70. [D 20:43:08.095672] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 31776. [D 20:43:08.095686] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 55/70. [D 20:43:08.098009] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.098024] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.098034] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:08.098051] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.098063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.098071] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:08.110667] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.110681] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.110692] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:08.110723] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5501 [D 20:43:08.110734] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:08.112958] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 56/70. [D 20:43:08.112979] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.112992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.113001] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:08.113018] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5503 [D 20:43:08.113028] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:08.113038] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 57/70. [D 20:43:08.118150] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5503 [D 20:43:08.118207] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 58/70. [D 20:43:08.118355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 31776. [D 20:43:08.118416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 31777. [D 20:43:08.118427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 31778. [D 20:43:08.118437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 31779. [D 20:43:08.118447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 31780. [D 20:43:08.118463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 31781. [D 20:43:08.118473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 31782. [D 20:43:08.118483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 31783. [D 20:43:08.118493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 31784. [D 20:43:08.118503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 31785. [D 20:43:08.118513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 31786. [D 20:43:08.118523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 31787. [D 20:43:08.118572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 31788. [D 20:43:08.118588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 31789. [D 20:43:08.118599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 31790. [D 20:43:08.118609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 31791. [D 20:43:08.118619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 31792. [D 20:43:08.118629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 31793. [D 20:43:08.118639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 31794. [D 20:43:08.118681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 31795. [D 20:43:08.118692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 31796. [D 20:43:08.118702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 31797. [D 20:43:08.118722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 31798. [D 20:43:08.118732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 31799. [D 20:43:08.118742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 31800. [D 20:43:08.118752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 31801. [D 20:43:08.118761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 31802. [D 20:43:08.118787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 31803. [D 20:43:08.118797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 31804. [D 20:43:08.118807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 31805. [D 20:43:08.118817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 31806. [D 20:43:08.118827] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 31807. [D 20:43:08.118915] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5501 [D 20:43:08.118935] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 59/70. [D 20:43:08.130027] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 31807. [D 20:43:08.130047] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 60/70. [D 20:43:08.130073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 31807. [D 20:43:08.130086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 31808. [D 20:43:08.130096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 31809. [D 20:43:08.130106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 31810. [D 20:43:08.130117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 31811. [D 20:43:08.130127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 31812. [D 20:43:08.130137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 31813. [D 20:43:08.130148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 31814. [D 20:43:08.130158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 31815. [D 20:43:08.130168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 31816. [D 20:43:08.130186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 31817. [D 20:43:08.130196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 31818. [D 20:43:08.130206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 31819. [D 20:43:08.130216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 31820. [D 20:43:08.130226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 31821. [D 20:43:08.130236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 31822. [D 20:43:08.130246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 31823. [D 20:43:08.130262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 31824. [D 20:43:08.130272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 31825. [D 20:43:08.130282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 31826. [D 20:43:08.130320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 31827. [D 20:43:08.130333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 31828. [D 20:43:08.130343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 31829. [D 20:43:08.130353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 31830. [D 20:43:08.130364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 31831. [D 20:43:08.130374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 31832. [D 20:43:08.130384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 31833. [D 20:43:08.130394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 31834. [D 20:43:08.130404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 31835. [D 20:43:08.130414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 31836. [D 20:43:08.130439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 31837. [D 20:43:08.130449] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 31838. [D 20:43:08.132785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.132800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.132810] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:08.140294] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 31838. [D 20:43:08.140308] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 0/70. [D 20:43:08.142579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.142592] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.142602] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:08.155869] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.155883] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.155894] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:08.155924] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5507 [D 20:43:08.155934] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:08.155946] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 1/70. [D 20:43:08.155964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.155977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.155986] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:08.156000] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5509 [D 20:43:08.156010] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:08.156019] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 2/70. [D 20:43:08.161163] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5507 [D 20:43:08.161217] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 3/70. [D 20:43:08.161240] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.161298] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.161308] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.161342] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5512 [D 20:43:08.161353] element 0: offset: 0x2aaaab203d30, size: 24 [D 20:43:08.161373] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 4/70. [D 20:43:08.161405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 31838. [D 20:43:08.161418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 31839. [D 20:43:08.161428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 31840. [D 20:43:08.161439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 31841. [D 20:43:08.161486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 31842. [D 20:43:08.161496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 31843. [D 20:43:08.161508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 31844. [D 20:43:08.161517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 31845. [D 20:43:08.161543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 31846. [D 20:43:08.161553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 31847. [D 20:43:08.161563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 31848. [D 20:43:08.161573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 31849. [D 20:43:08.161583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 31850. [D 20:43:08.161593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 31851. [D 20:43:08.161619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 31852. [D 20:43:08.161693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 31853. [D 20:43:08.161668] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5509 [D 20:43:08.161707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 31854. [D 20:43:08.161732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 31855. [D 20:43:08.161743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 31856. [D 20:43:08.161753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 31857. [D 20:43:08.161763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 31858. [D 20:43:08.161772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 31859. [D 20:43:08.161783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 31860. [D 20:43:08.161795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 31861. [D 20:43:08.161805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 31862. [D 20:43:08.161815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 31863. [D 20:43:08.161825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 31864. [D 20:43:08.161838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 31865. [D 20:43:08.161848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 31866. [D 20:43:08.161857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 31867. [D 20:43:08.161868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 31868. [D 20:43:08.161878] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 31869. [D 20:43:08.161904] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 5/70. [D 20:43:08.164005] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5512 [D 20:43:08.164022] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 6/70. [D 20:43:08.173055] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 31869. [D 20:43:08.173116] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 7/70. [D 20:43:08.173133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 31869. [D 20:43:08.173147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 31870. [D 20:43:08.173160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 31871. [D 20:43:08.173170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 31872. [D 20:43:08.173184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 31873. [D 20:43:08.173196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 31874. [D 20:43:08.173205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 31875. [D 20:43:08.173216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 31876. [D 20:43:08.173226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 31877. [D 20:43:08.173236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 31878. [D 20:43:08.173246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 31879. [D 20:43:08.173262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 31880. [D 20:43:08.173273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 31881. [D 20:43:08.173282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 31882. [D 20:43:08.173310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 31883. [D 20:43:08.173321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 31884. [D 20:43:08.173345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 31885. [D 20:43:08.173355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 31886. [D 20:43:08.173368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 31887. [D 20:43:08.173378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 31888. [D 20:43:08.173388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 31889. [D 20:43:08.173398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 31890. [D 20:43:08.173426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 31891. [D 20:43:08.173441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 31892. [D 20:43:08.173450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 31893. [D 20:43:08.173460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 31894. [D 20:43:08.173486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 31895. [D 20:43:08.173495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 31896. [D 20:43:08.173510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 31897. [D 20:43:08.173520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 31898. [D 20:43:08.173532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 31899. [D 20:43:08.173556] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 31900. [D 20:43:08.173568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 31901. [D 20:43:08.173583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 31902. [D 20:43:08.173592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 31903. [D 20:43:08.173618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 31904. [D 20:43:08.173628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 31905. [D 20:43:08.173639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 31906. [D 20:43:08.173649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 31907. [D 20:43:08.173659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 31908. [D 20:43:08.173669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 31909. [D 20:43:08.173680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 31910. [D 20:43:08.173703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 31911. [D 20:43:08.173713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 31912. [D 20:43:08.173725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 31913. [D 20:43:08.173734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 31914. [D 20:43:08.173749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 31915. [D 20:43:08.173771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 31916. [D 20:43:08.173781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 31917. [D 20:43:08.173795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 31918. [D 20:43:08.173805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 31919. [D 20:43:08.173815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 31920. [D 20:43:08.173840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 31921. [D 20:43:08.173850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 31922. [D 20:43:08.173864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 31923. [D 20:43:08.173874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 31924. [D 20:43:08.173884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 31925. [D 20:43:08.173910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 31926. [D 20:43:08.173920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 31927. [D 20:43:08.173933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 31928. [D 20:43:08.173943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 31929. [D 20:43:08.173953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 31930. [D 20:43:08.173977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 31931. [D 20:43:08.173987] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 31932. [D 20:43:08.174063] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.174077] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.174088] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.181257] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.181272] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.181283] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.181314] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5514 [D 20:43:08.181325] element 0: offset: 0x2aaaab222ae0, size: 24 [D 20:43:08.181337] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 8/70. [D 20:43:08.182338] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 31932. [D 20:43:08.182352] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 9/70. [D 20:43:08.184786] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.184799] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.184810] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:08.184824] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5518 [D 20:43:08.184835] element 0: offset: 0x2aaaab209430, size: 24 [D 20:43:08.184845] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 10/70. [D 20:43:08.192363] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 31931. [D 20:43:08.192377] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 11/70. [D 20:43:08.194675] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.194688] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.194699] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:08.194772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.194782] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.194791] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.197555] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5514 [D 20:43:08.197610] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 12/70. [D 20:43:08.197631] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5518 [D 20:43:08.197641] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 13/70. [D 20:43:08.203228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 31931. [D 20:43:08.203280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 31932. [D 20:43:08.203291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 31933. [D 20:43:08.203302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 31934. [D 20:43:08.203317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 31935. [D 20:43:08.203329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 31936. [D 20:43:08.203338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 31937. [D 20:43:08.203349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 31938. [D 20:43:08.203359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 31939. [D 20:43:08.203369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 31940. [D 20:43:08.203379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 31941. [D 20:43:08.203397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 31942. [D 20:43:08.203407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 31943. [D 20:43:08.203416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 31944. [D 20:43:08.203427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 31945. [D 20:43:08.203437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 31946. [D 20:43:08.203447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 31947. [D 20:43:08.203457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 31948. [D 20:43:08.203485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 31949. [D 20:43:08.203496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 31950. [D 20:43:08.203505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 31951. [D 20:43:08.203521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 31952. [D 20:43:08.203531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 31953. [D 20:43:08.203559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 31954. [D 20:43:08.203569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 31955. [D 20:43:08.203579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 31956. [D 20:43:08.203593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 31957. [D 20:43:08.203603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 31958. [D 20:43:08.203613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 31959. [D 20:43:08.203642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 31960. [D 20:43:08.203652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 31961. [D 20:43:08.203664] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 31962. [D 20:43:08.203677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 31963. [D 20:43:08.203688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 31964. [D 20:43:08.203715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 31965. [D 20:43:08.203728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 31966. [D 20:43:08.203738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 31967. [D 20:43:08.203752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 31968. [D 20:43:08.203776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 31969. [D 20:43:08.203786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 31970. [D 20:43:08.203797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 31971. [D 20:43:08.203807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 31972. [D 20:43:08.203817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 31973. [D 20:43:08.203842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 31974. [D 20:43:08.203852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 31975. [D 20:43:08.203862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 31976. [D 20:43:08.203872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 31977. [D 20:43:08.203899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 31978. [D 20:43:08.203910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 31979. [D 20:43:08.203920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 31980. [D 20:43:08.203933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 31981. [D 20:43:08.203943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 31982. [D 20:43:08.203953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 31983. [D 20:43:08.203963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 31984. [D 20:43:08.203973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 31985. [D 20:43:08.203983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 31986. [D 20:43:08.203993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 31987. [D 20:43:08.204006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 31988. [D 20:43:08.204016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 31989. [D 20:43:08.204026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 31990. [D 20:43:08.204047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 31991. [D 20:43:08.204057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 31992. [D 20:43:08.204067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 31993. [D 20:43:08.204077] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 31994. [D 20:43:08.206666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.206681] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.206693] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.206728] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5522 [D 20:43:08.206738] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:08.208634] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 14/70. [D 20:43:08.208664] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.208674] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.208684] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:08.208700] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5524 [D 20:43:08.208713] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:08.208722] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 15/70. [D 20:43:08.214932] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 31994. [D 20:43:08.214947] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 16/70. [D 20:43:08.226705] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 31993. [D 20:43:08.226719] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 17/70. [D 20:43:08.229003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.229016] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.229025] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:08.229106] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.229119] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.229128] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.231579] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5522 [D 20:43:08.231631] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 18/70. [D 20:43:08.231653] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5524 [D 20:43:08.231664] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 19/70. [D 20:43:08.237113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 31993. [D 20:43:08.237167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 31994. [D 20:43:08.237179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 31995. [D 20:43:08.237189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 31996. [D 20:43:08.237200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 31997. [D 20:43:08.237210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 31998. [D 20:43:08.237220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 31999. [D 20:43:08.237230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32000. [D 20:43:08.237240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32001. [D 20:43:08.237250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32002. [D 20:43:08.237260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32003. [D 20:43:08.237277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32004. [D 20:43:08.237287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32005. [D 20:43:08.237297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32006. [D 20:43:08.237308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32007. [D 20:43:08.237318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 32008. [D 20:43:08.237328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 32009. [D 20:43:08.237368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 32010. [D 20:43:08.237383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 32011. [D 20:43:08.237393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 32012. [D 20:43:08.237403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 32013. [D 20:43:08.237433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 32014. [D 20:43:08.237443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 32015. [D 20:43:08.237455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 32016. [D 20:43:08.237464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 32017. [D 20:43:08.237475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 32018. [D 20:43:08.237498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 32019. [D 20:43:08.237508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 32020. [D 20:43:08.237522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 32021. [D 20:43:08.237532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 32022. [D 20:43:08.237542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 32023. [D 20:43:08.237566] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 32024. [D 20:43:08.237580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 32025. [D 20:43:08.237595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 32026. [D 20:43:08.237605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 32027. [D 20:43:08.237626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 32028. [D 20:43:08.237637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 32029. [D 20:43:08.237647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 32030. [D 20:43:08.237657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 32031. [D 20:43:08.237668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 32032. [D 20:43:08.237678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 32033. [D 20:43:08.237688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 32034. [D 20:43:08.237713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 32035. [D 20:43:08.237723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 32036. [D 20:43:08.237734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 32037. [D 20:43:08.237744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 32038. [D 20:43:08.237754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 32039. [D 20:43:08.237778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 32040. [D 20:43:08.237793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 32041. [D 20:43:08.237804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 32042. [D 20:43:08.237814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 32043. [D 20:43:08.237836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 32044. [D 20:43:08.237846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 32045. [D 20:43:08.237856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 32046. [D 20:43:08.237871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 32047. [D 20:43:08.237882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 32048. [D 20:43:08.237891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 32049. [D 20:43:08.237915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 32050. [D 20:43:08.237925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 32051. [D 20:43:08.237935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 32052. [D 20:43:08.237946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 32053. [D 20:43:08.237955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 32054. [D 20:43:08.237966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 32055. [D 20:43:08.237981] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 32056. [D 20:43:08.242318] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.242333] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.242345] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.242379] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5527 [D 20:43:08.242390] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:08.242405] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 20/70. [D 20:43:08.242429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.242439] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.242447] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:08.242463] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5530 [D 20:43:08.242472] element 0: offset: 0x2aaaab222ae0, size: 24 [D 20:43:08.242500] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 21/70. [D 20:43:08.246131] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 32056. [D 20:43:08.246147] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 22/70. [D 20:43:08.252014] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 32055. [D 20:43:08.252028] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 23/70. [D 20:43:08.254334] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.254348] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.254358] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:08.254438] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.254451] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.254460] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.257258] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5527 [D 20:43:08.257308] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 24/70. [D 20:43:08.257323] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5530 [D 20:43:08.257333] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 25/70. [D 20:43:08.257371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 32055. [D 20:43:08.257430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 32056. [D 20:43:08.257442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 32057. [D 20:43:08.257452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 32058. [D 20:43:08.257467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 32059. [D 20:43:08.257504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 32060. [D 20:43:08.257514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 32061. [D 20:43:08.257525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 32062. [D 20:43:08.257536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 32063. [D 20:43:08.257546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 32064. [D 20:43:08.257556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 32065. [D 20:43:08.257566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 32066. [D 20:43:08.257576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 32067. [D 20:43:08.257586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 32068. [D 20:43:08.257614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 32069. [D 20:43:08.257624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 32070. [D 20:43:08.257634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 32071. [D 20:43:08.257644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 32072. [D 20:43:08.257655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 32073. [D 20:43:08.257664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 32074. [D 20:43:08.257675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 32075. [D 20:43:08.257685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 32076. [D 20:43:08.257694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 32077. [D 20:43:08.257705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 32078. [D 20:43:08.257726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 32079. [D 20:43:08.257736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 32080. [D 20:43:08.257745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 32081. [D 20:43:08.257755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 32082. [D 20:43:08.257772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 32083. [D 20:43:08.257792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 32084. [D 20:43:08.257809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 32085. [D 20:43:08.257820] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 32086. [D 20:43:08.257834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 32087. [D 20:43:08.257849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 32088. [D 20:43:08.257859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 32089. [D 20:43:08.257869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 32090. [D 20:43:08.257900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 32091. [D 20:43:08.257914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 32092. [D 20:43:08.257925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 32093. [D 20:43:08.257935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 32094. [D 20:43:08.257945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 32095. [D 20:43:08.257956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 32096. [D 20:43:08.257966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 32097. [D 20:43:08.257976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 32098. [D 20:43:08.258007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 32099. [D 20:43:08.258017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 32100. [D 20:43:08.258031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 32101. [D 20:43:08.258041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 32102. [D 20:43:08.258051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 32103. [D 20:43:08.258065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 32104. [D 20:43:08.258086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 32105. [D 20:43:08.258097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 32106. [D 20:43:08.258107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 32107. [D 20:43:08.258117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 32108. [D 20:43:08.258128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 32109. [D 20:43:08.258138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 32110. [D 20:43:08.258165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 32111. [D 20:43:08.258180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 32112. [D 20:43:08.258190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 32113. [D 20:43:08.258200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 32114. [D 20:43:08.258216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 32115. [D 20:43:08.258236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 32116. [D 20:43:08.258247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 32117. [D 20:43:08.258258] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 32118. [D 20:43:08.263284] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 32118. [D 20:43:08.263301] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 26/70. [D 20:43:08.269201] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 32117. [D 20:43:08.269214] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 27/70. [D 20:43:08.270698] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.270714] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.270724] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:08.270740] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.270750] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.270759] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:08.501824] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.501839] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.501850] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:08.501883] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5534 [D 20:43:08.501894] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:08.501906] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 28/70. [D 20:43:08.501925] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.501937] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.501945] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:08.501959] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5536 [D 20:43:08.501969] element 0: offset: 0x2aaaab209460, size: 24 [D 20:43:08.501978] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 29/70. [D 20:43:08.506729] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5534 [D 20:43:08.506791] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 30/70. [D 20:43:08.506812] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5536 [D 20:43:08.506823] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 31/70. [D 20:43:08.507897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 32117. [D 20:43:08.507959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 32118. [D 20:43:08.507971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 32119. [D 20:43:08.507982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 32120. [D 20:43:08.507997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 32121. [D 20:43:08.508007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 32122. [D 20:43:08.508016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 32123. [D 20:43:08.508032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32124. [D 20:43:08.508042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32125. [D 20:43:08.508052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32126. [D 20:43:08.508068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32127. [D 20:43:08.508078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32128. [D 20:43:08.508088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32129. [D 20:43:08.508103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32130. [D 20:43:08.508113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32131. [D 20:43:08.508123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 32132. [D 20:43:08.508189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 32133. [D 20:43:08.508199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 32134. [D 20:43:08.508209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 32135. [D 20:43:08.508233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 32136. [D 20:43:08.508243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 32137. [D 20:43:08.508253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 32138. [D 20:43:08.508263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 32139. [D 20:43:08.508273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 32140. [D 20:43:08.508283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 32141. [D 20:43:08.508293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 32142. [D 20:43:08.508318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 32143. [D 20:43:08.508328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 32144. [D 20:43:08.508344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 32145. [D 20:43:08.508355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 32146. [D 20:43:08.508365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 32147. [D 20:43:08.508375] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 32148. [D 20:43:08.508389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 32149. [D 20:43:08.508399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 32150. [D 20:43:08.508409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 32151. [D 20:43:08.508438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 32152. [D 20:43:08.508449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 32153. [D 20:43:08.508458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 32154. [D 20:43:08.508468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 32155. [D 20:43:08.508479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 32156. [D 20:43:08.508488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 32157. [D 20:43:08.508498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 32158. [D 20:43:08.508508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 32159. [D 20:43:08.508538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 32160. [D 20:43:08.508549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 32161. [D 20:43:08.508561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 32162. [D 20:43:08.508570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 32163. [D 20:43:08.508581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 32164. [D 20:43:08.508594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 32165. [D 20:43:08.508603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 32166. [D 20:43:08.508627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 32167. [D 20:43:08.508637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 32168. [D 20:43:08.508647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 32169. [D 20:43:08.508658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 32170. [D 20:43:08.508667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 32171. [D 20:43:08.508692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 32172. [D 20:43:08.508706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 32173. [D 20:43:08.508716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 32174. [D 20:43:08.508726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 32175. [D 20:43:08.508753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 32176. [D 20:43:08.508763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 32177. [D 20:43:08.508775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 32178. [D 20:43:08.508785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 32179. [D 20:43:08.508795] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 32180. [D 20:43:08.517681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.517696] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.517707] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.517741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5538 [D 20:43:08.517752] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:08.517764] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 32/70. [D 20:43:08.519615] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 32180. [D 20:43:08.519631] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 33/70. [D 20:43:08.522065] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.522078] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.522087] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:08.522103] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5542 [D 20:43:08.522116] element 0: offset: 0x2aaaab222ae0, size: 24 [D 20:43:08.522125] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 34/70. [D 20:43:08.531167] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 32179. [D 20:43:08.531183] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 35/70. [D 20:43:08.533506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.533520] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.533530] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:08.533601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.533612] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.533621] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.536402] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5542 [D 20:43:08.536452] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 36/70. [D 20:43:08.536467] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5538 [D 20:43:08.536478] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 37/70. [D 20:43:08.536700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 32179. [D 20:43:08.536754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 32180. [D 20:43:08.536765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 32181. [D 20:43:08.536776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 32182. [D 20:43:08.536787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 32183. [D 20:43:08.536797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 32184. [D 20:43:08.536807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 32185. [D 20:43:08.536817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 32186. [D 20:43:08.536827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 32187. [D 20:43:08.536837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 32188. [D 20:43:08.536847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 32189. [D 20:43:08.536864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 32190. [D 20:43:08.536873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 32191. [D 20:43:08.536883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 32192. [D 20:43:08.536894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 32193. [D 20:43:08.536904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 32194. [D 20:43:08.536914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 32195. [D 20:43:08.536924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 32196. [D 20:43:08.536939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 32197. [D 20:43:08.536949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 32198. [D 20:43:08.536959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 32199. [D 20:43:08.536969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 32200. [D 20:43:08.537003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 32201. [D 20:43:08.537014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 32202. [D 20:43:08.537024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 32203. [D 20:43:08.537035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 32204. [D 20:43:08.537061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 32205. [D 20:43:08.537072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 32206. [D 20:43:08.537082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 32207. [D 20:43:08.537092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 32208. [D 20:43:08.537102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 32209. [D 20:43:08.537118] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 32210. [D 20:43:08.537131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 32211. [D 20:43:08.537141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 32212. [D 20:43:08.537174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 32213. [D 20:43:08.537184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 32214. [D 20:43:08.537200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 32215. [D 20:43:08.537211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 32216. [D 20:43:08.537233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 32217. [D 20:43:08.537245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 32218. [D 20:43:08.537255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 32219. [D 20:43:08.537270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 32220. [D 20:43:08.537281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 32221. [D 20:43:08.537291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 32222. [D 20:43:08.537301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 32223. [D 20:43:08.537311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 32224. [D 20:43:08.537321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 32225. [D 20:43:08.537331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 32226. [D 20:43:08.537363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 32227. [D 20:43:08.537373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 32228. [D 20:43:08.537383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 32229. [D 20:43:08.537398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 32230. [D 20:43:08.537407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 32231. [D 20:43:08.537417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 32232. [D 20:43:08.537440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 32233. [D 20:43:08.537450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 32234. [D 20:43:08.537460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 32235. [D 20:43:08.537486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 32236. [D 20:43:08.537497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 32237. [D 20:43:08.537525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 32238. [D 20:43:08.537535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 32239. [D 20:43:08.537545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 32240. [D 20:43:08.537555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 32241. [D 20:43:08.537570] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 32242. [D 20:43:08.547739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.547755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.547765] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.547801] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5546 [D 20:43:08.547813] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:08.547827] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 38/70. [D 20:43:08.547848] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.547858] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.547866] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:08.547885] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5548 [D 20:43:08.547894] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:08.547907] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 39/70. [D 20:43:08.548509] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 32242. [D 20:43:08.548524] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 40/70. [D 20:43:08.560184] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 32241. [D 20:43:08.560198] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 41/70. [D 20:43:08.562465] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.562478] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.562488] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:08.562569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.562581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.562590] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.565012] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5548 [D 20:43:08.565065] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 42/70. [D 20:43:08.565086] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5546 [D 20:43:08.565096] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 43/70. [D 20:43:08.570942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 32241. [D 20:43:08.570994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 32242. [D 20:43:08.571006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 32243. [D 20:43:08.571017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 32244. [D 20:43:08.571027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 32245. [D 20:43:08.571037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 32246. [D 20:43:08.571047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 32247. [D 20:43:08.571057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 32248. [D 20:43:08.571073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 32249. [D 20:43:08.571083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 32250. [D 20:43:08.571093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 32251. [D 20:43:08.571103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 32252. [D 20:43:08.571113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 32253. [D 20:43:08.571123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 32254. [D 20:43:08.571133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 32255. [D 20:43:08.571143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 32256. [D 20:43:08.571171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 32257. [D 20:43:08.571182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 32258. [D 20:43:08.571192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 32259. [D 20:43:08.571202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 32260. [D 20:43:08.571212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 32261. [D 20:43:08.571228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 32262. [D 20:43:08.571238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 32263. [D 20:43:08.571262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 32264. [D 20:43:08.571279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 32265. [D 20:43:08.571289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 32266. [D 20:43:08.571310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 32267. [D 20:43:08.571321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 32268. [D 20:43:08.571331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 32269. [D 20:43:08.571342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 32270. [D 20:43:08.571352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 32271. [D 20:43:08.571362] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 32272. [D 20:43:08.571376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 32273. [D 20:43:08.571400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 32274. [D 20:43:08.571411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 32275. [D 20:43:08.571420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 32276. [D 20:43:08.571430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 32277. [D 20:43:08.571453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 32278. [D 20:43:08.571464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 32279. [D 20:43:08.571474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32280. [D 20:43:08.571490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32281. [D 20:43:08.571500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32282. [D 20:43:08.571510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32283. [D 20:43:08.571532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32284. [D 20:43:08.571541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32285. [D 20:43:08.571552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32286. [D 20:43:08.571562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32287. [D 20:43:08.571572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 32288. [D 20:43:08.571582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 32289. [D 20:43:08.571608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 32290. [D 20:43:08.571622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 32291. [D 20:43:08.571634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 32292. [D 20:43:08.571643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 32293. [D 20:43:08.571654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 32294. [D 20:43:08.571677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 32295. [D 20:43:08.571687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 32296. [D 20:43:08.571701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 32297. [D 20:43:08.571710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 32298. [D 20:43:08.571720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 32299. [D 20:43:08.571743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 32300. [D 20:43:08.571753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 32301. [D 20:43:08.571764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 32302. [D 20:43:08.571775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 32303. [D 20:43:08.571784] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 32304. [D 20:43:08.574692] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.574708] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.574720] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.574754] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5551 [D 20:43:08.574765] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:08.574779] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 44/70. [D 20:43:08.574803] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.574813] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.574821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:08.574836] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5554 [D 20:43:08.574845] element 0: offset: 0x2aaaab209460, size: 24 [D 20:43:08.574871] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 45/70. [D 20:43:08.582698] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 32304. [D 20:43:08.582713] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 46/70. [D 20:43:08.594337] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 32303. [D 20:43:08.594351] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 47/70. [D 20:43:08.596617] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.596630] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.596640] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:08.596721] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.596735] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.596743] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.599130] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5554 [D 20:43:08.599181] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 48/70. [D 20:43:08.599203] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5551 [D 20:43:08.599213] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 49/70. [D 20:43:08.605483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 32303. [D 20:43:08.605537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 32304. [D 20:43:08.605549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 32305. [D 20:43:08.605560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 32306. [D 20:43:08.605570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 32307. [D 20:43:08.605581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 32308. [D 20:43:08.605590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 32309. [D 20:43:08.605601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 32310. [D 20:43:08.605611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 32311. [D 20:43:08.605620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 32312. [D 20:43:08.605630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 32313. [D 20:43:08.605648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 32314. [D 20:43:08.605658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 32315. [D 20:43:08.605667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 32316. [D 20:43:08.605678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 32317. [D 20:43:08.605688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 32318. [D 20:43:08.605715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 32319. [D 20:43:08.605728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 32320. [D 20:43:08.605738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 32321. [D 20:43:08.605748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 32322. [D 20:43:08.606129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 32323. [D 20:43:08.606140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 32324. [D 20:43:08.606150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 32325. [D 20:43:08.606160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 32326. [D 20:43:08.606170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 32327. [D 20:43:08.606180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 32328. [D 20:43:08.606190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 32329. [D 20:43:08.606200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 32330. [D 20:43:08.606210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 32331. [D 20:43:08.606220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 32332. [D 20:43:08.606252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 32333. [D 20:43:08.606645] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 32334. [D 20:43:08.606661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 32335. [D 20:43:08.606671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 32336. [D 20:43:08.606686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 32337. [D 20:43:08.606699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 32338. [D 20:43:08.606709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 32339. [D 20:43:08.606719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 32340. [D 20:43:08.606729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 32341. [D 20:43:08.606749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 32342. [D 20:43:08.606776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 32343. [D 20:43:08.606787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 32344. [D 20:43:08.606798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 32345. [D 20:43:08.606808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 32346. [D 20:43:08.606819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 32347. [D 20:43:08.606828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 32348. [D 20:43:08.606838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 32349. [D 20:43:08.606848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 32350. [D 20:43:08.606866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 32351. [D 20:43:08.606876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 32352. [D 20:43:08.606885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 32353. [D 20:43:08.606896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 32354. [D 20:43:08.606906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 32355. [D 20:43:08.606915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 32356. [D 20:43:08.606926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 32357. [D 20:43:08.606941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 32358. [D 20:43:08.606965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 32359. [D 20:43:08.606976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 32360. [D 20:43:08.606986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 32361. [D 20:43:08.606996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 32362. [D 20:43:08.607006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 32363. [D 20:43:08.607021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 32364. [D 20:43:08.607031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 32365. [D 20:43:08.607041] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 32366. [D 20:43:08.610741] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.610755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.610766] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.610801] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5558 [D 20:43:08.610812] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:08.610826] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 50/70. [D 20:43:08.610846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.610856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.610864] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:08.610881] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5560 [D 20:43:08.610891] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:08.610917] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 51/70. [D 20:43:08.617233] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 32366. [D 20:43:08.617248] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 52/70. [D 20:43:08.628923] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 32365. [D 20:43:08.628937] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 53/70. [D 20:43:08.631235] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.631248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.631259] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:08.631343] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.631354] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.631363] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.633726] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5558 [D 20:43:08.633784] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 54/70. [D 20:43:08.636024] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5560 [D 20:43:08.636042] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 55/70. [D 20:43:08.639737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 32365. [D 20:43:08.639787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 32366. [D 20:43:08.639799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 32367. [D 20:43:08.639810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 32368. [D 20:43:08.639820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 32369. [D 20:43:08.639830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 32370. [D 20:43:08.639840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 32371. [D 20:43:08.639851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32372. [D 20:43:08.639861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32373. [D 20:43:08.639870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32374. [D 20:43:08.639880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32375. [D 20:43:08.639898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32376. [D 20:43:08.639908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32377. [D 20:43:08.639937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32378. [D 20:43:08.639948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32379. [D 20:43:08.639963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 32380. [D 20:43:08.639974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 32381. [D 20:43:08.639984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 32382. [D 20:43:08.639994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 32383. [D 20:43:08.640019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 32384. [D 20:43:08.640030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 32385. [D 20:43:08.640040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 32386. [D 20:43:08.640066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 32387. [D 20:43:08.640077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 32388. [D 20:43:08.640087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 32389. [D 20:43:08.640097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 32390. [D 20:43:08.640107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 32391. [D 20:43:08.640117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 32392. [D 20:43:08.640127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 32393. [D 20:43:08.640144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 32394. [D 20:43:08.640164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 32395. [D 20:43:08.640175] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 32396. [D 20:43:08.640188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 32397. [D 20:43:08.640201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 32398. [D 20:43:08.640211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 32399. [D 20:43:08.640233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 32400. [D 20:43:08.640244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 32401. [D 20:43:08.640253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 32402. [D 20:43:08.640285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 32403. [D 20:43:08.640296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 32404. [D 20:43:08.640305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 32405. [D 20:43:08.640318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 32406. [D 20:43:08.640334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 32407. [D 20:43:08.640356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 32408. [D 20:43:08.640367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 32409. [D 20:43:08.640378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 32410. [D 20:43:08.640388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 32411. [D 20:43:08.640398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 32412. [D 20:43:08.640408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 32413. [D 20:43:08.640419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 32414. [D 20:43:08.640429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 32415. [D 20:43:08.640459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 32416. [D 20:43:08.640470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 32417. [D 20:43:08.640482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 32418. [D 20:43:08.640492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 32419. [D 20:43:08.640504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 32420. [D 20:43:08.640527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 32421. [D 20:43:08.640538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 32422. [D 20:43:08.640552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 32423. [D 20:43:08.640563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 32424. [D 20:43:08.640573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 32425. [D 20:43:08.640596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 32426. [D 20:43:08.640606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 32427. [D 20:43:08.640616] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 32428. [D 20:43:08.644810] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.644825] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.644834] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.644867] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5562 [D 20:43:08.644879] element 0: offset: 0x2aaaab234060, size: 24 [D 20:43:08.644893] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 56/70. [D 20:43:08.651460] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 32428. [D 20:43:08.651476] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 57/70. [D 20:43:08.658042] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 32427. [D 20:43:08.658056] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 58/70. [D 20:43:08.660323] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.660337] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.660346] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.660406] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.660419] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.660427] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:08.662621] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5562 [D 20:43:08.662673] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 59/70. [D 20:43:08.662724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 32427. [D 20:43:08.662739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 32428. [D 20:43:08.662749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 32429. [D 20:43:08.662760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 32430. [D 20:43:08.662770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 32431. [D 20:43:08.662780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 32432. [D 20:43:08.662790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 32433. [D 20:43:08.662801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 32434. [D 20:43:08.662816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 32435. [D 20:43:08.662826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 32436. [D 20:43:08.662836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 32437. [D 20:43:08.662846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 32438. [D 20:43:08.662856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 32439. [D 20:43:08.662875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 32440. [D 20:43:08.662885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 32441. [D 20:43:08.662895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 32442. [D 20:43:08.662905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 32443. [D 20:43:08.662915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 32444. [D 20:43:08.662927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 32445. [D 20:43:08.662937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 32446. [D 20:43:08.662947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 32447. [D 20:43:08.662957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 32448. [D 20:43:08.662967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 32449. [D 20:43:08.662977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 32450. [D 20:43:08.662987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 32451. [D 20:43:08.663011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 32452. [D 20:43:08.663022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 32453. [D 20:43:08.663031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 32454. [D 20:43:08.663046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 32455. [D 20:43:08.663056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 32456. [D 20:43:08.663066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 32457. [D 20:43:08.663093] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 32458. [D 20:43:08.668608] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 32458. [D 20:43:08.668621] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 60/70. [D 20:43:08.670703] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.670716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.670727] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:08.769501] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.769518] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.769529] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:08.769546] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5566 [D 20:43:08.769556] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:08.769566] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 0/70. [D 20:43:08.773821] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5566 [D 20:43:08.773840] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 1/70. [D 20:43:08.773899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 32458. [D 20:43:08.773962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 32459. [D 20:43:08.774020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 32460. [D 20:43:08.774032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 32461. [D 20:43:08.774042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 32462. [D 20:43:08.774053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 32463. [D 20:43:08.774064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 32464. [D 20:43:08.774074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 32465. [D 20:43:08.774085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 32466. [D 20:43:08.774094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 32467. [D 20:43:08.774105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 32468. [D 20:43:08.774115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 32469. [D 20:43:08.774132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 32470. [D 20:43:08.774142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 32471. [D 20:43:08.774152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 32472. [D 20:43:08.774163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 32473. [D 20:43:08.774173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 32474. [D 20:43:08.774182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 32475. [D 20:43:08.774215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 32476. [D 20:43:08.774225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 32477. [D 20:43:08.774235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 32478. [D 20:43:08.774245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 32479. [D 20:43:08.774255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 32480. [D 20:43:08.774265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 32481. [D 20:43:08.774281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 32482. [D 20:43:08.774291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 32483. [D 20:43:08.774301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 32484. [D 20:43:08.774311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 32485. [D 20:43:08.774322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 32486. [D 20:43:08.774332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 32487. [D 20:43:08.774358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 32488. [D 20:43:08.774368] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 32489. [D 20:43:08.779814] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 32489. [D 20:43:08.779830] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 2/70. [D 20:43:08.782120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.782135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.782145] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:08.947877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.947933] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.947943] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:08.947980] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5569 [D 20:43:08.947992] element 0: offset: 0x2aaaab2087d0, size: 24 [D 20:43:08.948005] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 3/70. [D 20:43:08.952791] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5569 [D 20:43:08.952845] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 4/70. [D 20:43:08.954380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 32489. [D 20:43:08.954400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 32490. [D 20:43:08.954411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 32491. [D 20:43:08.954421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 32492. [D 20:43:08.954431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 32493. [D 20:43:08.954445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 32494. [D 20:43:08.954455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 32495. [D 20:43:08.954465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32496. [D 20:43:08.954481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32497. [D 20:43:08.954491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32498. [D 20:43:08.954501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32499. [D 20:43:08.954517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32500. [D 20:43:08.954538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32501. [D 20:43:08.954549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32502. [D 20:43:08.954575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32503. [D 20:43:08.954586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 32504. [D 20:43:08.954600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 32505. [D 20:43:08.954625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 32506. [D 20:43:08.954638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 32507. [D 20:43:08.954659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 32508. [D 20:43:08.954669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 32509. [D 20:43:08.954679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 32510. [D 20:43:08.954702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 32511. [D 20:43:08.954719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 32512. [D 20:43:08.954733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 32513. [D 20:43:08.954759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 32514. [D 20:43:08.954769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 32515. [D 20:43:08.954790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 32516. [D 20:43:08.954800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 32517. [D 20:43:08.954810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 32518. [D 20:43:08.954832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 32519. [D 20:43:08.954847] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 32520. [D 20:43:08.964097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.964111] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.964122] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:08.964138] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5571 [D 20:43:08.964148] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:08.964158] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 5/70. [D 20:43:08.965999] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 32520. [D 20:43:08.966014] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 6/70. [D 20:43:08.968352] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.968366] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.968377] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.968391] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5575 [D 20:43:08.968401] element 0: offset: 0x2aaaab209460, size: 24 [D 20:43:08.968411] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 7/70. [D 20:43:08.968459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.968472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.968481] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.970626] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5571 [D 20:43:08.970645] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 8/70. [D 20:43:08.972693] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5575 [D 20:43:08.972745] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 9/70. [D 20:43:08.973250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 32520. [D 20:43:08.973301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 32521. [D 20:43:08.973313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 32522. [D 20:43:08.973323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 32523. [D 20:43:08.973334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 32524. [D 20:43:08.973345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 32525. [D 20:43:08.973354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 32526. [D 20:43:08.973365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 32527. [D 20:43:08.973375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 32528. [D 20:43:08.973384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 32529. [D 20:43:08.973394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 32530. [D 20:43:08.973404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 32531. [D 20:43:08.973423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 32532. [D 20:43:08.973433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 32533. [D 20:43:08.973443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 32534. [D 20:43:08.973453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 32535. [D 20:43:08.973463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 32536. [D 20:43:08.973473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 32537. [D 20:43:08.973501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 32538. [D 20:43:08.973516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 32539. [D 20:43:08.973526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 32540. [D 20:43:08.973536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 32541. [D 20:43:08.973546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 32542. [D 20:43:08.973561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 32543. [D 20:43:08.973587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 32544. [D 20:43:08.973598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 32545. [D 20:43:08.973608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 32546. [D 20:43:08.973617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 32547. [D 20:43:08.973632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 32548. [D 20:43:08.973643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 32549. [D 20:43:08.973653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 32550. [D 20:43:08.973663] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 32551. [D 20:43:08.973700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 32552. [D 20:43:08.973710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 32553. [D 20:43:08.973720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 32554. [D 20:43:08.973730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 32555. [D 20:43:08.973740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 32556. [D 20:43:08.973755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 32557. [D 20:43:08.973765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 32558. [D 20:43:08.973775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 32559. [D 20:43:08.973785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 32560. [D 20:43:08.973795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 32561. [D 20:43:08.973821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 32562. [D 20:43:08.973834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 32563. [D 20:43:08.973848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 32564. [D 20:43:08.973858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 32565. [D 20:43:08.973868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 32566. [D 20:43:08.973884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 32567. [D 20:43:08.973893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 32568. [D 20:43:08.973903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 32569. [D 20:43:08.973933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 32570. [D 20:43:08.973948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 32571. [D 20:43:08.973958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 32572. [D 20:43:08.973968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 32573. [D 20:43:08.973998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 32574. [D 20:43:08.974010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 32575. [D 20:43:08.974021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 32576. [D 20:43:08.974031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 32577. [D 20:43:08.974043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 32578. [D 20:43:08.974058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 32579. [D 20:43:08.974068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 32580. [D 20:43:08.974078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 32581. [D 20:43:08.974108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 32582. [D 20:43:08.974118] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 32583. [D 20:43:08.978256] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:08.978271] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.978282] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:08.978313] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5578 [D 20:43:08.978325] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:08.978338] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 10/70. [D 20:43:08.984928] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 32583. [D 20:43:08.984943] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 11/70. [D 20:43:08.996515] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 32582. [D 20:43:08.996529] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 12/70. [D 20:43:08.998855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.998869] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.998880] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:08.998918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:08.998929] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:08.998938] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:09.001199] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5578 [D 20:43:09.001219] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 13/70. [D 20:43:09.001852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 32582. [D 20:43:09.001904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 32583. [D 20:43:09.001916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 32584. [D 20:43:09.001927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 32585. [D 20:43:09.001942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 32586. [D 20:43:09.001951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 32587. [D 20:43:09.001961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 32588. [D 20:43:09.001975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32589. [D 20:43:09.001985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32590. [D 20:43:09.001995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32591. [D 20:43:09.002010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32592. [D 20:43:09.002020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32593. [D 20:43:09.002030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32594. [D 20:43:09.002045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32595. [D 20:43:09.002055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32596. [D 20:43:09.002065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 32597. [D 20:43:09.002111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 32598. [D 20:43:09.002122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 32599. [D 20:43:09.002132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 32600. [D 20:43:09.002143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 32601. [D 20:43:09.002168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 32602. [D 20:43:09.002179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 32603. [D 20:43:09.002188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 32604. [D 20:43:09.002198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 32605. [D 20:43:09.002208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 32606. [D 20:43:09.002224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 32607. [D 20:43:09.002233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 32608. [D 20:43:09.002243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 32609. [D 20:43:09.002271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 32610. [D 20:43:09.002281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 32611. [D 20:43:09.002295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 32612. [D 20:43:09.002305] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 32613. [D 20:43:09.013570] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.013625] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.013636] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:09.013670] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5581 [D 20:43:09.013684] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:09.013697] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 14/70. [D 20:43:09.013720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.013730] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.013738] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.013755] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5584 [D 20:43:09.013765] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:09.013801] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 15/70. [D 20:43:09.013849] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 32613. [D 20:43:09.013865] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 16/70. [D 20:43:09.016242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.016257] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.016265] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.018431] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5581 [D 20:43:09.018492] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 17/70. [D 20:43:09.018684] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5584 [D 20:43:09.018702] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 18/70. [D 20:43:09.020074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 32613. [D 20:43:09.020118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 32614. [D 20:43:09.020130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 32615. [D 20:43:09.020140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 32616. [D 20:43:09.020151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 32617. [D 20:43:09.020161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 32618. [D 20:43:09.020171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 32619. [D 20:43:09.020181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 32620. [D 20:43:09.020191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 32621. [D 20:43:09.020201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 32622. [D 20:43:09.020211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 32623. [D 20:43:09.020220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 32624. [D 20:43:09.020238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 32625. [D 20:43:09.020248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 32626. [D 20:43:09.020258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 32627. [D 20:43:09.020284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 32628. [D 20:43:09.020294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 32629. [D 20:43:09.020305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 32630. [D 20:43:09.020315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 32631. [D 20:43:09.020324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 32632. [D 20:43:09.020402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 32633. [D 20:43:09.020415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 32634. [D 20:43:09.020425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 32635. [D 20:43:09.020448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 32636. [D 20:43:09.020458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 32637. [D 20:43:09.020472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 32638. [D 20:43:09.020482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 32639. [D 20:43:09.020492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 32640. [D 20:43:09.020505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 32641. [D 20:43:09.020531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 32642. [D 20:43:09.020545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 32643. [D 20:43:09.020555] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 32644. [D 20:43:09.020568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 32645. [D 20:43:09.020579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 32646. [D 20:43:09.020603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 32647. [D 20:43:09.020615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 32648. [D 20:43:09.020625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 32649. [D 20:43:09.020635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 32650. [D 20:43:09.020646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 32651. [D 20:43:09.020655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 32652. [D 20:43:09.020678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 32653. [D 20:43:09.020693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 32654. [D 20:43:09.020703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 32655. [D 20:43:09.020712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 32656. [D 20:43:09.020727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 32657. [D 20:43:09.020747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 32658. [D 20:43:09.020757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 32659. [D 20:43:09.020772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 32660. [D 20:43:09.020782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 32661. [D 20:43:09.020808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 32662. [D 20:43:09.020818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 32663. [D 20:43:09.020833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 32664. [D 20:43:09.020844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 32665. [D 20:43:09.020854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 32666. [D 20:43:09.020864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 32667. [D 20:43:09.020887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 32668. [D 20:43:09.020898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 32669. [D 20:43:09.020911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 32670. [D 20:43:09.020921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 32671. [D 20:43:09.020931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 32672. [D 20:43:09.020947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 32673. [D 20:43:09.020956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 32674. [D 20:43:09.020966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 32675. [D 20:43:09.020976] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 32676. [D 20:43:09.024988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.025003] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.025014] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.025049] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5587 [D 20:43:09.025060] element 0: offset: 0x2aaaab222ae0, size: 24 [D 20:43:09.025075] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 19/70. [D 20:43:09.031806] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 32676. [D 20:43:09.031828] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 20/70. [D 20:43:09.043423] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 32675. [D 20:43:09.043442] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 21/70. [D 20:43:09.045775] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.045788] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.045798] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.045858] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.045871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.045879] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:09.048193] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5587 [D 20:43:09.048209] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 22/70. [D 20:43:09.048745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 32675. [D 20:43:09.048761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 32676. [D 20:43:09.048771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 32677. [D 20:43:09.048782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 32678. [D 20:43:09.048792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 32679. [D 20:43:09.048805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 32680. [D 20:43:09.048815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 32681. [D 20:43:09.048825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32682. [D 20:43:09.048841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32683. [D 20:43:09.048851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32684. [D 20:43:09.048861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32685. [D 20:43:09.048876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32686. [D 20:43:09.048886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32687. [D 20:43:09.048896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32688. [D 20:43:09.048913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32689. [D 20:43:09.048922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 32690. [D 20:43:09.048949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 32691. [D 20:43:09.048959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 32692. [D 20:43:09.048971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 32693. [D 20:43:09.048998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 32694. [D 20:43:09.049009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 32695. [D 20:43:09.049024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 32696. [D 20:43:09.049034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 32697. [D 20:43:09.049044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 32698. [D 20:43:09.049055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 32699. [D 20:43:09.049078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 32700. [D 20:43:09.049089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 32701. [D 20:43:09.049103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 32702. [D 20:43:09.049113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 32703. [D 20:43:09.049123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 32704. [D 20:43:09.049139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 32705. [D 20:43:09.049149] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 32706. [D 20:43:09.059658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.059672] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.059683] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:09.059698] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5590 [D 20:43:09.059708] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:09.059717] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 23/70. [D 20:43:09.059732] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.059743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.059752] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.059765] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5593 [D 20:43:09.059776] element 0: offset: 0x2aaaab209460, size: 24 [D 20:43:09.059785] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 24/70. [D 20:43:09.060478] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 32706. [D 20:43:09.060492] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 25/70. [D 20:43:09.062778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.062792] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.062801] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.065416] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5590 [D 20:43:09.065469] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 26/70. [D 20:43:09.066867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 32706. [D 20:43:09.066885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 32707. [D 20:43:09.066897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 32708. [D 20:43:09.066907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 32709. [D 20:43:09.066917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 32710. [D 20:43:09.066931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 32711. [D 20:43:09.066941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 32712. [D 20:43:09.066951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 32713. [D 20:43:09.066967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 32714. [D 20:43:09.066977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 32715. [D 20:43:09.066987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 32716. [D 20:43:09.066997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 32717. [D 20:43:09.067013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 32718. [D 20:43:09.067023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 32719. [D 20:43:09.067033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 32720. [D 20:43:09.067043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 32721. [D 20:43:09.067054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 32722. [D 20:43:09.067064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 32723. [D 20:43:09.067095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 32724. [D 20:43:09.067105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 32725. [D 20:43:09.067116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 32726. [D 20:43:09.067126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 32727. [D 20:43:09.067136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 32728. [D 20:43:09.067146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 32729. [D 20:43:09.067172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 32730. [D 20:43:09.067182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 32731. [D 20:43:09.067194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 32732. [D 20:43:09.067203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 32733. [D 20:43:09.067214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 32734. [D 20:43:09.067224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 32735. [D 20:43:09.067234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 32736. [D 20:43:09.067244] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 32737. [D 20:43:09.069587] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5593 [D 20:43:09.069603] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 27/70. [D 20:43:09.076323] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.076339] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.076350] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.076383] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5596 [D 20:43:09.076395] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:09.076406] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 28/70. [D 20:43:09.078522] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 32737. [D 20:43:09.078538] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 29/70. [D 20:43:09.078569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 32737. [D 20:43:09.078580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 32738. [D 20:43:09.078590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 32739. [D 20:43:09.078603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 32740. [D 20:43:09.078613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 32741. [D 20:43:09.078623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 32742. [D 20:43:09.078637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 32743. [D 20:43:09.078646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 32744. [D 20:43:09.078674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 32745. [D 20:43:09.078684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 32746. [D 20:43:09.078766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 32747. [D 20:43:09.078779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 32748. [D 20:43:09.078789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 32749. [D 20:43:09.078799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 32750. [D 20:43:09.078822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 32751. [D 20:43:09.078832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 32752. [D 20:43:09.078842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 32753. [D 20:43:09.078851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 32754. [D 20:43:09.078861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 32755. [D 20:43:09.078872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 32756. [D 20:43:09.078881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 32757. [D 20:43:09.078891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 32758. [D 20:43:09.078901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 32759. [D 20:43:09.078911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 32760. [D 20:43:09.078921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 32761. [D 20:43:09.078931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 32762. [D 20:43:09.078941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 32763. [D 20:43:09.078951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 32764. [D 20:43:09.078960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 32765. [D 20:43:09.078970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 32766. [D 20:43:09.078980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 32767. [D 20:43:09.078990] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 32768. [D 20:43:09.079030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.079040] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.079049] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.081209] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5596 [D 20:43:09.081222] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 30/70. [D 20:43:09.090127] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 32768. [D 20:43:09.090142] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 31/70. [D 20:43:09.090171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 32768. [D 20:43:09.090183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 32769. [D 20:43:09.090193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 32770. [D 20:43:09.090203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 32771. [D 20:43:09.090213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 32772. [D 20:43:09.090223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 32773. [D 20:43:09.090234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 32774. [D 20:43:09.090244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32775. [D 20:43:09.090254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32776. [D 20:43:09.090263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32777. [D 20:43:09.090280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32778. [D 20:43:09.090290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32779. [D 20:43:09.090317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32780. [D 20:43:09.090327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32781. [D 20:43:09.090337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32782. [D 20:43:09.090352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 32783. [D 20:43:09.090372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 32784. [D 20:43:09.090382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 32785. [D 20:43:09.090397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 32786. [D 20:43:09.090407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 32787. [D 20:43:09.090417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 32788. [D 20:43:09.090432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 32789. [D 20:43:09.090442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 32790. [D 20:43:09.090452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 32791. [D 20:43:09.090477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 32792. [D 20:43:09.090487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 32793. [D 20:43:09.090497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 32794. [D 20:43:09.090507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 32795. [D 20:43:09.090517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 32796. [D 20:43:09.090540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 32797. [D 20:43:09.090550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 32798. [D 20:43:09.090560] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 32799. [D 20:43:09.092878] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.092891] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.092901] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:09.096254] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 32799. [D 20:43:09.096268] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 32/70. [D 20:43:09.098482] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.098495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.098505] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:09.120618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.120675] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.120685] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:09.120720] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5599 [D 20:43:09.120731] element 0: offset: 0x2aaaab2086f0, size: 24 [D 20:43:09.120746] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 33/70. [D 20:43:09.123059] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.123073] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.123083] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:09.123098] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5602 [D 20:43:09.123107] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:09.123118] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 34/70. [D 20:43:09.125318] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5602 [D 20:43:09.125377] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 35/70. [D 20:43:09.125513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 32799. [D 20:43:09.125537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 32800. [D 20:43:09.125549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 32801. [D 20:43:09.125559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 32802. [D 20:43:09.125569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 32803. [D 20:43:09.125580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 32804. [D 20:43:09.125589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 32805. [D 20:43:09.125616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32806. [D 20:43:09.125626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32807. [D 20:43:09.125636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32808. [D 20:43:09.125646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32809. [D 20:43:09.125657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32810. [D 20:43:09.125667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32811. [D 20:43:09.125677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32812. [D 20:43:09.125710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32813. [D 20:43:09.125720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 32814. [D 20:43:09.125730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 32815. [D 20:43:09.125740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 32816. [D 20:43:09.125750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 32817. [D 20:43:09.125760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 32818. [D 20:43:09.125784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 32819. [D 20:43:09.125794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 32820. [D 20:43:09.125804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 32821. [D 20:43:09.125814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 32822. [D 20:43:09.125825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 32823. [D 20:43:09.125835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 32824. [D 20:43:09.125851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 32825. [D 20:43:09.125861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 32826. [D 20:43:09.125885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 32827. [D 20:43:09.125899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 32828. [D 20:43:09.125909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 32829. [D 20:43:09.125919] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 32830. [D 20:43:09.133999] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 32830. [D 20:43:09.134018] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 36/70. [D 20:43:09.136287] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.136300] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.136311] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:09.194807] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.194866] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.194876] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:09.194913] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5605 [D 20:43:09.194924] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:09.194938] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 37/70. [D 20:43:09.224318] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5599 [D 20:43:09.224337] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 38/70. [D 20:43:09.224403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 32830. [D 20:43:09.224470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 32831. [D 20:43:09.224490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 32832. [D 20:43:09.224504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 32833. [D 20:43:09.224514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 32834. [D 20:43:09.224525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 32835. [D 20:43:09.224535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 32836. [D 20:43:09.224545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 32837. [D 20:43:09.224562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 32838. [D 20:43:09.224572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 32839. [D 20:43:09.224582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 32840. [D 20:43:09.224592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 32841. [D 20:43:09.224602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 32842. [D 20:43:09.224622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 32843. [D 20:43:09.224631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 32844. [D 20:43:09.224680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 32845. [D 20:43:09.224692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 32846. [D 20:43:09.224702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 32847. [D 20:43:09.224712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 32848. [D 20:43:09.224722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 32849. [D 20:43:09.224733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 32850. [D 20:43:09.224757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 32851. [D 20:43:09.224767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 32852. [D 20:43:09.224777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 32853. [D 20:43:09.224791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 32854. [D 20:43:09.224801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 32855. [D 20:43:09.224811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 32856. [D 20:43:09.224821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 32857. [D 20:43:09.224838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 32858. [D 20:43:09.224848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 32859. [D 20:43:09.224858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 32860. [D 20:43:09.224868] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 32861. [D 20:43:09.229832] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.229848] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.229859] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.229895] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5607 [D 20:43:09.229907] element 0: offset: 0x2aaaab234120, size: 24 [D 20:43:09.229920] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 39/70. [D 20:43:09.230337] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 32861. [D 20:43:09.230353] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 40/70. [D 20:43:09.232670] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.232684] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.232695] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.234739] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5607 [D 20:43:09.234765] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 41/70. [D 20:43:09.236137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 32861. [D 20:43:09.236191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 32862. [D 20:43:09.236203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 32863. [D 20:43:09.236214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 32864. [D 20:43:09.236229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 32865. [D 20:43:09.236239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 32866. [D 20:43:09.236628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 32867. [D 20:43:09.236643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 32868. [D 20:43:09.236654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 32869. [D 20:43:09.236668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 32870. [D 20:43:09.236678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 32871. [D 20:43:09.236688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 32872. [D 20:43:09.236701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 32873. [D 20:43:09.236711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 32874. [D 20:43:09.236721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 32875. [D 20:43:09.236737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 32876. [D 20:43:09.236747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 32877. [D 20:43:09.236757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 32878. [D 20:43:09.236767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 32879. [D 20:43:09.236795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 32880. [D 20:43:09.236805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 32881. [D 20:43:09.236818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 32882. [D 20:43:09.236834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 32883. [D 20:43:09.236844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 32884. [D 20:43:09.236869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 32885. [D 20:43:09.236879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 32886. [D 20:43:09.236889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 32887. [D 20:43:09.236904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 32888. [D 20:43:09.236914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 32889. [D 20:43:09.236924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 32890. [D 20:43:09.236939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 32891. [D 20:43:09.236949] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 32892. [D 20:43:09.240983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.240999] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.241010] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.241046] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5611 [D 20:43:09.241058] element 0: offset: 0x2aaaab222ae0, size: 24 [D 20:43:09.241073] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 42/70. [D 20:43:09.242057] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 32892. [D 20:43:09.242072] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 43/70. [D 20:43:09.244390] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.244403] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.244413] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.246445] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5611 [D 20:43:09.246464] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 44/70. [D 20:43:09.246527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 32892. [D 20:43:09.246580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 32893. [D 20:43:09.246591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 32894. [D 20:43:09.246629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 32895. [D 20:43:09.246640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 32896. [D 20:43:09.246650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 32897. [D 20:43:09.246660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 32898. [D 20:43:09.246676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 32899. [D 20:43:09.246686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 32900. [D 20:43:09.246695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 32901. [D 20:43:09.246706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 32902. [D 20:43:09.246731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 32903. [D 20:43:09.246743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 32904. [D 20:43:09.246766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 32905. [D 20:43:09.246777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 32906. [D 20:43:09.246801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 32907. [D 20:43:09.246812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 32908. [D 20:43:09.246821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 32909. [D 20:43:09.246838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 32910. [D 20:43:09.246848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 32911. [D 20:43:09.246857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 32912. [D 20:43:09.246884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 32913. [D 20:43:09.246894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 32914. [D 20:43:09.246908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 32915. [D 20:43:09.246918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 32916. [D 20:43:09.246934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 32917. [D 20:43:09.246945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 32918. [D 20:43:09.246968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 32919. [D 20:43:09.246979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 32920. [D 20:43:09.246989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 32921. [D 20:43:09.246999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 32922. [D 20:43:09.247011] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 32923. [D 20:43:09.252490] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 32923. [D 20:43:09.252506] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 45/70. [D 20:43:09.254718] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.254733] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.254743] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:09.290146] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5605 [D 20:43:09.290165] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 46/70. [D 20:43:09.290228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 32923. [D 20:43:09.290295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 32924. [D 20:43:09.290316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 32925. [D 20:43:09.290329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 32926. [D 20:43:09.290339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 32927. [D 20:43:09.290350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 32928. [D 20:43:09.290361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 32929. [D 20:43:09.290371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 32930. [D 20:43:09.290381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 32931. [D 20:43:09.290392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 32932. [D 20:43:09.290401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 32933. [D 20:43:09.290411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 32934. [D 20:43:09.290421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 32935. [D 20:43:09.290440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 32936. [D 20:43:09.290450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 32937. [D 20:43:09.290460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 32938. [D 20:43:09.290480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 32939. [D 20:43:09.290490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 32940. [D 20:43:09.290500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 32941. [D 20:43:09.290510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 32942. [D 20:43:09.290527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 32943. [D 20:43:09.290537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 32944. [D 20:43:09.290547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 32945. [D 20:43:09.290587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 32946. [D 20:43:09.290601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 32947. [D 20:43:09.290610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 32948. [D 20:43:09.290621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 32949. [D 20:43:09.290631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 32950. [D 20:43:09.290641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 32951. [D 20:43:09.290678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 32952. [D 20:43:09.290688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 32953. [D 20:43:09.290699] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 32954. [D 20:43:09.296149] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 32954. [D 20:43:09.296165] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 47/70. [D 20:43:09.298384] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.298399] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.298409] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:09.389198] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.389213] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.389225] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:09.389258] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5614 [D 20:43:09.389270] element 0: offset: 0x2aaaab2087d0, size: 24 [D 20:43:09.389282] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 48/70. [D 20:43:09.393810] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5614 [D 20:43:09.393828] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 49/70. [D 20:43:09.393909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 32954. [D 20:43:09.393979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 32955. [D 20:43:09.393992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 32956. [D 20:43:09.394003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 32957. [D 20:43:09.394017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 32958. [D 20:43:09.394027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 32959. [D 20:43:09.394037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 32960. [D 20:43:09.394050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32961. [D 20:43:09.394060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32962. [D 20:43:09.394069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32963. [D 20:43:09.394085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32964. [D 20:43:09.394095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32965. [D 20:43:09.394105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32966. [D 20:43:09.394120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32967. [D 20:43:09.394130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32968. [D 20:43:09.394140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 32969. [D 20:43:09.394156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 32970. [D 20:43:09.394165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 32971. [D 20:43:09.394175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 32972. [D 20:43:09.394234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 32973. [D 20:43:09.394244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 32974. [D 20:43:09.394254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 32975. [D 20:43:09.394270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 32976. [D 20:43:09.394280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 32977. [D 20:43:09.394290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 32978. [D 20:43:09.394306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 32979. [D 20:43:09.394315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 32980. [D 20:43:09.394325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 32981. [D 20:43:09.394341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 32982. [D 20:43:09.394351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 32983. [D 20:43:09.394360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 32984. [D 20:43:09.394393] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 32985. [D 20:43:09.405649] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 32985. [D 20:43:09.405666] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 50/70. [D 20:43:09.406795] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.406810] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.406820] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:09.416250] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.416264] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.416274] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:09.416305] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5617 [D 20:43:09.416316] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:09.416333] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 51/70. [D 20:43:09.418701] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5617 [D 20:43:09.418720] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 52/70. [D 20:43:09.424235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 32985. [D 20:43:09.424298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 32986. [D 20:43:09.424310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 32987. [D 20:43:09.424321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 32988. [D 20:43:09.424331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 32989. [D 20:43:09.424342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 32990. [D 20:43:09.424352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 32991. [D 20:43:09.424362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 32992. [D 20:43:09.424372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 32993. [D 20:43:09.424382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 32994. [D 20:43:09.424392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 32995. [D 20:43:09.424402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 32996. [D 20:43:09.424412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 32997. [D 20:43:09.424422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 32998. [D 20:43:09.424431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 32999. [D 20:43:09.424442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33000. [D 20:43:09.424452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33001. [D 20:43:09.424462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 33002. [D 20:43:09.424471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 33003. [D 20:43:09.424489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 33004. [D 20:43:09.424499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 33005. [D 20:43:09.424509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 33006. [D 20:43:09.424543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33007. [D 20:43:09.424554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33008. [D 20:43:09.424565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33009. [D 20:43:09.424575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 33010. [D 20:43:09.424591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 33011. [D 20:43:09.424614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 33012. [D 20:43:09.424627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 33013. [D 20:43:09.424637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 33014. [D 20:43:09.424663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33015. [D 20:43:09.424677] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33016. [D 20:43:09.430173] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 33016. [D 20:43:09.430189] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 53/70. [D 20:43:09.430797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.430812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.430822] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:09.439404] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.439418] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.439429] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:09.439459] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5622 [D 20:43:09.439471] element 0: offset: 0x2aaaab209460, size: 24 [D 20:43:09.439482] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 54/70. [D 20:43:09.439502] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.439516] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.439525] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:09.439539] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5624 [D 20:43:09.439550] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:09.439563] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 55/70. [D 20:43:09.439579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.439588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.439597] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.439635] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5625 [D 20:43:09.439646] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:09.439655] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 56/70. [D 20:43:09.445986] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5624 [D 20:43:09.446047] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 57/70. [D 20:43:09.446106] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5625 [D 20:43:09.446119] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 58/70. [D 20:43:09.447181] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5622 [D 20:43:09.447198] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 59/70. [D 20:43:09.447231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 33016. [D 20:43:09.447301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 33017. [D 20:43:09.447313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 33018. [D 20:43:09.447323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 33019. [D 20:43:09.447365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 33020. [D 20:43:09.447375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 33021. [D 20:43:09.447385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 33022. [D 20:43:09.447400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 33023. [D 20:43:09.447409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 33024. [D 20:43:09.447419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 33025. [D 20:43:09.447435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 33026. [D 20:43:09.447445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 33027. [D 20:43:09.447455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 33028. [D 20:43:09.447471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 33029. [D 20:43:09.447481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 33030. [D 20:43:09.447490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 33031. [D 20:43:09.447540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 33032. [D 20:43:09.447552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 33033. [D 20:43:09.447562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 33034. [D 20:43:09.447587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 33035. [D 20:43:09.447597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 33036. [D 20:43:09.447607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 33037. [D 20:43:09.447623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 33038. [D 20:43:09.447633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 33039. [D 20:43:09.447659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 33040. [D 20:43:09.447669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 33041. [D 20:43:09.447679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 33042. [D 20:43:09.447694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 33043. [D 20:43:09.447704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 33044. [D 20:43:09.447714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 33045. [D 20:43:09.447744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 33046. [D 20:43:09.447764] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 33047. [D 20:43:09.447778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 33048. [D 20:43:09.447805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 33049. [D 20:43:09.447816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 33050. [D 20:43:09.447826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 33051. [D 20:43:09.447837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 33052. [D 20:43:09.447847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 33053. [D 20:43:09.447873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 33054. [D 20:43:09.447884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 33055. [D 20:43:09.447894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 33056. [D 20:43:09.447905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 33057. [D 20:43:09.447915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 33058. [D 20:43:09.447925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 33059. [D 20:43:09.447950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 33060. [D 20:43:09.447964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 33061. [D 20:43:09.447975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 33062. [D 20:43:09.447985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 33063. [D 20:43:09.448009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 33064. [D 20:43:09.448019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 33065. [D 20:43:09.448029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 33066. [D 20:43:09.448045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 33067. [D 20:43:09.448055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 33068. [D 20:43:09.448065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 33069. [D 20:43:09.448088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 33070. [D 20:43:09.448098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 33071. [D 20:43:09.448108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 33072. [D 20:43:09.448118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 33073. [D 20:43:09.448128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 33074. [D 20:43:09.448139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 33075. [D 20:43:09.448163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 33076. [D 20:43:09.448176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 33077. [D 20:43:09.448191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 33078. [D 20:43:09.448201] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 33079. [D 20:43:09.448212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 33080. [D 20:43:09.448227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33081. [D 20:43:09.448236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33082. [D 20:43:09.448247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33083. [D 20:43:09.448261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33084. [D 20:43:09.448271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33085. [D 20:43:09.448281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33086. [E 20:43:09.448300] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 33087, block for 10 ms. [D 20:43:09.448586] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33086. [E 20:43:09.448600] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 33087, block for 10 ms. [D 20:43:09.458829] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 33086. [D 20:43:09.458846] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 60/70. [D 20:43:09.458857] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33085. [D 20:43:09.458868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33086. [D 20:43:09.458878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33087. [D 20:43:09.458888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33088. [D 20:43:09.458898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33089. [D 20:43:09.458908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33090. [D 20:43:09.458924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33091. [D 20:43:09.458933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33092. [D 20:43:09.458944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33093. [D 20:43:09.458954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33094. [D 20:43:09.458965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33095. [D 20:43:09.458975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33096. [D 20:43:09.458989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33097. [D 20:43:09.458999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33098. [D 20:43:09.459009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33099. [D 20:43:09.459019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33100. [D 20:43:09.459036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33101. [D 20:43:09.459046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 33102. [D 20:43:09.459056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 33103. [D 20:43:09.459066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 33104. [D 20:43:09.459076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 33105. [D 20:43:09.459086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 33106. [D 20:43:09.459096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 33107. [D 20:43:09.459118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 33108. [D 20:43:09.459129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 33109. [D 20:43:09.459139] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 33110. [D 20:43:09.461430] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.461445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.461455] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:09.461492] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5629 [D 20:43:09.461505] element 0: offset: 0x2aaaab2086f0, size: 24 [D 20:43:09.461518] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 0/70. [D 20:43:09.470568] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 33110. [D 20:43:09.470582] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 1/70. [D 20:43:09.475127] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.475141] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.475152] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:09.482160] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 33109. [D 20:43:09.482174] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 2/70. [D 20:43:09.482779] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.482792] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.482801] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:09.482816] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5632 [D 20:43:09.482826] element 0: offset: 0x2aaaab234120, size: 24 [D 20:43:09.482835] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 3/70. [D 20:43:09.482851] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.482861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.482869] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:09.482945] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.482958] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.482976] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.487783] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5629 [D 20:43:09.487841] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 4/70. [D 20:43:09.489546] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5632 [D 20:43:09.489581] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 5/70. [D 20:43:09.492604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 33109. [D 20:43:09.492664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 33110. [D 20:43:09.492676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 33111. [D 20:43:09.492686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 33112. [D 20:43:09.492697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 33113. [D 20:43:09.492707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 33114. [D 20:43:09.492717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 33115. [D 20:43:09.492729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 33116. [D 20:43:09.492746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 33117. [D 20:43:09.492757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 33118. [D 20:43:09.492766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 33119. [D 20:43:09.492777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 33120. [D 20:43:09.492787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 33121. [D 20:43:09.492796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 33122. [D 20:43:09.492806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 33123. [D 20:43:09.492823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33124. [D 20:43:09.492833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33125. [D 20:43:09.492842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 33126. [D 20:43:09.492877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 33127. [D 20:43:09.492900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 33128. [D 20:43:09.492911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 33129. [D 20:43:09.492921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 33130. [D 20:43:09.492937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33131. [D 20:43:09.492947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33132. [D 20:43:09.492957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33133. [D 20:43:09.492983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 33134. [D 20:43:09.492993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 33135. [D 20:43:09.493007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 33136. [D 20:43:09.493017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 33137. [D 20:43:09.493027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 33138. [D 20:43:09.493054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33139. [D 20:43:09.493064] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33140. [D 20:43:09.493079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 33141. [D 20:43:09.493089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 33142. [D 20:43:09.493100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 33143. [D 20:43:09.493124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 33144. [D 20:43:09.493138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 33145. [D 20:43:09.493148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 33146. [D 20:43:09.493158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 33147. [D 20:43:09.493168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 33148. [D 20:43:09.493178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 33149. [D 20:43:09.493188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 33150. [D 20:43:09.493198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 33151. [D 20:43:09.493221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 33152. [D 20:43:09.493234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 33153. [D 20:43:09.493244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 33154. [D 20:43:09.493254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 33155. [D 20:43:09.493264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 33156. [D 20:43:09.493283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 33157. [D 20:43:09.493293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 33158. [D 20:43:09.493303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 33159. [D 20:43:09.493313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 33160. [D 20:43:09.493329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 33161. [D 20:43:09.493339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 33162. [D 20:43:09.493349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 33163. [D 20:43:09.493359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 33164. [D 20:43:09.493385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 33165. [D 20:43:09.493396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 33166. [D 20:43:09.493406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 33167. [D 20:43:09.493416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 33168. [D 20:43:09.493426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 33169. [D 20:43:09.493449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 33170. [D 20:43:09.493460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 33171. [D 20:43:09.493470] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 33172. [D 20:43:09.497698] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.497713] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.497724] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.497757] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5635 [D 20:43:09.497768] element 0: offset: 0x2aaaab2087d0, size: 24 [D 20:43:09.497782] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 6/70. [D 20:43:09.497801] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.497811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.497819] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:09.497839] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5638 [D 20:43:09.497849] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:09.497858] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 7/70. [D 20:43:09.502776] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 33172. [D 20:43:09.502792] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 8/70. [D 20:43:09.510276] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 33171. [D 20:43:09.510290] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 9/70. [D 20:43:09.512558] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.512572] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.512582] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:09.512649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.512662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.512671] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.514885] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5635 [D 20:43:09.514943] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 10/70. [D 20:43:09.515165] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5638 [D 20:43:09.515182] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 11/70. [D 20:43:09.515867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 33171. [D 20:43:09.515913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 33172. [D 20:43:09.515925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 33173. [D 20:43:09.515935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 33174. [D 20:43:09.515946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 33175. [D 20:43:09.515957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 33176. [D 20:43:09.515966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 33177. [D 20:43:09.515977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 33178. [D 20:43:09.515987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 33179. [D 20:43:09.515997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 33180. [D 20:43:09.516006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 33181. [D 20:43:09.516024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 33182. [D 20:43:09.516034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 33183. [D 20:43:09.516043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 33184. [D 20:43:09.516054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 33185. [D 20:43:09.516065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 33186. [D 20:43:09.516074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 33187. [D 20:43:09.516089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 33188. [D 20:43:09.516100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 33189. [D 20:43:09.516110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 33190. [D 20:43:09.516119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 33191. [D 20:43:09.516159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 33192. [D 20:43:09.516172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 33193. [D 20:43:09.516182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 33194. [D 20:43:09.516197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 33195. [D 20:43:09.516208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 33196. [D 20:43:09.516218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 33197. [D 20:43:09.516228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 33198. [D 20:43:09.516238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 33199. [D 20:43:09.516248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 33200. [D 20:43:09.516258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 33201. [D 20:43:09.516285] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 33202. [D 20:43:09.516298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 33203. [D 20:43:09.516309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33204. [D 20:43:09.516320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33205. [D 20:43:09.516330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33206. [D 20:43:09.516340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33207. [D 20:43:09.516350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33208. [D 20:43:09.516360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33209. [D 20:43:09.516370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33210. [D 20:43:09.516403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33211. [D 20:43:09.516414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33212. [D 20:43:09.516424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33213. [D 20:43:09.516434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33214. [D 20:43:09.516445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33215. [D 20:43:09.516456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33216. [D 20:43:09.516465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33217. [D 20:43:09.516480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33218. [D 20:43:09.516491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33219. [D 20:43:09.516501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33220. [D 20:43:09.516526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33221. [D 20:43:09.516536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33222. [D 20:43:09.516547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33223. [D 20:43:09.516562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33224. [D 20:43:09.516572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33225. [D 20:43:09.516582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 33226. [D 20:43:09.516611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 33227. [D 20:43:09.516621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 33228. [D 20:43:09.516634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 33229. [D 20:43:09.516644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 33230. [D 20:43:09.516654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 33231. [D 20:43:09.516670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 33232. [D 20:43:09.516680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 33233. [D 20:43:09.516690] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 33234. [D 20:43:09.526722] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.526737] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.526748] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.526790] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5642 [D 20:43:09.526801] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:09.526814] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 12/70. [D 20:43:09.526834] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.526858] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.526867] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:09.526883] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5644 [D 20:43:09.526893] element 0: offset: 0x2aaaab209460, size: 24 [D 20:43:09.526903] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 13/70. [D 20:43:09.527642] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 33234. [D 20:43:09.527657] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 14/70. [D 20:43:09.536629] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 33233. [D 20:43:09.536645] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 15/70. [D 20:43:09.538917] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.538931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.538940] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:09.539019] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.539033] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.539042] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.541507] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5644 [D 20:43:09.541560] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 16/70. [D 20:43:09.541630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 33233. [D 20:43:09.541646] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5642 [D 20:43:09.541689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 33234. [D 20:43:09.541725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 33235. [D 20:43:09.541736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 33236. [D 20:43:09.541746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 33237. [D 20:43:09.541756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 33238. [D 20:43:09.541772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 33239. [D 20:43:09.541782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 33240. [D 20:43:09.541792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 33241. [D 20:43:09.541808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 33242. [D 20:43:09.541818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 33243. [D 20:43:09.541828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 33244. [D 20:43:09.541838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 33245. [D 20:43:09.541856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 33246. [D 20:43:09.541883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 33247. [D 20:43:09.541898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 33248. [D 20:43:09.541909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 33249. [D 20:43:09.541919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 33250. [D 20:43:09.541933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 33251. [D 20:43:09.541943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 33252. [D 20:43:09.541953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 33253. [D 20:43:09.541963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 33254. [D 20:43:09.541973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 33255. [D 20:43:09.541983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 33256. [D 20:43:09.542003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 33257. [D 20:43:09.542013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 33258. [D 20:43:09.542023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 33259. [D 20:43:09.542033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 33260. [D 20:43:09.542043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 33261. [D 20:43:09.542056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 33262. [D 20:43:09.542066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 33263. [D 20:43:09.542076] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 33264. [D 20:43:09.542121] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 17/70. [D 20:43:09.547601] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 33264. [D 20:43:09.547620] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 18/70. [D 20:43:09.547632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 33264. [D 20:43:09.547642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 33265. [D 20:43:09.547653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 33266. [D 20:43:09.547664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 33267. [D 20:43:09.547674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 33268. [D 20:43:09.547684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 33269. [D 20:43:09.547694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 33270. [D 20:43:09.547704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 33271. [D 20:43:09.547714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 33272. [D 20:43:09.547745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 33273. [D 20:43:09.547755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 33274. [D 20:43:09.547765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 33275. [D 20:43:09.547781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 33276. [D 20:43:09.547791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 33277. [D 20:43:09.547810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 33278. [D 20:43:09.547820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33279. [D 20:43:09.547830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33280. [D 20:43:09.547845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 33281. [D 20:43:09.547855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 33282. [D 20:43:09.547865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 33283. [D 20:43:09.547875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 33284. [D 20:43:09.547902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 33285. [D 20:43:09.547912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33286. [D 20:43:09.547922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33287. [D 20:43:09.547933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33288. [D 20:43:09.547942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 33289. [D 20:43:09.547966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 33290. [D 20:43:09.547977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 33291. [D 20:43:09.547987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 33292. [D 20:43:09.547997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 33293. [D 20:43:09.548007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33294. [D 20:43:09.548033] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33295. [D 20:43:09.548086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.548113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.548123] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:09.553503] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 33295. [D 20:43:09.553519] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 19/70. [D 20:43:09.555793] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.555806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.555816] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:09.841072] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.841087] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.841098] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:09.841131] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5646 [D 20:43:09.841143] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:09.841154] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 20/70. [D 20:43:09.843122] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5646 [D 20:43:09.843178] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 21/70. [D 20:43:09.847718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 33295. [D 20:43:09.847736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 33296. [D 20:43:09.847748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 33297. [D 20:43:09.847758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 33298. [D 20:43:09.847768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 33299. [D 20:43:09.847785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 33300. [D 20:43:09.847795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 33301. [D 20:43:09.847805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 33302. [D 20:43:09.847821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 33303. [D 20:43:09.847831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 33304. [D 20:43:09.847840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 33305. [D 20:43:09.847856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 33306. [D 20:43:09.847866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 33307. [D 20:43:09.847876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 33308. [D 20:43:09.847892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 33309. [D 20:43:09.847917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 33310. [D 20:43:09.847930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 33311. [D 20:43:09.847940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 33312. [D 20:43:09.847950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 33313. [D 20:43:09.847974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 33314. [D 20:43:09.847984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 33315. [D 20:43:09.847995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 33316. [D 20:43:09.848004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 33317. [D 20:43:09.848014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 33318. [D 20:43:09.848036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 33319. [D 20:43:09.848047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 33320. [D 20:43:09.848057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 33321. [D 20:43:09.848072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 33322. [D 20:43:09.848082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 33323. [D 20:43:09.848092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 33324. [D 20:43:09.848118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 33325. [D 20:43:09.848128] openib_post_sr_rdmaw: ibv_post_send wr_id 661d80 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 33326. [D 20:43:09.850414] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.850428] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.850439] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:09.850454] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5650 [D 20:43:09.850467] element 0: offset: 0x2aaaab222c10, size: 24 [D 20:43:09.850477] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 22/70. [D 20:43:09.859387] openib_check_cq: completed rdma wr_id 661d80, nic_wr_credit 33326. [D 20:43:09.859402] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 23/70. [D 20:43:09.861732] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.861745] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.861755] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:09.864095] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5650 [D 20:43:09.864115] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 24/70. [D 20:43:09.865421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 33326. [D 20:43:09.865475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33327. [D 20:43:09.865487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33328. [D 20:43:09.865497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33329. [D 20:43:09.865508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33330. [D 20:43:09.865518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33331. [D 20:43:09.865528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33332. [D 20:43:09.865538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33333. [D 20:43:09.865549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33334. [D 20:43:09.865559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33335. [D 20:43:09.865569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33336. [D 20:43:09.865583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33337. [D 20:43:09.865593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33338. [D 20:43:09.865603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33339. [D 20:43:09.865614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33340. [D 20:43:09.865625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33341. [D 20:43:09.865634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33342. [D 20:43:09.865644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33343. [D 20:43:09.865681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33344. [D 20:43:09.865692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33345. [D 20:43:09.865702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33346. [D 20:43:09.865711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33347. [D 20:43:09.865743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33348. [D 20:43:09.865754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 33349. [D 20:43:09.865765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 33350. [D 20:43:09.865775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 33351. [D 20:43:09.865790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 33352. [D 20:43:09.865801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 33353. [D 20:43:09.865811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 33354. [D 20:43:09.865820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 33355. [D 20:43:09.865830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 33356. [D 20:43:09.865840] openib_post_sr_rdmaw: ibv_post_send wr_id 691f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 33357. [D 20:43:09.874037] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.874053] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.874064] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:09.874100] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5653 [D 20:43:09.874111] element 0: offset: 0x2aaaab234120, size: 24 [D 20:43:09.874125] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 25/70. [D 20:43:09.876660] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.876674] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.876684] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.876699] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5655 [D 20:43:09.876709] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:09.876719] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 26/70. [D 20:43:09.877135] openib_check_cq: completed rdma wr_id 691f20, nic_wr_credit 33357. [D 20:43:09.877150] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 27/70. [D 20:43:09.879583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.879598] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.879607] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.881765] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5655 [D 20:43:09.881821] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 28/70. [D 20:43:09.881878] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5653 [D 20:43:09.881891] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 29/70. [D 20:43:09.883430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 33357. [D 20:43:09.883473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 33358. [D 20:43:09.883485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 33359. [D 20:43:09.883495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 33360. [D 20:43:09.883506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 33361. [D 20:43:09.883517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 33362. [D 20:43:09.883527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 33363. [D 20:43:09.883537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 33364. [D 20:43:09.883547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 33365. [D 20:43:09.883557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 33366. [D 20:43:09.883567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 33367. [D 20:43:09.883584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 33368. [D 20:43:09.883594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 33369. [D 20:43:09.883604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 33370. [D 20:43:09.883614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 33371. [D 20:43:09.883624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 33372. [D 20:43:09.883634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 33373. [D 20:43:09.883644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 33374. [D 20:43:09.883677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 33375. [D 20:43:09.883687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 33376. [D 20:43:09.883698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 33377. [D 20:43:09.883708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 33378. [D 20:43:09.883718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 33379. [D 20:43:09.883742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 33380. [D 20:43:09.883751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 33381. [D 20:43:09.883766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 33382. [D 20:43:09.883776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 33383. [D 20:43:09.883785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 33384. [D 20:43:09.883814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 33385. [D 20:43:09.883823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 33386. [D 20:43:09.883833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 33387. [D 20:43:09.883843] openib_post_sr_rdmaw: ibv_post_send wr_id 662390 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 33388. [D 20:43:09.883856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 33389. [D 20:43:09.883866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 33390. [D 20:43:09.883876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 33391. [D 20:43:09.883886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 33392. [D 20:43:09.883896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 33393. [D 20:43:09.883924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 33394. [D 20:43:09.883934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 33395. [D 20:43:09.883944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 33396. [D 20:43:09.883954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 33397. [D 20:43:09.883964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 33398. [D 20:43:09.883974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 33399. [D 20:43:09.883984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 33400. [D 20:43:09.883994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 33401. [D 20:43:09.884003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 33402. [D 20:43:09.884033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 33403. [D 20:43:09.884044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33404. [D 20:43:09.884056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33405. [D 20:43:09.884066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 33406. [D 20:43:09.884082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 33407. [D 20:43:09.884093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 33408. [D 20:43:09.884102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 33409. [D 20:43:09.884113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 33410. [D 20:43:09.884123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33411. [D 20:43:09.884132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33412. [D 20:43:09.884142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33413. [D 20:43:09.884180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 33414. [D 20:43:09.884190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 33415. [D 20:43:09.884201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 33416. [D 20:43:09.884211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 33417. [D 20:43:09.884222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 33418. [D 20:43:09.884235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33419. [D 20:43:09.884245] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33420. [D 20:43:09.888456] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.888471] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.888483] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.888518] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5659 [D 20:43:09.888529] element 0: offset: 0x2aaaab2370e0, size: 24 [D 20:43:09.888544] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 30/70. [D 20:43:09.895123] openib_check_cq: completed rdma wr_id 662390, nic_wr_credit 33420. [D 20:43:09.895138] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 31/70. [D 20:43:09.906683] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 33419. [D 20:43:09.906697] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 32/70. [D 20:43:09.909015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.909028] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.909038] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.909095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.909108] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.909117] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:09.911475] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5659 [D 20:43:09.911494] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 33/70. [D 20:43:09.912323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 33419. [D 20:43:09.912376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33420. [D 20:43:09.912387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33421. [D 20:43:09.912398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33422. [D 20:43:09.912413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33423. [D 20:43:09.912423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33424. [D 20:43:09.912432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33425. [D 20:43:09.912446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33426. [D 20:43:09.912456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33427. [D 20:43:09.912466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33428. [D 20:43:09.912482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33429. [D 20:43:09.912492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33430. [D 20:43:09.912502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33431. [D 20:43:09.912517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33432. [D 20:43:09.912527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33433. [D 20:43:09.912537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33434. [D 20:43:09.912573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33435. [D 20:43:09.912584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33436. [D 20:43:09.912594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33437. [D 20:43:09.912604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33438. [D 20:43:09.912634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33439. [D 20:43:09.912649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33440. [D 20:43:09.912659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33441. [D 20:43:09.912670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 33442. [D 20:43:09.912686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 33443. [D 20:43:09.912696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 33444. [D 20:43:09.912705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 33445. [D 20:43:09.912721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 33446. [D 20:43:09.912747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 33447. [D 20:43:09.912757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 33448. [D 20:43:09.912767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 33449. [D 20:43:09.912783] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 33450. [D 20:43:09.922812] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.922828] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.922839] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:09.922873] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5663 [D 20:43:09.922885] element 0: offset: 0x2aaaab237090, size: 24 [D 20:43:09.923509] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 34/70. [D 20:43:09.923533] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.923543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.923557] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.923573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5664 [D 20:43:09.923583] element 0: offset: 0x2aaaab229ca0, size: 24 [D 20:43:09.923593] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 35/70. [D 20:43:09.924165] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 33450. [D 20:43:09.924180] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 36/70. [D 20:43:09.926519] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.926534] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.926543] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.928817] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5664 [D 20:43:09.928871] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 37/70. [D 20:43:09.928887] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5663 [D 20:43:09.928897] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 38/70. [D 20:43:09.930274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 33450. [D 20:43:09.930319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 33451. [D 20:43:09.930330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 33452. [D 20:43:09.930341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 33453. [D 20:43:09.930351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 33454. [D 20:43:09.930362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 33455. [D 20:43:09.930372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 33456. [D 20:43:09.930382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 33457. [D 20:43:09.930393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 33458. [D 20:43:09.930402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 33459. [D 20:43:09.930412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 33460. [D 20:43:09.930430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 33461. [D 20:43:09.930440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 33462. [D 20:43:09.930450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 33463. [D 20:43:09.930500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 33464. [D 20:43:09.930511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 33465. [D 20:43:09.930521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 33466. [D 20:43:09.930532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 33467. [D 20:43:09.930557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 33468. [D 20:43:09.930572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 33469. [D 20:43:09.930582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 33470. [D 20:43:09.930591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 33471. [D 20:43:09.930606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 33472. [D 20:43:09.930616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 33473. [D 20:43:09.930626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 33474. [D 20:43:09.930657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 33475. [D 20:43:09.930667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 33476. [D 20:43:09.930677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 33477. [D 20:43:09.930691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 33478. [D 20:43:09.930701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 33479. [D 20:43:09.930711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 33480. [D 20:43:09.930721] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 33481. [D 20:43:09.930740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 33482. [D 20:43:09.930750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 33483. [D 20:43:09.930775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 33484. [D 20:43:09.930785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 33485. [D 20:43:09.930806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 33486. [D 20:43:09.930817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 33487. [D 20:43:09.930827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 33488. [D 20:43:09.930837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 33489. [D 20:43:09.930863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 33490. [D 20:43:09.930872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 33491. [D 20:43:09.930882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 33492. [D 20:43:09.930897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 33493. [D 20:43:09.930907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 33494. [D 20:43:09.930916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 33495. [D 20:43:09.930927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 33496. [D 20:43:09.930938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33497. [D 20:43:09.930947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33498. [D 20:43:09.930972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 33499. [D 20:43:09.930982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 33500. [D 20:43:09.930992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 33501. [D 20:43:09.931021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 33502. [D 20:43:09.931031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 33503. [D 20:43:09.931043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33504. [D 20:43:09.931053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33505. [D 20:43:09.931065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33506. [D 20:43:09.931089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 33507. [D 20:43:09.931099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 33508. [D 20:43:09.931109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 33509. [D 20:43:09.931119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 33510. [D 20:43:09.931129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 33511. [D 20:43:09.931139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33512. [D 20:43:09.931154] openib_post_sr_rdmaw: ibv_post_send wr_id 61e780 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33513. [D 20:43:09.942018] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 33513. [D 20:43:09.942034] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 39/70. [D 20:43:09.953515] openib_check_cq: completed rdma wr_id 61e780, nic_wr_credit 33512. [D 20:43:09.953529] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 40/70. [D 20:43:09.955862] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.955878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.955887] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:09.955904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.955916] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.955925] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:09.970811] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.970826] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.970836] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:09.970867] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5670 [D 20:43:09.970878] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:09.970901] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 41/70. [D 20:43:09.970942] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.970953] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.970962] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:09.970990] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5671 [D 20:43:09.971000] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:09.971011] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 42/70. [D 20:43:09.971030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:09.971040] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.971048] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:09.971063] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5674 [D 20:43:09.971073] element 0: offset: 0x2aaaab2086f0, size: 24 [D 20:43:09.971083] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 43/70. [D 20:43:09.975517] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5671 [D 20:43:09.975564] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 44/70. [D 20:43:09.975665] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5670 [D 20:43:09.975678] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 45/70. [D 20:43:09.975696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 33512. [D 20:43:09.975713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 33513. [D 20:43:09.975723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 33514. [D 20:43:09.975733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 33515. [D 20:43:09.975743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 33516. [D 20:43:09.975753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 33517. [D 20:43:09.975763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 33518. [D 20:43:09.975773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 33519. [D 20:43:09.975782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 33520. [D 20:43:09.975792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33521. [D 20:43:09.975802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 33522. [D 20:43:09.975812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 33523. [D 20:43:09.975822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 33524. [D 20:43:09.975832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 33525. [D 20:43:09.975842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 33526. [D 20:43:09.975851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33527. [D 20:43:09.975861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33528. [D 20:43:09.975871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33529. [D 20:43:09.975881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 33530. [D 20:43:09.975891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 33531. [D 20:43:09.975902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 33532. [D 20:43:09.975912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 33533. [D 20:43:09.975922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 33534. [D 20:43:09.975931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33535. [D 20:43:09.975941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33536. [D 20:43:09.975951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33537. [D 20:43:09.975961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 33538. [D 20:43:09.975971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 33539. [D 20:43:09.975980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 33540. [D 20:43:09.975991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 33541. [D 20:43:09.976000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 33542. [D 20:43:09.976010] openib_post_sr_rdmaw: ibv_post_send wr_id 61fa10 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33543. [D 20:43:09.976023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 33544. [D 20:43:09.976033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33545. [D 20:43:09.976043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33546. [D 20:43:09.976053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33547. [D 20:43:09.976062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33548. [D 20:43:09.976072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33549. [D 20:43:09.976082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33550. [D 20:43:09.976093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33551. [D 20:43:09.976102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33552. [D 20:43:09.976112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33553. [D 20:43:09.976122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33554. [D 20:43:09.976132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33555. [D 20:43:09.976142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33556. [D 20:43:09.976152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33557. [D 20:43:09.976162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33558. [D 20:43:09.976171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33559. [D 20:43:09.976181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33560. [D 20:43:09.976192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33561. [D 20:43:09.976202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33562. [D 20:43:09.976212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33563. [D 20:43:09.976222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33564. [D 20:43:09.976232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33565. [D 20:43:09.976242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33566. [D 20:43:09.976252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 33567. [D 20:43:09.976261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 33568. [D 20:43:09.976271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 33569. [D 20:43:09.976281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 33570. [D 20:43:09.976291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 33571. [D 20:43:09.976301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 33572. [D 20:43:09.976310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 33573. [D 20:43:09.976320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 33574. [D 20:43:09.976330] openib_post_sr_rdmaw: ibv_post_send wr_id 6423a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 33575. [D 20:43:09.978765] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5674 [D 20:43:09.978783] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 46/70. [D 20:43:09.987257] openib_check_cq: completed rdma wr_id 61fa10, nic_wr_credit 33575. [D 20:43:09.987272] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 47/70. [D 20:43:09.997864] openib_check_cq: completed rdma wr_id 6423a0, nic_wr_credit 33574. [D 20:43:09.997878] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 48/70. [D 20:43:09.997891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 33574. [D 20:43:09.997901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 33575. [D 20:43:09.997916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 33576. [D 20:43:09.997927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 33577. [D 20:43:09.997937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 33578. [D 20:43:09.997948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 33579. [D 20:43:09.997958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 33580. [D 20:43:09.997968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 33581. [D 20:43:09.997977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 33582. [D 20:43:09.997993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 33583. [D 20:43:09.998003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 33584. [D 20:43:09.998013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 33585. [D 20:43:09.998045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 33586. [D 20:43:09.998056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 33587. [D 20:43:09.998067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 33588. [D 20:43:09.998077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 33589. [D 20:43:09.998088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 33590. [D 20:43:09.998098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 33591. [D 20:43:09.998108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 33592. [D 20:43:09.998131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 33593. [D 20:43:09.998141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 33594. [D 20:43:09.998151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 33595. [D 20:43:09.998178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 33596. [D 20:43:09.998189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 33597. [D 20:43:09.998203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 33598. [D 20:43:09.998213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 33599. [D 20:43:09.998223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 33600. [D 20:43:09.998233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 33601. [D 20:43:09.998243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 33602. [D 20:43:09.998262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 33603. [D 20:43:09.998273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 33604. [D 20:43:09.998284] openib_post_sr_rdmaw: ibv_post_send wr_id 64dc20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 33605. [D 20:43:09.998343] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.998378] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.998387] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:09.998410] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:09.998419] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:09.998427] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:10.004095] openib_check_cq: completed rdma wr_id 64dc20, nic_wr_credit 33605. [D 20:43:10.004112] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 49/70. [D 20:43:10.004181] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.004197] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.004206] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.007429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.007442] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.007451] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.007478] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5677 [D 20:43:10.007488] element 0: offset: 0x2aaaab222c10, size: 24 [D 20:43:10.007500] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 50/70. [D 20:43:10.009804] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5677 [D 20:43:10.009832] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 51/70. [D 20:43:10.009880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 33605. [D 20:43:10.009892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33606. [D 20:43:10.009902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33607. [D 20:43:10.009913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33608. [D 20:43:10.009922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33609. [D 20:43:10.009933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33610. [D 20:43:10.009947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33611. [D 20:43:10.009957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33612. [D 20:43:10.009967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33613. [D 20:43:10.009982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33614. [D 20:43:10.009993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33615. [D 20:43:10.010003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33616. [D 20:43:10.010013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33617. [D 20:43:10.010023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33618. [D 20:43:10.010033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33619. [D 20:43:10.010043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33620. [D 20:43:10.010053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33621. [D 20:43:10.010063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33622. [D 20:43:10.010093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33623. [D 20:43:10.010103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33624. [D 20:43:10.010113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33625. [D 20:43:10.010123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33626. [D 20:43:10.010133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33627. [D 20:43:10.010156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 33628. [D 20:43:10.010166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 33629. [D 20:43:10.010176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 33630. [D 20:43:10.010192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 33631. [D 20:43:10.010202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 33632. [D 20:43:10.010212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 33633. [D 20:43:10.010240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 33634. [D 20:43:10.010250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 33635. [D 20:43:10.010264] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 33636. [D 20:43:10.015745] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 33636. [D 20:43:10.015759] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 52/70. [D 20:43:10.015824] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.015861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.015870] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.060200] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.060214] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.060223] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.060249] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5680 [D 20:43:10.060259] element 0: offset: 0x2aaaab234120, size: 24 [D 20:43:10.060272] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 53/70. [D 20:43:10.062691] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5680 [D 20:43:10.062720] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 54/70. [D 20:43:10.062768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 33636. [D 20:43:10.062780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 33637. [D 20:43:10.062790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 33638. [D 20:43:10.062802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 33639. [D 20:43:10.062813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 33640. [D 20:43:10.062823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 33641. [D 20:43:10.062832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 33642. [D 20:43:10.062842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 33643. [D 20:43:10.062852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 33644. [D 20:43:10.062862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 33645. [D 20:43:10.062873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 33646. [D 20:43:10.062904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 33647. [D 20:43:10.062914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 33648. [D 20:43:10.062924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 33649. [D 20:43:10.062934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 33650. [D 20:43:10.062949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 33651. [D 20:43:10.062963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 33652. [D 20:43:10.062972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 33653. [D 20:43:10.062982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 33654. [D 20:43:10.062992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 33655. [D 20:43:10.063004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 33656. [D 20:43:10.063014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 33657. [D 20:43:10.063024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 33658. [D 20:43:10.063034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 33659. [D 20:43:10.063044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 33660. [D 20:43:10.063075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 33661. [D 20:43:10.063091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 33662. [D 20:43:10.063101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 33663. [D 20:43:10.063110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 33664. [D 20:43:10.063126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 33665. [D 20:43:10.063148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 33666. [D 20:43:10.063159] openib_post_sr_rdmaw: ibv_post_send wr_id 63d8f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 33667. [D 20:43:10.068634] openib_check_cq: completed rdma wr_id 63d8f0, nic_wr_credit 33667. [D 20:43:10.068648] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 55/70. [D 20:43:10.068713] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.068749] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.068758] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.287456] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.287471] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.287479] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.287504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5683 [D 20:43:10.287514] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:10.287527] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 56/70. [D 20:43:10.287579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.287591] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.287599] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:10.287617] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5686 [D 20:43:10.287626] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:10.287636] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 57/70. [D 20:43:10.290090] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5683 [D 20:43:10.290109] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 58/70. [D 20:43:10.290255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 33667. [D 20:43:10.290267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 33668. [D 20:43:10.290277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 33669. [D 20:43:10.290286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 33670. [D 20:43:10.290297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 33671. [D 20:43:10.290306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 33672. [D 20:43:10.290316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 33673. [D 20:43:10.290326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 33674. [D 20:43:10.290336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 33675. [D 20:43:10.290345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 33676. [D 20:43:10.290355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 33677. [D 20:43:10.290365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 33678. [D 20:43:10.290375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 33679. [D 20:43:10.290385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 33680. [D 20:43:10.290395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 33681. [D 20:43:10.290404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 33682. [D 20:43:10.290414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 33683. [D 20:43:10.290424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 33684. [D 20:43:10.290434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 33685. [D 20:43:10.290443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 33686. [D 20:43:10.290453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 33687. [D 20:43:10.290463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 33688. [D 20:43:10.290473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 33689. [D 20:43:10.290483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 33690. [D 20:43:10.290493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 33691. [D 20:43:10.290503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 33692. [D 20:43:10.290513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 33693. [D 20:43:10.290523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 33694. [D 20:43:10.290533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 33695. [D 20:43:10.290543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 33696. [D 20:43:10.290552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 33697. [D 20:43:10.290562] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab203410 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 33698. [D 20:43:10.293002] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5686 [D 20:43:10.293019] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 59/70. [D 20:43:10.300852] openib_check_cq: completed rdma wr_id 2aaaab203410, nic_wr_credit 33698. [D 20:43:10.300866] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 60/70. [D 20:43:10.300917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 33698. [D 20:43:10.300929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 33699. [D 20:43:10.300940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 33700. [D 20:43:10.300951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 33701. [D 20:43:10.300961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 33702. [D 20:43:10.300970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 33703. [D 20:43:10.300980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 33704. [D 20:43:10.300995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 33705. [D 20:43:10.301005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 33706. [D 20:43:10.301015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 33707. [D 20:43:10.301042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 33708. [D 20:43:10.301052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 33709. [D 20:43:10.301062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 33710. [D 20:43:10.301078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 33711. [D 20:43:10.301088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 33712. [D 20:43:10.301097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 33713. [D 20:43:10.301108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 33714. [D 20:43:10.301131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 33715. [D 20:43:10.301146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 33716. [D 20:43:10.301156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 33717. [D 20:43:10.301166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 33718. [D 20:43:10.301177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 33719. [D 20:43:10.301186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 33720. [D 20:43:10.301196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 33721. [D 20:43:10.301206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 33722. [D 20:43:10.301223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 33723. [D 20:43:10.301233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 33724. [D 20:43:10.301243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 33725. [D 20:43:10.301269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 33726. [D 20:43:10.301280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 33727. [D 20:43:10.301290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 33728. [D 20:43:10.301300] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208c80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 33729. [D 20:43:10.301361] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.301405] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.301414] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:10.312665] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.312679] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.312687] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:10.312716] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5689 [D 20:43:10.312726] element 0: offset: 0x661b60, size: 24 [D 20:43:10.312739] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 0/70. [D 20:43:10.312757] openib_check_cq: completed rdma wr_id 2aaaab208c80, nic_wr_credit 33729. [D 20:43:10.312773] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 1/70. [D 20:43:10.312874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.312889] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.312898] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:10.315179] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5689 [D 20:43:10.315196] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 2/70. [D 20:43:10.319862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 33729. [D 20:43:10.319877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33730. [D 20:43:10.319889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33731. [D 20:43:10.319899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33732. [D 20:43:10.319909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33733. [D 20:43:10.319924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33734. [D 20:43:10.319934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33735. [D 20:43:10.319943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33736. [D 20:43:10.319960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33737. [D 20:43:10.319969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33738. [D 20:43:10.319979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33739. [D 20:43:10.319995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33740. [D 20:43:10.320005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33741. [D 20:43:10.320015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33742. [D 20:43:10.320031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33743. [D 20:43:10.320041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33744. [D 20:43:10.320066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33745. [D 20:43:10.320076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33746. [D 20:43:10.320086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33747. [D 20:43:10.320101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33748. [D 20:43:10.320122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33749. [D 20:43:10.320137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33750. [D 20:43:10.320147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33751. [D 20:43:10.320156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 33752. [D 20:43:10.320170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 33753. [D 20:43:10.320180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 33754. [D 20:43:10.320204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 33755. [D 20:43:10.320214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 33756. [D 20:43:10.320224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 33757. [D 20:43:10.320238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 33758. [D 20:43:10.320248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 33759. [D 20:43:10.320258] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233fa0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 33760. [D 20:43:10.326163] openib_check_cq: completed rdma wr_id 2aaaab233fa0, nic_wr_credit 33760. [D 20:43:10.326176] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 3/70. [D 20:43:10.326244] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.326282] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.326290] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.329212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.329226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.329234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.329262] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5692 [D 20:43:10.329272] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:10.329285] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 4/70. [D 20:43:10.331711] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5692 [D 20:43:10.331728] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 5/70. [D 20:43:10.331862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 33760. [D 20:43:10.331876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 33761. [D 20:43:10.331887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 33762. [D 20:43:10.331897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 33763. [D 20:43:10.331907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 33764. [D 20:43:10.331932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 33765. [D 20:43:10.331942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 33766. [D 20:43:10.331952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 33767. [D 20:43:10.331962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 33768. [D 20:43:10.331977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 33769. [D 20:43:10.331987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 33770. [D 20:43:10.332009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 33771. [D 20:43:10.332025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 33772. [D 20:43:10.332034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 33773. [D 20:43:10.332044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 33774. [D 20:43:10.332060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33775. [D 20:43:10.332070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33776. [D 20:43:10.332093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 33777. [D 20:43:10.332103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 33778. [D 20:43:10.332113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 33779. [D 20:43:10.332129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 33780. [D 20:43:10.332139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 33781. [D 20:43:10.332149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33782. [D 20:43:10.332158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33783. [D 20:43:10.332182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33784. [D 20:43:10.332192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 33785. [D 20:43:10.332202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 33786. [D 20:43:10.332227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 33787. [D 20:43:10.332238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 33788. [D 20:43:10.332252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 33789. [D 20:43:10.332261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33790. [D 20:43:10.332271] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233fa0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33791. [D 20:43:10.338407] openib_check_cq: completed rdma wr_id 2aaaab233fa0, nic_wr_credit 33791. [D 20:43:10.338420] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 6/70. [D 20:43:10.338485] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.338526] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.338535] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.342254] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.342268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.342276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.342303] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5695 [D 20:43:10.342313] element 0: offset: 0x2aaaab222c10, size: 24 [D 20:43:10.342326] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 7/70. [D 20:43:10.344821] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5695 [D 20:43:10.344841] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 8/70. [D 20:43:10.344972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 33791. [D 20:43:10.344986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33792. [D 20:43:10.344998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33793. [D 20:43:10.345007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33794. [D 20:43:10.345018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33795. [D 20:43:10.345027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33796. [D 20:43:10.345038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33797. [D 20:43:10.345047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33798. [D 20:43:10.345057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33799. [D 20:43:10.345067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33800. [D 20:43:10.345077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33801. [D 20:43:10.345098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33802. [D 20:43:10.345121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33803. [D 20:43:10.345132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33804. [D 20:43:10.345142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33805. [D 20:43:10.345153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33806. [D 20:43:10.345163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33807. [D 20:43:10.345173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33808. [D 20:43:10.345190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33809. [D 20:43:10.345200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33810. [D 20:43:10.345210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33811. [D 20:43:10.345220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33812. [D 20:43:10.345230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33813. [D 20:43:10.345240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 33814. [D 20:43:10.345250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 33815. [D 20:43:10.345277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 33816. [D 20:43:10.345287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 33817. [D 20:43:10.345297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 33818. [D 20:43:10.345308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 33819. [D 20:43:10.345318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 33820. [D 20:43:10.345328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 33821. [D 20:43:10.345338] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233fa0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 33822. [D 20:43:10.351309] openib_check_cq: completed rdma wr_id 2aaaab233fa0, nic_wr_credit 33822. [D 20:43:10.351323] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 9/70. [D 20:43:10.351389] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.351430] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.351439] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.354575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.354589] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.354598] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.354624] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5698 [D 20:43:10.354635] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:10.354647] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 10/70. [D 20:43:10.357043] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5698 [D 20:43:10.357063] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 11/70. [D 20:43:10.357196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 33822. [D 20:43:10.357210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 33823. [D 20:43:10.357221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 33824. [D 20:43:10.357231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 33825. [D 20:43:10.357241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 33826. [D 20:43:10.357265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 33827. [D 20:43:10.357275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 33828. [D 20:43:10.357285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 33829. [D 20:43:10.357295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 33830. [D 20:43:10.357310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 33831. [D 20:43:10.357320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 33832. [D 20:43:10.357342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 33833. [D 20:43:10.357358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 33834. [D 20:43:10.357368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 33835. [D 20:43:10.357378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 33836. [D 20:43:10.357394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33837. [D 20:43:10.357412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33838. [D 20:43:10.357422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 33839. [D 20:43:10.357433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 33840. [D 20:43:10.357443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 33841. [D 20:43:10.357453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 33842. [D 20:43:10.357462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 33843. [D 20:43:10.357488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33844. [D 20:43:10.357498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33845. [D 20:43:10.357508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33846. [D 20:43:10.357518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 33847. [D 20:43:10.357528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 33848. [D 20:43:10.357538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 33849. [D 20:43:10.357553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 33850. [D 20:43:10.357562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 33851. [D 20:43:10.357572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33852. [D 20:43:10.357598] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233fa0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33853. [D 20:43:10.363887] openib_check_cq: completed rdma wr_id 2aaaab233fa0, nic_wr_credit 33853. [D 20:43:10.363901] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 12/70. [D 20:43:10.363965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.364005] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.364014] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.367846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.367860] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.367869] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.367895] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5701 [D 20:43:10.367905] element 0: offset: 0x2aaaab234120, size: 24 [D 20:43:10.367918] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 13/70. [D 20:43:10.370380] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5701 [D 20:43:10.370398] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 14/70. [D 20:43:10.370531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 33853. [D 20:43:10.370546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33854. [D 20:43:10.370556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33855. [D 20:43:10.370566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33856. [D 20:43:10.370577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33857. [D 20:43:10.370586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33858. [D 20:43:10.370596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33859. [D 20:43:10.370606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33860. [D 20:43:10.370633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33861. [D 20:43:10.370643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33862. [D 20:43:10.370653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33863. [D 20:43:10.370663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33864. [D 20:43:10.370673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33865. [D 20:43:10.370699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33866. [D 20:43:10.370710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33867. [D 20:43:10.370720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33868. [D 20:43:10.370735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33869. [D 20:43:10.370745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33870. [D 20:43:10.370754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33871. [D 20:43:10.370771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33872. [D 20:43:10.370781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33873. [D 20:43:10.370805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33874. [D 20:43:10.370820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33875. [D 20:43:10.370833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 33876. [D 20:43:10.370843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 33877. [D 20:43:10.370853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 33878. [D 20:43:10.370863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 33879. [D 20:43:10.370873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 33880. [D 20:43:10.370883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 33881. [D 20:43:10.370893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 33882. [D 20:43:10.370916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 33883. [D 20:43:10.370927] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233fa0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 33884. [D 20:43:10.376956] openib_check_cq: completed rdma wr_id 2aaaab233fa0, nic_wr_credit 33884. [D 20:43:10.376970] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 15/70. [D 20:43:10.377034] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.377075] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.377084] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.380250] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.380264] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.380272] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.380299] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5704 [D 20:43:10.380309] element 0: offset: 0x2aaaab229ca0, size: 24 [D 20:43:10.380322] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 16/70. [D 20:43:10.382713] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5704 [D 20:43:10.382732] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 17/70. [D 20:43:10.382860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 33884. [D 20:43:10.382872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 33885. [D 20:43:10.382884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 33886. [D 20:43:10.382894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 33887. [D 20:43:10.382912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 33888. [D 20:43:10.382927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 33889. [D 20:43:10.382937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 33890. [D 20:43:10.382947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 33891. [D 20:43:10.382963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 33892. [D 20:43:10.382973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 33893. [D 20:43:10.382983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 33894. [D 20:43:10.383005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 33895. [D 20:43:10.383017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 33896. [D 20:43:10.383027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 33897. [D 20:43:10.383037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 33898. [D 20:43:10.383050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33899. [D 20:43:10.383060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33900. [D 20:43:10.383085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 33901. [D 20:43:10.383095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 33902. [D 20:43:10.383105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 33903. [D 20:43:10.383120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 33904. [D 20:43:10.383130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 33905. [D 20:43:10.383140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33906. [D 20:43:10.383170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33907. [D 20:43:10.383181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33908. [D 20:43:10.383192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 33909. [D 20:43:10.383201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 33910. [D 20:43:10.383212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 33911. [D 20:43:10.383234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 33912. [D 20:43:10.383250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 33913. [D 20:43:10.383261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33914. [D 20:43:10.383271] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab236b30 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33915. [D 20:43:10.389458] openib_check_cq: completed rdma wr_id 2aaaab236b30, nic_wr_credit 33915. [D 20:43:10.389473] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 18/70. [D 20:43:10.389538] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.389579] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.389587] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.393326] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.393340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.393348] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.393375] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5707 [D 20:43:10.393385] element 0: offset: 0x2aaaab2087b0, size: 24 [D 20:43:10.393398] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 19/70. [D 20:43:10.395854] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5707 [D 20:43:10.395873] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 20/70. [D 20:43:10.396006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 33915. [D 20:43:10.396020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33916. [D 20:43:10.396031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33917. [D 20:43:10.396041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33918. [D 20:43:10.396066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33919. [D 20:43:10.396076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33920. [D 20:43:10.396087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33921. [D 20:43:10.396097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33922. [D 20:43:10.396106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33923. [D 20:43:10.396121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33924. [D 20:43:10.396145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33925. [D 20:43:10.396156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33926. [D 20:43:10.396170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33927. [D 20:43:10.396179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33928. [D 20:43:10.396189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33929. [D 20:43:10.396211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33930. [D 20:43:10.396221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33931. [D 20:43:10.396235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33932. [D 20:43:10.396245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33933. [D 20:43:10.396255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33934. [D 20:43:10.396282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33935. [D 20:43:10.396292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33936. [D 20:43:10.396302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33937. [D 20:43:10.396317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 33938. [D 20:43:10.396327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 33939. [D 20:43:10.396347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 33940. [D 20:43:10.396359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 33941. [D 20:43:10.396368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 33942. [D 20:43:10.396383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 33943. [D 20:43:10.396394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 33944. [D 20:43:10.396403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 33945. [D 20:43:10.396413] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab236b30 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 33946. [D 20:43:10.402388] openib_check_cq: completed rdma wr_id 2aaaab236b30, nic_wr_credit 33946. [D 20:43:10.402402] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 21/70. [D 20:43:10.402467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.402509] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.402518] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.405575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.405589] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.405598] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.405624] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5710 [D 20:43:10.405634] element 0: offset: 0x2aaaab222c10, size: 24 [D 20:43:10.405647] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 22/70. [D 20:43:10.408284] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5710 [D 20:43:10.408304] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 23/70. [D 20:43:10.408430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 33946. [D 20:43:10.408444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 33947. [D 20:43:10.408455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 33948. [D 20:43:10.408465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 33949. [D 20:43:10.408475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 33950. [D 20:43:10.408500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 33951. [D 20:43:10.408510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 33952. [D 20:43:10.408520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 33953. [D 20:43:10.408530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 33954. [D 20:43:10.408540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 33955. [D 20:43:10.408552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 33956. [D 20:43:10.408573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 33957. [D 20:43:10.408589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 33958. [D 20:43:10.408599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 33959. [D 20:43:10.408609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 33960. [D 20:43:10.408630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 33961. [D 20:43:10.408640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 33962. [D 20:43:10.408651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 33963. [D 20:43:10.408661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 33964. [D 20:43:10.408670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 33965. [D 20:43:10.408680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 33966. [D 20:43:10.408703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 33967. [D 20:43:10.408714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 33968. [D 20:43:10.408723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 33969. [D 20:43:10.408734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 33970. [D 20:43:10.408744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 33971. [D 20:43:10.408761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 33972. [D 20:43:10.408771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 33973. [D 20:43:10.408782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 33974. [D 20:43:10.408792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 33975. [D 20:43:10.408802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 33976. [D 20:43:10.408811] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab236b30 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 33977. [D 20:43:10.414801] openib_check_cq: completed rdma wr_id 2aaaab236b30, nic_wr_credit 33977. [D 20:43:10.414815] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 24/70. [D 20:43:10.417082] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.417096] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.417106] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.420653] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.420667] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.420676] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.420693] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5713 [D 20:43:10.420706] element 0: offset: 0x2aaaab23aa00, size: 24 [D 20:43:10.420717] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 25/70. [D 20:43:10.423299] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5713 [D 20:43:10.423316] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 26/70. [D 20:43:10.427565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 33977. [D 20:43:10.427580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 33978. [D 20:43:10.427591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 33979. [D 20:43:10.427601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 33980. [D 20:43:10.427611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 33981. [D 20:43:10.427625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 33982. [D 20:43:10.427635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 33983. [D 20:43:10.427645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 33984. [D 20:43:10.427661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 33985. [D 20:43:10.427671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 33986. [D 20:43:10.427681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 33987. [D 20:43:10.427691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 33988. [D 20:43:10.427718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 33989. [D 20:43:10.427729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 33990. [D 20:43:10.427739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 33991. [D 20:43:10.427749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 33992. [D 20:43:10.427759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 33993. [D 20:43:10.427783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 33994. [D 20:43:10.427792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 33995. [D 20:43:10.427802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 33996. [D 20:43:10.427818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 33997. [D 20:43:10.427828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 33998. [D 20:43:10.427838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 33999. [D 20:43:10.427848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 34000. [D 20:43:10.427857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 34001. [D 20:43:10.427867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 34002. [D 20:43:10.427888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 34003. [D 20:43:10.427897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 34004. [D 20:43:10.427907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 34005. [D 20:43:10.427917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 34006. [D 20:43:10.427938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 34007. [D 20:43:10.427948] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab236b30 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 34008. [D 20:43:10.430517] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.430531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.430540] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:10.430556] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5717 [D 20:43:10.430569] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:10.430579] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 27/70. [D 20:43:10.432941] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.432954] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.432965] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:10.432980] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5719 [D 20:43:10.432990] element 0: offset: 0x2aaaab229ca0, size: 24 [D 20:43:10.433000] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 28/70. [D 20:43:10.439206] openib_check_cq: completed rdma wr_id 2aaaab236b30, nic_wr_credit 34008. [D 20:43:10.439220] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 29/70. [D 20:43:10.441546] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.441560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.441569] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:10.444206] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5717 [D 20:43:10.444262] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 30/70. [D 20:43:10.444382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 34008. [D 20:43:10.444411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 34009. [D 20:43:10.444422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 34010. [D 20:43:10.444432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 34011. [D 20:43:10.444448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 34012. [D 20:43:10.444460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 34013. [D 20:43:10.444469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 34014. [D 20:43:10.444480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 34015. [D 20:43:10.444489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 34016. [D 20:43:10.444499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 34017. [D 20:43:10.444509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 34018. [D 20:43:10.444527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 34019. [D 20:43:10.444537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 34020. [D 20:43:10.444546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 34021. [D 20:43:10.444557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 34022. [D 20:43:10.444583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 34023. [D 20:43:10.444593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 34024. [D 20:43:10.444603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 34025. [D 20:43:10.444613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 34026. [D 20:43:10.444631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 34027. [D 20:43:10.444655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 34028. [D 20:43:10.444666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 34029. [D 20:43:10.444676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 34030. [D 20:43:10.444686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 34031. [D 20:43:10.444696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 34032. [D 20:43:10.444706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 34033. [D 20:43:10.444716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 34034. [D 20:43:10.444739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 34035. [D 20:43:10.444753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 34036. [D 20:43:10.444763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 34037. [D 20:43:10.444792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 34038. [D 20:43:10.444807] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab232cd0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 34039. [D 20:43:10.446997] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5719 [D 20:43:10.447013] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 31/70. [D 20:43:10.450279] openib_check_cq: completed rdma wr_id 2aaaab232cd0, nic_wr_credit 34039. [D 20:43:10.450294] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 32/70. [D 20:43:10.450306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 34039. [D 20:43:10.450316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 34040. [D 20:43:10.450327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 34041. [D 20:43:10.450337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 34042. [D 20:43:10.450347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 34043. [D 20:43:10.450358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 34044. [D 20:43:10.450368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 34045. [D 20:43:10.450377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 34046. [D 20:43:10.450387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 34047. [D 20:43:10.450403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 34048. [D 20:43:10.450413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 34049. [D 20:43:10.450423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 34050. [D 20:43:10.450433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 34051. [D 20:43:10.450459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 34052. [D 20:43:10.450469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 34053. [D 20:43:10.450480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 34054. [D 20:43:10.450489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 34055. [D 20:43:10.450500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 34056. [D 20:43:10.450521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 34057. [D 20:43:10.450532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 34058. [D 20:43:10.450546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 34059. [D 20:43:10.450556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 34060. [D 20:43:10.450565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 34061. [D 20:43:10.450576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 34062. [D 20:43:10.450587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 34063. [D 20:43:10.450597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 34064. [D 20:43:10.450607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 34065. [D 20:43:10.450650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 34066. [D 20:43:10.450659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 34067. [D 20:43:10.450669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 34068. [D 20:43:10.450680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 34069. [D 20:43:10.450704] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab243d60 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 34070. [D 20:43:10.453176] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.453191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.453201] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:10.453222] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.453232] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.453241] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:10.453273] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5721 [D 20:43:10.453287] element 0: offset: 0x2aaaab222c10, size: 24 [D 20:43:10.453298] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 33/70. [D 20:43:10.456180] openib_check_cq: completed rdma wr_id 2aaaab243d60, nic_wr_credit 34070. [D 20:43:10.456194] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 34/70. [D 20:43:10.458513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.458527] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.458536] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:10.690634] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5721 [D 20:43:10.690704] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 35/70. [D 20:43:10.690877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 34070. [D 20:43:10.690894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 34071. [D 20:43:10.690905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 34072. [D 20:43:10.690915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 34073. [D 20:43:10.690930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 34074. [D 20:43:10.690941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 34075. [D 20:43:10.690951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 34076. [D 20:43:10.690961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 34077. [D 20:43:10.690971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 34078. [D 20:43:10.690981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 34079. [D 20:43:10.690991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 34080. [D 20:43:10.691001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 34081. [D 20:43:10.691019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 34082. [D 20:43:10.691029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 34083. [D 20:43:10.691038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 34084. [D 20:43:10.691093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 34085. [D 20:43:10.691103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 34086. [D 20:43:10.691114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 34087. [D 20:43:10.691124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 34088. [D 20:43:10.691134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 34089. [D 20:43:10.691143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 34090. [D 20:43:10.691154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 34091. [D 20:43:10.691164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 34092. [D 20:43:10.691174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 34093. [D 20:43:10.691188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 34094. [D 20:43:10.691224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 34095. [D 20:43:10.691234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 34096. [D 20:43:10.691250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 34097. [D 20:43:10.691260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 34098. [D 20:43:10.691270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 34099. [D 20:43:10.691286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 34100. [D 20:43:10.691296] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab243d60 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 34101. [D 20:43:10.696748] openib_check_cq: completed rdma wr_id 2aaaab243d60, nic_wr_credit 34101. [D 20:43:10.696764] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 36/70. [D 20:43:10.699098] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.699114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.699124] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.731495] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.731510] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.731521] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.731552] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5725 [D 20:43:10.731564] element 0: offset: 0x2aaaab2207d0, size: 24 [D 20:43:10.731575] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 37/70. [D 20:43:10.736012] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5725 [D 20:43:10.736082] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 38/70. [D 20:43:10.736217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 34101. [D 20:43:10.736234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 34102. [D 20:43:10.736244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 34103. [D 20:43:10.736255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 34104. [D 20:43:10.736265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 34105. [D 20:43:10.736275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 34106. [D 20:43:10.736285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 34107. [D 20:43:10.736300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 34108. [D 20:43:10.736311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 34109. [D 20:43:10.736321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 34110. [D 20:43:10.736330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 34111. [D 20:43:10.736346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 34112. [D 20:43:10.736356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 34113. [D 20:43:10.736366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 34114. [D 20:43:10.736381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 34115. [D 20:43:10.736391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 34116. [D 20:43:10.736460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 34117. [D 20:43:10.736475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 34118. [D 20:43:10.736485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 34119. [D 20:43:10.736495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 34120. [D 20:43:10.736505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 34121. [D 20:43:10.736515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 34122. [D 20:43:10.736526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 34123. [D 20:43:10.736536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 34124. [D 20:43:10.736546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 34125. [D 20:43:10.736556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 34126. [D 20:43:10.736592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 34127. [D 20:43:10.736602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 34128. [D 20:43:10.736616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 34129. [D 20:43:10.736625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 34130. [D 20:43:10.736635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 34131. [D 20:43:10.736649] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab243d60 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 34132. [D 20:43:10.748012] openib_check_cq: completed rdma wr_id 2aaaab243d60, nic_wr_credit 34132. [D 20:43:10.748027] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 39/70. [D 20:43:10.750370] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.750385] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.750395] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.774776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.774790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.774801] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.774831] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5730 [D 20:43:10.774841] element 0: offset: 0x2aaaab2087b0, size: 24 [D 20:43:10.774852] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 40/70. [D 20:43:10.775099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.775113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.775122] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:10.775137] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5733 [D 20:43:10.775147] element 0: offset: 0x2aaaab23f9d0, size: 24 [D 20:43:10.775157] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 41/70. [D 20:43:10.778919] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.778975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.778986] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:10.779021] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5734 [D 20:43:10.779034] element 0: offset: 0x2aaaab209460, size: 24 [D 20:43:10.779048] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 42/70. [D 20:43:10.779125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.779170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.779182] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:10.779199] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5737 [D 20:43:10.779208] element 0: offset: 0x2aaaab229ca0, size: 24 [D 20:43:10.779220] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 43/70. [D 20:43:10.782343] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 5730 [D 20:43:10.782403] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 44/70. [D 20:43:10.782499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 34132. [D 20:43:10.782559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 34133. [D 20:43:10.782572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 34134. [D 20:43:10.782582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 34135. [D 20:43:10.782592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 34136. [D 20:43:10.782602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 34137. [D 20:43:10.782612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 34138. [D 20:43:10.782622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 34139. [D 20:43:10.782633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 34140. [D 20:43:10.782643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 34141. [D 20:43:10.782653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 34142. [D 20:43:10.782670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 34143. [D 20:43:10.782680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 34144. [D 20:43:10.782689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 34145. [D 20:43:10.782700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 34146. [D 20:43:10.782709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 34147. [D 20:43:10.782719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 34148. [D 20:43:10.782729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 34149. [D 20:43:10.782777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 34150. [D 20:43:10.782789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 34151. [D 20:43:10.782799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 34152. [D 20:43:10.782809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 34153. [D 20:43:10.782820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 34154. [D 20:43:10.782829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 34155. [D 20:43:10.782840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 34156. [D 20:43:10.782850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 34157. [D 20:43:10.782860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 34158. [D 20:43:10.782899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 34159. [D 20:43:10.782910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 34160. [D 20:43:10.782919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 34161. [D 20:43:10.782930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 34162. [D 20:43:10.782940] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab243d60 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 34163. [D 20:43:10.787148] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5733 [D 20:43:10.787166] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 45/70. [D 20:43:10.789556] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5737 [D 20:43:10.789575] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 46/70. [D 20:43:10.794090] openib_check_cq: completed rdma wr_id 2aaaab243d60, nic_wr_credit 34163. [D 20:43:10.794158] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 47/70. [D 20:43:10.794176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 34163. [D 20:43:10.794188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 34164. [D 20:43:10.794198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 34165. [D 20:43:10.794208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 34166. [D 20:43:10.794223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 34167. [D 20:43:10.794233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 34168. [D 20:43:10.794243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 34169. [D 20:43:10.794259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 34170. [D 20:43:10.794269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 34171. [D 20:43:10.794278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 34172. [D 20:43:10.794294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 34173. [D 20:43:10.794304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 34174. [D 20:43:10.794314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 34175. [D 20:43:10.794329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 34176. [D 20:43:10.794339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 34177. [D 20:43:10.794348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 34178. [D 20:43:10.794386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 34179. [D 20:43:10.794398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 34180. [D 20:43:10.794408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 34181. [D 20:43:10.794419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 34182. [D 20:43:10.794429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 34183. [D 20:43:10.794438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 34184. [D 20:43:10.794449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 34185. [D 20:43:10.794459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 34186. [D 20:43:10.794469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 34187. [D 20:43:10.794479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 34188. [D 20:43:10.794509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 34189. [D 20:43:10.794519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 34190. [D 20:43:10.794533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 34191. [D 20:43:10.794543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 34192. [D 20:43:10.794553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 34193. [D 20:43:10.794567] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab236c60 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 34194. [D 20:43:10.794580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 34195. [D 20:43:10.794590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 34196. [D 20:43:10.794621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 34197. [D 20:43:10.794632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 34198. [D 20:43:10.794643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 34199. [D 20:43:10.794652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 34200. [D 20:43:10.794663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 34201. [D 20:43:10.794673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 34202. [D 20:43:10.794683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 34203. [D 20:43:10.794698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 34204. [D 20:43:10.794709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 34205. [D 20:43:10.794732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 34206. [D 20:43:10.794748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 34207. [D 20:43:10.794758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 34208. [D 20:43:10.794767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 34209. [D 20:43:10.794783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 34210. [D 20:43:10.794792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 34211. [D 20:43:10.794802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 34212. [D 20:43:10.794832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 34213. [D 20:43:10.794846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 34214. [D 20:43:10.794856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 34215. [D 20:43:10.794866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 34216. [D 20:43:10.794880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 34217. [D 20:43:10.794890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 34218. [D 20:43:10.794900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 34219. [D 20:43:10.794909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 34220. [D 20:43:10.794948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 34221. [D 20:43:10.794958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 34222. [D 20:43:10.794968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 34223. [D 20:43:10.794977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 34224. [D 20:43:10.794994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 34225. [D 20:43:10.795003] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab203b20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 34226. [D 20:43:10.795077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.795093] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.795102] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:10.805915] openib_check_cq: completed rdma wr_id 2aaaab236c60, nic_wr_credit 34226. [D 20:43:10.805935] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 48/70. [D 20:43:10.817714] openib_check_cq: completed rdma wr_id 2aaaab203b20, nic_wr_credit 34225. [D 20:43:10.817733] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 49/70. [D 20:43:10.817778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.817793] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.817802] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:10.817831] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.817841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.817849] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:10.829206] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.829220] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.829229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:10.829256] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5740 [D 20:43:10.829266] element 0: offset: 0x5b0030, size: 24 [D 20:43:10.829277] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 50/70. [D 20:43:10.833754] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5740 [D 20:43:10.833771] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 51/70. [D 20:43:10.834779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 34225. [D 20:43:10.834847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 34226. [D 20:43:10.834858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 34227. [D 20:43:10.834869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 34228. [D 20:43:10.834887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 34229. [D 20:43:10.834897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 34230. [D 20:43:10.834906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 34231. [D 20:43:10.834917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 34232. [D 20:43:10.834927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 34233. [D 20:43:10.834936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 34234. [D 20:43:10.834946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 34235. [D 20:43:10.834962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 34236. [D 20:43:10.834972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 34237. [D 20:43:10.834982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 34238. [D 20:43:10.834992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 34239. [D 20:43:10.835003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 34240. [D 20:43:10.835012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 34241. [D 20:43:10.835022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 34242. [D 20:43:10.835053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 34243. [D 20:43:10.835063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 34244. [D 20:43:10.835092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 34245. [D 20:43:10.835103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 34246. [D 20:43:10.835113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 34247. [D 20:43:10.835123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 34248. [D 20:43:10.835134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 34249. [D 20:43:10.835161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 34250. [D 20:43:10.835171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 34251. [D 20:43:10.835193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 34252. [D 20:43:10.835204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 34253. [D 20:43:10.835213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 34254. [D 20:43:10.835228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 34255. [D 20:43:10.835238] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab243d60 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 34256. [D 20:43:10.846420] openib_check_cq: completed rdma wr_id 2aaaab243d60, nic_wr_credit 34256. [D 20:43:10.846440] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 52/70. [D 20:43:10.846508] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.846523] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.846532] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:10.855223] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.855237] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.855245] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:10.855261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5743 [D 20:43:10.855271] element 0: offset: 0x5b0030, size: 24 [D 20:43:10.855281] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 53/70. [D 20:43:10.859885] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5743 [D 20:43:10.859904] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 54/70. [D 20:43:10.860084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 34256. [D 20:43:10.860150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 34257. [D 20:43:10.860161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 34258. [D 20:43:10.860171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 34259. [D 20:43:10.860182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 34260. [D 20:43:10.860191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 34261. [D 20:43:10.860201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 34262. [D 20:43:10.860211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 34263. [D 20:43:10.860226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 34264. [D 20:43:10.860236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 34265. [D 20:43:10.860246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 34266. [D 20:43:10.860256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 34267. [D 20:43:10.860266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 34268. [D 20:43:10.860276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 34269. [D 20:43:10.860286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 34270. [D 20:43:10.860301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 34271. [D 20:43:10.860310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 34272. [D 20:43:10.860320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 34273. [D 20:43:10.860347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 34274. [D 20:43:10.860358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 34275. [D 20:43:10.860387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 34276. [D 20:43:10.860397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 34277. [D 20:43:10.860406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 34278. [D 20:43:10.860422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 34279. [D 20:43:10.860431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 34280. [D 20:43:10.860456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 34281. [D 20:43:10.860466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 34282. [D 20:43:10.860479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 34283. [D 20:43:10.860493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 34284. [D 20:43:10.860503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 34285. [D 20:43:10.860513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 34286. [D 20:43:10.860541] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab243d60 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 34287. [D 20:43:10.865015] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5734 [D 20:43:10.865034] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 55/70. [D 20:43:10.870447] openib_check_cq: completed rdma wr_id 2aaaab243d60, nic_wr_credit 34287. [D 20:43:10.870471] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 56/70. [D 20:43:10.870484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 34287. [D 20:43:10.870494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 34288. [D 20:43:10.870505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 34289. [D 20:43:10.870515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 34290. [D 20:43:10.870524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 34291. [D 20:43:10.870535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 34292. [D 20:43:10.870546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 34293. [D 20:43:10.870555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 34294. [D 20:43:10.870571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 34295. [D 20:43:10.870581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 34296. [D 20:43:10.870591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 34297. [D 20:43:10.870601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 34298. [D 20:43:10.870617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 34299. [D 20:43:10.870627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 34300. [D 20:43:10.870637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 34301. [D 20:43:10.870672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 34302. [D 20:43:10.870683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 34303. [D 20:43:10.870693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 34304. [D 20:43:10.870703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 34305. [D 20:43:10.870719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 34306. [D 20:43:10.870747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 34307. [D 20:43:10.870758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 34308. [D 20:43:10.870767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 34309. [D 20:43:10.870791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 34310. [D 20:43:10.870802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 34311. [D 20:43:10.870812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 34312. [D 20:43:10.870823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 34313. [D 20:43:10.870833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 34314. [D 20:43:10.870855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 34315. [D 20:43:10.870865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 34316. [D 20:43:10.870875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 34317. [D 20:43:10.870888] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 34318. [D 20:43:10.870939] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.870953] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.870962] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:10.876691] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34318. [D 20:43:10.876708] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 57/70. [D 20:43:10.876755] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.876770] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.876778] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.886148] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.886161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.886169] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.886185] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5747 [D 20:43:10.886195] element 0: offset: 0x5b0030, size: 24 [D 20:43:10.886214] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 58/70. [D 20:43:10.886242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.886251] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.886259] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:10.886275] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5748 [D 20:43:10.886284] element 0: offset: 0x61f310, size: 24 [D 20:43:10.886294] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 59/70. [D 20:43:10.890328] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5747 [D 20:43:10.890346] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 60/70. [D 20:43:10.890421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 34318. [D 20:43:10.890487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 34319. [D 20:43:10.890499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 34320. [D 20:43:10.890509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 34321. [D 20:43:10.890521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 34322. [D 20:43:10.890531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 34323. [D 20:43:10.890547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 34324. [D 20:43:10.890557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 34325. [D 20:43:10.890566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 34326. [D 20:43:10.890582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 34327. [D 20:43:10.890592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 34328. [D 20:43:10.890602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 34329. [D 20:43:10.890645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 34330. [D 20:43:10.890657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 34331. [D 20:43:10.890693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 34332. [D 20:43:10.890711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 34333. [D 20:43:10.890721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 34334. [D 20:43:10.890731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 34335. [D 20:43:10.890740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 34336. [D 20:43:10.890750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 34337. [D 20:43:10.890759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 34338. [D 20:43:10.890769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 34339. [D 20:43:10.890778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 34340. [D 20:43:10.890788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 34341. [D 20:43:10.890797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 34342. [D 20:43:10.890806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 34343. [D 20:43:10.890816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 34344. [D 20:43:10.890825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 34345. [D 20:43:10.890835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 34346. [D 20:43:10.890844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 34347. [D 20:43:10.890853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 34348. [D 20:43:10.890863] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 34349. [D 20:43:10.899034] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34349. [D 20:43:10.899105] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 0/70. [D 20:43:10.899212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.899228] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.899237] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:10.916040] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5748 [D 20:43:10.916057] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 1/70. [D 20:43:10.916121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 34349. [D 20:43:10.916228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 34350. [D 20:43:10.916240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 34351. [D 20:43:10.916251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 34352. [D 20:43:10.916265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 34353. [D 20:43:10.916275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 34354. [D 20:43:10.916285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 34355. [D 20:43:10.916301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 34356. [D 20:43:10.916311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 34357. [D 20:43:10.916321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 34358. [D 20:43:10.916337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 34359. [D 20:43:10.916347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 34360. [D 20:43:10.916357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 34361. [D 20:43:10.916389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 34362. [D 20:43:10.916400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 34363. [D 20:43:10.916410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 34364. [D 20:43:10.916420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 34365. [D 20:43:10.916430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 34366. [D 20:43:10.916441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 34367. [D 20:43:10.916451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 34368. [D 20:43:10.916478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 34369. [D 20:43:10.916488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 34370. [D 20:43:10.916517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 34371. [D 20:43:10.916528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 34372. [D 20:43:10.916543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 34373. [D 20:43:10.916552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 34374. [D 20:43:10.916562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 34375. [D 20:43:10.916577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 34376. [D 20:43:10.916586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 34377. [D 20:43:10.916612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 34378. [D 20:43:10.916622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 34379. [D 20:43:10.916632] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 34380. [D 20:43:10.922092] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34380. [D 20:43:10.922109] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 2/70. [D 20:43:10.922159] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.922174] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.922183] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:10.963957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.963971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.963979] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:10.963995] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5752 [D 20:43:10.964005] element 0: offset: 0x61f310, size: 24 [D 20:43:10.964015] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 3/70. [D 20:43:10.966811] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:10.966825] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.966833] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:10.966849] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5755 [D 20:43:10.966858] element 0: offset: 0x5b0030, size: 24 [D 20:43:10.966870] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 4/70. [D 20:43:10.969249] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5755 [D 20:43:10.969308] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 5/70. [D 20:43:10.969365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 34380. [D 20:43:10.969420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 34381. [D 20:43:10.969431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 34382. [D 20:43:10.969441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 34383. [D 20:43:10.969452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 34384. [D 20:43:10.969463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 34385. [D 20:43:10.969488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 34386. [D 20:43:10.969503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 34387. [D 20:43:10.969514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 34388. [D 20:43:10.969523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 34389. [D 20:43:10.969550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 34390. [D 20:43:10.969560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 34391. [D 20:43:10.969582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 34392. [D 20:43:10.969592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 34393. [D 20:43:10.969602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 34394. [D 20:43:10.969613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 34395. [D 20:43:10.969638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 34396. [D 20:43:10.969652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 34397. [D 20:43:10.969674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 34398. [D 20:43:10.969688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 34399. [D 20:43:10.969710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 34400. [D 20:43:10.969722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 34401. [D 20:43:10.969731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 34402. [D 20:43:10.969760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 34403. [D 20:43:10.969772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 34404. [D 20:43:10.969800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 34405. [D 20:43:10.969810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 34406. [D 20:43:10.969820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 34407. [D 20:43:10.969843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 34408. [D 20:43:10.969858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 34409. [D 20:43:10.969869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 34410. [D 20:43:10.969890] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 34411. [D 20:43:10.973847] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5752 [D 20:43:10.973867] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 6/70. [D 20:43:10.975298] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34411. [D 20:43:10.975349] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 7/70. [D 20:43:10.975365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 34411. [D 20:43:10.975376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 34412. [D 20:43:10.975388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 34413. [D 20:43:10.975398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 34414. [D 20:43:10.975413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 34415. [D 20:43:10.975424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 34416. [D 20:43:10.975434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 34417. [D 20:43:10.975444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 34418. [D 20:43:10.975469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 34419. [D 20:43:10.975480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 34420. [D 20:43:10.975501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 34421. [D 20:43:10.975512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 34422. [D 20:43:10.975522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 34423. [D 20:43:10.975543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 34424. [D 20:43:10.975558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 34425. [D 20:43:10.975577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 34426. [D 20:43:10.975588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 34427. [D 20:43:10.975598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 34428. [D 20:43:10.975608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 34429. [D 20:43:10.975618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 34430. [D 20:43:10.975649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 34431. [D 20:43:10.975659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 34432. [D 20:43:10.975673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 34433. [D 20:43:10.975683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 34434. [D 20:43:10.975695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 34435. [D 20:43:10.975710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 34436. [D 20:43:10.975720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 34437. [D 20:43:10.975730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 34438. [D 20:43:10.975740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 34439. [D 20:43:10.975750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 34440. [D 20:43:10.975760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 34441. [D 20:43:10.975770] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab232b60 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 34442. [D 20:43:10.975867] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.975883] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.975892] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:10.981233] openib_check_cq: completed rdma wr_id 2aaaab232b60, nic_wr_credit 34442. [D 20:43:10.981250] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 8/70. [D 20:43:10.981298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:10.981312] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:10.981321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:11.172667] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.172681] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.172690] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:11.172718] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5759 [D 20:43:11.172728] element 0: offset: 0x61f310, size: 24 [D 20:43:11.172739] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 9/70. [D 20:43:11.172767] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.172777] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.172785] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.172800] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5760 [D 20:43:11.172809] element 0: offset: 0x5b0030, size: 24 [D 20:43:11.172820] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 10/70. [D 20:43:11.174921] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5759 [D 20:43:11.174966] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 11/70. [D 20:43:11.175221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 34442. [D 20:43:11.175242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 34443. [D 20:43:11.175253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 34444. [D 20:43:11.175263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 34445. [D 20:43:11.175274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 34446. [D 20:43:11.175284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 34447. [D 20:43:11.175294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 34448. [D 20:43:11.175303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 34449. [D 20:43:11.175320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 34450. [D 20:43:11.175329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 34451. [D 20:43:11.175339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 34452. [D 20:43:11.175372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 34453. [D 20:43:11.175383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 34454. [D 20:43:11.175393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 34455. [D 20:43:11.175403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 34456. [D 20:43:11.175414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 34457. [D 20:43:11.175425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 34458. [D 20:43:11.175434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 34459. [D 20:43:11.175461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 34460. [D 20:43:11.175471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 34461. [D 20:43:11.175481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 34462. [D 20:43:11.175497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 34463. [D 20:43:11.175520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 34464. [D 20:43:11.175532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 34465. [D 20:43:11.175541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 34466. [D 20:43:11.175556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 34467. [D 20:43:11.175568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 34468. [D 20:43:11.175596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 34469. [D 20:43:11.175607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 34470. [D 20:43:11.175616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 34471. [D 20:43:11.175627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 34472. [D 20:43:11.175637] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 34473. [D 20:43:11.187040] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34473. [D 20:43:11.187103] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 12/70. [D 20:43:11.187229] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.187268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.187277] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.200452] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.200466] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.200474] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.200501] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5765 [D 20:43:11.200511] element 0: offset: 0x61f310, size: 24 [D 20:43:11.200524] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 13/70. [D 20:43:11.200555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.200565] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.200573] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.200588] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5767 [D 20:43:11.200597] element 0: offset: 0x61f7d0, size: 24 [D 20:43:11.200608] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 14/70. [D 20:43:11.202695] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5765 [D 20:43:11.202740] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 15/70. [D 20:43:11.202936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 34473. [D 20:43:11.203002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 34474. [D 20:43:11.203013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 34475. [D 20:43:11.203023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 34476. [D 20:43:11.203033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 34477. [D 20:43:11.203043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 34478. [D 20:43:11.203053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 34479. [D 20:43:11.203063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 34480. [D 20:43:11.203072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 34481. [D 20:43:11.203082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 34482. [D 20:43:11.203092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 34483. [D 20:43:11.203102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 34484. [D 20:43:11.203112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 34485. [D 20:43:11.203122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 34486. [D 20:43:11.203132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 34487. [D 20:43:11.203142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 34488. [D 20:43:11.203151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 34489. [D 20:43:11.203161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 34490. [D 20:43:11.203171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 34491. [D 20:43:11.203181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 34492. [D 20:43:11.203191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 34493. [D 20:43:11.203200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 34494. [D 20:43:11.203211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 34495. [D 20:43:11.203221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 34496. [D 20:43:11.203231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 34497. [D 20:43:11.203241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 34498. [D 20:43:11.203251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 34499. [D 20:43:11.203260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 34500. [D 20:43:11.203270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 34501. [D 20:43:11.203280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 34502. [D 20:43:11.203289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 34503. [D 20:43:11.203299] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 34504. [D 20:43:11.205386] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5767 [D 20:43:11.205431] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 16/70. [D 20:43:11.205710] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5760 [D 20:43:11.205727] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 17/70. [D 20:43:11.214748] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34504. [D 20:43:11.214769] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 18/70. [D 20:43:11.214796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 34504. [D 20:43:11.214809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 34505. [D 20:43:11.214819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 34506. [D 20:43:11.214829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 34507. [D 20:43:11.214839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 34508. [D 20:43:11.214849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 34509. [D 20:43:11.214864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 34510. [D 20:43:11.214874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 34511. [D 20:43:11.214884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 34512. [D 20:43:11.214894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 34513. [D 20:43:11.214924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 34514. [D 20:43:11.214934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 34515. [D 20:43:11.214944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 34516. [D 20:43:11.214967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 34517. [D 20:43:11.214977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 34518. [D 20:43:11.214987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 34519. [D 20:43:11.214997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 34520. [D 20:43:11.215007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 34521. [D 20:43:11.215017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 34522. [D 20:43:11.215027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 34523. [D 20:43:11.215048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 34524. [D 20:43:11.215059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 34525. [D 20:43:11.215069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 34526. [D 20:43:11.215078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 34527. [D 20:43:11.215094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 34528. [D 20:43:11.215104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 34529. [D 20:43:11.215113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 34530. [D 20:43:11.215129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 34531. [D 20:43:11.215152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 34532. [D 20:43:11.215165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 34533. [D 20:43:11.215175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 34534. [D 20:43:11.215185] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab232b60 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 34535. [D 20:43:11.215213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 34536. [D 20:43:11.215223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 34537. [D 20:43:11.215234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 34538. [D 20:43:11.215244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 34539. [D 20:43:11.215254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 34540. [D 20:43:11.215280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 34541. [D 20:43:11.215291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 34542. [D 20:43:11.215301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 34543. [D 20:43:11.215310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 34544. [D 20:43:11.215321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 34545. [D 20:43:11.215351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 34546. [D 20:43:11.215361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 34547. [D 20:43:11.215371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 34548. [D 20:43:11.215381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 34549. [D 20:43:11.215411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 34550. [D 20:43:11.215422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 34551. [D 20:43:11.215432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 34552. [D 20:43:11.215442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 34553. [D 20:43:11.215451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 34554. [D 20:43:11.215462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 34555. [D 20:43:11.215472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 34556. [D 20:43:11.215482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 34557. [D 20:43:11.215491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 34558. [D 20:43:11.215507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 34559. [D 20:43:11.215517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 34560. [D 20:43:11.215527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 34561. [D 20:43:11.215552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 34562. [D 20:43:11.215562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 34563. [D 20:43:11.215582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 34564. [D 20:43:11.215593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 34565. [D 20:43:11.215603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 34566. [D 20:43:11.215613] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2089f0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 34567. [D 20:43:11.215670] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.215686] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.215695] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.220994] openib_check_cq: completed rdma wr_id 2aaaab232b60, nic_wr_credit 34567. [D 20:43:11.221013] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 19/70. [D 20:43:11.224066] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.224082] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.224090] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.224117] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5770 [D 20:43:11.224127] element 0: offset: 0x61f310, size: 24 [D 20:43:11.224138] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 20/70. [D 20:43:11.232180] openib_check_cq: completed rdma wr_id 2aaaab2089f0, nic_wr_credit 34566. [D 20:43:11.232197] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 21/70. [D 20:43:11.232241] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.232256] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.232264] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.232326] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.232336] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.232344] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.234870] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5770 [D 20:43:11.234908] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 22/70. [D 20:43:11.237597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 34566. [D 20:43:11.237614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 34567. [D 20:43:11.237625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 34568. [D 20:43:11.237635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 34569. [D 20:43:11.237645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 34570. [D 20:43:11.237661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 34571. [D 20:43:11.237671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 34572. [D 20:43:11.237681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 34573. [D 20:43:11.237697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 34574. [D 20:43:11.237707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 34575. [D 20:43:11.237716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 34576. [D 20:43:11.237733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 34577. [D 20:43:11.237742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 34578. [D 20:43:11.237752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 34579. [D 20:43:11.237768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 34580. [D 20:43:11.237778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 34581. [D 20:43:11.237788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 34582. [D 20:43:11.237819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 34583. [D 20:43:11.237830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 34584. [D 20:43:11.237841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 34585. [D 20:43:11.237851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 34586. [D 20:43:11.237861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 34587. [D 20:43:11.237884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 34588. [D 20:43:11.237895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 34589. [D 20:43:11.237908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 34590. [D 20:43:11.237918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 34591. [D 20:43:11.237928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 34592. [D 20:43:11.237938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 34593. [D 20:43:11.237948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 34594. [D 20:43:11.237958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 34595. [D 20:43:11.237968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 34596. [D 20:43:11.237978] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 34597. [D 20:43:11.245301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.245318] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.245327] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.245355] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5773 [D 20:43:11.245365] element 0: offset: 0x6151c0, size: 24 [D 20:43:11.245376] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 23/70. [D 20:43:11.245406] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.245415] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.245424] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.245439] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5776 [D 20:43:11.245448] element 0: offset: 0x61f7d0, size: 24 [D 20:43:11.245458] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 24/70. [D 20:43:11.249314] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34597. [D 20:43:11.249331] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 25/70. [D 20:43:11.249449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.249464] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.249473] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.253709] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5776 [D 20:43:11.253751] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 26/70. [D 20:43:11.255055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 34597. [D 20:43:11.255130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 34598. [D 20:43:11.255141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 34599. [D 20:43:11.255151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 34600. [D 20:43:11.255161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 34601. [D 20:43:11.255171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 34602. [D 20:43:11.255181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 34603. [D 20:43:11.255191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 34604. [D 20:43:11.255201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 34605. [D 20:43:11.255210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 34606. [D 20:43:11.255220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 34607. [D 20:43:11.255230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 34608. [D 20:43:11.255240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 34609. [D 20:43:11.255250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 34610. [D 20:43:11.255259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 34611. [D 20:43:11.255270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 34612. [D 20:43:11.255279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 34613. [D 20:43:11.255289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 34614. [D 20:43:11.255299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 34615. [D 20:43:11.255309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 34616. [D 20:43:11.255319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 34617. [D 20:43:11.255330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 34618. [D 20:43:11.255359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 34619. [D 20:43:11.255369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 34620. [D 20:43:11.255379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 34621. [D 20:43:11.255389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 34622. [D 20:43:11.255398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 34623. [D 20:43:11.255408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 34624. [D 20:43:11.255418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 34625. [D 20:43:11.255434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 34626. [D 20:43:11.255444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 34627. [D 20:43:11.255454] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 34628. [D 20:43:11.261337] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34628. [D 20:43:11.261355] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 27/70. [D 20:43:11.261427] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.261455] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.261465] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.262850] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.262864] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.262873] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.262900] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5779 [D 20:43:11.262910] element 0: offset: 0x5b0030, size: 24 [D 20:43:11.262927] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 28/70. [D 20:43:11.269520] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.269581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.269591] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.269627] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5782 [D 20:43:11.269641] element 0: offset: 0x661e10, size: 24 [D 20:43:11.269654] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 29/70. [D 20:43:11.272386] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5779 [D 20:43:11.272446] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 30/70. [D 20:43:11.272581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 34628. [D 20:43:11.272607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 34629. [D 20:43:11.272617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 34630. [D 20:43:11.272627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 34631. [D 20:43:11.272637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 34632. [D 20:43:11.272647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 34633. [D 20:43:11.272657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 34634. [D 20:43:11.272667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 34635. [D 20:43:11.272677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 34636. [D 20:43:11.272687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 34637. [D 20:43:11.272696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 34638. [D 20:43:11.272706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 34639. [D 20:43:11.272716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 34640. [D 20:43:11.272726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 34641. [D 20:43:11.272736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 34642. [D 20:43:11.272746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 34643. [D 20:43:11.272756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 34644. [D 20:43:11.272765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 34645. [D 20:43:11.272775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 34646. [D 20:43:11.272785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 34647. [D 20:43:11.272795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 34648. [D 20:43:11.272805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 34649. [D 20:43:11.272815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 34650. [D 20:43:11.272825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 34651. [D 20:43:11.272835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 34652. [D 20:43:11.272844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 34653. [D 20:43:11.272854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 34654. [D 20:43:11.272864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 34655. [D 20:43:11.272874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 34656. [D 20:43:11.272884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 34657. [D 20:43:11.272894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 34658. [D 20:43:11.272905] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 34659. [D 20:43:11.273540] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5782 [D 20:43:11.273577] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 31/70. [D 20:43:11.278572] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5773 [D 20:43:11.278589] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 32/70. [D 20:43:11.280290] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34659. [D 20:43:11.280311] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 33/70. [D 20:43:11.281266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 34659. [D 20:43:11.281279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 34660. [D 20:43:11.281290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 34661. [D 20:43:11.281300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 34662. [D 20:43:11.281311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 34663. [D 20:43:11.281321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 34664. [D 20:43:11.281331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 34665. [D 20:43:11.281340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 34666. [D 20:43:11.281356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 34667. [D 20:43:11.281366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 34668. [D 20:43:11.281375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 34669. [D 20:43:11.281385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 34670. [D 20:43:11.281397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 34671. [D 20:43:11.281406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 34672. [D 20:43:11.281416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 34673. [D 20:43:11.281431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 34674. [D 20:43:11.281440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 34675. [D 20:43:11.281450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 34676. [D 20:43:11.281461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 34677. [D 20:43:11.281471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 34678. [D 20:43:11.281481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 34679. [D 20:43:11.281493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 34680. [D 20:43:11.281534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 34681. [D 20:43:11.281544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 34682. [D 20:43:11.281555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 34683. [D 20:43:11.281564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 34684. [D 20:43:11.281575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 34685. [D 20:43:11.281586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 34686. [D 20:43:11.281595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 34687. [D 20:43:11.281647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 34688. [D 20:43:11.281658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 34689. [D 20:43:11.281668] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab232cd0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 34690. [D 20:43:11.281683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 34691. [D 20:43:11.281693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 34692. [D 20:43:11.281703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 34693. [D 20:43:11.281716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 34694. [D 20:43:11.281726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 34695. [D 20:43:11.281736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 34696. [D 20:43:11.281752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 34697. [D 20:43:11.281761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 34698. [D 20:43:11.281771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 34699. [D 20:43:11.281796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 34700. [D 20:43:11.281806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 34701. [D 20:43:11.281816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 34702. [D 20:43:11.281832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 34703. [D 20:43:11.281841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 34704. [D 20:43:11.281851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 34705. [D 20:43:11.281867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 34706. [D 20:43:11.281877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 34707. [D 20:43:11.281887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 34708. [D 20:43:11.281902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 34709. [D 20:43:11.281916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 34710. [D 20:43:11.281925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 34711. [D 20:43:11.281955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 34712. [D 20:43:11.281966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 34713. [D 20:43:11.281978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 34714. [D 20:43:11.281988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 34715. [D 20:43:11.282000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 34716. [D 20:43:11.282015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 34717. [D 20:43:11.282025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 34718. [D 20:43:11.282034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 34719. [D 20:43:11.282051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 34720. [D 20:43:11.282060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 34721. [D 20:43:11.282070] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab232620 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 34722. [D 20:43:11.281631] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.286061] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.286072] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.286105] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.286115] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.286126] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.286154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5785 [D 20:43:11.286165] element 0: offset: 0x61f310, size: 24 [D 20:43:11.286176] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 34/70. [D 20:43:11.290871] openib_check_cq: completed rdma wr_id 2aaaab232cd0, nic_wr_credit 34722. [D 20:43:11.290885] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 35/70. [D 20:43:11.302505] openib_check_cq: completed rdma wr_id 2aaaab232620, nic_wr_credit 34721. [D 20:43:11.302519] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 36/70. [D 20:43:11.302938] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.302951] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.304780] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.304830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.304842] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.304851] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.306917] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5785 [D 20:43:11.306944] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 37/70. [D 20:43:11.308083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 34721. [D 20:43:11.308135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 34722. [D 20:43:11.308147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 34723. [D 20:43:11.308158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 34724. [D 20:43:11.308173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 34725. [D 20:43:11.308184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 34726. [D 20:43:11.308194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 34727. [D 20:43:11.308204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 34728. [D 20:43:11.308214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 34729. [D 20:43:11.308224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 34730. [D 20:43:11.308234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 34731. [D 20:43:11.308274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 34732. [D 20:43:11.308287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 34733. [D 20:43:11.308296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 34734. [D 20:43:11.308307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 34735. [D 20:43:11.308317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 34736. [D 20:43:11.308327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 34737. [D 20:43:11.308341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 34738. [D 20:43:11.308367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 34739. [D 20:43:11.308377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 34740. [D 20:43:11.308387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 34741. [D 20:43:11.308410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 34742. [D 20:43:11.308420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 34743. [D 20:43:11.308430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 34744. [D 20:43:11.308444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 34745. [D 20:43:11.308454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 34746. [D 20:43:11.308464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 34747. [D 20:43:11.308474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 34748. [D 20:43:11.308491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 34749. [D 20:43:11.308524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 34750. [D 20:43:11.308534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 34751. [D 20:43:11.308543] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 34752. [D 20:43:11.310904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.310919] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.310933] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.310968] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5788 [D 20:43:11.310980] element 0: offset: 0x657310, size: 24 [D 20:43:11.310993] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 38/70. [D 20:43:11.319182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.319196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.319207] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.319222] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5790 [D 20:43:11.319233] element 0: offset: 0x691fe0, size: 24 [D 20:43:11.319243] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 39/70. [D 20:43:11.319835] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34752. [D 20:43:11.319850] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 40/70. [D 20:43:11.322191] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.322205] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.322213] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.324992] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5788 [D 20:43:11.325046] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 41/70. [D 20:43:11.325308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 34752. [D 20:43:11.325363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 34753. [D 20:43:11.325374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 34754. [D 20:43:11.325385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 34755. [D 20:43:11.325395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 34756. [D 20:43:11.325405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 34757. [D 20:43:11.325415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 34758. [D 20:43:11.325424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 34759. [D 20:43:11.325441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 34760. [D 20:43:11.325451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 34761. [D 20:43:11.325460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 34762. [D 20:43:11.325470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 34763. [D 20:43:11.325480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 34764. [D 20:43:11.325490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 34765. [D 20:43:11.325499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 34766. [D 20:43:11.325517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 34767. [D 20:43:11.325527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 34768. [D 20:43:11.325557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 34769. [D 20:43:11.325567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 34770. [D 20:43:11.325577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 34771. [D 20:43:11.325605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 34772. [D 20:43:11.325615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 34773. [D 20:43:11.325628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 34774. [D 20:43:11.325643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 34775. [D 20:43:11.325653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 34776. [D 20:43:11.325662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 34777. [D 20:43:11.325690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 34778. [D 20:43:11.325700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 34779. [D 20:43:11.325714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 34780. [D 20:43:11.325724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 34781. [D 20:43:11.325733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 34782. [D 20:43:11.325749] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 34783. [D 20:43:11.330301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.330317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.330328] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.330364] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5794 [D 20:43:11.330375] element 0: offset: 0x5b0030, size: 24 [D 20:43:11.330389] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 42/70. [D 20:43:11.335572] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34783. [D 20:43:11.335589] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 43/70. [D 20:43:11.337824] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.337838] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.337849] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.339836] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5794 [D 20:43:11.339867] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 44/70. [D 20:43:11.339933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 34783. [D 20:43:11.339986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 34784. [D 20:43:11.339997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 34785. [D 20:43:11.340007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 34786. [D 20:43:11.340020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 34787. [D 20:43:11.340035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 34788. [D 20:43:11.340045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 34789. [D 20:43:11.340054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 34790. [D 20:43:11.340070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 34791. [D 20:43:11.340080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 34792. [D 20:43:11.340090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 34793. [D 20:43:11.340128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 34794. [D 20:43:11.340137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 34795. [D 20:43:11.340149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 34796. [D 20:43:11.340159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 34797. [D 20:43:11.340169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 34798. [D 20:43:11.340184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 34799. [D 20:43:11.340208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 34800. [D 20:43:11.340220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 34801. [D 20:43:11.340230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 34802. [D 20:43:11.340240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 34803. [D 20:43:11.340253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 34804. [D 20:43:11.340263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 34805. [D 20:43:11.340287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 34806. [D 20:43:11.340298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 34807. [D 20:43:11.340307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 34808. [D 20:43:11.340322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 34809. [D 20:43:11.340331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 34810. [D 20:43:11.340341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 34811. [D 20:43:11.340371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 34812. [D 20:43:11.340387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 34813. [D 20:43:11.340412] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 34814. [D 20:43:11.345727] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5790 [D 20:43:11.345754] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 45/70. [D 20:43:11.345845] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34814. [D 20:43:11.345865] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 46/70. [D 20:43:11.345878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 34814. [D 20:43:11.345888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 34815. [D 20:43:11.345903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 34816. [D 20:43:11.345913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 34817. [D 20:43:11.345927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 34818. [D 20:43:11.345937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 34819. [D 20:43:11.345947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 34820. [D 20:43:11.345957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 34821. [D 20:43:11.345988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 34822. [D 20:43:11.345999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 34823. [D 20:43:11.346011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 34824. [D 20:43:11.346021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 34825. [D 20:43:11.346034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 34826. [D 20:43:11.346063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 34827. [D 20:43:11.346077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 34828. [D 20:43:11.346088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 34829. [D 20:43:11.346098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 34830. [D 20:43:11.346114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 34831. [D 20:43:11.346124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 34832. [D 20:43:11.346146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 34833. [D 20:43:11.346157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 34834. [D 20:43:11.346167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 34835. [D 20:43:11.346177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 34836. [D 20:43:11.346201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 34837. [D 20:43:11.346212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 34838. [D 20:43:11.346222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 34839. [D 20:43:11.346232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 34840. [D 20:43:11.346242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 34841. [D 20:43:11.346252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 34842. [D 20:43:11.346262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 34843. [D 20:43:11.346284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 34844. [D 20:43:11.346294] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cea0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 34845. [D 20:43:11.348627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.348642] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.348653] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.351747] openib_check_cq: completed rdma wr_id 2aaaab23cea0, nic_wr_credit 34845. [D 20:43:11.351761] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 47/70. [D 20:43:11.354030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.354043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.354052] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:11.455644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.455659] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.455669] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:11.455702] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5797 [D 20:43:11.455713] element 0: offset: 0x61f7d0, size: 24 [D 20:43:11.455725] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 48/70. [D 20:43:11.460055] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5797 [D 20:43:11.460116] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 49/70. [D 20:43:11.460167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 34845. [D 20:43:11.460186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 34846. [D 20:43:11.460196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 34847. [D 20:43:11.460206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 34848. [D 20:43:11.460216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 34849. [D 20:43:11.460226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 34850. [D 20:43:11.460235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 34851. [D 20:43:11.460246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 34852. [D 20:43:11.460258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 34853. [D 20:43:11.460268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 34854. [D 20:43:11.460278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 34855. [D 20:43:11.460288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 34856. [D 20:43:11.460307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 34857. [D 20:43:11.460330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 34858. [D 20:43:11.460341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 34859. [D 20:43:11.460351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 34860. [D 20:43:11.460361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 34861. [D 20:43:11.460371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 34862. [D 20:43:11.460381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 34863. [D 20:43:11.460402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 34864. [D 20:43:11.460419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 34865. [D 20:43:11.460428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 34866. [D 20:43:11.460438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 34867. [D 20:43:11.460460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 34868. [D 20:43:11.460470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 34869. [D 20:43:11.460480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 34870. [D 20:43:11.460490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 34871. [D 20:43:11.460517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 34872. [D 20:43:11.460528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 34873. [D 20:43:11.460539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 34874. [D 20:43:11.460560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 34875. [D 20:43:11.460570] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 34876. [D 20:43:11.466088] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34876. [D 20:43:11.466102] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 50/70. [D 20:43:11.466952] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.466965] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.466975] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:11.639427] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.639441] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.639452] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:11.639467] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5800 [D 20:43:11.639477] element 0: offset: 0x661e10, size: 24 [D 20:43:11.639487] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 51/70. [D 20:43:11.639502] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.639516] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.639525] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.639539] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5803 [D 20:43:11.639548] element 0: offset: 0x6151c0, size: 24 [D 20:43:11.639557] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 52/70. [D 20:43:11.643866] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5803 [D 20:43:11.643894] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 53/70. [D 20:43:11.643918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.643979] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.643989] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.644024] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5806 [D 20:43:11.644037] element 0: offset: 0x691fe0, size: 24 [D 20:43:11.644051] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 54/70. [D 20:43:11.644125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 34876. [D 20:43:11.644139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 34877. [D 20:43:11.644150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 34878. [D 20:43:11.644160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 34879. [D 20:43:11.644183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 34880. [D 20:43:11.644193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 34881. [D 20:43:11.644203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 34882. [D 20:43:11.644213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 34883. [D 20:43:11.644223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 34884. [D 20:43:11.644233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 34885. [D 20:43:11.644243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 34886. [D 20:43:11.644253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 34887. [D 20:43:11.644263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 34888. [D 20:43:11.644273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 34889. [D 20:43:11.644283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 34890. [D 20:43:11.644292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 34891. [D 20:43:11.644302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 34892. [D 20:43:11.644312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 34893. [D 20:43:11.644322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 34894. [D 20:43:11.644332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 34895. [D 20:43:11.644341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 34896. [D 20:43:11.644351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 34897. [D 20:43:11.644361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 34898. [D 20:43:11.644371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 34899. [D 20:43:11.644381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 34900. [D 20:43:11.644390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 34901. [D 20:43:11.644400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 34902. [D 20:43:11.644410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 34903. [D 20:43:11.644420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 34904. [D 20:43:11.644430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 34905. [D 20:43:11.644441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 34906. [D 20:43:11.644451] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 34907. [D 20:43:11.647656] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.647670] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.647681] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:11.647697] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5809 [D 20:43:11.647707] element 0: offset: 0x5b0030, size: 24 [D 20:43:11.647717] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 55/70. [D 20:43:11.649842] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5806 [D 20:43:11.649882] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 56/70. [D 20:43:11.650037] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34907. [D 20:43:11.650091] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 57/70. [D 20:43:11.650107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 34907. [D 20:43:11.650118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 34908. [D 20:43:11.650129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 34909. [D 20:43:11.650139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 34910. [D 20:43:11.650153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 34911. [D 20:43:11.650163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 34912. [D 20:43:11.650173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 34913. [D 20:43:11.650188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 34914. [D 20:43:11.650198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 34915. [D 20:43:11.650207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 34916. [D 20:43:11.650224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 34917. [D 20:43:11.650233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 34918. [D 20:43:11.650243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 34919. [D 20:43:11.650306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 34920. [D 20:43:11.650317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 34921. [D 20:43:11.650327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 34922. [D 20:43:11.650337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 34923. [D 20:43:11.650347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 34924. [D 20:43:11.650357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 34925. [D 20:43:11.650367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 34926. [D 20:43:11.650378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 34927. [D 20:43:11.650388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 34928. [D 20:43:11.650398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 34929. [D 20:43:11.650430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 34930. [D 20:43:11.650440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 34931. [D 20:43:11.650454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 34932. [D 20:43:11.650464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 34933. [D 20:43:11.650474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 34934. [D 20:43:11.650484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 34935. [D 20:43:11.650494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 34936. [D 20:43:11.650504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 34937. [D 20:43:11.650513] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab232b60 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 34938. [D 20:43:11.652782] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.652797] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.652809] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:11.655060] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5809 [D 20:43:11.655103] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 58/70. [D 20:43:11.660239] openib_check_cq: completed rdma wr_id 2aaaab232b60, nic_wr_credit 34938. [D 20:43:11.660297] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 59/70. [D 20:43:11.660315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 34938. [D 20:43:11.660326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 34939. [D 20:43:11.660337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 34940. [D 20:43:11.660347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 34941. [D 20:43:11.660361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 34942. [D 20:43:11.660371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 34943. [D 20:43:11.660380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 34944. [D 20:43:11.660391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 34945. [D 20:43:11.660402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 34946. [D 20:43:11.660411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 34947. [D 20:43:11.660421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 34948. [D 20:43:11.660436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 34949. [D 20:43:11.660446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 34950. [D 20:43:11.660455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 34951. [D 20:43:11.660466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 34952. [D 20:43:11.660475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 34953. [D 20:43:11.660485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 34954. [D 20:43:11.660514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 34955. [D 20:43:11.660525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 34956. [D 20:43:11.660535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 34957. [D 20:43:11.660544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 34958. [D 20:43:11.660561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 34959. [D 20:43:11.660570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 34960. [D 20:43:11.660591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 34961. [D 20:43:11.660601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 34962. [D 20:43:11.660617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 34963. [D 20:43:11.660626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 34964. [D 20:43:11.660636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 34965. [D 20:43:11.660646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 34966. [D 20:43:11.660656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 34967. [D 20:43:11.660666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 34968. [D 20:43:11.660676] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 34969. [D 20:43:11.662949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.662968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.662977] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.671890] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 34969. [D 20:43:11.671905] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 60/70. [D 20:43:11.674235] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.674248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.674259] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.677700] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5800 [D 20:43:11.677754] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 0/70. [D 20:43:11.677890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 34969. [D 20:43:11.677916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 34970. [D 20:43:11.677926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 34971. [D 20:43:11.677937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 34972. [D 20:43:11.677952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 34973. [D 20:43:11.677964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 34974. [D 20:43:11.677978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 34975. [D 20:43:11.677995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 34976. [D 20:43:11.678005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 34977. [D 20:43:11.678015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 34978. [D 20:43:11.678047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 34979. [D 20:43:11.678057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 34980. [D 20:43:11.678068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 34981. [D 20:43:11.678078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 34982. [D 20:43:11.678088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 34983. [D 20:43:11.678129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 34984. [D 20:43:11.678139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 34985. [D 20:43:11.678149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 34986. [D 20:43:11.678159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 34987. [D 20:43:11.678189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 34988. [D 20:43:11.678200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 34989. [D 20:43:11.678210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 34990. [D 20:43:11.678220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 34991. [D 20:43:11.678230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 34992. [D 20:43:11.678240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 34993. [D 20:43:11.678250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 34994. [D 20:43:11.678260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 34995. [D 20:43:11.678270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 34996. [D 20:43:11.678287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 34997. [D 20:43:11.678297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 34998. [D 20:43:11.678307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 34999. [D 20:43:11.678317] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 35000. [D 20:43:11.689792] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35000. [D 20:43:11.689807] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 1/70. [D 20:43:11.692155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.692169] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.692179] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:11.697715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.697729] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.697740] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:11.697771] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5812 [D 20:43:11.697782] element 0: offset: 0x61f7d0, size: 24 [D 20:43:11.697794] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 2/70. [D 20:43:11.699929] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5812 [D 20:43:11.699949] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 3/70. [D 20:43:11.706475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 35000. [D 20:43:11.706540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 35001. [D 20:43:11.706551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 35002. [D 20:43:11.706561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 35003. [D 20:43:11.706572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 35004. [D 20:43:11.706582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 35005. [D 20:43:11.706591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 35006. [D 20:43:11.706604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 35007. [D 20:43:11.706620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 35008. [D 20:43:11.706630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 35009. [D 20:43:11.706640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 35010. [D 20:43:11.706650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 35011. [D 20:43:11.706659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 35012. [D 20:43:11.706691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 35013. [D 20:43:11.706702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 35014. [D 20:43:11.706712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 35015. [D 20:43:11.706723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 35016. [D 20:43:11.706750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 35017. [D 20:43:11.706761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 35018. [D 20:43:11.706771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 35019. [D 20:43:11.706780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 35020. [D 20:43:11.706791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 35021. [D 20:43:11.706810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 35022. [D 20:43:11.706820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 35023. [D 20:43:11.706830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 35024. [D 20:43:11.706840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 35025. [D 20:43:11.706850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 35026. [D 20:43:11.706860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 35027. [D 20:43:11.706880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 35028. [D 20:43:11.706890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 35029. [D 20:43:11.706900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 35030. [D 20:43:11.706910] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 35031. [D 20:43:11.713763] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.713778] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.713789] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.713822] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5816 [D 20:43:11.713833] element 0: offset: 0x661b60, size: 24 [D 20:43:11.713846] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 4/70. [D 20:43:11.713871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.713880] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.713888] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.713923] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5819 [D 20:43:11.713933] element 0: offset: 0x61f310, size: 24 [D 20:43:11.713960] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 5/70. [D 20:43:11.713976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.713986] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.713995] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:11.714013] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5821 [D 20:43:11.714023] element 0: offset: 0x6151c0, size: 24 [D 20:43:11.714047] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 6/70. [D 20:43:11.718090] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35031. [D 20:43:11.718106] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 7/70. [D 20:43:11.719061] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.719076] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.719086] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:11.723740] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5821 [D 20:43:11.723801] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 8/70. [D 20:43:11.723879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 35031. [D 20:43:11.723954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 35032. [D 20:43:11.723966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 35033. [D 20:43:11.723976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 35034. [D 20:43:11.723987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 35035. [D 20:43:11.723997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 35036. [D 20:43:11.724007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 35037. [D 20:43:11.724019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 35038. [D 20:43:11.724036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 35039. [D 20:43:11.724046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 35040. [D 20:43:11.724056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 35041. [D 20:43:11.724066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 35042. [D 20:43:11.724076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 35043. [D 20:43:11.724085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 35044. [D 20:43:11.724095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 35045. [D 20:43:11.724142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 35046. [D 20:43:11.724152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 35047. [D 20:43:11.724237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 35048. [D 20:43:11.724257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 35049. [D 20:43:11.724267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 35050. [D 20:43:11.724238] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5819 [D 20:43:11.724281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 35051. [D 20:43:11.724332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 35052. [D 20:43:11.724342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 35053. [D 20:43:11.724375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 35054. [D 20:43:11.724385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 35055. [D 20:43:11.724395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 35056. [D 20:43:11.724406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 35057. [D 20:43:11.724417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 35058. [D 20:43:11.724426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 35059. [D 20:43:11.724439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 35060. [D 20:43:11.724456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 35061. [D 20:43:11.724466] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 35062. [D 20:43:11.724516] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 9/70. [D 20:43:11.728812] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.728830] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.728841] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:11.728877] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5824 [D 20:43:11.728889] element 0: offset: 0x661e10, size: 24 [D 20:43:11.728903] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 10/70. [D 20:43:11.734454] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35062. [D 20:43:11.734506] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 11/70. [D 20:43:11.734522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 35062. [D 20:43:11.734533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 35063. [D 20:43:11.734544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 35064. [D 20:43:11.734553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 35065. [D 20:43:11.734569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 35066. [D 20:43:11.734578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 35067. [D 20:43:11.734588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 35068. [D 20:43:11.734598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 35069. [D 20:43:11.734608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 35070. [D 20:43:11.734618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 35071. [D 20:43:11.734628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 35072. [D 20:43:11.734674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 35073. [D 20:43:11.734686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 35074. [D 20:43:11.734695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 35075. [D 20:43:11.734705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 35076. [D 20:43:11.734729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 35077. [D 20:43:11.734738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 35078. [D 20:43:11.734749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 35079. [D 20:43:11.734759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 35080. [D 20:43:11.734769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 35081. [D 20:43:11.734779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 35082. [D 20:43:11.734803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 35083. [D 20:43:11.734814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 35084. [D 20:43:11.734823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 35085. [D 20:43:11.734833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 35086. [D 20:43:11.734846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 35087. [D 20:43:11.734869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 35088. [D 20:43:11.734878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 35089. [D 20:43:11.734888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 35090. [D 20:43:11.734902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 35091. [D 20:43:11.734912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 35092. [D 20:43:11.734937] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cea0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 35093. [D 20:43:11.737172] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.737187] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.737198] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:11.739920] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5824 [D 20:43:11.739980] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 12/70. [D 20:43:11.746194] openib_check_cq: completed rdma wr_id 2aaaab23cea0, nic_wr_credit 35093. [D 20:43:11.746256] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 13/70. [D 20:43:11.746272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 35093. [D 20:43:11.746284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 35094. [D 20:43:11.746295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 35095. [D 20:43:11.746305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 35096. [D 20:43:11.746321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 35097. [D 20:43:11.746331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 35098. [D 20:43:11.746341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 35099. [D 20:43:11.746351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 35100. [D 20:43:11.746360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 35101. [D 20:43:11.746370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 35102. [D 20:43:11.746380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 35103. [D 20:43:11.746397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 35104. [D 20:43:11.746407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 35105. [D 20:43:11.746416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 35106. [D 20:43:11.746462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 35107. [D 20:43:11.746473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 35108. [D 20:43:11.746482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 35109. [D 20:43:11.746493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 35110. [D 20:43:11.746502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 35111. [D 20:43:11.746512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 35112. [D 20:43:11.746522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 35113. [D 20:43:11.746537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 35114. [D 20:43:11.746547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 35115. [D 20:43:11.746557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 35116. [D 20:43:11.746567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 35117. [D 20:43:11.746576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 35118. [D 20:43:11.746586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 35119. [D 20:43:11.746607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 35120. [D 20:43:11.746632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 35121. [D 20:43:11.746642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 35122. [D 20:43:11.746652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 35123. [D 20:43:11.746662] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 35124. [D 20:43:11.748867] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.748882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.748893] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.749555] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5816 [D 20:43:11.749575] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 14/70. [D 20:43:11.755002] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.755032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.755043] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.755081] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5827 [D 20:43:11.755092] element 0: offset: 0x6252d0, size: 24 [D 20:43:11.755105] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 15/70. [D 20:43:11.758125] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35124. [D 20:43:11.758140] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 16/70. [D 20:43:11.758174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 35124. [D 20:43:11.758186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 35125. [D 20:43:11.758259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 35126. [D 20:43:11.758271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 35127. [D 20:43:11.758299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 35128. [D 20:43:11.758309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 35129. [D 20:43:11.758319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 35130. [D 20:43:11.758328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 35131. [D 20:43:11.758339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 35132. [D 20:43:11.758355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 35133. [D 20:43:11.758366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 35134. [D 20:43:11.758376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 35135. [D 20:43:11.758402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 35136. [D 20:43:11.758413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 35137. [D 20:43:11.758422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 35138. [D 20:43:11.758432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 35139. [D 20:43:11.758454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 35140. [D 20:43:11.758464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 35141. [D 20:43:11.758474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 35142. [D 20:43:11.758486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 35143. [D 20:43:11.758496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 35144. [D 20:43:11.758506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 35145. [D 20:43:11.758529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 35146. [D 20:43:11.758539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 35147. [D 20:43:11.758549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 35148. [D 20:43:11.758563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 35149. [D 20:43:11.758573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 35150. [D 20:43:11.758582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 35151. [D 20:43:11.758606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 35152. [D 20:43:11.758615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 35153. [D 20:43:11.758626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 35154. [D 20:43:11.758636] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cea0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 35155. [D 20:43:11.758687] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.758700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.758710] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.762830] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5827 [D 20:43:11.762850] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 17/70. [D 20:43:11.769847] openib_check_cq: completed rdma wr_id 2aaaab23cea0, nic_wr_credit 35155. [D 20:43:11.769904] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 18/70. [D 20:43:11.769921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 35155. [D 20:43:11.769935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 35156. [D 20:43:11.769948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 35157. [D 20:43:11.769957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 35158. [D 20:43:11.769967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 35159. [D 20:43:11.769980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 35160. [D 20:43:11.769992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 35161. [D 20:43:11.770003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 35162. [D 20:43:11.770016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 35163. [D 20:43:11.770026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 35164. [D 20:43:11.770070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 35165. [D 20:43:11.770080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 35166. [D 20:43:11.770090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 35167. [D 20:43:11.770112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 35168. [D 20:43:11.770126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 35169. [D 20:43:11.770136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 35170. [D 20:43:11.770146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 35171. [D 20:43:11.770162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 35172. [D 20:43:11.770211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.770230] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.770240] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:11.770289] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5830 [D 20:43:11.770303] element 0: offset: 0x63fac0, size: 24 [D 20:43:11.770329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 35173. [D 20:43:11.770341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 35174. [D 20:43:11.770351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 35175. [D 20:43:11.770362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 35176. [D 20:43:11.770372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 35177. [D 20:43:11.770382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 35178. [D 20:43:11.770392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 35179. [D 20:43:11.770402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 35180. [D 20:43:11.770429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 35181. [D 20:43:11.770440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 35182. [D 20:43:11.770449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 35183. [D 20:43:11.770459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 35184. [D 20:43:11.770474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 35185. [D 20:43:11.770484] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 35186. [D 20:43:11.770501] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 19/70. [D 20:43:11.770571] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.770596] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.770606] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:11.778072] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35186. [D 20:43:11.778086] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 20/70. [D 20:43:11.780479] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.780492] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.780501] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.782901] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5830 [D 20:43:11.782954] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 21/70. [D 20:43:11.783094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 35186. [D 20:43:11.783112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 35187. [D 20:43:11.783124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 35188. [D 20:43:11.783134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 35189. [D 20:43:11.783144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 35190. [D 20:43:11.783158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 35191. [D 20:43:11.783183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 35192. [D 20:43:11.783198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 35193. [D 20:43:11.783208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 35194. [D 20:43:11.783218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 35195. [D 20:43:11.783233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 35196. [D 20:43:11.783242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 35197. [D 20:43:11.783252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 35198. [D 20:43:11.783268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 35199. [D 20:43:11.783277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 35200. [D 20:43:11.783298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 35201. [D 20:43:11.783314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 35202. [D 20:43:11.783323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 35203. [D 20:43:11.783333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 35204. [D 20:43:11.783349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 35205. [D 20:43:11.783359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 35206. [D 20:43:11.783369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 35207. [D 20:43:11.783393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 35208. [D 20:43:11.783403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 35209. [D 20:43:11.783413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 35210. [D 20:43:11.783423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 35211. [D 20:43:11.783433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 35212. [D 20:43:11.783449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 35213. [D 20:43:11.783472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 35214. [D 20:43:11.783482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 35215. [D 20:43:11.783496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 35216. [D 20:43:11.783506] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 35217. [D 20:43:11.784106] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.784120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.784129] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.784145] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5833 [D 20:43:11.784158] element 0: offset: 0x625730, size: 24 [D 20:43:11.784168] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 22/70. [D 20:43:11.794435] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35217. [D 20:43:11.794449] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 23/70. [D 20:43:11.795006] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.795019] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.795029] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.798620] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5833 [D 20:43:11.798641] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 24/70. [D 20:43:11.800242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 35217. [D 20:43:11.800296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 35218. [D 20:43:11.800307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 35219. [D 20:43:11.800317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 35220. [D 20:43:11.800333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 35221. [D 20:43:11.800344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 35222. [D 20:43:11.800354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 35223. [D 20:43:11.800364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 35224. [D 20:43:11.800373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 35225. [D 20:43:11.800383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 35226. [D 20:43:11.800393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 35227. [D 20:43:11.800410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 35228. [D 20:43:11.800420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 35229. [D 20:43:11.800429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 35230. [D 20:43:11.800440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 35231. [D 20:43:11.800468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 35232. [D 20:43:11.800482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 35233. [D 20:43:11.800492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 35234. [D 20:43:11.800502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 35235. [D 20:43:11.800516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 35236. [D 20:43:11.800541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 35237. [D 20:43:11.800552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 35238. [D 20:43:11.800561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 35239. [D 20:43:11.800571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 35240. [D 20:43:11.800581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 35241. [D 20:43:11.800596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 35242. [D 20:43:11.800618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 35243. [D 20:43:11.800633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 35244. [D 20:43:11.800643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 35245. [D 20:43:11.800657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 35246. [D 20:43:11.800668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 35247. [D 20:43:11.800688] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 35248. [D 20:43:11.811028] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.811043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.811054] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.811089] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5836 [D 20:43:11.811100] element 0: offset: 0x64dd40, size: 24 [D 20:43:11.811115] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 25/70. [D 20:43:11.812124] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35248. [D 20:43:11.812139] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 26/70. [D 20:43:11.814449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.814463] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.814472] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.816534] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5836 [D 20:43:11.816553] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 27/70. [D 20:43:11.820878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 35248. [D 20:43:11.820931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 35249. [D 20:43:11.820942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 35250. [D 20:43:11.820952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 35251. [D 20:43:11.820962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 35252. [D 20:43:11.820972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 35253. [D 20:43:11.820982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 35254. [D 20:43:11.820997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 35255. [D 20:43:11.821007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 35256. [D 20:43:11.821017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 35257. [D 20:43:11.821027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 35258. [D 20:43:11.821043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 35259. [D 20:43:11.821069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 35260. [D 20:43:11.821080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 35261. [D 20:43:11.821089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 35262. [D 20:43:11.821099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 35263. [D 20:43:11.821109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 35264. [D 20:43:11.821124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 35265. [D 20:43:11.821134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 35266. [D 20:43:11.821144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 35267. [D 20:43:11.821171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 35268. [D 20:43:11.821182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 35269. [D 20:43:11.821204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 35270. [D 20:43:11.821214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 35271. [D 20:43:11.821228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 35272. [D 20:43:11.821239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 35273. [D 20:43:11.821248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 35274. [D 20:43:11.821263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 35275. [D 20:43:11.821287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 35276. [D 20:43:11.821301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 35277. [D 20:43:11.821311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 35278. [D 20:43:11.821321] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 35279. [D 20:43:11.827316] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35279. [D 20:43:11.827332] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 28/70. [D 20:43:11.829586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.829600] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.829610] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:11.917641] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.917656] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.917667] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:11.917699] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5838 [D 20:43:11.917710] element 0: offset: 0x61f7d0, size: 24 [D 20:43:11.917722] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 29/70. [D 20:43:11.932628] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5838 [D 20:43:11.932682] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 30/70. [D 20:43:11.932745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 35279. [D 20:43:11.932813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 35280. [D 20:43:11.932824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 35281. [D 20:43:11.932839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 35282. [D 20:43:11.932849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 35283. [D 20:43:11.932859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 35284. [D 20:43:11.932875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 35285. [D 20:43:11.932884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 35286. [D 20:43:11.932894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 35287. [D 20:43:11.932935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 35288. [D 20:43:11.932946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 35289. [D 20:43:11.932977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 35290. [D 20:43:11.932987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 35291. [D 20:43:11.933006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 35292. [D 20:43:11.933019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 35293. [D 20:43:11.933029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 35294. [D 20:43:11.933049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 35295. [D 20:43:11.933060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 35296. [D 20:43:11.933070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 35297. [D 20:43:11.933095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 35298. [D 20:43:11.933106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 35299. [D 20:43:11.933116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 35300. [D 20:43:11.933142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 35301. [D 20:43:11.933152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 35302. [D 20:43:11.933165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 35303. [D 20:43:11.933183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 35304. [D 20:43:11.933194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 35305. [D 20:43:11.933204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 35306. [D 20:43:11.933224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 35307. [D 20:43:11.933238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 35308. [D 20:43:11.933247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 35309. [D 20:43:11.933266] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 35310. [D 20:43:11.936804] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.936820] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.936831] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.936867] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5842 [D 20:43:11.936878] element 0: offset: 0x657310, size: 24 [D 20:43:11.936893] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 31/70. [D 20:43:11.938679] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35310. [D 20:43:11.938695] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 32/70. [D 20:43:11.941067] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.941081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.941090] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.943139] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5842 [D 20:43:11.943158] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 33/70. [D 20:43:11.943221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 35310. [D 20:43:11.943273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 35311. [D 20:43:11.943284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 35312. [D 20:43:11.943295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 35313. [D 20:43:11.943304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 35314. [D 20:43:11.943314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 35315. [D 20:43:11.943324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 35316. [D 20:43:11.943334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 35317. [D 20:43:11.943344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 35318. [D 20:43:11.943353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 35319. [D 20:43:11.943364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 35320. [D 20:43:11.943374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 35321. [D 20:43:11.943412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 35322. [D 20:43:11.943423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 35323. [D 20:43:11.943433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 35324. [D 20:43:11.943443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 35325. [D 20:43:11.943466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 35326. [D 20:43:11.943481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 35327. [D 20:43:11.943492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 35328. [D 20:43:11.943502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 35329. [D 20:43:11.943524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 35330. [D 20:43:11.943536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 35331. [D 20:43:11.943546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 35332. [D 20:43:11.943556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 35333. [D 20:43:11.943566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 35334. [D 20:43:11.943576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 35335. [D 20:43:11.943597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 35336. [D 20:43:11.943607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 35337. [D 20:43:11.943617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 35338. [D 20:43:11.943640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 35339. [D 20:43:11.943650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 35340. [D 20:43:11.943672] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 35341. [D 20:43:11.949126] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35341. [D 20:43:11.949143] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 34/70. [D 20:43:11.951303] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:11.951318] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.951329] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:11.951363] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5845 [D 20:43:11.951374] element 0: offset: 0x61f310, size: 24 [D 20:43:11.951388] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 35/70. [D 20:43:11.951421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.951431] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.951440] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:11.953898] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 131072, tag: 5845 [D 20:43:11.953918] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 36/70. [D 20:43:11.953963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 35341. [D 20:43:11.953982] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 35342. [D 20:43:11.954358] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35342. [D 20:43:11.954371] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 37/70. [D 20:43:11.954409] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:11.954420] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:11.954429] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:12.071818] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.071833] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.071844] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:12.071861] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5848 [D 20:43:12.071871] element 0: offset: 0x661e10, size: 24 [D 20:43:12.071880] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 38/70. [D 20:43:12.073979] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5848 [D 20:43:12.074000] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 39/70. [D 20:43:12.079077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 35342. [D 20:43:12.079137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 35343. [D 20:43:12.079148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 35344. [D 20:43:12.079159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 35345. [D 20:43:12.079169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 35346. [D 20:43:12.079179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 35347. [D 20:43:12.079189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 35348. [D 20:43:12.079203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 35349. [D 20:43:12.079213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 35350. [D 20:43:12.079223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 35351. [D 20:43:12.079233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 35352. [D 20:43:12.079264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 35353. [D 20:43:12.079275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 35354. [D 20:43:12.079287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 35355. [D 20:43:12.079308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 35356. [D 20:43:12.079320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 35357. [D 20:43:12.079330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 35358. [D 20:43:12.079352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 35359. [D 20:43:12.079362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 35360. [D 20:43:12.079372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 35361. [D 20:43:12.079400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 35362. [D 20:43:12.079413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 35363. [D 20:43:12.079426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 35364. [D 20:43:12.079444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 35365. [D 20:43:12.079455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 35366. [D 20:43:12.079481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 35367. [D 20:43:12.079496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 35368. [D 20:43:12.079517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 35369. [D 20:43:12.079530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 35370. [D 20:43:12.079540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 35371. [D 20:43:12.079550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 35372. [D 20:43:12.079560] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 35373. [D 20:43:12.086022] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35373. [D 20:43:12.086038] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 40/70. [D 20:43:12.089764] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.089780] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.089791] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:12.089811] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.089822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.089831] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:12.089861] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5850 [D 20:43:12.089874] element 0: offset: 0x6252d0, size: 24 [D 20:43:12.089886] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 41/70. [D 20:43:12.093667] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.093729] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.093739] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:12.093774] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5855 [D 20:43:12.093788] element 0: offset: 0x63fac0, size: 24 [D 20:43:12.093801] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 42/70. [D 20:43:12.093828] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.093844] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.093853] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:12.093869] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5857 [D 20:43:12.093918] element 0: offset: 0x64dd40, size: 24 [D 20:43:12.093928] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 43/70. [D 20:43:12.096421] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5855 [D 20:43:12.096442] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 44/70. [D 20:43:12.096498] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.096563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.096574] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:12.097883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 35373. [D 20:43:12.097903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 35374. [D 20:43:12.097914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 35375. [D 20:43:12.097924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 35376. [D 20:43:12.097934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 35377. [D 20:43:12.097945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 35378. [D 20:43:12.097955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 35379. [D 20:43:12.097965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 35380. [D 20:43:12.097975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 35381. [D 20:43:12.097984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 35382. [D 20:43:12.097994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 35383. [D 20:43:12.098011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 35384. [D 20:43:12.098021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 35385. [D 20:43:12.098031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 35386. [D 20:43:12.098040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 35387. [D 20:43:12.098061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 35388. [D 20:43:12.098071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 35389. [D 20:43:12.098080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 35390. [D 20:43:12.098109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 35391. [D 20:43:12.098131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 35392. [D 20:43:12.098142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 35393. [D 20:43:12.098791] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5850 [D 20:43:12.098807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 35394. [D 20:43:12.098843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 35395. [D 20:43:12.098854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 35396. [D 20:43:12.098868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 35397. [D 20:43:12.098877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 35398. [D 20:43:12.098887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 35399. [D 20:43:12.098901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 35400. [D 20:43:12.098911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 35401. [D 20:43:12.098920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 35402. [D 20:43:12.098936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 35403. [D 20:43:12.098946] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 35404. [D 20:43:12.099028] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 45/70. [D 20:43:12.103321] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.103339] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.103349] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:12.103384] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5860 [D 20:43:12.103395] element 0: offset: 0x657310, size: 24 [D 20:43:12.103410] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 46/70. [D 20:43:12.106914] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35404. [D 20:43:12.106929] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 47/70. [D 20:43:12.106957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 35404. [D 20:43:12.106970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 35405. [D 20:43:12.106981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 35406. [D 20:43:12.106991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 35407. [D 20:43:12.107001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 35408. [D 20:43:12.107011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 35409. [D 20:43:12.107024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 35410. [D 20:43:12.107054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 35411. [D 20:43:12.107064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 35412. [D 20:43:12.107090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 35413. [D 20:43:12.107102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 35414. [D 20:43:12.107127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 35415. [D 20:43:12.107138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 35416. [D 20:43:12.107149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 35417. [D 20:43:12.107159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 35418. [D 20:43:12.107169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 35419. [D 20:43:12.107192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 35420. [D 20:43:12.107202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 35421. [D 20:43:12.107216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 35422. [D 20:43:12.107226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 35423. [D 20:43:12.107235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 35424. [D 20:43:12.107261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 35425. [D 20:43:12.107271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 35426. [D 20:43:12.107284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 35427. [D 20:43:12.107294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 35428. [D 20:43:12.107304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 35429. [D 20:43:12.107328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 35430. [D 20:43:12.107338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 35431. [D 20:43:12.107357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 35432. [D 20:43:12.107367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 35433. [D 20:43:12.107387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 35434. [D 20:43:12.107397] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab232620 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 35435. [D 20:43:12.109834] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.109848] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.109857] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:12.112224] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5860 [D 20:43:12.112243] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 48/70. [D 20:43:12.118575] openib_check_cq: completed rdma wr_id 2aaaab232620, nic_wr_credit 35435. [D 20:43:12.118630] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 49/70. [D 20:43:12.118647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 35435. [D 20:43:12.118659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 35436. [D 20:43:12.118669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 35437. [D 20:43:12.118679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 35438. [D 20:43:12.118693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 35439. [D 20:43:12.118703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 35440. [D 20:43:12.118713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 35441. [D 20:43:12.118729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 35442. [D 20:43:12.118738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 35443. [D 20:43:12.118748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 35444. [D 20:43:12.118764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 35445. [D 20:43:12.118774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 35446. [D 20:43:12.118783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 35447. [D 20:43:12.118799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 35448. [D 20:43:12.118829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 35449. [D 20:43:12.118839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 35450. [D 20:43:12.118849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 35451. [D 20:43:12.118864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 35452. [D 20:43:12.118874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 35453. [D 20:43:12.118884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 35454. [D 20:43:12.118893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 35455. [D 20:43:12.118912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 35456. [D 20:43:12.118935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 35457. [D 20:43:12.118946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 35458. [D 20:43:12.118956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 35459. [D 20:43:12.118965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 35460. [D 20:43:12.118975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 35461. [D 20:43:12.118991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 35462. [D 20:43:12.119001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 35463. [D 20:43:12.119011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 35464. [D 20:43:12.119039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 35465. [D 20:43:12.119049] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 35466. [D 20:43:12.121277] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.121292] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.121301] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:12.130299] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35466. [D 20:43:12.130313] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 50/70. [D 20:43:12.131031] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.131044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.131054] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:12.131085] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5862 [D 20:43:12.131096] element 0: offset: 0x61f310, size: 24 [D 20:43:12.131108] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 51/70. [D 20:43:12.131128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.131138] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.131146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:12.135077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.135114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.135124] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:12.135150] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5866 [D 20:43:12.135161] element 0: offset: 0x5b0030, size: 24 [D 20:43:12.135173] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 52/70. [D 20:43:12.139395] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5866 [D 20:43:12.139415] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 53/70. [D 20:43:12.139475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 35466. [D 20:43:12.139540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 35467. [D 20:43:12.139560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 35468. [D 20:43:12.139571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 35469. [D 20:43:12.139581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 35470. [D 20:43:12.139591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 35471. [D 20:43:12.139606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 35472. [D 20:43:12.139616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 35473. [D 20:43:12.139625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 35474. [D 20:43:12.139641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 35475. [D 20:43:12.139685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 35476. [D 20:43:12.139695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 35477. [D 20:43:12.139710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 35478. [D 20:43:12.139730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 35479. [D 20:43:12.139741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 35480. [D 20:43:12.139751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 35481. [D 20:43:12.139761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 35482. [D 20:43:12.139771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 35483. [D 20:43:12.139781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 35484. [D 20:43:12.139790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 35485. [D 20:43:12.139816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 35486. [D 20:43:12.139826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 35487. [D 20:43:12.139851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 35488. [D 20:43:12.139873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 35489. [D 20:43:12.139886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 35490. [D 20:43:12.139895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 35491. [D 20:43:12.139905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 35492. [D 20:43:12.139934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 35493. [D 20:43:12.139946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 35494. [D 20:43:12.139956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 35495. [D 20:43:12.139965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 35496. [D 20:43:12.139993] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 35497. [D 20:43:12.143734] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.143750] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.143761] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:12.143795] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5869 [D 20:43:12.143807] element 0: offset: 0x661b60, size: 24 [D 20:43:12.143821] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 54/70. [D 20:43:12.150465] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35497. [D 20:43:12.150485] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 55/70. [D 20:43:12.152770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.152784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.152796] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:12.154999] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5869 [D 20:43:12.155023] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 56/70. [D 20:43:12.155167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 35497. [D 20:43:12.155246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 35498. [D 20:43:12.155258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 35499. [D 20:43:12.155269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 35500. [D 20:43:12.155283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 35501. [D 20:43:12.155293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 35502. [D 20:43:12.155303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 35503. [D 20:43:12.155316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 35504. [D 20:43:12.155326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 35505. [D 20:43:12.155335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 35506. [D 20:43:12.155351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 35507. [D 20:43:12.155372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 35508. [D 20:43:12.155383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 35509. [D 20:43:12.155396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 35510. [D 20:43:12.155406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 35511. [D 20:43:12.155415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 35512. [D 20:43:12.155454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 35513. [D 20:43:12.155464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 35514. [D 20:43:12.155478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 35515. [D 20:43:12.155488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 35516. [D 20:43:12.155511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 35517. [D 20:43:12.155521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 35518. [D 20:43:12.155531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 35519. [D 20:43:12.155544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 35520. [D 20:43:12.155554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 35521. [D 20:43:12.155564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 35522. [D 20:43:12.155592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 35523. [D 20:43:12.155602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 35524. [D 20:43:12.155614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 35525. [D 20:43:12.155624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 35526. [D 20:43:12.155634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 35527. [D 20:43:12.155644] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 35528. [D 20:43:12.166969] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35528. [D 20:43:12.167031] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 57/70. [D 20:43:12.169311] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.169327] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.169337] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:12.169373] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5872 [D 20:43:12.169387] element 0: offset: 0x64dbb0, size: 24 [D 20:43:12.169400] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 58/70. [D 20:43:12.169435] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.169447] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.169504] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:12.170401] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5862 [D 20:43:12.170420] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 59/70. [D 20:43:12.174676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 35528. [D 20:43:12.174745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 35529. [D 20:43:12.174757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 35530. [D 20:43:12.174767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 35531. [D 20:43:12.174781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 35532. [D 20:43:12.174791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 35533. [D 20:43:12.174801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 35534. [D 20:43:12.174815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 35535. [D 20:43:12.174824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 35536. [D 20:43:12.174834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 35537. [D 20:43:12.174850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 35538. [D 20:43:12.174860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 35539. [D 20:43:12.174869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 35540. [D 20:43:12.174939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 35541. [D 20:43:12.174950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 35542. [D 20:43:12.174960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 35543. [D 20:43:12.175046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 35544. [D 20:43:12.175065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 35545. [D 20:43:12.175090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 35546. [D 20:43:12.175101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 35547. [D 20:43:12.175052] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5872 [D 20:43:12.175111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 35548. [D 20:43:12.175150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 35549. [D 20:43:12.175160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 35550. [D 20:43:12.175170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 35551. [D 20:43:12.175180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 35552. [D 20:43:12.175196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 35553. [D 20:43:12.175206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 35554. [D 20:43:12.175215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 35555. [D 20:43:12.175226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 35556. [D 20:43:12.175236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 35557. [D 20:43:12.175246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 35558. [D 20:43:12.175261] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 35559. [D 20:43:12.175296] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 60/70. [D 20:43:12.186342] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35559. [D 20:43:12.186361] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 0/70. [D 20:43:12.186374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 35559. [D 20:43:12.186384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 35560. [D 20:43:12.186395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 35561. [D 20:43:12.186405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 35562. [D 20:43:12.186415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 35563. [D 20:43:12.186425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 35564. [D 20:43:12.186435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 35565. [D 20:43:12.186445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 35566. [D 20:43:12.186454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 35567. [D 20:43:12.186472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 35568. [D 20:43:12.186481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 35569. [D 20:43:12.186491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 35570. [D 20:43:12.186502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 35571. [D 20:43:12.186512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 35572. [D 20:43:12.186522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 35573. [D 20:43:12.186532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 35574. [D 20:43:12.186561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 35575. [D 20:43:12.186571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 35576. [D 20:43:12.186581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 35577. [D 20:43:12.186591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 35578. [D 20:43:12.186601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 35579. [D 20:43:12.186631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 35580. [D 20:43:12.186642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 35581. [D 20:43:12.186652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 35582. [D 20:43:12.186663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 35583. [D 20:43:12.186673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 35584. [D 20:43:12.186683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 35585. [D 20:43:12.186706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 35586. [D 20:43:12.186716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 35587. [D 20:43:12.186730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 35588. [D 20:43:12.186740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 35589. [D 20:43:12.186750] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab232840 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 35590. [D 20:43:12.186815] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.186830] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.186839] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:12.192295] openib_check_cq: completed rdma wr_id 2aaaab232840, nic_wr_credit 35590. [D 20:43:12.192309] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 1/70. [D 20:43:12.194445] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.194458] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.194468] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:12.199976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.199990] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.200000] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:12.200031] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5874 [D 20:43:12.200042] element 0: offset: 0x625730, size: 24 [D 20:43:12.200054] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 2/70. [D 20:43:12.200380] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.200394] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.200403] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:12.200418] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5878 [D 20:43:12.200428] element 0: offset: 0x64dd40, size: 24 [D 20:43:12.200438] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 3/70. [D 20:43:12.206316] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5878 [D 20:43:12.206339] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 4/70. [D 20:43:12.206482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 35590. [D 20:43:12.206551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 35591. [D 20:43:12.206562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 35592. [D 20:43:12.206573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 35593. [D 20:43:12.206587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 35594. [D 20:43:12.206596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 35595. [D 20:43:12.206606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 35596. [D 20:43:12.206620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 35597. [D 20:43:12.206630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 35598. [D 20:43:12.206639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 35599. [D 20:43:12.206695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 35600. [D 20:43:12.206706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 35601. [D 20:43:12.206716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 35602. [D 20:43:12.206742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 35603. [D 20:43:12.206752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 35604. [D 20:43:12.206762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 35605. [D 20:43:12.206772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 35606. [D 20:43:12.206782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 35607. [D 20:43:12.206793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 35608. [D 20:43:12.206802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 35609. [D 20:43:12.206824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 35610. [D 20:43:12.206835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 35611. [D 20:43:12.206846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 35612. [D 20:43:12.206855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 35613. [D 20:43:12.206865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 35614. [D 20:43:12.206893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 35615. [D 20:43:12.206904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 35616. [D 20:43:12.206917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 35617. [D 20:43:12.206927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 35618. [D 20:43:12.206937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 35619. [D 20:43:12.206964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 35620. [D 20:43:12.206974] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 35621. [D 20:43:12.212961] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35621. [D 20:43:12.212981] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 5/70. [D 20:43:12.215052] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.215067] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.215078] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:12.233534] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5874 [D 20:43:12.233553] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 6/70. [D 20:43:12.233604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 35621. [D 20:43:12.233656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 35622. [D 20:43:12.233668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 35623. [D 20:43:12.233678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 35624. [D 20:43:12.233693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 35625. [D 20:43:12.233739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 35626. [D 20:43:12.233751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 35627. [D 20:43:12.233761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 35628. [D 20:43:12.233773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 35629. [D 20:43:12.233787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 35630. [D 20:43:12.233808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 35631. [D 20:43:12.233819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 35632. [D 20:43:12.233830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 35633. [D 20:43:12.233840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 35634. [D 20:43:12.233850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 35635. [D 20:43:12.233860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 35636. [D 20:43:12.233884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 35637. [D 20:43:12.233899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 35638. [D 20:43:12.233909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 35639. [D 20:43:12.233918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 35640. [D 20:43:12.233941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 35641. [D 20:43:12.233951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 35642. [D 20:43:12.233961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 35643. [D 20:43:12.233975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 35644. [D 20:43:12.233985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 35645. [D 20:43:12.233995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 35646. [D 20:43:12.234014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 35647. [D 20:43:12.234024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 35648. [D 20:43:12.234034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 35649. [D 20:43:12.234044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 35650. [D 20:43:12.234061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 35651. [D 20:43:12.234074] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 35652. [D 20:43:12.239511] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35652. [D 20:43:12.239528] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 7/70. [D 20:43:12.241789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.241804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.241813] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:12.316442] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.316457] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.316468] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:12.316501] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5881 [D 20:43:12.316513] element 0: offset: 0x6252d0, size: 24 [D 20:43:12.316525] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 8/70. [D 20:43:12.320846] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5881 [D 20:43:12.320865] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 9/70. [D 20:43:12.320927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 35652. [D 20:43:12.320989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 35653. [D 20:43:12.321036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 35654. [D 20:43:12.321047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 35655. [D 20:43:12.321058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 35656. [D 20:43:12.321068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 35657. [D 20:43:12.321078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 35658. [D 20:43:12.321088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 35659. [D 20:43:12.321110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 35660. [D 20:43:12.321120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 35661. [D 20:43:12.321130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 35662. [D 20:43:12.321146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 35663. [D 20:43:12.321157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 35664. [D 20:43:12.321166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 35665. [D 20:43:12.321176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 35666. [D 20:43:12.321186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 35667. [D 20:43:12.321210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 35668. [D 20:43:12.321231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 35669. [D 20:43:12.321241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 35670. [D 20:43:12.321251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 35671. [D 20:43:12.321262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 35672. [D 20:43:12.321272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 35673. [D 20:43:12.321282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 35674. [D 20:43:12.321306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 35675. [D 20:43:12.321316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 35676. [D 20:43:12.321341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 35677. [D 20:43:12.321351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 35678. [D 20:43:12.321364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 35679. [D 20:43:12.321374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 35680. [D 20:43:12.321384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 35681. [D 20:43:12.321412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 35682. [D 20:43:12.321424] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d3d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 35683. [D 20:43:12.326888] openib_check_cq: completed rdma wr_id 2aaaab23d3d0, nic_wr_credit 35683. [D 20:43:12.326904] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 10/70. [D 20:43:12.327065] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.327081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.327091] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:12.523935] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.523950] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.523961] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:12.523993] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5884 [D 20:43:12.524004] element 0: offset: 0x657310, size: 24 [D 20:43:12.524016] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 11/70. [D 20:43:12.524035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.524049] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.524058] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:12.524072] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5887 [D 20:43:12.524082] element 0: offset: 0x661e10, size: 24 [D 20:43:12.524091] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 12/70. [D 20:43:12.526524] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.526539] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.526548] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:12.526562] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5890 [D 20:43:12.526573] element 0: offset: 0x5b0030, size: 24 [D 20:43:12.526582] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 13/70. [D 20:43:12.529290] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5887 [D 20:43:12.529309] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 14/70. [D 20:43:12.529369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 35683. [D 20:43:12.529434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 35684. [D 20:43:12.529452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 35685. [D 20:43:12.529463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 35686. [D 20:43:12.529473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 35687. [D 20:43:12.529483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 35688. [D 20:43:12.529499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 35689. [D 20:43:12.529508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 35690. [D 20:43:12.529518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 35691. [D 20:43:12.529534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 35692. [D 20:43:12.529544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 35693. [D 20:43:12.529553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 35694. [D 20:43:12.529569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 35695. [D 20:43:12.529579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 35696. [D 20:43:12.529589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 35697. [D 20:43:12.529635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 35698. [D 20:43:12.529646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 35699. [D 20:43:12.529656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 35700. [D 20:43:12.529666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 35701. [D 20:43:12.529692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 35702. [D 20:43:12.529707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 35703. [D 20:43:12.529717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 35704. [D 20:43:12.529726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 35705. [D 20:43:12.529741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 35706. [D 20:43:12.529751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 35707. [D 20:43:12.529760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 35708. [D 20:43:12.529786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 35709. [D 20:43:12.529796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 35710. [D 20:43:12.529807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 35711. [D 20:43:12.529817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 35712. [D 20:43:12.529826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 35713. [D 20:43:12.529860] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 35714. [D 20:43:12.532437] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5890 [D 20:43:12.532455] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 15/70. [D 20:43:12.537859] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 35714. [D 20:43:12.537923] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 16/70. [D 20:43:12.537940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 35714. [D 20:43:12.537952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 35715. [D 20:43:12.537962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 35716. [D 20:43:12.537972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 35717. [D 20:43:12.537987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 35718. [D 20:43:12.537996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 35719. [D 20:43:12.538006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 35720. [D 20:43:12.538022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 35721. [D 20:43:12.538061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 35722. [D 20:43:12.538071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 35723. [D 20:43:12.538085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 35724. [D 20:43:12.538094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 35725. [D 20:43:12.538131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 35726. [D 20:43:12.538142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 35727. [D 20:43:12.538152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 35728. [D 20:43:12.538161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 35729. [D 20:43:12.538186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 35730. [D 20:43:12.538196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 35731. [D 20:43:12.538206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 35732. [D 20:43:12.538217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 35733. [D 20:43:12.538226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 35734. [D 20:43:12.538251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 35735. [D 20:43:12.538261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 35736. [D 20:43:12.538271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 35737. [D 20:43:12.538281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 35738. [D 20:43:12.538292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 35739. [D 20:43:12.538301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 35740. [D 20:43:12.538325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 35741. [D 20:43:12.538335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 35742. [D 20:43:12.538345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 35743. [D 20:43:12.538360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 35744. [D 20:43:12.538370] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2031f0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 35745. [D 20:43:12.540530] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.540546] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.540556] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:12.543337] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5884 [D 20:43:12.543355] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 17/70. [D 20:43:12.549725] openib_check_cq: completed rdma wr_id 2aaaab2031f0, nic_wr_credit 35745. [D 20:43:12.549788] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 18/70. [D 20:43:12.549805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 35745. [D 20:43:12.549816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 35746. [D 20:43:12.549827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 35747. [D 20:43:12.549836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 35748. [D 20:43:12.549850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 35749. [D 20:43:12.549860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 35750. [D 20:43:12.549869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 35751. [D 20:43:12.549885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 35752. [D 20:43:12.549895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 35753. [D 20:43:12.549904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 35754. [D 20:43:12.549921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 35755. [D 20:43:12.549949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 35756. [D 20:43:12.549959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 35757. [D 20:43:12.549969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 35758. [D 20:43:12.549997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 35759. [D 20:43:12.550008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 35760. [D 20:43:12.550021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 35761. [D 20:43:12.550035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 35762. [D 20:43:12.550045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 35763. [D 20:43:12.550055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 35764. [D 20:43:12.550079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 35765. [D 20:43:12.550088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 35766. [D 20:43:12.550098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 35767. [D 20:43:12.550109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 35768. [D 20:43:12.550119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 35769. [D 20:43:12.550132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 35770. [D 20:43:12.550157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 35771. [D 20:43:12.550168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 35772. [D 20:43:12.550178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 35773. [D 20:43:12.550187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 35774. [D 20:43:12.550217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 35775. [D 20:43:12.550227] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 35776. [D 20:43:12.552379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.552394] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.552405] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:12.561558] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 35776. [D 20:43:12.561572] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 19/70. [D 20:43:12.563059] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.563072] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.563081] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:12.582693] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.582708] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.582719] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:12.582752] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5894 [D 20:43:12.582763] element 0: offset: 0x64dbb0, size: 24 [D 20:43:12.582776] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 20/70. [D 20:43:12.582796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.582809] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.582817] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:12.582831] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5897 [D 20:43:12.582842] element 0: offset: 0x691fe0, size: 24 [D 20:43:12.582852] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 21/70. [D 20:43:12.585051] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.585065] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.585076] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:12.585090] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5899 [D 20:43:12.585100] element 0: offset: 0x66e860, size: 24 [D 20:43:12.585111] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 22/70. [D 20:43:12.588857] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 5897 [D 20:43:12.588877] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 23/70. [D 20:43:12.588975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 35776. [D 20:43:12.589049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 35777. [D 20:43:12.589060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 35778. [D 20:43:12.589070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 35779. [D 20:43:12.589085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 35780. [D 20:43:12.589095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 35781. [D 20:43:12.589104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 35782. [D 20:43:12.589118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 35783. [D 20:43:12.589128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 35784. [D 20:43:12.589138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 35785. [D 20:43:12.589154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 35786. [D 20:43:12.589163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 35787. [D 20:43:12.589173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 35788. [D 20:43:12.589189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 35789. [D 20:43:12.589198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 35790. [D 20:43:12.589208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 35791. [D 20:43:12.589252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 35792. [D 20:43:12.589265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 35793. [D 20:43:12.589275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 35794. [D 20:43:12.589285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 35795. [D 20:43:12.589324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 35796. [D 20:43:12.589334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 35797. [D 20:43:12.589344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 35798. [D 20:43:12.589359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 35799. [D 20:43:12.589369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 35800. [D 20:43:12.589395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 35801. [D 20:43:12.589405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 35802. [D 20:43:12.589415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 35803. [D 20:43:12.589443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 35804. [D 20:43:12.589454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 35805. [D 20:43:12.589468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 35806. [D 20:43:12.589478] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 35807. [D 20:43:12.594173] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5899 [D 20:43:12.594192] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 24/70. [D 20:43:12.599334] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 35807. [D 20:43:12.599401] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 25/70. [D 20:43:12.599418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 35807. [D 20:43:12.599430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 35808. [D 20:43:12.599441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 35809. [D 20:43:12.599451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 35810. [D 20:43:12.599467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 35811. [D 20:43:12.599476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 35812. [D 20:43:12.599486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 35813. [D 20:43:12.599501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 35814. [D 20:43:12.599511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 35815. [D 20:43:12.599521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 35816. [D 20:43:12.599537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 35817. [D 20:43:12.599546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 35818. [D 20:43:12.599576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 35819. [D 20:43:12.599586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 35820. [D 20:43:12.599596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 35821. [D 20:43:12.599607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 35822. [D 20:43:12.599616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 35823. [D 20:43:12.599626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 35824. [D 20:43:12.599636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 35825. [D 20:43:12.599653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 35826. [D 20:43:12.599662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 35827. [D 20:43:12.599682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 35828. [D 20:43:12.599692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 35829. [D 20:43:12.599702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 35830. [D 20:43:12.599712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 35831. [D 20:43:12.599721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 35832. [D 20:43:12.599739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 35833. [D 20:43:12.599748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 35834. [D 20:43:12.599758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 35835. [D 20:43:12.599783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 35836. [D 20:43:12.599793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 35837. [D 20:43:12.599804] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2031f0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 35838. [D 20:43:12.602015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.602031] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.602041] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:12.602298] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5894 [D 20:43:12.602318] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 26/70. [D 20:43:12.611182] openib_check_cq: completed rdma wr_id 2aaaab2031f0, nic_wr_credit 35838. [D 20:43:12.611200] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 27/70. [D 20:43:12.611228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 35838. [D 20:43:12.611241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 35839. [D 20:43:12.611251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 35840. [D 20:43:12.611261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 35841. [D 20:43:12.611271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 35842. [D 20:43:12.611281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 35843. [D 20:43:12.611291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 35844. [D 20:43:12.611301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 35845. [D 20:43:12.611311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 35846. [D 20:43:12.611321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 35847. [D 20:43:12.611353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 35848. [D 20:43:12.611363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 35849. [D 20:43:12.611375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 35850. [D 20:43:12.611385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 35851. [D 20:43:12.611394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 35852. [D 20:43:12.611417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 35853. [D 20:43:12.611427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 35854. [D 20:43:12.611442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 35855. [D 20:43:12.611453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 35856. [D 20:43:12.611463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 35857. [D 20:43:12.611486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 35858. [D 20:43:12.611496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 35859. [D 20:43:12.611505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 35860. [D 20:43:12.611520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 35861. [D 20:43:12.611530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 35862. [D 20:43:12.611539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 35863. [D 20:43:12.611566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 35864. [D 20:43:12.611575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 35865. [D 20:43:12.611589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 35866. [D 20:43:12.611599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 35867. [D 20:43:12.611609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 35868. [D 20:43:12.611623] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 35869. [D 20:43:12.611655] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.611667] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.611676] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:12.622936] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 35869. [D 20:43:12.622950] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 28/70. [D 20:43:12.625231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.625244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.625254] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:12.625287] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5902 [D 20:43:12.625311] element 0: offset: 0x6252d0, size: 24 [D 20:43:12.625325] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 29/70. [D 20:43:12.625345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.625359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.625368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:12.629655] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5902 [D 20:43:12.629673] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 30/70. [D 20:43:12.634260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 35869. [D 20:43:12.634322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 35870. [D 20:43:12.634333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 35871. [D 20:43:12.634344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 35872. [D 20:43:12.634355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 35873. [D 20:43:12.634364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 35874. [D 20:43:12.634374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 35875. [D 20:43:12.634389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 35876. [D 20:43:12.634399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 35877. [D 20:43:12.634409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 35878. [D 20:43:12.634418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 35879. [D 20:43:12.634435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 35880. [D 20:43:12.634477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 35881. [D 20:43:12.634487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 35882. [D 20:43:12.634514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 35883. [D 20:43:12.634525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 35884. [D 20:43:12.634535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 35885. [D 20:43:12.634545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 35886. [D 20:43:12.634554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 35887. [D 20:43:12.634567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 35888. [D 20:43:12.634604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 35889. [D 20:43:12.634614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 35890. [D 20:43:12.634628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 35891. [D 20:43:12.634638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 35892. [D 20:43:12.634648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 35893. [D 20:43:12.634671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 35894. [D 20:43:12.634681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 35895. [D 20:43:12.634691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 35896. [D 20:43:12.634701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 35897. [D 20:43:12.634711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 35898. [D 20:43:12.634722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 35899. [D 20:43:12.634747] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 35900. [D 20:43:12.639167] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.639182] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.639193] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:12.639228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5905 [D 20:43:12.639239] element 0: offset: 0x661b60, size: 24 [D 20:43:12.639255] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 31/70. [D 20:43:12.639278] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.639289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.639297] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:12.639312] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5908 [D 20:43:12.639322] element 0: offset: 0x661e10, size: 24 [D 20:43:12.639334] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 32/70. [D 20:43:12.640783] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 35900. [D 20:43:12.640798] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 33/70. [D 20:43:12.643128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.643141] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.643152] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:12.646118] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5908 [D 20:43:12.646137] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 34/70. [D 20:43:12.649860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 35900. [D 20:43:12.649928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 35901. [D 20:43:12.649940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 35902. [D 20:43:12.649950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 35903. [D 20:43:12.649960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 35904. [D 20:43:12.649970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 35905. [D 20:43:12.649980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 35906. [D 20:43:12.649990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 35907. [D 20:43:12.650000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 35908. [D 20:43:12.650009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 35909. [D 20:43:12.650019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 35910. [D 20:43:12.650036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 35911. [D 20:43:12.650089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 35912. [D 20:43:12.650114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 35913. [D 20:43:12.650126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 35914. [D 20:43:12.650135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 35915. [D 20:43:12.650148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 35916. [D 20:43:12.650162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 35917. [D 20:43:12.650185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 35918. [D 20:43:12.650196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 35919. [D 20:43:12.650206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 35920. [D 20:43:12.650216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 35921. [D 20:43:12.650226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 35922. [D 20:43:12.650236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 35923. [D 20:43:12.650246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 35924. [D 20:43:12.650273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 35925. [D 20:43:12.650283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 35926. [D 20:43:12.650292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 35927. [D 20:43:12.650318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 35928. [D 20:43:12.650328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 35929. [D 20:43:12.650338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 35930. [D 20:43:12.650353] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 35931. [D 20:43:12.661769] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 35931. [D 20:43:12.661804] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 35/70. [D 20:43:12.663978] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.663993] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.664004] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:12.671072] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.671090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.671100] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:12.671134] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5911 [D 20:43:12.671145] element 0: offset: 0x657310, size: 24 [D 20:43:12.671734] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 36/70. [D 20:43:12.676309] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5911 [D 20:43:12.676327] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 37/70. [D 20:43:12.676393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 35931. [D 20:43:12.676468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 35932. [D 20:43:12.676480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 35933. [D 20:43:12.676490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 35934. [D 20:43:12.676501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 35935. [D 20:43:12.676510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 35936. [D 20:43:12.676520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 35937. [D 20:43:12.676530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 35938. [D 20:43:12.676540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 35939. [D 20:43:12.676550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 35940. [D 20:43:12.676559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 35941. [D 20:43:12.676570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 35942. [D 20:43:12.676616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 35943. [D 20:43:12.676629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 35944. [D 20:43:12.676638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 35945. [D 20:43:12.676648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 35946. [D 20:43:12.676658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 35947. [D 20:43:12.676674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 35948. [D 20:43:12.676683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 35949. [D 20:43:12.676693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 35950. [D 20:43:12.676704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 35951. [D 20:43:12.676714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 35952. [D 20:43:12.676724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 35953. [D 20:43:12.676749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 35954. [D 20:43:12.676766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 35955. [D 20:43:12.676776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 35956. [D 20:43:12.676785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 35957. [D 20:43:12.676796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 35958. [D 20:43:12.676806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 35959. [D 20:43:12.676829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 35960. [D 20:43:12.676843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 35961. [D 20:43:12.676853] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 35962. [D 20:43:12.682334] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 35962. [D 20:43:12.682354] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 38/70. [D 20:43:12.684535] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.684550] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.684560] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:12.685203] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5905 [D 20:43:12.685226] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 39/70. [D 20:43:12.685283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 35962. [D 20:43:12.685327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 35963. [D 20:43:12.685339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 35964. [D 20:43:12.685349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 35965. [D 20:43:12.685363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 35966. [D 20:43:12.685373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 35967. [D 20:43:12.685383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 35968. [D 20:43:12.685398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 35969. [D 20:43:12.685407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 35970. [D 20:43:12.685417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 35971. [D 20:43:12.685454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 35972. [D 20:43:12.685465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 35973. [D 20:43:12.685475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 35974. [D 20:43:12.685485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 35975. [D 20:43:12.685500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 35976. [D 20:43:12.685510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 35977. [D 20:43:12.685519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 35978. [D 20:43:12.685529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 35979. [D 20:43:12.685539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 35980. [D 20:43:12.685549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 35981. [D 20:43:12.685559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 35982. [D 20:43:12.685569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 35983. [D 20:43:12.685580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 35984. [D 20:43:12.685604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 35985. [D 20:43:12.685614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 35986. [D 20:43:12.685624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 35987. [D 20:43:12.685642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 35988. [D 20:43:12.685652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 35989. [D 20:43:12.685671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 35990. [D 20:43:12.685686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 35991. [D 20:43:12.685695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 35992. [D 20:43:12.685705] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 35993. [D 20:43:12.691190] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 35993. [D 20:43:12.691207] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 40/70. [D 20:43:12.693362] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.693376] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.693386] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:12.702415] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.702429] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.702440] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:12.702473] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5913 [D 20:43:12.702484] element 0: offset: 0x6a6520, size: 24 [D 20:43:12.702496] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 41/70. [D 20:43:12.741743] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5913 [D 20:43:12.741761] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 42/70. [D 20:43:12.741822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 35993. [D 20:43:12.741909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 35994. [D 20:43:12.741923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 35995. [D 20:43:12.741934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 35996. [D 20:43:12.741945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 35997. [D 20:43:12.741955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 35998. [D 20:43:12.741966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 35999. [D 20:43:12.741976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36000. [D 20:43:12.741986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36001. [D 20:43:12.742010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36002. [D 20:43:12.742020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 36003. [D 20:43:12.742044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 36004. [D 20:43:12.742055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 36005. [D 20:43:12.742069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 36006. [D 20:43:12.742093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 36007. [D 20:43:12.742103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36008. [D 20:43:12.742125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36009. [D 20:43:12.742135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36010. [D 20:43:12.742145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 36011. [D 20:43:12.742170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 36012. [D 20:43:12.742180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 36013. [D 20:43:12.742190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 36014. [D 20:43:12.742220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 36015. [D 20:43:12.742230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36016. [D 20:43:12.742243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36017. [D 20:43:12.742264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36018. [D 20:43:12.742277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 36019. [D 20:43:12.742295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 36020. [D 20:43:12.742306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 36021. [D 20:43:12.742316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 36022. [D 20:43:12.742336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 36023. [D 20:43:12.742347] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36024. [D 20:43:12.747773] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36024. [D 20:43:12.747791] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 43/70. [D 20:43:12.750076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.750091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.750101] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:12.783086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.783101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.783112] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:12.783145] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5917 [D 20:43:12.783156] element 0: offset: 0x625730, size: 24 [D 20:43:12.783168] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 44/70. [D 20:43:12.787565] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5917 [D 20:43:12.787583] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 45/70. [D 20:43:12.787643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 36024. [D 20:43:12.787706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 36025. [D 20:43:12.787754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 36026. [D 20:43:12.787765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 36027. [D 20:43:12.787776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 36028. [D 20:43:12.787786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 36029. [D 20:43:12.787796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 36030. [D 20:43:12.787806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 36031. [D 20:43:12.787829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 36032. [D 20:43:12.787839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 36033. [D 20:43:12.787849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 36034. [D 20:43:12.787859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 36035. [D 20:43:12.787879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 36036. [D 20:43:12.787889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 36037. [D 20:43:12.787899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 36038. [D 20:43:12.787921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 36039. [D 20:43:12.787931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 36040. [D 20:43:12.787953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 36041. [D 20:43:12.787968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 36042. [D 20:43:12.787978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 36043. [D 20:43:12.787988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 36044. [D 20:43:12.788005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 36045. [D 20:43:12.788016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 36046. [D 20:43:12.788026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 36047. [D 20:43:12.788035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 36048. [D 20:43:12.788052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 36049. [D 20:43:12.788062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 36050. [D 20:43:12.788094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 36051. [D 20:43:12.788104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 36052. [D 20:43:12.788114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 36053. [D 20:43:12.788138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 36054. [D 20:43:12.788149] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 36055. [D 20:43:12.793642] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36055. [D 20:43:12.793659] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 46/70. [D 20:43:12.795954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.795969] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.795979] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:12.961791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.961807] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.961817] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:12.961850] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5920 [D 20:43:12.961860] element 0: offset: 0x66e860, size: 24 [D 20:43:12.961872] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 47/70. [D 20:43:12.964029] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5920 [D 20:43:12.964048] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 48/70. [D 20:43:12.971867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36055. [D 20:43:12.971925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 36056. [D 20:43:12.971935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 36057. [D 20:43:12.971946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 36058. [D 20:43:12.971961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 36059. [D 20:43:12.971972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 36060. [D 20:43:12.971982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36061. [D 20:43:12.971992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36062. [D 20:43:12.972002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36063. [D 20:43:12.972012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 36064. [D 20:43:12.972022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 36065. [D 20:43:12.972039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 36066. [D 20:43:12.972048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 36067. [D 20:43:12.972058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 36068. [D 20:43:12.972069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36069. [D 20:43:12.972079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36070. [D 20:43:12.972089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36071. [D 20:43:12.972121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 36072. [D 20:43:12.972132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 36073. [D 20:43:12.972142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 36074. [D 20:43:12.972153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 36075. [D 20:43:12.972162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 36076. [D 20:43:12.972173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36077. [D 20:43:12.972183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36078. [D 20:43:12.972207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36079. [D 20:43:12.972221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 36080. [D 20:43:12.972231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 36081. [D 20:43:12.972240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 36082. [D 20:43:12.972256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 36083. [D 20:43:12.972266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 36084. [D 20:43:12.972276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36085. [D 20:43:12.972285] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36086. [D 20:43:12.978301] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36086. [D 20:43:12.978317] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 49/70. [D 20:43:12.982310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:12.982325] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.982336] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:12.982357] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.982367] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.982376] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:12.982407] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5923 [D 20:43:12.982418] element 0: offset: 0x64dbb0, size: 24 [D 20:43:12.982430] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 50/70. [D 20:43:12.985119] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5923 [D 20:43:12.985137] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 51/70. [D 20:43:12.989174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 36086. [D 20:43:12.989238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36087. [D 20:43:12.989250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36088. [D 20:43:12.989260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36089. [D 20:43:12.989275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36090. [D 20:43:12.989284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36091. [D 20:43:12.989294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36092. [D 20:43:12.989309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36093. [D 20:43:12.989319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36094. [D 20:43:12.989328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36095. [D 20:43:12.989344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36096. [D 20:43:12.989385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36097. [D 20:43:12.989395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36098. [D 20:43:12.989421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36099. [D 20:43:12.989432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36100. [D 20:43:12.989443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36101. [D 20:43:12.989452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36102. [D 20:43:12.989483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36103. [D 20:43:12.989494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36104. [D 20:43:12.989508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36105. [D 20:43:12.989518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36106. [D 20:43:12.989528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36107. [D 20:43:12.989554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36108. [D 20:43:12.989564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36109. [D 20:43:12.989578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36110. [D 20:43:12.989587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36111. [D 20:43:12.989597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36112. [D 20:43:12.989621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36113. [D 20:43:12.989631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36114. [D 20:43:12.989645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36115. [D 20:43:12.989655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36116. [D 20:43:12.989665] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36117. [D 20:43:12.994070] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:12.994085] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:12.994096] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:12.994130] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5926 [D 20:43:12.994142] element 0: offset: 0x5b0030, size: 24 [D 20:43:12.994156] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 52/70. [D 20:43:13.000866] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36117. [D 20:43:13.000882] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 53/70. [D 20:43:13.003188] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.003202] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.003212] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.005281] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5926 [D 20:43:13.005300] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 54/70. [D 20:43:13.006998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36117. [D 20:43:13.007050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 36118. [D 20:43:13.007062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 36119. [D 20:43:13.007072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 36120. [D 20:43:13.007087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 36121. [D 20:43:13.007111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 36122. [D 20:43:13.007120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36123. [D 20:43:13.007136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36124. [D 20:43:13.007146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36125. [D 20:43:13.007155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 36126. [D 20:43:13.007187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 36127. [D 20:43:13.007196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 36128. [D 20:43:13.007211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 36129. [D 20:43:13.007221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 36130. [D 20:43:13.007230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36131. [D 20:43:13.007260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36132. [D 20:43:13.007275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36133. [D 20:43:13.007286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 36134. [D 20:43:13.007296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 36135. [D 20:43:13.007326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 36136. [D 20:43:13.007338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 36137. [D 20:43:13.007351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 36138. [D 20:43:13.007361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36139. [D 20:43:13.007382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36140. [D 20:43:13.007394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36141. [D 20:43:13.007404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 36142. [D 20:43:13.007419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 36143. [D 20:43:13.007428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 36144. [D 20:43:13.007438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 36145. [D 20:43:13.007464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 36146. [D 20:43:13.007473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36147. [D 20:43:13.007487] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36148. [D 20:43:13.011100] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.011115] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.011126] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.011160] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5929 [D 20:43:13.011171] element 0: offset: 0x657310, size: 24 [D 20:43:13.011186] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 55/70. [D 20:43:13.018870] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36148. [D 20:43:13.018886] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 56/70. [D 20:43:13.021202] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.021216] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.021226] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.023266] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5929 [D 20:43:13.023284] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 57/70. [D 20:43:13.024291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36148. [D 20:43:13.024344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36149. [D 20:43:13.024355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36150. [D 20:43:13.024366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36151. [D 20:43:13.024380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36152. [D 20:43:13.024390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36153. [D 20:43:13.024400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36154. [D 20:43:13.024414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36155. [D 20:43:13.024424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36156. [D 20:43:13.024433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36157. [D 20:43:13.024449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36158. [D 20:43:13.024481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36159. [D 20:43:13.024492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36160. [D 20:43:13.024502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36161. [D 20:43:13.024516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36162. [D 20:43:13.024526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36163. [D 20:43:13.024535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36164. [D 20:43:13.024545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36165. [D 20:43:13.024562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36166. [D 20:43:13.024572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36167. [D 20:43:13.024596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36168. [D 20:43:13.024607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36169. [D 20:43:13.024617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36170. [D 20:43:13.024633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36171. [D 20:43:13.024643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36172. [D 20:43:13.024652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36173. [D 20:43:13.024668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36174. [D 20:43:13.024694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36175. [D 20:43:13.024707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36176. [D 20:43:13.024717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36177. [D 20:43:13.024726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36178. [D 20:43:13.024750] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36179. [D 20:43:13.029225] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.029241] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.029251] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.029284] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5932 [D 20:43:13.029296] element 0: offset: 0x620d50, size: 24 [D 20:43:13.029311] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 58/70. [D 20:43:13.035968] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36179. [D 20:43:13.035984] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 59/70. [D 20:43:13.038334] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.038348] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.038358] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.040395] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5932 [D 20:43:13.040413] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 60/70. [D 20:43:13.042195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36179. [D 20:43:13.042255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 36180. [D 20:43:13.042267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 36181. [D 20:43:13.042278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 36182. [D 20:43:13.042288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 36183. [D 20:43:13.042298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 36184. [D 20:43:13.042307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36185. [D 20:43:13.042318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36186. [D 20:43:13.042327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36187. [D 20:43:13.042337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 36188. [D 20:43:13.042347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 36189. [D 20:43:13.042363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 36190. [D 20:43:13.042373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 36191. [D 20:43:13.042415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 36192. [D 20:43:13.042425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36193. [D 20:43:13.042449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36194. [D 20:43:13.042462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36195. [D 20:43:13.042472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 36196. [D 20:43:13.042482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 36197. [D 20:43:13.042492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 36198. [D 20:43:13.042516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 36199. [D 20:43:13.042526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 36200. [D 20:43:13.042536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36201. [D 20:43:13.042545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36202. [D 20:43:13.042561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36203. [D 20:43:13.042584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 36204. [D 20:43:13.042598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 36205. [D 20:43:13.042609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 36206. [D 20:43:13.042619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 36207. [D 20:43:13.042629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 36208. [D 20:43:13.042654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36209. [D 20:43:13.042665] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36210. [D 20:43:13.047105] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.047120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.047129] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.047166] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5935 [D 20:43:13.047178] element 0: offset: 0x6a6520, size: 24 [D 20:43:13.047191] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 0/70. [D 20:43:13.054064] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36210. [D 20:43:13.054079] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 1/70. [D 20:43:13.056434] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.056448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.056458] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.058471] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5935 [D 20:43:13.058490] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 2/70. [D 20:43:13.059361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36210. [D 20:43:13.059412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36211. [D 20:43:13.059424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36212. [D 20:43:13.059434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36213. [D 20:43:13.059445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36214. [D 20:43:13.059454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36215. [D 20:43:13.059464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36216. [D 20:43:13.059475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36217. [D 20:43:13.059484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36218. [D 20:43:13.059494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36219. [D 20:43:13.059504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36220. [D 20:43:13.059514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36221. [D 20:43:13.059524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36222. [D 20:43:13.059556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36223. [D 20:43:13.059570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36224. [D 20:43:13.059580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36225. [D 20:43:13.059609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36226. [D 20:43:13.059619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36227. [D 20:43:13.059629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36228. [D 20:43:13.059640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36229. [D 20:43:13.059650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36230. [D 20:43:13.059660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36231. [D 20:43:13.059670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36232. [D 20:43:13.059695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36233. [D 20:43:13.059705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36234. [D 20:43:13.059715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36235. [D 20:43:13.059744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36236. [D 20:43:13.059754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36237. [D 20:43:13.059765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36238. [D 20:43:13.059775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36239. [D 20:43:13.059785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36240. [D 20:43:13.059797] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36241. [D 20:43:13.071030] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36241. [D 20:43:13.071047] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 3/70. [D 20:43:13.073332] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.073347] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.073357] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:13.082031] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.082044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.082055] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:13.082087] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5938 [D 20:43:13.082098] element 0: offset: 0x66e710, size: 24 [D 20:43:13.082110] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 4/70. [D 20:43:13.086474] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5938 [D 20:43:13.086493] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 5/70. [D 20:43:13.086642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36241. [D 20:43:13.086706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36242. [D 20:43:13.086717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36243. [D 20:43:13.086728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36244. [D 20:43:13.086742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36245. [D 20:43:13.086752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36246. [D 20:43:13.086761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36247. [D 20:43:13.086776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36248. [D 20:43:13.086786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36249. [D 20:43:13.086795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36250. [D 20:43:13.086811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36251. [D 20:43:13.086821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36252. [D 20:43:13.086830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36253. [D 20:43:13.086840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36254. [D 20:43:13.086857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36255. [D 20:43:13.086867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36256. [D 20:43:13.086911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36257. [D 20:43:13.086929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36258. [D 20:43:13.086940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36259. [D 20:43:13.086950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36260. [D 20:43:13.086961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36261. [D 20:43:13.086985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36262. [D 20:43:13.086995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36263. [D 20:43:13.087006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36264. [D 20:43:13.087015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36265. [D 20:43:13.087026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36266. [D 20:43:13.087054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36267. [D 20:43:13.087069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36268. [D 20:43:13.087078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36269. [D 20:43:13.087088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36270. [D 20:43:13.087120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36271. [D 20:43:13.087131] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36272. [D 20:43:13.095161] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36272. [D 20:43:13.095180] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 6/70. [D 20:43:13.097460] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.097475] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.097485] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:13.106207] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.106221] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.106233] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:13.106265] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5941 [D 20:43:13.106276] element 0: offset: 0x66e860, size: 24 [D 20:43:13.106288] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 7/70. [D 20:43:13.106307] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.106320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.106329] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.106344] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5944 [D 20:43:13.106353] element 0: offset: 0x691fe0, size: 24 [D 20:43:13.106363] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 8/70. [D 20:43:13.112670] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5944 [D 20:43:13.112688] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 9/70. [D 20:43:13.112831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36272. [D 20:43:13.112899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36273. [D 20:43:13.112911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36274. [D 20:43:13.112921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36275. [D 20:43:13.112936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36276. [D 20:43:13.112945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36277. [D 20:43:13.112955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36278. [D 20:43:13.112968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36279. [D 20:43:13.112978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36280. [D 20:43:13.112988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36281. [D 20:43:13.113043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36282. [D 20:43:13.113055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36283. [D 20:43:13.113066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36284. [D 20:43:13.113091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36285. [D 20:43:13.113101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36286. [D 20:43:13.113110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36287. [D 20:43:13.113138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36288. [D 20:43:13.113149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36289. [D 20:43:13.113159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36290. [D 20:43:13.113173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36291. [D 20:43:13.113182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36292. [D 20:43:13.113192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36293. [D 20:43:13.113207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36294. [D 20:43:13.113230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36295. [D 20:43:13.113243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36296. [D 20:43:13.113253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36297. [D 20:43:13.113263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36298. [D 20:43:13.113276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36299. [D 20:43:13.113286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36300. [D 20:43:13.113295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36301. [D 20:43:13.113305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36302. [D 20:43:13.113323] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36303. [D 20:43:13.116623] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5941 [D 20:43:13.116642] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 10/70. [D 20:43:13.124529] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36303. [D 20:43:13.124550] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 11/70. [D 20:43:13.124573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36303. [D 20:43:13.124584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36304. [D 20:43:13.124594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 36305. [D 20:43:13.124607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 36306. [D 20:43:13.124621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 36307. [D 20:43:13.124631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 36308. [D 20:43:13.124641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 36309. [D 20:43:13.124657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36310. [D 20:43:13.124666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36311. [D 20:43:13.124676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36312. [D 20:43:13.124714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 36313. [D 20:43:13.124725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 36314. [D 20:43:13.124737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 36315. [D 20:43:13.124747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 36316. [D 20:43:13.124769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 36317. [D 20:43:13.124780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36318. [D 20:43:13.124789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36319. [D 20:43:13.124803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36320. [D 20:43:13.124813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 36321. [D 20:43:13.124822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 36322. [D 20:43:13.124852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 36323. [D 20:43:13.124868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 36324. [D 20:43:13.124878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 36325. [D 20:43:13.124887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36326. [D 20:43:13.124898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36327. [D 20:43:13.124920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36328. [D 20:43:13.124931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 36329. [D 20:43:13.124941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 36330. [D 20:43:13.124951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 36331. [D 20:43:13.124976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 36332. [D 20:43:13.124986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 36333. [D 20:43:13.124996] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2031f0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36334. [D 20:43:13.125070] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.125085] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.125094] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.132709] openib_check_cq: completed rdma wr_id 2aaaab2031f0, nic_wr_credit 36334. [D 20:43:13.132723] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 12/70. [D 20:43:13.134989] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.135002] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.135012] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:13.145280] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.145294] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.145305] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:13.145337] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5948 [D 20:43:13.145348] element 0: offset: 0x64dbb0, size: 24 [D 20:43:13.145360] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 13/70. [D 20:43:13.145378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.145393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.145402] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.145416] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5949 [D 20:43:13.145426] element 0: offset: 0x5b0030, size: 24 [D 20:43:13.145435] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 14/70. [D 20:43:13.149714] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5948 [D 20:43:13.149732] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 15/70. [D 20:43:13.149879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36334. [D 20:43:13.149939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36335. [D 20:43:13.149951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36336. [D 20:43:13.149961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36337. [D 20:43:13.149975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36338. [D 20:43:13.149985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36339. [D 20:43:13.149995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36340. [D 20:43:13.150009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36341. [D 20:43:13.150019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36342. [D 20:43:13.150028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36343. [D 20:43:13.150044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36344. [D 20:43:13.150054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36345. [D 20:43:13.150064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36346. [D 20:43:13.150114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36347. [D 20:43:13.150125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36348. [D 20:43:13.150135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36349. [D 20:43:13.150164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36350. [D 20:43:13.150175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36351. [D 20:43:13.150187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36352. [D 20:43:13.150197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36353. [D 20:43:13.150207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36354. [D 20:43:13.150240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36355. [D 20:43:13.150250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36356. [D 20:43:13.150260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36357. [D 20:43:13.150270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36358. [D 20:43:13.150293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36359. [D 20:43:13.150304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36360. [D 20:43:13.150314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36361. [D 20:43:13.150327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36362. [D 20:43:13.150337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36363. [D 20:43:13.150363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36364. [D 20:43:13.150372] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36365. [D 20:43:13.161565] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36365. [D 20:43:13.161630] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 16/70. [D 20:43:13.163147] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.163162] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.163173] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.172245] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.172260] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.172270] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.172303] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5953 [D 20:43:13.172315] element 0: offset: 0x620d50, size: 24 [D 20:43:13.172329] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 17/70. [D 20:43:13.173216] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 655360, tag: 5953 [D 20:43:13.173271] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 18/70. [D 20:43:13.173325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36365. [D 20:43:13.173343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36366. [D 20:43:13.173355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36367. [D 20:43:13.173364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36368. [D 20:43:13.173374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36369. [D 20:43:13.173384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36370. [D 20:43:13.173394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36371. [D 20:43:13.173403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36372. [D 20:43:13.173427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36373. [D 20:43:13.173437] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36374. [D 20:43:13.175180] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36374. [D 20:43:13.175194] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 19/70. [D 20:43:13.175234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.175245] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.175253] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.190730] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.190758] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.190769] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.190796] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5956 [D 20:43:13.190807] element 0: offset: 0x61f310, size: 24 [D 20:43:13.190818] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 20/70. [D 20:43:13.193228] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5956 [D 20:43:13.193289] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 21/70. [D 20:43:13.193346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 36374. [D 20:43:13.193366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 36375. [D 20:43:13.193378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 36376. [D 20:43:13.193388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 36377. [D 20:43:13.193397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 36378. [D 20:43:13.193407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 36379. [D 20:43:13.193417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 36380. [D 20:43:13.193427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 36381. [D 20:43:13.193437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 36382. [D 20:43:13.193447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 36383. [D 20:43:13.193464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 36384. [D 20:43:13.193474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 36385. [D 20:43:13.193484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 36386. [D 20:43:13.193494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 36387. [D 20:43:13.193504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 36388. [D 20:43:13.193537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 36389. [D 20:43:13.193548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 36390. [D 20:43:13.193558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 36391. [D 20:43:13.193568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 36392. [D 20:43:13.193577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 36393. [D 20:43:13.193593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 36394. [D 20:43:13.193603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 36395. [D 20:43:13.193613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 36396. [D 20:43:13.193623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 36397. [D 20:43:13.193648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 36398. [D 20:43:13.193659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 36399. [D 20:43:13.193670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 36400. [D 20:43:13.193680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 36401. [D 20:43:13.193689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 36402. [D 20:43:13.193699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 36403. [D 20:43:13.193711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 36404. [D 20:43:13.193721] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 36405. [D 20:43:13.199221] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36405. [D 20:43:13.199239] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 22/70. [D 20:43:13.201412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.201425] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.201435] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.240473] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5949 [D 20:43:13.240491] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 23/70. [D 20:43:13.240551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36405. [D 20:43:13.240625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36406. [D 20:43:13.240636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 36407. [D 20:43:13.240646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 36408. [D 20:43:13.240657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 36409. [D 20:43:13.240667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 36410. [D 20:43:13.240682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 36411. [D 20:43:13.240692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36412. [D 20:43:13.240702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36413. [D 20:43:13.240718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36414. [D 20:43:13.240764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 36415. [D 20:43:13.240775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 36416. [D 20:43:13.240798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 36417. [D 20:43:13.240813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 36418. [D 20:43:13.240823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 36419. [D 20:43:13.240832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36420. [D 20:43:13.240860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36421. [D 20:43:13.240870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36422. [D 20:43:13.240882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 36423. [D 20:43:13.240892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 36424. [D 20:43:13.240902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 36425. [D 20:43:13.240912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 36426. [D 20:43:13.240923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 36427. [D 20:43:13.240949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36428. [D 20:43:13.240959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36429. [D 20:43:13.240968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36430. [D 20:43:13.240991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 36431. [D 20:43:13.241001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 36432. [D 20:43:13.241011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 36433. [D 20:43:13.241027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 36434. [D 20:43:13.241037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 36435. [D 20:43:13.241046] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36436. [D 20:43:13.246472] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36436. [D 20:43:13.246488] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 24/70. [D 20:43:13.248625] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.248640] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.248651] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:13.256696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.256710] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.256721] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:13.256754] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5958 [D 20:43:13.256765] element 0: offset: 0x66e860, size: 24 [D 20:43:13.256778] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 25/70. [D 20:43:13.274598] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5958 [D 20:43:13.274653] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 26/70. [D 20:43:13.274706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36436. [D 20:43:13.274763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36437. [D 20:43:13.274773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 36438. [D 20:43:13.274783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 36439. [D 20:43:13.274794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 36440. [D 20:43:13.274804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 36441. [D 20:43:13.274813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 36442. [D 20:43:13.274823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36443. [D 20:43:13.274840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36444. [D 20:43:13.274850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36445. [D 20:43:13.274860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 36446. [D 20:43:13.274907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 36447. [D 20:43:13.274918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 36448. [D 20:43:13.274929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 36449. [D 20:43:13.274938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 36450. [D 20:43:13.274963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36451. [D 20:43:13.274973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36452. [D 20:43:13.274983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36453. [D 20:43:13.274994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 36454. [D 20:43:13.275003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 36455. [D 20:43:13.275028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 36456. [D 20:43:13.275038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 36457. [D 20:43:13.275048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 36458. [D 20:43:13.275065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36459. [D 20:43:13.275075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36460. [D 20:43:13.275084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36461. [D 20:43:13.275108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 36462. [D 20:43:13.275118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 36463. [D 20:43:13.275133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 36464. [D 20:43:13.275143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 36465. [D 20:43:13.275153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 36466. [D 20:43:13.275163] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36467. [D 20:43:13.280664] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36467. [D 20:43:13.280681] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 27/70. [D 20:43:13.282983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.282997] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.283008] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:13.379145] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.379160] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.379171] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:13.379203] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5962 [D 20:43:13.379214] element 0: offset: 0x625730, size: 24 [D 20:43:13.379226] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 28/70. [D 20:43:13.381565] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.381579] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.381588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:13.411147] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.411161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.411172] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:13.411187] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5966 [D 20:43:13.411198] element 0: offset: 0x63fe20, size: 24 [D 20:43:13.411208] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 29/70. [D 20:43:13.411223] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.411237] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.411246] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.411260] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5967 [D 20:43:13.411269] element 0: offset: 0x64dbb0, size: 24 [D 20:43:13.411279] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 30/70. [D 20:43:13.415932] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5966 [D 20:43:13.415951] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 31/70. [D 20:43:13.416292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36467. [D 20:43:13.416355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36468. [D 20:43:13.416367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36469. [D 20:43:13.416377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36470. [D 20:43:13.416388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36471. [D 20:43:13.416397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36472. [D 20:43:13.416407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36473. [D 20:43:13.416417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36474. [D 20:43:13.416427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36475. [D 20:43:13.416437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36476. [D 20:43:13.416446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36477. [D 20:43:13.416463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36478. [D 20:43:13.416473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36479. [D 20:43:13.416483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36480. [D 20:43:13.416528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36481. [D 20:43:13.416539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36482. [D 20:43:13.416548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36483. [D 20:43:13.416558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36484. [D 20:43:13.416587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36485. [D 20:43:13.416597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36486. [D 20:43:13.416607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36487. [D 20:43:13.416617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36488. [D 20:43:13.416627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36489. [D 20:43:13.416640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36490. [D 20:43:13.416656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36491. [D 20:43:13.416666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36492. [D 20:43:13.416676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36493. [D 20:43:13.416700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36494. [D 20:43:13.416710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36495. [D 20:43:13.416720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36496. [D 20:43:13.416730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36497. [D 20:43:13.416740] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36498. [D 20:43:13.428158] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36498. [D 20:43:13.428195] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 32/70. [D 20:43:13.430428] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.430443] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.430454] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.438646] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.438662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.438673] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.438706] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5971 [D 20:43:13.438717] element 0: offset: 0x661d50, size: 24 [D 20:43:13.438730] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 33/70. [D 20:43:13.440845] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5971 [D 20:43:13.440901] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 34/70. [D 20:43:13.441035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36498. [D 20:43:13.441056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36499. [D 20:43:13.441068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36500. [D 20:43:13.441077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36501. [D 20:43:13.441087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36502. [D 20:43:13.441101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36503. [D 20:43:13.441110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36504. [D 20:43:13.441120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36505. [D 20:43:13.441136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36506. [D 20:43:13.441146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36507. [D 20:43:13.441156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36508. [D 20:43:13.441165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36509. [D 20:43:13.441194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36510. [D 20:43:13.441204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36511. [D 20:43:13.441214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36512. [D 20:43:13.441225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36513. [D 20:43:13.441234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36514. [D 20:43:13.441257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36515. [D 20:43:13.441267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36516. [D 20:43:13.441277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36517. [D 20:43:13.441292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36518. [D 20:43:13.441302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36519. [D 20:43:13.441311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36520. [D 20:43:13.441335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36521. [D 20:43:13.441345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36522. [D 20:43:13.441355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36523. [D 20:43:13.441366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36524. [D 20:43:13.441375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36525. [D 20:43:13.441386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36526. [D 20:43:13.441411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36527. [D 20:43:13.441421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36528. [D 20:43:13.441434] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36529. [D 20:43:13.450081] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5967 [D 20:43:13.450100] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 35/70. [D 20:43:13.451779] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36529. [D 20:43:13.451839] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 36/70. [D 20:43:13.451856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36529. [D 20:43:13.451873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36530. [D 20:43:13.451884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 36531. [D 20:43:13.451894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 36532. [D 20:43:13.451908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 36533. [D 20:43:13.451918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 36534. [D 20:43:13.451927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 36535. [D 20:43:13.451938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36536. [D 20:43:13.451948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36537. [D 20:43:13.451958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36538. [D 20:43:13.451967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 36539. [D 20:43:13.451985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 36540. [D 20:43:13.451995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 36541. [D 20:43:13.452005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 36542. [D 20:43:13.452034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 36543. [D 20:43:13.452044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36544. [D 20:43:13.452059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36545. [D 20:43:13.452069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36546. [D 20:43:13.452078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 36547. [D 20:43:13.452114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 36548. [D 20:43:13.452127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 36549. [D 20:43:13.452137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 36550. [D 20:43:13.452147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 36551. [D 20:43:13.452171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36552. [D 20:43:13.452181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36553. [D 20:43:13.452191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36554. [D 20:43:13.452200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 36555. [D 20:43:13.452210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 36556. [D 20:43:13.452238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 36557. [D 20:43:13.452248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 36558. [D 20:43:13.452257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 36559. [D 20:43:13.452273] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2031f0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36560. [D 20:43:13.452337] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.452367] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.452386] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.457739] openib_check_cq: completed rdma wr_id 2aaaab2031f0, nic_wr_credit 36560. [D 20:43:13.457754] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 37/70. [D 20:43:13.459895] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.459908] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.459918] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:13.465990] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.466004] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.466015] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:13.466047] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5974 [D 20:43:13.466058] element 0: offset: 0x66e710, size: 24 [D 20:43:13.466070] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 38/70. [D 20:43:13.468563] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.468578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.468586] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.468601] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5976 [D 20:43:13.468610] element 0: offset: 0x61f310, size: 24 [D 20:43:13.468620] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 39/70. [D 20:43:13.471975] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5974 [D 20:43:13.472033] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 40/70. [D 20:43:13.472161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36560. [D 20:43:13.472179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36561. [D 20:43:13.472192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36562. [D 20:43:13.472202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36563. [D 20:43:13.472225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36564. [D 20:43:13.472235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36565. [D 20:43:13.472246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36566. [D 20:43:13.472261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36567. [D 20:43:13.472270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36568. [D 20:43:13.472280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36569. [D 20:43:13.472296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36570. [D 20:43:13.472306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36571. [D 20:43:13.472315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36572. [D 20:43:13.472326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36573. [D 20:43:13.472336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36574. [D 20:43:13.472346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36575. [D 20:43:13.472356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36576. [D 20:43:13.472402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36577. [D 20:43:13.472413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36578. [D 20:43:13.472424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36579. [D 20:43:13.472453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36580. [D 20:43:13.472465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36581. [D 20:43:13.472475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36582. [D 20:43:13.472485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36583. [D 20:43:13.472495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36584. [D 20:43:13.472519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36585. [D 20:43:13.472536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36586. [D 20:43:13.472546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36587. [D 20:43:13.472555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36588. [D 20:43:13.472572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36589. [D 20:43:13.472581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36590. [D 20:43:13.472591] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36591. [D 20:43:13.481540] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5976 [D 20:43:13.481558] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 41/70. [D 20:43:13.483989] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36591. [D 20:43:13.484053] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 42/70. [D 20:43:13.484071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36591. [D 20:43:13.484082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36592. [D 20:43:13.484092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 36593. [D 20:43:13.484102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 36594. [D 20:43:13.484117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 36595. [D 20:43:13.484127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 36596. [D 20:43:13.484137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 36597. [D 20:43:13.484152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36598. [D 20:43:13.484200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36599. [D 20:43:13.484210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36600. [D 20:43:13.484220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 36601. [D 20:43:13.484246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 36602. [D 20:43:13.484257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 36603. [D 20:43:13.484272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 36604. [D 20:43:13.484282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 36605. [D 20:43:13.484293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36606. [D 20:43:13.484303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36607. [D 20:43:13.484312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36608. [D 20:43:13.484331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 36609. [D 20:43:13.484341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 36610. [D 20:43:13.484351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 36611. [D 20:43:13.484374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 36612. [D 20:43:13.484384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 36613. [D 20:43:13.484394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36614. [D 20:43:13.484409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36615. [D 20:43:13.484419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36616. [D 20:43:13.484429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 36617. [D 20:43:13.484444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 36618. [D 20:43:13.484454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 36619. [D 20:43:13.484486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 36620. [D 20:43:13.484497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 36621. [D 20:43:13.484507] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2031f0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36622. [D 20:43:13.484603] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.484618] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.484628] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.493845] openib_check_cq: completed rdma wr_id 2aaaab2031f0, nic_wr_credit 36622. [D 20:43:13.493859] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 43/70. [D 20:43:13.496034] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.496047] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.496059] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:13.507154] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.507168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.507179] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:13.507210] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5981 [D 20:43:13.507221] element 0: offset: 0x5b0030, size: 24 [D 20:43:13.507233] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 44/70. [D 20:43:13.507252] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.507263] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.507271] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.507285] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5982 [D 20:43:13.507296] element 0: offset: 0x66e860, size: 24 [D 20:43:13.507305] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 45/70. [D 20:43:13.512252] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 5981 [D 20:43:13.512306] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 46/70. [D 20:43:13.512443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36622. [D 20:43:13.512524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36623. [D 20:43:13.512534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36624. [D 20:43:13.512545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36625. [D 20:43:13.512555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36626. [D 20:43:13.512565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36627. [D 20:43:13.512575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36628. [D 20:43:13.512584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36629. [D 20:43:13.512601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36630. [D 20:43:13.512611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36631. [D 20:43:13.512620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36632. [D 20:43:13.512631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36633. [D 20:43:13.512640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36634. [D 20:43:13.512650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36635. [D 20:43:13.512702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36636. [D 20:43:13.512716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36637. [D 20:43:13.512729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36638. [D 20:43:13.512747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36639. [D 20:43:13.512757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36640. [D 20:43:13.512772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36641. [D 20:43:13.512782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36642. [D 20:43:13.512791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36643. [D 20:43:13.512807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36644. [D 20:43:13.512817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36645. [D 20:43:13.512838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36646. [D 20:43:13.512847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36647. [D 20:43:13.512857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36648. [D 20:43:13.512874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36649. [D 20:43:13.512884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36650. [D 20:43:13.512894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36651. [D 20:43:13.512904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36652. [D 20:43:13.512930] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36653. [D 20:43:13.524146] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36653. [D 20:43:13.524212] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 47/70. [D 20:43:13.526377] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.526393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.526403] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.526546] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5982 [D 20:43:13.526579] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 48/70. [D 20:43:13.529676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36653. [D 20:43:13.529696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36654. [D 20:43:13.529707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 36655. [D 20:43:13.529717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 36656. [D 20:43:13.529727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 36657. [D 20:43:13.529743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 36658. [D 20:43:13.529752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 36659. [D 20:43:13.529762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36660. [D 20:43:13.529778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36661. [D 20:43:13.529788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36662. [D 20:43:13.529798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 36663. [D 20:43:13.529814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 36664. [D 20:43:13.529824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 36665. [D 20:43:13.529833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 36666. [D 20:43:13.529868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 36667. [D 20:43:13.529878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36668. [D 20:43:13.529889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36669. [D 20:43:13.529899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36670. [D 20:43:13.529909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 36671. [D 20:43:13.529933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 36672. [D 20:43:13.529943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 36673. [D 20:43:13.529953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 36674. [D 20:43:13.529963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 36675. [D 20:43:13.529972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36676. [D 20:43:13.529983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36677. [D 20:43:13.529993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36678. [D 20:43:13.530003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 36679. [D 20:43:13.530012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 36680. [D 20:43:13.530044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 36681. [D 20:43:13.530054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 36682. [D 20:43:13.530064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 36683. [D 20:43:13.530074] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36684. [D 20:43:13.534654] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.534669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.534679] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.534714] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5986 [D 20:43:13.534724] element 0: offset: 0x625730, size: 24 [D 20:43:13.534739] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 49/70. [D 20:43:13.535639] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36684. [D 20:43:13.535654] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 50/70. [D 20:43:13.537952] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.537965] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.537974] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.540080] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5986 [D 20:43:13.540099] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 51/70. [D 20:43:13.541001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 36684. [D 20:43:13.541054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36685. [D 20:43:13.541066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36686. [D 20:43:13.541076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36687. [D 20:43:13.541087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36688. [D 20:43:13.541097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36689. [D 20:43:13.541106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36690. [D 20:43:13.541117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36691. [D 20:43:13.541126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36692. [D 20:43:13.541136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36693. [D 20:43:13.541146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36694. [D 20:43:13.541163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36695. [D 20:43:13.541197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36696. [D 20:43:13.541207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36697. [D 20:43:13.541217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36698. [D 20:43:13.541243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36699. [D 20:43:13.541253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36700. [D 20:43:13.541263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36701. [D 20:43:13.541273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36702. [D 20:43:13.541282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36703. [D 20:43:13.541305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36704. [D 20:43:13.541316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36705. [D 20:43:13.541325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36706. [D 20:43:13.541340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36707. [D 20:43:13.541350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36708. [D 20:43:13.541359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36709. [D 20:43:13.541383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36710. [D 20:43:13.541393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36711. [D 20:43:13.541403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36712. [D 20:43:13.541414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36713. [D 20:43:13.541423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36714. [D 20:43:13.541433] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36715. [D 20:43:13.545781] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.545796] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.545807] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.545842] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5988 [D 20:43:13.545853] element 0: offset: 0x63fe20, size: 24 [D 20:43:13.545868] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 52/70. [D 20:43:13.551688] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36715. [D 20:43:13.551703] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 53/70. [D 20:43:13.554006] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.554019] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.554028] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.556109] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5988 [D 20:43:13.556127] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 54/70. [D 20:43:13.556191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36715. [D 20:43:13.556244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36716. [D 20:43:13.556263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 36717. [D 20:43:13.556273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 36718. [D 20:43:13.556284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 36719. [D 20:43:13.556294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 36720. [D 20:43:13.556304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 36721. [D 20:43:13.556314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36722. [D 20:43:13.556324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36723. [D 20:43:13.556333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36724. [D 20:43:13.556343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 36725. [D 20:43:13.556386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 36726. [D 20:43:13.556399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 36727. [D 20:43:13.556409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 36728. [D 20:43:13.556439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 36729. [D 20:43:13.556450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36730. [D 20:43:13.556464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36731. [D 20:43:13.556474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36732. [D 20:43:13.556484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 36733. [D 20:43:13.556514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 36734. [D 20:43:13.556525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 36735. [D 20:43:13.556535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 36736. [D 20:43:13.556545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 36737. [D 20:43:13.556555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36738. [D 20:43:13.556579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36739. [D 20:43:13.556589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36740. [D 20:43:13.556599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 36741. [D 20:43:13.556609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 36742. [D 20:43:13.556634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 36743. [D 20:43:13.556645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 36744. [D 20:43:13.556655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 36745. [D 20:43:13.556670] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36746. [D 20:43:13.562177] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36746. [D 20:43:13.562193] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 55/70. [D 20:43:13.564398] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.564413] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.564422] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:13.841329] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.841344] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.841355] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:13.841388] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5992 [D 20:43:13.841398] element 0: offset: 0x6a6520, size: 24 [D 20:43:13.841410] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 56/70. [D 20:43:13.843535] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5992 [D 20:43:13.843554] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 57/70. [D 20:43:13.847765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 36746. [D 20:43:13.847827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36747. [D 20:43:13.847837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36748. [D 20:43:13.847848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36749. [D 20:43:13.847859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36750. [D 20:43:13.847868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36751. [D 20:43:13.847878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36752. [D 20:43:13.847890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36753. [D 20:43:13.847907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36754. [D 20:43:13.847916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36755. [D 20:43:13.847926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36756. [D 20:43:13.847936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36757. [D 20:43:13.847946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36758. [D 20:43:13.847979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36759. [D 20:43:13.847990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36760. [D 20:43:13.848000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36761. [D 20:43:13.848010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36762. [D 20:43:13.848037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36763. [D 20:43:13.848048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36764. [D 20:43:13.848058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36765. [D 20:43:13.848068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36766. [D 20:43:13.848077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36767. [D 20:43:13.848101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36768. [D 20:43:13.848121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36769. [D 20:43:13.848131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36770. [D 20:43:13.848140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36771. [D 20:43:13.848162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36772. [D 20:43:13.848172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36773. [D 20:43:13.848193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36774. [D 20:43:13.848203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36775. [D 20:43:13.848216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36776. [D 20:43:13.848239] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36777. [D 20:43:13.852582] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.852597] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.852607] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.852641] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5994 [D 20:43:13.852652] element 0: offset: 0x64dbb0, size: 24 [D 20:43:13.852667] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 58/70. [D 20:43:13.858022] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36777. [D 20:43:13.858037] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 59/70. [D 20:43:13.859215] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.859229] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.859239] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.862443] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5994 [D 20:43:13.862462] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 60/70. [D 20:43:13.865018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 36777. [D 20:43:13.865071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 36778. [D 20:43:13.865082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 36779. [D 20:43:13.865092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 36780. [D 20:43:13.865102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 36781. [D 20:43:13.865112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 36782. [D 20:43:13.865122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 36783. [D 20:43:13.865132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 36784. [D 20:43:13.865147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 36785. [D 20:43:13.865157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 36786. [D 20:43:13.865166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 36787. [D 20:43:13.865177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 36788. [D 20:43:13.865201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 36789. [D 20:43:13.865211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 36790. [D 20:43:13.865227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 36791. [D 20:43:13.865236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 36792. [D 20:43:13.865246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 36793. [D 20:43:13.865256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 36794. [D 20:43:13.865277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 36795. [D 20:43:13.865287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 36796. [D 20:43:13.865297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 36797. [D 20:43:13.865330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 36798. [D 20:43:13.865341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 36799. [D 20:43:13.865351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 36800. [D 20:43:13.865361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 36801. [D 20:43:13.865377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 36802. [D 20:43:13.865407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 36803. [D 20:43:13.865417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 36804. [D 20:43:13.865426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 36805. [D 20:43:13.865452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 36806. [D 20:43:13.865462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 36807. [D 20:43:13.865472] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 36808. [D 20:43:13.869938] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:13.869953] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.869963] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:13.869997] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 5998 [D 20:43:13.870008] element 0: offset: 0x661d50, size: 24 [D 20:43:13.870023] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 0/70. [D 20:43:13.875455] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36808. [D 20:43:13.875470] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 1/70. [D 20:43:13.877865] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.877879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.877888] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:13.879915] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 5998 [D 20:43:13.879933] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 2/70. [D 20:43:13.882272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 36808. [D 20:43:13.882321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 36809. [D 20:43:13.882333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 36810. [D 20:43:13.882343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 36811. [D 20:43:13.882362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 36812. [D 20:43:13.882372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 36813. [D 20:43:13.882382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 36814. [D 20:43:13.882393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 36815. [D 20:43:13.882403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 36816. [D 20:43:13.882413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 36817. [D 20:43:13.882423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 36818. [D 20:43:13.882432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 36819. [D 20:43:13.882442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 36820. [D 20:43:13.882459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 36821. [D 20:43:13.882469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 36822. [D 20:43:13.882479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 36823. [D 20:43:13.882510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 36824. [D 20:43:13.882520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 36825. [D 20:43:13.882532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 36826. [D 20:43:13.882542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 36827. [D 20:43:13.882552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 36828. [D 20:43:13.882579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 36829. [D 20:43:13.882595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 36830. [D 20:43:13.882606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 36831. [D 20:43:13.882615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 36832. [D 20:43:13.882646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 36833. [D 20:43:13.882656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 36834. [D 20:43:13.882668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 36835. [D 20:43:13.882677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 36836. [D 20:43:13.882690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 36837. [D 20:43:13.882705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 36838. [D 20:43:13.882714] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 36839. [D 20:43:13.894084] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36839. [D 20:43:13.894100] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 3/70. [D 20:43:13.895188] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:13.895203] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:13.895214] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.013859] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.013875] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.013886] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.013918] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6000 [D 20:43:14.013928] element 0: offset: 0x63c1c0, size: 24 [D 20:43:14.013940] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 4/70. [D 20:43:14.018105] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6000 [D 20:43:14.018123] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 5/70. [D 20:43:14.018272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 36839. [D 20:43:14.018335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 36840. [D 20:43:14.018347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 36841. [D 20:43:14.018357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 36842. [D 20:43:14.018372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 36843. [D 20:43:14.018388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 36844. [D 20:43:14.018399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 36845. [D 20:43:14.018408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36846. [D 20:43:14.018418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36847. [D 20:43:14.018428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36848. [D 20:43:14.018438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 36849. [D 20:43:14.018447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 36850. [D 20:43:14.018491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 36851. [D 20:43:14.018505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 36852. [D 20:43:14.018528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 36853. [D 20:43:14.018540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36854. [D 20:43:14.018550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36855. [D 20:43:14.018559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36856. [D 20:43:14.018573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 36857. [D 20:43:14.018596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 36858. [D 20:43:14.018610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 36859. [D 20:43:14.018620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 36860. [D 20:43:14.018629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 36861. [D 20:43:14.018640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36862. [D 20:43:14.018664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36863. [D 20:43:14.018674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36864. [D 20:43:14.018684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 36865. [D 20:43:14.018694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 36866. [D 20:43:14.018704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 36867. [D 20:43:14.018729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 36868. [D 20:43:14.018739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 36869. [D 20:43:14.018749] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36870. [D 20:43:14.027178] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36870. [D 20:43:14.027195] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 6/70. [D 20:43:14.029481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.029496] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.029506] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.037504] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.037519] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.037529] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.037560] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6005 [D 20:43:14.037571] element 0: offset: 0x5b0030, size: 24 [D 20:43:14.037583] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 7/70. [D 20:43:14.037602] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.037617] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.037626] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.037640] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6006 [D 20:43:14.037650] element 0: offset: 0x691fe0, size: 24 [D 20:43:14.037659] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 8/70. [D 20:43:14.041905] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6005 [D 20:43:14.041924] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 9/70. [D 20:43:14.044049] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6006 [D 20:43:14.044065] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 10/70. [D 20:43:14.044116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36870. [D 20:43:14.044182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 36871. [D 20:43:14.044194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 36872. [D 20:43:14.044246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 36873. [D 20:43:14.044257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 36874. [D 20:43:14.044267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 36875. [D 20:43:14.044277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36876. [D 20:43:14.044292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36877. [D 20:43:14.044302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36878. [D 20:43:14.044312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 36879. [D 20:43:14.044341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 36880. [D 20:43:14.044352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 36881. [D 20:43:14.044363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 36882. [D 20:43:14.044373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 36883. [D 20:43:14.044383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36884. [D 20:43:14.044396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36885. [D 20:43:14.044406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36886. [D 20:43:14.044416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 36887. [D 20:43:14.044431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 36888. [D 20:43:14.044458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 36889. [D 20:43:14.044472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 36890. [D 20:43:14.044481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 36891. [D 20:43:14.044507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36892. [D 20:43:14.044519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36893. [D 20:43:14.044528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36894. [D 20:43:14.044543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 36895. [D 20:43:14.044553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 36896. [D 20:43:14.044562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 36897. [D 20:43:14.044585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 36898. [D 20:43:14.044595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 36899. [D 20:43:14.044605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36900. [D 20:43:14.044616] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36901. [D 20:43:14.044629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 36902. [D 20:43:14.044657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 36903. [D 20:43:14.044668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 36904. [D 20:43:14.044681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 36905. [D 20:43:14.044690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 36906. [D 20:43:14.044700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 36907. [D 20:43:14.044723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 36908. [D 20:43:14.044732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36909. [D 20:43:14.044751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36910. [D 20:43:14.044762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36911. [D 20:43:14.044772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 36912. [D 20:43:14.044795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 36913. [D 20:43:14.044804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 36914. [D 20:43:14.044814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 36915. [D 20:43:14.044829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 36916. [D 20:43:14.044839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36917. [D 20:43:14.044848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36918. [D 20:43:14.044876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36919. [D 20:43:14.044886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 36920. [D 20:43:14.044900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 36921. [D 20:43:14.044909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 36922. [D 20:43:14.044919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 36923. [D 20:43:14.044933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 36924. [D 20:43:14.044942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36925. [D 20:43:14.044952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36926. [D 20:43:14.044962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36927. [D 20:43:14.044980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 36928. [D 20:43:14.044989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 36929. [D 20:43:14.045009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 36930. [D 20:43:14.045023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 36931. [D 20:43:14.045033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 36932. [D 20:43:14.045043] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2031f0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36933. [D 20:43:14.055767] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36933. [D 20:43:14.055784] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 11/70. [D 20:43:14.064809] openib_check_cq: completed rdma wr_id 2aaaab2031f0, nic_wr_credit 36932. [D 20:43:14.064822] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 12/70. [D 20:43:14.067108] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.067124] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.067133] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.067149] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.067162] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.067172] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.079183] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.079198] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.079208] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.079239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6011 [D 20:43:14.079250] element 0: offset: 0x63fe20, size: 24 [D 20:43:14.080134] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 13/70. [D 20:43:14.080154] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.080170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.080179] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.080194] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6012 [D 20:43:14.080203] element 0: offset: 0x625730, size: 24 [D 20:43:14.080213] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 14/70. [D 20:43:14.085085] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6011 [D 20:43:14.085142] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 15/70. [D 20:43:14.085282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36932. [D 20:43:14.085348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 36933. [D 20:43:14.085360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 36934. [D 20:43:14.085370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 36935. [D 20:43:14.085380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 36936. [D 20:43:14.085389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 36937. [D 20:43:14.085399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 36938. [D 20:43:14.085408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 36939. [D 20:43:14.085418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 36940. [D 20:43:14.085428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 36941. [D 20:43:14.085454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 36942. [D 20:43:14.085464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 36943. [D 20:43:14.085473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 36944. [D 20:43:14.085483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 36945. [D 20:43:14.085503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 36946. [D 20:43:14.085517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 36947. [D 20:43:14.085527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 36948. [D 20:43:14.085536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 36949. [D 20:43:14.085547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 36950. [D 20:43:14.085557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 36951. [D 20:43:14.085567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 36952. [D 20:43:14.085577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 36953. [D 20:43:14.085586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 36954. [D 20:43:14.085641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 36955. [D 20:43:14.085653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 36956. [D 20:43:14.085679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 36957. [D 20:43:14.085693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 36958. [D 20:43:14.085703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 36959. [D 20:43:14.085712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 36960. [D 20:43:14.085728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 36961. [D 20:43:14.085737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 36962. [D 20:43:14.085761] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 36963. [D 20:43:14.085829] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6012 [D 20:43:14.085849] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 16/70. [D 20:43:14.096979] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 36963. [D 20:43:14.096999] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 17/70. [D 20:43:14.097023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 36963. [D 20:43:14.097034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 36964. [D 20:43:14.097044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 36965. [D 20:43:14.097054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 36966. [D 20:43:14.097069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 36967. [D 20:43:14.097079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 36968. [D 20:43:14.097089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 36969. [D 20:43:14.097105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 36970. [D 20:43:14.097114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 36971. [D 20:43:14.097124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 36972. [D 20:43:14.097140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 36973. [D 20:43:14.097150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 36974. [D 20:43:14.097159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 36975. [D 20:43:14.097169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 36976. [D 20:43:14.097179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 36977. [D 20:43:14.097189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 36978. [D 20:43:14.097199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 36979. [D 20:43:14.097236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 36980. [D 20:43:14.097247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 36981. [D 20:43:14.097257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 36982. [D 20:43:14.097267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 36983. [D 20:43:14.097295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 36984. [D 20:43:14.097305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 36985. [D 20:43:14.097318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 36986. [D 20:43:14.097328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 36987. [D 20:43:14.097337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 36988. [D 20:43:14.097351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 36989. [D 20:43:14.097361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 36990. [D 20:43:14.097384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 36991. [D 20:43:14.097395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 36992. [D 20:43:14.097405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 36993. [D 20:43:14.097442] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2031f0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 36994. [D 20:43:14.099786] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.099801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.099812] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.107348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.107362] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.107373] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.107404] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6016 [D 20:43:14.107414] element 0: offset: 0x6a6520, size: 24 [D 20:43:14.107428] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 18/70. [D 20:43:14.107708] openib_check_cq: completed rdma wr_id 2aaaab2031f0, nic_wr_credit 36994. [D 20:43:14.107722] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 19/70. [D 20:43:14.110032] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.110045] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.110054] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.112073] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6016 [D 20:43:14.112091] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 20/70. [D 20:43:14.113091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 36994. [D 20:43:14.113141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 36995. [D 20:43:14.113153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 36996. [D 20:43:14.113164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 36997. [D 20:43:14.113174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 36998. [D 20:43:14.113184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 36999. [D 20:43:14.113193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 37000. [D 20:43:14.113204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 37001. [D 20:43:14.113213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 37002. [D 20:43:14.113223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 37003. [D 20:43:14.113232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 37004. [D 20:43:14.113250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 37005. [D 20:43:14.113288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 37006. [D 20:43:14.113299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 37007. [D 20:43:14.113309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 37008. [D 20:43:14.113333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 37009. [D 20:43:14.113342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 37010. [D 20:43:14.113353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 37011. [D 20:43:14.113363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 37012. [D 20:43:14.113373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 37013. [D 20:43:14.113383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 37014. [D 20:43:14.113408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 37015. [D 20:43:14.113418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 37016. [D 20:43:14.113428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 37017. [D 20:43:14.113437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 37018. [D 20:43:14.113447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 37019. [D 20:43:14.113462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 37020. [D 20:43:14.113495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 37021. [D 20:43:14.113505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 37022. [D 20:43:14.113514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 37023. [D 20:43:14.113540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 37024. [D 20:43:14.113550] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 37025. [D 20:43:14.117911] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.117926] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.117937] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.117971] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6018 [D 20:43:14.117982] element 0: offset: 0x661d50, size: 24 [D 20:43:14.117996] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 21/70. [D 20:43:14.124892] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37025. [D 20:43:14.124907] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 22/70. [D 20:43:14.127228] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.127241] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.127250] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.129644] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6018 [D 20:43:14.129696] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 23/70. [D 20:43:14.130080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 37025. [D 20:43:14.130098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 37026. [D 20:43:14.130109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37027. [D 20:43:14.130119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37028. [D 20:43:14.130129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37029. [D 20:43:14.130144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37030. [D 20:43:14.130153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37031. [D 20:43:14.130163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37032. [D 20:43:14.130179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37033. [D 20:43:14.130189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37034. [D 20:43:14.130198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37035. [D 20:43:14.130215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37036. [D 20:43:14.130224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37037. [D 20:43:14.130234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37038. [D 20:43:14.130244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37039. [D 20:43:14.130255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37040. [D 20:43:14.130281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37041. [D 20:43:14.130293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37042. [D 20:43:14.130303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37043. [D 20:43:14.130313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37044. [D 20:43:14.130337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37045. [D 20:43:14.130347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37046. [D 20:43:14.130357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37047. [D 20:43:14.130373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37048. [D 20:43:14.130382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37049. [D 20:43:14.130407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37050. [D 20:43:14.130417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37051. [D 20:43:14.130427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37052. [D 20:43:14.130443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37053. [D 20:43:14.130453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37054. [D 20:43:14.130462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37055. [D 20:43:14.130492] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37056. [D 20:43:14.135040] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.135054] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.135064] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.135079] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6022 [D 20:43:14.135089] element 0: offset: 0x66e810, size: 24 [D 20:43:14.135099] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 24/70. [D 20:43:14.141909] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37056. [D 20:43:14.141925] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 25/70. [D 20:43:14.144252] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.144265] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.144276] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.146248] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6022 [D 20:43:14.146267] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 26/70. [D 20:43:14.147527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 37056. [D 20:43:14.147576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 37057. [D 20:43:14.147588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 37058. [D 20:43:14.147598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 37059. [D 20:43:14.147612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 37060. [D 20:43:14.147622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 37061. [D 20:43:14.147632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 37062. [D 20:43:14.147646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 37063. [D 20:43:14.147656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 37064. [D 20:43:14.147665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 37065. [D 20:43:14.147681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 37066. [D 20:43:14.147716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 37067. [D 20:43:14.147729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 37068. [D 20:43:14.147738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 37069. [D 20:43:14.147761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 37070. [D 20:43:14.147772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 37071. [D 20:43:14.147781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 37072. [D 20:43:14.147792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 37073. [D 20:43:14.147802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 37074. [D 20:43:14.147812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 37075. [D 20:43:14.147822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 37076. [D 20:43:14.147847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 37077. [D 20:43:14.147857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 37078. [D 20:43:14.147866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 37079. [D 20:43:14.147876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 37080. [D 20:43:14.147906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 37081. [D 20:43:14.147917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 37082. [D 20:43:14.147928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 37083. [D 20:43:14.147937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 37084. [D 20:43:14.147947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 37085. [D 20:43:14.147974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 37086. [D 20:43:14.147985] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 37087. [D 20:43:14.151182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.151196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.151205] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.151241] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6024 [D 20:43:14.151252] element 0: offset: 0x63c1c0, size: 24 [D 20:43:14.152534] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 27/70. [D 20:43:14.159344] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37087. [D 20:43:14.159359] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 28/70. [D 20:43:14.161678] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.161692] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.161700] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.163982] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6024 [D 20:43:14.163998] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 29/70. [D 20:43:14.164565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 37087. [D 20:43:14.164579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 37088. [D 20:43:14.164591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37089. [D 20:43:14.164601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37090. [D 20:43:14.164611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37091. [D 20:43:14.164625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37092. [D 20:43:14.164634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37093. [D 20:43:14.164644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37094. [D 20:43:14.164660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37095. [D 20:43:14.164670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37096. [D 20:43:14.164679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37097. [D 20:43:14.164695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37098. [D 20:43:14.164705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37099. [D 20:43:14.164715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37100. [D 20:43:14.164731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37101. [D 20:43:14.164740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37102. [D 20:43:14.164765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37103. [D 20:43:14.164776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37104. [D 20:43:14.164785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37105. [D 20:43:14.164811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37106. [D 20:43:14.164822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37107. [D 20:43:14.164835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37108. [D 20:43:14.164845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37109. [D 20:43:14.164854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37110. [D 20:43:14.164880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37111. [D 20:43:14.164889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37112. [D 20:43:14.164903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37113. [D 20:43:14.164913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37114. [D 20:43:14.164923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37115. [D 20:43:14.164947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37116. [D 20:43:14.164957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37117. [D 20:43:14.164967] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37118. [D 20:43:14.169478] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.169492] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.169503] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.169517] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6028 [D 20:43:14.169527] element 0: offset: 0x61f310, size: 24 [D 20:43:14.169537] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 30/70. [D 20:43:14.176399] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37118. [D 20:43:14.176413] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 31/70. [D 20:43:14.178721] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.178735] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.178745] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.180786] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6028 [D 20:43:14.180845] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 32/70. [D 20:43:14.181938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 37118. [D 20:43:14.181954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 37119. [D 20:43:14.181965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 37120. [D 20:43:14.181975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 37121. [D 20:43:14.181990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 37122. [D 20:43:14.182001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 37123. [D 20:43:14.182011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 37124. [D 20:43:14.182021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 37125. [D 20:43:14.182031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 37126. [D 20:43:14.182041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 37127. [D 20:43:14.182050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 37128. [D 20:43:14.182068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 37129. [D 20:43:14.182078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 37130. [D 20:43:14.182087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 37131. [D 20:43:14.182097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 37132. [D 20:43:14.182107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 37133. [D 20:43:14.182117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 37134. [D 20:43:14.182144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 37135. [D 20:43:14.182154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 37136. [D 20:43:14.182164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 37137. [D 20:43:14.182174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 37138. [D 20:43:14.182198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 37139. [D 20:43:14.182208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 37140. [D 20:43:14.182218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 37141. [D 20:43:14.182228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 37142. [D 20:43:14.182237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 37143. [D 20:43:14.182261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 37144. [D 20:43:14.182271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 37145. [D 20:43:14.182281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 37146. [D 20:43:14.182290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 37147. [D 20:43:14.182300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 37148. [D 20:43:14.182326] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 37149. [D 20:43:14.186746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.186761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.186772] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.186806] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6030 [D 20:43:14.186817] element 0: offset: 0x64dd40, size: 24 [D 20:43:14.186828] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 33/70. [D 20:43:14.193702] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37149. [D 20:43:14.193718] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 34/70. [D 20:43:14.196068] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.196082] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.196091] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.198457] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6030 [D 20:43:14.198472] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 35/70. [D 20:43:14.198860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37149. [D 20:43:14.198874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37150. [D 20:43:14.198885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37151. [D 20:43:14.198895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37152. [D 20:43:14.198905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37153. [D 20:43:14.198919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37154. [D 20:43:14.198929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37155. [D 20:43:14.198938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37156. [D 20:43:14.198954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37157. [D 20:43:14.198964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37158. [D 20:43:14.198974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37159. [D 20:43:14.198983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37160. [D 20:43:14.199001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37161. [D 20:43:14.199011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37162. [D 20:43:14.199021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37163. [D 20:43:14.199031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37164. [D 20:43:14.199059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37165. [D 20:43:14.199070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37166. [D 20:43:14.199080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37167. [D 20:43:14.199090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37168. [D 20:43:14.199100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37169. [D 20:43:14.199125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37170. [D 20:43:14.199148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37171. [D 20:43:14.199158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37172. [D 20:43:14.199168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37173. [D 20:43:14.199193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37174. [D 20:43:14.199203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37175. [D 20:43:14.199213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37176. [D 20:43:14.199223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37177. [D 20:43:14.199232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37178. [D 20:43:14.199242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37179. [D 20:43:14.199252] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37180. [D 20:43:14.203831] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.203844] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.203854] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.203869] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6034 [D 20:43:14.203878] element 0: offset: 0x691fe0, size: 24 [D 20:43:14.203888] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 36/70. [D 20:43:14.209729] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37180. [D 20:43:14.209743] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 37/70. [D 20:43:14.212058] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.212072] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.212082] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.214059] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6034 [D 20:43:14.214115] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 38/70. [D 20:43:14.214171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 37180. [D 20:43:14.214187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 37181. [D 20:43:14.214198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 37182. [D 20:43:14.214208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 37183. [D 20:43:14.214243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 37184. [D 20:43:14.214254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 37185. [D 20:43:14.214264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 37186. [D 20:43:14.214274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 37187. [D 20:43:14.214289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 37188. [D 20:43:14.214313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 37189. [D 20:43:14.214326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 37190. [D 20:43:14.214335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 37191. [D 20:43:14.214345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 37192. [D 20:43:14.214359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 37193. [D 20:43:14.214383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 37194. [D 20:43:14.214396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 37195. [D 20:43:14.214406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 37196. [D 20:43:14.214422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 37197. [D 20:43:14.214434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 37198. [D 20:43:14.214453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 37199. [D 20:43:14.214463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 37200. [D 20:43:14.214473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 37201. [D 20:43:14.214489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 37202. [D 20:43:14.214499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 37203. [D 20:43:14.214508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 37204. [D 20:43:14.214533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 37205. [D 20:43:14.214543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 37206. [D 20:43:14.214553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 37207. [D 20:43:14.214563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 37208. [D 20:43:14.214572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 37209. [D 20:43:14.214582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 37210. [D 20:43:14.214592] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 37211. [D 20:43:14.220101] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37211. [D 20:43:14.220115] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 39/70. [D 20:43:14.222264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.222279] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.222288] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.295205] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.295219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.295230] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.295261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6036 [D 20:43:14.295272] element 0: offset: 0x5b0030, size: 24 [D 20:43:14.296842] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 40/70. [D 20:43:14.301176] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6036 [D 20:43:14.301194] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 41/70. [D 20:43:14.301321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37211. [D 20:43:14.301335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37212. [D 20:43:14.301346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37213. [D 20:43:14.301356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37214. [D 20:43:14.301371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37215. [D 20:43:14.301381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37216. [D 20:43:14.301391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37217. [D 20:43:14.301401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37218. [D 20:43:14.301416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37219. [D 20:43:14.301425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37220. [D 20:43:14.301454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37221. [D 20:43:14.301464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37222. [D 20:43:14.301474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37223. [D 20:43:14.301488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37224. [D 20:43:14.301497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37225. [D 20:43:14.301507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37226. [D 20:43:14.301523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37227. [D 20:43:14.301533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37228. [D 20:43:14.301557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37229. [D 20:43:14.301571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37230. [D 20:43:14.301581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37231. [D 20:43:14.301590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37232. [D 20:43:14.301601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37233. [D 20:43:14.301611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37234. [D 20:43:14.301621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37235. [D 20:43:14.301645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37236. [D 20:43:14.301655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37237. [D 20:43:14.301665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37238. [D 20:43:14.301680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37239. [D 20:43:14.301690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37240. [D 20:43:14.301715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37241. [D 20:43:14.301725] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37242. [D 20:43:14.312949] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37242. [D 20:43:14.312963] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 42/70. [D 20:43:14.315303] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.315316] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.315326] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.331971] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.331985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.331995] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.332010] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6040 [D 20:43:14.332019] element 0: offset: 0x63fe20, size: 24 [D 20:43:14.332029] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 43/70. [D 20:43:14.332044] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.332056] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.332068] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.332123] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6043 [D 20:43:14.332164] element 0: offset: 0x625730, size: 24 [D 20:43:14.332177] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 44/70. [D 20:43:14.334535] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6040 [D 20:43:14.334599] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 45/70. [D 20:43:14.334651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 37242. [D 20:43:14.334665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 37243. [D 20:43:14.334675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37244. [D 20:43:14.334685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37245. [D 20:43:14.334702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37246. [D 20:43:14.334712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37247. [D 20:43:14.334722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37248. [D 20:43:14.334731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37249. [D 20:43:14.334742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37250. [D 20:43:14.334752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37251. [D 20:43:14.334761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37252. [D 20:43:14.334771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37253. [D 20:43:14.334781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37254. [D 20:43:14.334792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37255. [D 20:43:14.334802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37256. [D 20:43:14.334837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37257. [D 20:43:14.334847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37258. [D 20:43:14.334863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37259. [D 20:43:14.334874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37260. [D 20:43:14.334884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37261. [D 20:43:14.334894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37262. [D 20:43:14.334903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37263. [D 20:43:14.334913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37264. [D 20:43:14.334923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37265. [D 20:43:14.334955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37266. [D 20:43:14.334965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37267. [D 20:43:14.334974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37268. [D 20:43:14.334990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37269. [D 20:43:14.335000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37270. [D 20:43:14.335010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37271. [D 20:43:14.335026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37272. [D 20:43:14.335036] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37273. [D 20:43:14.335110] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6043 [D 20:43:14.335125] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 46/70. [D 20:43:14.343863] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37273. [D 20:43:14.343880] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 47/70. [D 20:43:14.343897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 37273. [D 20:43:14.343907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 37274. [D 20:43:14.343917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 37275. [D 20:43:14.343927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 37276. [D 20:43:14.343937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 37277. [D 20:43:14.343947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 37278. [D 20:43:14.343958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 37279. [D 20:43:14.343967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 37280. [D 20:43:14.343977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 37281. [D 20:43:14.343992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 37282. [D 20:43:14.344001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 37283. [D 20:43:14.344011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 37284. [D 20:43:14.344021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 37285. [D 20:43:14.344032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 37286. [D 20:43:14.344042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 37287. [D 20:43:14.344051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 37288. [D 20:43:14.344066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 37289. [D 20:43:14.344076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 37290. [D 20:43:14.344086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 37291. [D 20:43:14.344095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 37292. [D 20:43:14.344106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 37293. [D 20:43:14.344117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 37294. [D 20:43:14.344127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 37295. [D 20:43:14.344146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 37296. [D 20:43:14.344162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 37297. [D 20:43:14.344172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 37298. [D 20:43:14.344181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 37299. [D 20:43:14.344191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 37300. [D 20:43:14.344202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 37301. [D 20:43:14.344212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 37302. [D 20:43:14.344237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 37303. [D 20:43:14.344252] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2031f0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 37304. [D 20:43:14.344312] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.344354] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.344363] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.355682] openib_check_cq: completed rdma wr_id 2aaaab2031f0, nic_wr_credit 37304. [D 20:43:14.355698] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 48/70. [D 20:43:14.355797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.355813] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.355821] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.375481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.375494] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.375503] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.375529] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6046 [D 20:43:14.375539] element 0: offset: 0x662130, size: 24 [D 20:43:14.375552] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 49/70. [D 20:43:14.379802] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6046 [D 20:43:14.379865] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 50/70. [D 20:43:14.380019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 37304. [D 20:43:14.380035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 37305. [D 20:43:14.380046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 37306. [D 20:43:14.380056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 37307. [D 20:43:14.380071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 37308. [D 20:43:14.380082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 37309. [D 20:43:14.380092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 37310. [D 20:43:14.380102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 37311. [D 20:43:14.380112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 37312. [D 20:43:14.380121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 37313. [D 20:43:14.380131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 37314. [D 20:43:14.380148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 37315. [D 20:43:14.380157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 37316. [D 20:43:14.380167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 37317. [D 20:43:14.380177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 37318. [D 20:43:14.380204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 37319. [D 20:43:14.380219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 37320. [D 20:43:14.380228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 37321. [D 20:43:14.380238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 37322. [D 20:43:14.380248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 37323. [D 20:43:14.380271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 37324. [D 20:43:14.380281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 37325. [D 20:43:14.380295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 37326. [D 20:43:14.380304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 37327. [D 20:43:14.380327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 37328. [D 20:43:14.380337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 37329. [D 20:43:14.380347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 37330. [D 20:43:14.380357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 37331. [D 20:43:14.380368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 37332. [D 20:43:14.380378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 37333. [D 20:43:14.380388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 37334. [D 20:43:14.380413] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 37335. [D 20:43:14.390535] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37335. [D 20:43:14.390550] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 51/70. [D 20:43:14.390600] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.390616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.390625] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.490059] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.490072] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.490081] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.490098] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6048 [D 20:43:14.490107] element 0: offset: 0x691fe0, size: 24 [D 20:43:14.490118] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 52/70. [D 20:43:14.492426] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6048 [D 20:43:14.492445] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 53/70. [D 20:43:14.492498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37335. [D 20:43:14.492509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37336. [D 20:43:14.492519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37337. [D 20:43:14.492530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37338. [D 20:43:14.492540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37339. [D 20:43:14.492549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37340. [D 20:43:14.492559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37341. [D 20:43:14.492577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37342. [D 20:43:14.492586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37343. [D 20:43:14.492611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37344. [D 20:43:14.492626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37345. [D 20:43:14.492636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37346. [D 20:43:14.492645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37347. [D 20:43:14.492656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37348. [D 20:43:14.492666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37349. [D 20:43:14.492675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37350. [D 20:43:14.492685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37351. [D 20:43:14.492695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37352. [D 20:43:14.492705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37353. [D 20:43:14.492714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37354. [D 20:43:14.492725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37355. [D 20:43:14.492740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37356. [D 20:43:14.492749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37357. [D 20:43:14.492759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37358. [D 20:43:14.492783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37359. [D 20:43:14.492793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37360. [D 20:43:14.492802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37361. [D 20:43:14.492812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37362. [D 20:43:14.492822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37363. [D 20:43:14.492832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37364. [D 20:43:14.492842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37365. [D 20:43:14.492851] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37366. [D 20:43:14.502920] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37366. [D 20:43:14.502934] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 54/70. [D 20:43:14.503051] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.503094] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.503103] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.512146] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.512160] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.512168] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.512195] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6051 [D 20:43:14.512206] element 0: offset: 0x6252d0, size: 24 [D 20:43:14.512218] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 55/70. [D 20:43:14.516686] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6051 [D 20:43:14.516749] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 56/70. [D 20:43:14.516906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37366. [D 20:43:14.516922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37367. [D 20:43:14.516933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37368. [D 20:43:14.516943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37369. [D 20:43:14.516958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37370. [D 20:43:14.516968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37371. [D 20:43:14.516978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37372. [D 20:43:14.516989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37373. [D 20:43:14.516998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37374. [D 20:43:14.517008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37375. [D 20:43:14.517018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37376. [D 20:43:14.517035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37377. [D 20:43:14.517045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37378. [D 20:43:14.517055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37379. [D 20:43:14.517065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37380. [D 20:43:14.517092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37381. [D 20:43:14.517102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37382. [D 20:43:14.517113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37383. [D 20:43:14.517122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37384. [D 20:43:14.517132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37385. [D 20:43:14.517156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37386. [D 20:43:14.517168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37387. [D 20:43:14.517183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37388. [D 20:43:14.517193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37389. [D 20:43:14.517202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37390. [D 20:43:14.517225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37391. [D 20:43:14.517234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37392. [D 20:43:14.517244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37393. [D 20:43:14.517254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37394. [D 20:43:14.517264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37395. [D 20:43:14.517274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37396. [D 20:43:14.517297] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37397. [D 20:43:14.525643] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.525658] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.525667] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.525683] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6055 [D 20:43:14.525693] element 0: offset: 0x620d50, size: 24 [D 20:43:14.525703] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 57/70. [D 20:43:14.527847] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37397. [D 20:43:14.527865] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 58/70. [D 20:43:14.527967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.527982] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.527990] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.530204] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 237056, tag: 6055 [D 20:43:14.530221] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 59/70. [D 20:43:14.533285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 37397. [D 20:43:14.533301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 37398. [D 20:43:14.533313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 37399. [D 20:43:14.533323] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 37400. [D 20:43:14.533974] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37400. [D 20:43:14.533987] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 60/70. [D 20:43:14.534030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.534046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.534055] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.536062] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.536076] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.536084] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.536102] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6058 [D 20:43:14.536112] element 0: offset: 0x6a6550, size: 24 [D 20:43:14.536123] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 0/70. [D 20:43:14.538183] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6058 [D 20:43:14.538241] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 1/70. [D 20:43:14.538293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37400. [D 20:43:14.538301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.538308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37401. [D 20:43:14.538318] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.538326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37402. [D 20:43:14.538344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37403. [D 20:43:14.538355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37404. [D 20:43:14.538332] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:14.538369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37405. [D 20:43:14.538395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37406. [D 20:43:14.538408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37407. [D 20:43:14.538396] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6061 [D 20:43:14.538421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37408. [D 20:43:14.538445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37409. [D 20:43:14.538455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37410. [D 20:43:14.538465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37411. [D 20:43:14.538434] element 0: offset: 0x63fe20, size: 24 [D 20:43:14.538480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37412. [D 20:43:14.538494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37413. [D 20:43:14.538505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37414. [D 20:43:14.538530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37415. [D 20:43:14.538539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37416. [D 20:43:14.538568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37417. [D 20:43:14.538579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37418. [D 20:43:14.538597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37419. [D 20:43:14.538607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37420. [D 20:43:14.538616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37421. [D 20:43:14.538627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37422. [D 20:43:14.538636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37423. [D 20:43:14.538646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37424. [D 20:43:14.538656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37425. [D 20:43:14.538673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37426. [D 20:43:14.538706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37427. [D 20:43:14.538720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37428. [D 20:43:14.538729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37429. [D 20:43:14.538739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37430. [D 20:43:14.538753] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37431. [D 20:43:14.538778] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 2/70. [D 20:43:14.548385] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37431. [D 20:43:14.548403] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 3/70. [D 20:43:14.548456] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.548472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.548480] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:14.548497] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.548506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.548514] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.559226] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.559240] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.559248] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.559264] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6063 [D 20:43:14.559273] element 0: offset: 0x662130, size: 24 [D 20:43:14.559283] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 4/70. [D 20:43:14.561948] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6063 [D 20:43:14.561968] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 5/70. [D 20:43:14.562015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37431. [D 20:43:14.562029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37432. [D 20:43:14.562040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37433. [D 20:43:14.562050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37434. [D 20:43:14.562061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37435. [D 20:43:14.562070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37436. [D 20:43:14.562080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37437. [D 20:43:14.562090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37438. [D 20:43:14.562106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37439. [D 20:43:14.562115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37440. [D 20:43:14.562125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37441. [D 20:43:14.562136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37442. [D 20:43:14.562145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37443. [D 20:43:14.562155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37444. [D 20:43:14.562165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37445. [D 20:43:14.562182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37446. [D 20:43:14.562192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37447. [D 20:43:14.562201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37448. [D 20:43:14.562237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37449. [D 20:43:14.562247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37450. [D 20:43:14.562262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37451. [D 20:43:14.562273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37452. [D 20:43:14.562282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37453. [D 20:43:14.562297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37454. [D 20:43:14.562307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37455. [D 20:43:14.562316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37456. [D 20:43:14.562343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37457. [D 20:43:14.562353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37458. [D 20:43:14.562363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37459. [D 20:43:14.562373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37460. [D 20:43:14.562384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37461. [D 20:43:14.562394] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37462. [D 20:43:14.572827] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37462. [D 20:43:14.572841] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 6/70. [D 20:43:14.572960] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.572997] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.573006] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.581994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.582008] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.582016] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.582042] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6066 [D 20:43:14.582053] element 0: offset: 0x691fe0, size: 24 [D 20:43:14.582065] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 7/70. [D 20:43:14.586278] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6066 [D 20:43:14.586339] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 8/70. [D 20:43:14.586497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37462. [D 20:43:14.586514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37463. [D 20:43:14.586525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37464. [D 20:43:14.586535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37465. [D 20:43:14.586550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37466. [D 20:43:14.586561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37467. [D 20:43:14.586571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37468. [D 20:43:14.586582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37469. [D 20:43:14.586592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37470. [D 20:43:14.586601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37471. [D 20:43:14.586611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37472. [D 20:43:14.586628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37473. [D 20:43:14.586637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37474. [D 20:43:14.586647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37475. [D 20:43:14.586661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37476. [D 20:43:14.586690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37477. [D 20:43:14.586700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37478. [D 20:43:14.586711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37479. [D 20:43:14.586721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37480. [D 20:43:14.586731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37481. [D 20:43:14.586741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37482. [D 20:43:14.586765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37483. [D 20:43:14.586779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37484. [D 20:43:14.586789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37485. [D 20:43:14.586799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37486. [D 20:43:14.586814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37487. [D 20:43:14.586824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37488. [D 20:43:14.586848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37489. [D 20:43:14.586858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37490. [D 20:43:14.586867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37491. [D 20:43:14.586878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37492. [D 20:43:14.586888] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37493. [D 20:43:14.597166] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37493. [D 20:43:14.597181] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 9/70. [D 20:43:14.597230] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.597246] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.597254] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.605290] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.605303] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.605312] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.605327] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6069 [D 20:43:14.605337] element 0: offset: 0x5b0030, size: 24 [D 20:43:14.605348] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 10/70. [D 20:43:14.607922] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6069 [D 20:43:14.607941] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 11/70. [D 20:43:14.607998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37493. [D 20:43:14.608010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37494. [D 20:43:14.608020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37495. [D 20:43:14.608031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37496. [D 20:43:14.608042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37497. [D 20:43:14.608052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37498. [D 20:43:14.608065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37499. [D 20:43:14.608082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37500. [D 20:43:14.608092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37501. [D 20:43:14.608102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37502. [D 20:43:14.608112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37503. [D 20:43:14.608122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37504. [D 20:43:14.608132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37505. [D 20:43:14.608141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37506. [D 20:43:14.608158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37507. [D 20:43:14.608168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37508. [D 20:43:14.608178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37509. [D 20:43:14.608188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37510. [D 20:43:14.608199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37511. [D 20:43:14.608228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37512. [D 20:43:14.608239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37513. [D 20:43:14.608249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37514. [D 20:43:14.608259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37515. [D 20:43:14.608269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37516. [D 20:43:14.608278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37517. [D 20:43:14.608302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37518. [D 20:43:14.608313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37519. [D 20:43:14.608323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37520. [D 20:43:14.608339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37521. [D 20:43:14.608362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37522. [D 20:43:14.608372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37523. [D 20:43:14.608382] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37524. [D 20:43:14.618178] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37524. [D 20:43:14.618192] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 12/70. [D 20:43:14.618307] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.618349] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.618358] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.627827] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.627841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.627849] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.627876] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6072 [D 20:43:14.627886] element 0: offset: 0x661d50, size: 24 [D 20:43:14.627898] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 13/70. [D 20:43:14.632072] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6072 [D 20:43:14.632135] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 14/70. [D 20:43:14.632186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37524. [D 20:43:14.632202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37525. [D 20:43:14.632212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37526. [D 20:43:14.632223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37527. [D 20:43:14.632233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37528. [D 20:43:14.632243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37529. [D 20:43:14.632253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37530. [D 20:43:14.632268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37531. [D 20:43:14.632314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37532. [D 20:43:14.632325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37533. [D 20:43:14.632335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37534. [D 20:43:14.632346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37535. [D 20:43:14.632371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37536. [D 20:43:14.632382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37537. [D 20:43:14.632392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37538. [D 20:43:14.632407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37539. [D 20:43:14.632417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37540. [D 20:43:14.632427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37541. [D 20:43:14.632443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37542. [D 20:43:14.632452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37543. [D 20:43:14.632462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37544. [D 20:43:14.632472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37545. [D 20:43:14.632482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37546. [D 20:43:14.632492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37547. [D 20:43:14.632502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37548. [D 20:43:14.632517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37549. [D 20:43:14.632527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37550. [D 20:43:14.632536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37551. [D 20:43:14.632546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37552. [D 20:43:14.632571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37553. [D 20:43:14.632581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37554. [D 20:43:14.632591] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37555. [D 20:43:14.638102] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37555. [D 20:43:14.638117] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 15/70. [D 20:43:14.638164] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.638180] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.638189] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.755759] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.755772] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.755781] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.755797] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6075 [D 20:43:14.755806] element 0: offset: 0x63fbf0, size: 24 [D 20:43:14.755816] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 16/70. [D 20:43:14.758388] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6075 [D 20:43:14.758406] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 17/70. [D 20:43:14.758460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37555. [D 20:43:14.758472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37556. [D 20:43:14.758482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37557. [D 20:43:14.758497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37558. [D 20:43:14.758507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37559. [D 20:43:14.758520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37560. [D 20:43:14.758535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37561. [D 20:43:14.758545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37562. [D 20:43:14.758554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37563. [D 20:43:14.758565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37564. [D 20:43:14.758575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37565. [D 20:43:14.758585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37566. [D 20:43:14.758595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37567. [D 20:43:14.758605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37568. [D 20:43:14.758622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37569. [D 20:43:14.758632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37570. [D 20:43:14.758642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37571. [D 20:43:14.758652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37572. [D 20:43:14.758662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37573. [D 20:43:14.758693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37574. [D 20:43:14.758706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37575. [D 20:43:14.758715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37576. [D 20:43:14.758725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37577. [D 20:43:14.758735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37578. [D 20:43:14.758745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37579. [D 20:43:14.758755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37580. [D 20:43:14.758770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37581. [D 20:43:14.758780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37582. [D 20:43:14.758789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37583. [D 20:43:14.758800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37584. [D 20:43:14.758830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37585. [D 20:43:14.758843] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37586. [D 20:43:14.769077] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37586. [D 20:43:14.769091] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 18/70. [D 20:43:14.769210] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.769251] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.769260] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.901925] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.901939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.901948] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.901973] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6078 [D 20:43:14.901984] element 0: offset: 0x64dbb0, size: 24 [D 20:43:14.901996] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 19/70. [D 20:43:14.906166] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6078 [D 20:43:14.906233] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 20/70. [D 20:43:14.906371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37586. [D 20:43:14.906396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37587. [D 20:43:14.906407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37588. [D 20:43:14.906417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37589. [D 20:43:14.906432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37590. [D 20:43:14.906443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37591. [D 20:43:14.906453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37592. [D 20:43:14.906463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37593. [D 20:43:14.906472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37594. [D 20:43:14.906482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37595. [D 20:43:14.906492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37596. [D 20:43:14.906523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37597. [D 20:43:14.906533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37598. [D 20:43:14.906560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37599. [D 20:43:14.906571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37600. [D 20:43:14.906582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37601. [D 20:43:14.906604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37602. [D 20:43:14.906614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37603. [D 20:43:14.906624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37604. [D 20:43:14.906649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37605. [D 20:43:14.906660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37606. [D 20:43:14.906670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37607. [D 20:43:14.906681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37608. [D 20:43:14.906699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37609. [D 20:43:14.906714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37610. [D 20:43:14.906724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37611. [D 20:43:14.906745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37612. [D 20:43:14.906756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37613. [D 20:43:14.906766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37614. [D 20:43:14.906776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37615. [D 20:43:14.906804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37616. [D 20:43:14.906825] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37617. [D 20:43:14.917132] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37617. [D 20:43:14.917147] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 21/70. [D 20:43:14.917196] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.917212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.917221] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.925042] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.925055] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.925063] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.925079] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6081 [D 20:43:14.925088] element 0: offset: 0x61f310, size: 24 [D 20:43:14.925099] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 22/70. [D 20:43:14.927427] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6081 [D 20:43:14.927443] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 23/70. [D 20:43:14.927492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37617. [D 20:43:14.927504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37618. [D 20:43:14.927514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37619. [D 20:43:14.927530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37620. [D 20:43:14.927540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37621. [D 20:43:14.927550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37622. [D 20:43:14.927560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37623. [D 20:43:14.927577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37624. [D 20:43:14.927587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37625. [D 20:43:14.927597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37626. [D 20:43:14.927607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37627. [D 20:43:14.927617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37628. [D 20:43:14.927627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37629. [D 20:43:14.927636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37630. [D 20:43:14.927654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37631. [D 20:43:14.927663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37632. [D 20:43:14.927673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37633. [D 20:43:14.927683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37634. [D 20:43:14.927693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37635. [D 20:43:14.927703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37636. [D 20:43:14.927712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37637. [D 20:43:14.927744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37638. [D 20:43:14.927754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37639. [D 20:43:14.927764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37640. [D 20:43:14.927774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37641. [D 20:43:14.927785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37642. [D 20:43:14.927794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37643. [D 20:43:14.927804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37644. [D 20:43:14.927820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37645. [D 20:43:14.927830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37646. [D 20:43:14.927839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37647. [D 20:43:14.927866] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37648. [D 20:43:14.937550] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37648. [D 20:43:14.937563] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 24/70. [D 20:43:14.937683] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.937724] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.937733] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.947301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.947315] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.947324] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.947350] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6084 [D 20:43:14.947360] element 0: offset: 0x64dd40, size: 24 [D 20:43:14.947373] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 25/70. [D 20:43:14.951557] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6084 [D 20:43:14.951619] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 26/70. [D 20:43:14.951759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37648. [D 20:43:14.951784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37649. [D 20:43:14.951794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37650. [D 20:43:14.951805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37651. [D 20:43:14.951820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37652. [D 20:43:14.951831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37653. [D 20:43:14.951841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37654. [D 20:43:14.951851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37655. [D 20:43:14.951861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37656. [D 20:43:14.951871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37657. [D 20:43:14.951880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37658. [D 20:43:14.951890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37659. [D 20:43:14.951914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37660. [D 20:43:14.951923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37661. [D 20:43:14.951945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37662. [D 20:43:14.951955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37663. [D 20:43:14.951965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37664. [D 20:43:14.951989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37665. [D 20:43:14.951999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37666. [D 20:43:14.952013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37667. [D 20:43:14.952038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37668. [D 20:43:14.952051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37669. [D 20:43:14.952061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37670. [D 20:43:14.952083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37671. [D 20:43:14.952093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37672. [D 20:43:14.952103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37673. [D 20:43:14.952124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37674. [D 20:43:14.952134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37675. [D 20:43:14.952144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37676. [D 20:43:14.952168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37677. [D 20:43:14.952179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37678. [D 20:43:14.952189] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37679. [D 20:43:14.962597] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37679. [D 20:43:14.962612] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 27/70. [D 20:43:14.962661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.962677] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.962685] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.970559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.970572] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.970581] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.970597] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6087 [D 20:43:14.970606] element 0: offset: 0x691fe0, size: 24 [D 20:43:14.970616] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 28/70. [D 20:43:14.972979] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6087 [D 20:43:14.972998] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 29/70. [D 20:43:14.973046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37679. [D 20:43:14.973057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37680. [D 20:43:14.973067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37681. [D 20:43:14.973077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37682. [D 20:43:14.973093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37683. [D 20:43:14.973103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37684. [D 20:43:14.973112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37685. [D 20:43:14.973122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37686. [D 20:43:14.973132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37687. [D 20:43:14.973142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37688. [D 20:43:14.973151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37689. [D 20:43:14.973162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37690. [D 20:43:14.973172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37691. [D 20:43:14.973181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37692. [D 20:43:14.973191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37693. [D 20:43:14.973201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37694. [D 20:43:14.973211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37695. [D 20:43:14.973221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37696. [D 20:43:14.973230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37697. [D 20:43:14.973259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37698. [D 20:43:14.973269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37699. [D 20:43:14.973284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37700. [D 20:43:14.973295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37701. [D 20:43:14.973305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37702. [D 20:43:14.973328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37703. [D 20:43:14.973339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37704. [D 20:43:14.973349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37705. [D 20:43:14.973364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37706. [D 20:43:14.973374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37707. [D 20:43:14.973384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37708. [D 20:43:14.973414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37709. [D 20:43:14.973423] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37710. [D 20:43:14.983554] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37710. [D 20:43:14.983568] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 30/70. [D 20:43:14.983686] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:14.983728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.983737] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:14.992937] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:14.992951] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:14.992959] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:14.992985] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6090 [D 20:43:14.992995] element 0: offset: 0x5b0030, size: 24 [D 20:43:14.993008] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 31/70. [D 20:43:14.997153] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6090 [D 20:43:14.997215] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 32/70. [D 20:43:14.997354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37710. [D 20:43:14.997379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37711. [D 20:43:14.997389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37712. [D 20:43:14.997400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37713. [D 20:43:14.997415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37714. [D 20:43:14.997426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37715. [D 20:43:14.997435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37716. [D 20:43:14.997446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37717. [D 20:43:14.997455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37718. [D 20:43:14.997465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37719. [D 20:43:14.997475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37720. [D 20:43:14.997509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37721. [D 20:43:14.997519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37722. [D 20:43:14.997542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37723. [D 20:43:14.997552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37724. [D 20:43:14.997564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37725. [D 20:43:14.997585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37726. [D 20:43:14.997597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37727. [D 20:43:14.997606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37728. [D 20:43:14.997616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37729. [D 20:43:14.997640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37730. [D 20:43:14.997650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37731. [D 20:43:14.997660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37732. [D 20:43:14.997670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37733. [D 20:43:14.997680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37734. [D 20:43:14.997709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37735. [D 20:43:14.997721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37736. [D 20:43:14.997730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37737. [D 20:43:14.997745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37738. [D 20:43:14.997754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37739. [D 20:43:14.997764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37740. [D 20:43:14.997800] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37741. [D 20:43:15.008133] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37741. [D 20:43:15.008149] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 33/70. [D 20:43:15.008199] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.008215] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.008224] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.016109] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.016123] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.016131] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.016147] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6093 [D 20:43:15.016156] element 0: offset: 0x661d50, size: 24 [D 20:43:15.016167] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 34/70. [D 20:43:15.018492] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6093 [D 20:43:15.018509] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 35/70. [D 20:43:15.018550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37741. [D 20:43:15.018564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37742. [D 20:43:15.018575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37743. [D 20:43:15.018584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37744. [D 20:43:15.018602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37745. [D 20:43:15.018612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37746. [D 20:43:15.018622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37747. [D 20:43:15.018632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37748. [D 20:43:15.018642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37749. [D 20:43:15.018652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37750. [D 20:43:15.018661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37751. [D 20:43:15.018671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37752. [D 20:43:15.018681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37753. [D 20:43:15.018691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37754. [D 20:43:15.018701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37755. [D 20:43:15.018711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37756. [D 20:43:15.018731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37757. [D 20:43:15.018741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37758. [D 20:43:15.018750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37759. [D 20:43:15.018773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37760. [D 20:43:15.018785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37761. [D 20:43:15.018795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37762. [D 20:43:15.018805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37763. [D 20:43:15.018815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37764. [D 20:43:15.018825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37765. [D 20:43:15.018834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37766. [D 20:43:15.018844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37767. [D 20:43:15.018861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37768. [D 20:43:15.018871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37769. [D 20:43:15.018881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37770. [D 20:43:15.018892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37771. [D 20:43:15.018916] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37772. [D 20:43:15.028455] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37772. [D 20:43:15.028469] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 36/70. [D 20:43:15.028586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.028628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.028636] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.038478] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.038492] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.038501] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.038527] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6096 [D 20:43:15.038537] element 0: offset: 0x63fbf0, size: 24 [D 20:43:15.038550] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 37/70. [D 20:43:15.042801] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6096 [D 20:43:15.042866] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 38/70. [D 20:43:15.043012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37772. [D 20:43:15.043028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37773. [D 20:43:15.043039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37774. [D 20:43:15.043049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37775. [D 20:43:15.043064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37776. [D 20:43:15.043075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37777. [D 20:43:15.043085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37778. [D 20:43:15.043095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37779. [D 20:43:15.043105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37780. [D 20:43:15.043115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37781. [D 20:43:15.043125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37782. [D 20:43:15.043142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37783. [D 20:43:15.043152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37784. [D 20:43:15.043162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37785. [D 20:43:15.043172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37786. [D 20:43:15.043207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37787. [D 20:43:15.043219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37788. [D 20:43:15.043229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37789. [D 20:43:15.043238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37790. [D 20:43:15.043252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37791. [D 20:43:15.043284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37792. [D 20:43:15.043295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37793. [D 20:43:15.043305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37794. [D 20:43:15.043315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37795. [D 20:43:15.043326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37796. [D 20:43:15.043336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37797. [D 20:43:15.043362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37798. [D 20:43:15.043372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37799. [D 20:43:15.043382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37800. [D 20:43:15.043392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37801. [D 20:43:15.043402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37802. [D 20:43:15.043412] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37803. [D 20:43:15.053700] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37803. [D 20:43:15.053715] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 39/70. [D 20:43:15.053765] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.053781] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.053790] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.061707] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.061721] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.061729] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.061745] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6099 [D 20:43:15.061754] element 0: offset: 0x64dbb0, size: 24 [D 20:43:15.061764] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 40/70. [D 20:43:15.064285] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6099 [D 20:43:15.064302] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 41/70. [D 20:43:15.064359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37803. [D 20:43:15.064371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37804. [D 20:43:15.064381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37805. [D 20:43:15.064390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37806. [D 20:43:15.064401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37807. [D 20:43:15.064411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37808. [D 20:43:15.064421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37809. [D 20:43:15.064431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37810. [D 20:43:15.064441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37811. [D 20:43:15.064451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37812. [D 20:43:15.064461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37813. [D 20:43:15.064471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 37814. [D 20:43:15.064481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 37815. [D 20:43:15.064491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 37816. [D 20:43:15.064501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 37817. [D 20:43:15.064510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 37818. [D 20:43:15.064520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 37819. [D 20:43:15.064531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 37820. [D 20:43:15.064541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 37821. [D 20:43:15.064551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 37822. [D 20:43:15.064579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 37823. [D 20:43:15.064589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 37824. [D 20:43:15.064599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 37825. [D 20:43:15.064609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 37826. [D 20:43:15.064624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 37827. [D 20:43:15.064634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 37828. [D 20:43:15.064654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 37829. [D 20:43:15.064665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 37830. [D 20:43:15.064675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 37831. [D 20:43:15.064685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 37832. [D 20:43:15.064694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 37833. [D 20:43:15.064710] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 37834. [D 20:43:15.074474] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37834. [D 20:43:15.074488] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 42/70. [D 20:43:15.074611] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.074655] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.074664] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.210634] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.210648] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.210657] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.210683] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6102 [D 20:43:15.210693] element 0: offset: 0x620d50, size: 24 [D 20:43:15.210706] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 43/70. [D 20:43:15.213567] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 675520, tag: 6102 [D 20:43:15.213585] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 44/70. [D 20:43:15.213724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 37834. [D 20:43:15.213817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 37835. [D 20:43:15.213829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 37836. [D 20:43:15.213840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 37837. [D 20:43:15.213850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 37838. [D 20:43:15.213860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 37839. [D 20:43:15.213870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 37840. [D 20:43:15.213880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 37841. [D 20:43:15.213889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 37842. [D 20:43:15.213899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 37843. [D 20:43:15.213909] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 37844. [D 20:43:15.216043] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37844. [D 20:43:15.216059] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 45/70. [D 20:43:15.216123] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.216138] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.216147] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.221364] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.221377] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.221386] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.221401] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6105 [D 20:43:15.221411] element 0: offset: 0x691fe0, size: 24 [D 20:43:15.221421] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 46/70. [D 20:43:15.221479] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.221491] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.221499] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.246444] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.246458] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.246466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.246552] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6109 [D 20:43:15.246563] element 0: offset: 0x625390, size: 24 [D 20:43:15.246573] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 47/70. [D 20:43:15.246624] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6109 [D 20:43:15.246659] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 48/70. [D 20:43:15.248161] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6109 [D 20:43:15.248177] element 0: offset: 0x625390, size: 24 [D 20:43:15.248188] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 49/70. [D 20:43:15.248226] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.248236] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.248245] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.379702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.379716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.379724] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.379740] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6115 [D 20:43:15.379749] element 0: offset: 0x6a6550, size: 24 [D 20:43:15.379760] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 50/70. [D 20:43:15.381813] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.381827] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.381835] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:15.381896] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.381906] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.381915] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.381929] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6118 [D 20:43:15.381939] element 0: offset: 0x63fbf0, size: 24 [D 20:43:15.381949] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 51/70. [D 20:43:15.381967] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6117 [D 20:43:15.381976] element 0: offset: 0x61f310, size: 24 [D 20:43:15.381985] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 52/70. [D 20:43:15.383994] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6115 [D 20:43:15.384023] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 53/70. [D 20:43:15.384081] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6117 [D 20:43:15.384095] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 54/70. [D 20:43:15.384132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 37844. [D 20:43:15.384200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 37845. [D 20:43:15.384210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 37846. [D 20:43:15.384221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 37847. [D 20:43:15.384230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 37848. [D 20:43:15.384240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 37849. [D 20:43:15.384250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 37850. [D 20:43:15.384260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 37851. [D 20:43:15.384270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 37852. [D 20:43:15.384279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 37853. [D 20:43:15.384289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 37854. [D 20:43:15.384299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 37855. [D 20:43:15.384309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 37856. [D 20:43:15.384318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 37857. [D 20:43:15.384328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 37858. [D 20:43:15.384338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 37859. [D 20:43:15.384348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 37860. [D 20:43:15.384357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 37861. [D 20:43:15.384367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 37862. [D 20:43:15.384377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 37863. [D 20:43:15.384387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 37864. [D 20:43:15.384397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 37865. [D 20:43:15.384406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 37866. [D 20:43:15.384416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 37867. [D 20:43:15.384426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 37868. [D 20:43:15.384436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 37869. [D 20:43:15.384446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 37870. [D 20:43:15.384457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 37871. [D 20:43:15.384467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 37872. [D 20:43:15.384477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 37873. [D 20:43:15.384487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 37874. [D 20:43:15.384496] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 37875. [D 20:43:15.386318] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.386351] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.386361] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:15.386392] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6121 [D 20:43:15.386403] element 0: offset: 0x625390, size: 24 [D 20:43:15.386417] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 55/70. [D 20:43:15.386475] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6118 [D 20:43:15.386490] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 56/70. [D 20:43:15.386558] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6117 [D 20:43:15.386569] element 0: offset: 0x61f310, size: 24 [D 20:43:15.386579] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 57/70. [D 20:43:15.390450] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 37875. [D 20:43:15.390471] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 58/70. [D 20:43:15.390485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 37875. [D 20:43:15.390495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 37876. [D 20:43:15.390506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 37877. [D 20:43:15.390516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 37878. [D 20:43:15.390526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 37879. [D 20:43:15.390542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 37880. [D 20:43:15.390552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 37881. [D 20:43:15.390561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 37882. [D 20:43:15.390577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 37883. [D 20:43:15.390587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 37884. [D 20:43:15.390597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 37885. [D 20:43:15.390612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 37886. [D 20:43:15.390626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 37887. [D 20:43:15.390636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 37888. [D 20:43:15.390646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 37889. [D 20:43:15.390655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 37890. [D 20:43:15.390666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 37891. [D 20:43:15.390675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 37892. [D 20:43:15.390693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 37893. [D 20:43:15.390702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 37894. [D 20:43:15.390712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 37895. [D 20:43:15.390722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 37896. [D 20:43:15.390732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 37897. [D 20:43:15.390742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 37898. [D 20:43:15.390752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 37899. [D 20:43:15.390765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 37900. [D 20:43:15.390775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 37901. [D 20:43:15.390784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 37902. [D 20:43:15.390794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 37903. [D 20:43:15.390811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 37904. [D 20:43:15.390821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 37905. [D 20:43:15.390831] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 37906. [D 20:43:15.390893] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.390909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.390917] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:15.390972] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.390982] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.390990] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.393277] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6121 [D 20:43:15.393297] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 59/70. [D 20:43:15.394375] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.394408] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.394417] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.395326] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6124 [D 20:43:15.395341] element 0: offset: 0x5b0030, size: 24 [D 20:43:15.395354] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 60/70. [D 20:43:15.399562] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37906. [D 20:43:15.399580] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 0/70. [D 20:43:15.399618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 37906. [D 20:43:15.399629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 37907. [D 20:43:15.399636] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6124 [D 20:43:15.399639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 37908. [D 20:43:15.399667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 37909. [D 20:43:15.399688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 37910. [D 20:43:15.399698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 37911. [D 20:43:15.399708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 37912. [D 20:43:15.399717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 37913. [D 20:43:15.399728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 37914. [D 20:43:15.399738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 37915. [D 20:43:15.399747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 37916. [D 20:43:15.399757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 37917. [D 20:43:15.399767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 37918. [D 20:43:15.399778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 37919. [D 20:43:15.399787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 37920. [D 20:43:15.399797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 37921. [D 20:43:15.399821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 37922. [D 20:43:15.399831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 37923. [D 20:43:15.399841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 37924. [D 20:43:15.399856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 37925. [D 20:43:15.399866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 37926. [D 20:43:15.399876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 37927. [D 20:43:15.399900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 37928. [D 20:43:15.399910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 37929. [D 20:43:15.399920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 37930. [D 20:43:15.399931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 37931. [D 20:43:15.399940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 37932. [D 20:43:15.399951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 37933. [D 20:43:15.399973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 37934. [D 20:43:15.399983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 37935. [D 20:43:15.399998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 37936. [D 20:43:15.400007] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 37937. [D 20:43:15.400064] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 1/70. [D 20:43:15.400104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.400114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.400123] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.411465] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 37937. [D 20:43:15.411482] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 2/70. [D 20:43:15.411644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.411660] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.411668] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:15.415481] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6124 [D 20:43:15.415495] element 0: offset: 0x5b0030, size: 24 [D 20:43:15.415505] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 3/70. [D 20:43:15.415604] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.415617] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.415625] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.433914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.433928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.433936] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.433955] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6129 [D 20:43:15.433964] element 0: offset: 0x691fe0, size: 24 [D 20:43:15.433974] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 4/70. [D 20:43:15.434060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.434072] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.434080] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:15.434096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6130 [D 20:43:15.434105] element 0: offset: 0x661d50, size: 24 [D 20:43:15.434115] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 5/70. [D 20:43:15.436455] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.436475] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6129 [D 20:43:15.436507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.436513] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 6/70. [D 20:43:15.436522] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.436602] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6133 [D 20:43:15.436613] element 0: offset: 0x620d50, size: 24 [D 20:43:15.436624] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 7/70. [D 20:43:15.436652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 37937. [D 20:43:15.436664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 37938. [D 20:43:15.436674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 37939. [D 20:43:15.436689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 37940. [D 20:43:15.436698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 37941. [D 20:43:15.436708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 37942. [D 20:43:15.436724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 37943. [D 20:43:15.436751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 37944. [D 20:43:15.436765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 37945. [D 20:43:15.436774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 37946. [D 20:43:15.436784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 37947. [D 20:43:15.436797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 37948. [D 20:43:15.436807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 37949. [D 20:43:15.436817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 37950. [D 20:43:15.436827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 37951. [D 20:43:15.436854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 37952. [D 20:43:15.436864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 37953. [D 20:43:15.436879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 37954. [D 20:43:15.436890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 37955. [D 20:43:15.436900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 37956. [D 20:43:15.436910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 37957. [D 20:43:15.436920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 37958. [D 20:43:15.436939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 37959. [D 20:43:15.436950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 37960. [D 20:43:15.436968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 37961. [D 20:43:15.436977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 37962. [D 20:43:15.436997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 37963. [D 20:43:15.437011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 37964. [D 20:43:15.437020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 37965. [D 20:43:15.437030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 37966. [D 20:43:15.437046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 37967. [D 20:43:15.437055] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 37968. [D 20:43:15.439765] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6130 [D 20:43:15.439824] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 8/70. [D 20:43:15.442081] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6133 [D 20:43:15.442094] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.442100] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 9/70. [D 20:43:15.442162] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.442176] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:15.442222] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6136 [D 20:43:15.442233] element 0: offset: 0x662260, size: 24 [D 20:43:15.442247] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 10/70. [D 20:43:15.442736] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 37968. [D 20:43:15.442754] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 11/70. [D 20:43:15.442776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 37968. [D 20:43:15.442787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 37969. [D 20:43:15.442802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 37970. [D 20:43:15.442812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 37971. [D 20:43:15.442822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 37972. [D 20:43:15.442836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 37973. [D 20:43:15.442846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 37974. [D 20:43:15.442856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 37975. [D 20:43:15.442871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 37976. [D 20:43:15.442881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 37977. [D 20:43:15.442891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 37978. [D 20:43:15.442907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 37979. [D 20:43:15.442917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 37980. [D 20:43:15.442927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 37981. [D 20:43:15.442962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 37982. [D 20:43:15.442972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 37983. [D 20:43:15.442982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 37984. [D 20:43:15.442992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 37985. [D 20:43:15.443021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 37986. [D 20:43:15.443032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 37987. [D 20:43:15.443045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 37988. [D 20:43:15.443054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 37989. [D 20:43:15.443064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 37990. [D 20:43:15.443077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 37991. [D 20:43:15.443087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 37992. [D 20:43:15.443097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 37993. [D 20:43:15.443128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 37994. [D 20:43:15.443139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 37995. [D 20:43:15.443149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 37996. [D 20:43:15.443159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 37997. [D 20:43:15.443170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 37998. [D 20:43:15.443180] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 37999. [D 20:43:15.443193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 38000. [D 20:43:15.443203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 38001. [D 20:43:15.443221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 38002. [D 20:43:15.443230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 38003. [D 20:43:15.443255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 38004. [D 20:43:15.443267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 38005. [D 20:43:15.443276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 38006. [D 20:43:15.443287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 38007. [D 20:43:15.443297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 38008. [D 20:43:15.443396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 38009. [D 20:43:15.443408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 38010. [D 20:43:15.443418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 38011. [D 20:43:15.443440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 38012. [D 20:43:15.443450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 38013. [D 20:43:15.443460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 38014. [D 20:43:15.443470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 38015. [D 20:43:15.443480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 38016. [D 20:43:15.443490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 38017. [D 20:43:15.443500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 38018. [D 20:43:15.443509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 38019. [D 20:43:15.443519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 38020. [D 20:43:15.443529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 38021. [D 20:43:15.443539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 38022. [D 20:43:15.443549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 38023. [D 20:43:15.443558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 38024. [D 20:43:15.443568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 38025. [D 20:43:15.443578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 38026. [D 20:43:15.443588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 38027. [D 20:43:15.443597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 38028. [D 20:43:15.443607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 38029. [D 20:43:15.443617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 38030. [D 20:43:15.443627] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 38031. [D 20:43:15.445638] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6136 [D 20:43:15.445690] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 12/70. [D 20:43:15.445710] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.445724] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.445734] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:15.454469] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 38031. [D 20:43:15.454484] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 13/70. [D 20:43:15.465972] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 38030. [D 20:43:15.465986] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 14/70. [D 20:43:15.466018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 38030. [D 20:43:15.466030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 38031. [D 20:43:15.466040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 38032. [D 20:43:15.466054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 38033. [D 20:43:15.466064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 38034. [D 20:43:15.466074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 38035. [D 20:43:15.466088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 38036. [D 20:43:15.466098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 38037. [D 20:43:15.466124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 38038. [D 20:43:15.466134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 38039. [D 20:43:15.466143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 38040. [D 20:43:15.466158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 38041. [D 20:43:15.466167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 38042. [D 20:43:15.466177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 38043. [D 20:43:15.466201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 38044. [D 20:43:15.466211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 38045. [D 20:43:15.466221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 38046. [D 20:43:15.466232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 38047. [D 20:43:15.466251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 38048. [D 20:43:15.466261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 38049. [D 20:43:15.466271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 38050. [D 20:43:15.466281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 38051. [D 20:43:15.466291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 38052. [D 20:43:15.466308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 38053. [D 20:43:15.466318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 38054. [D 20:43:15.466339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 38055. [D 20:43:15.466356] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.466372] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.466381] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.466399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 38056. [D 20:43:15.466409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 38057. [D 20:43:15.466433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 38058. [D 20:43:15.466443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 38059. [D 20:43:15.466454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 38060. [D 20:43:15.466464] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 38061. [D 20:43:15.466505] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.466516] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.466524] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:15.479075] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38061. [D 20:43:15.479089] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 15/70. [D 20:43:15.481357] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.481370] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.481381] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:15.481395] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6139 [D 20:43:15.481405] element 0: offset: 0x6a6440, size: 24 [D 20:43:15.481416] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 16/70. [D 20:43:15.481430] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.481442] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.481450] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:15.481463] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.481473] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.481481] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:15.481498] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6142 [D 20:43:15.481509] element 0: offset: 0x625390, size: 24 [D 20:43:15.481518] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 17/70. [D 20:43:15.485764] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6139 [D 20:43:15.485839] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 18/70. [D 20:43:15.489022] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6142 [D 20:43:15.489039] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 19/70. [D 20:43:15.490924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 38061. [D 20:43:15.490989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 38062. [D 20:43:15.491000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 38063. [D 20:43:15.491011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 38064. [D 20:43:15.491020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 38065. [D 20:43:15.491031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 38066. [D 20:43:15.491042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 38067. [D 20:43:15.491052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 38068. [D 20:43:15.491062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 38069. [D 20:43:15.491077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 38070. [D 20:43:15.491087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 38071. [D 20:43:15.491097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 38072. [D 20:43:15.491107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 38073. [D 20:43:15.491118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 38074. [D 20:43:15.491127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 38075. [D 20:43:15.491137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 38076. [D 20:43:15.491153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 38077. [D 20:43:15.491163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 38078. [D 20:43:15.491194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 38079. [D 20:43:15.491204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 38080. [D 20:43:15.491214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 38081. [D 20:43:15.491224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 38082. [D 20:43:15.491251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 38083. [D 20:43:15.491265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 38084. [D 20:43:15.491275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 38085. [D 20:43:15.491285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 38086. [D 20:43:15.491302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 38087. [D 20:43:15.491317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 38088. [D 20:43:15.491327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 38089. [D 20:43:15.491337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 38090. [D 20:43:15.491347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 38091. [D 20:43:15.491357] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 38092. [D 20:43:15.491381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 38093. [D 20:43:15.491391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 38094. [D 20:43:15.491400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 38095. [D 20:43:15.491410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 38096. [D 20:43:15.491445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 38097. [D 20:43:15.491455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 38098. [D 20:43:15.491465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 38099. [D 20:43:15.491474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 38100. [D 20:43:15.491490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 38101. [D 20:43:15.491499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 38102. [D 20:43:15.491523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 38103. [D 20:43:15.491533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 38104. [D 20:43:15.491542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 38105. [D 20:43:15.491553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 38106. [D 20:43:15.491563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 38107. [D 20:43:15.491573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 38108. [D 20:43:15.491586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 38109. [D 20:43:15.491602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 38110. [D 20:43:15.491626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 38111. [D 20:43:15.491640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 38112. [D 20:43:15.491649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 38113. [D 20:43:15.491659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 38114. [D 20:43:15.491686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 38115. [D 20:43:15.491696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 38116. [D 20:43:15.491708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 38117. [D 20:43:15.491718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 38118. [D 20:43:15.491728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 38119. [D 20:43:15.491756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 38120. [D 20:43:15.491768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 38121. [D 20:43:15.491781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 38122. [D 20:43:15.491791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 38123. [D 20:43:15.491801] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 38124. [D 20:43:15.501881] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38124. [D 20:43:15.501898] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 20/70. [D 20:43:15.504260] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.504275] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.504286] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.504321] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6146 [D 20:43:15.504332] element 0: offset: 0x5b0030, size: 24 [D 20:43:15.504346] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 21/70. [D 20:43:15.504365] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.504375] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.504383] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:15.504398] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6148 [D 20:43:15.504407] element 0: offset: 0x620d50, size: 24 [D 20:43:15.504416] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 22/70. [D 20:43:15.513426] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 38123. [D 20:43:15.513441] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 23/70. [D 20:43:15.515800] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.515814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.515823] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:15.515896] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.515909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.515917] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.518638] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6146 [D 20:43:15.518709] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 24/70. [D 20:43:15.518907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 38123. [D 20:43:15.518959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 38124. [D 20:43:15.518969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 38125. [D 20:43:15.518980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 38126. [D 20:43:15.518990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 38127. [D 20:43:15.519000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 38128. [D 20:43:15.519010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 38129. [D 20:43:15.519337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 38130. [D 20:43:15.519350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 38131. [D 20:43:15.519360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 38132. [D 20:43:15.519377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 38133. [D 20:43:15.519387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 38134. [D 20:43:15.519396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 38135. [D 20:43:15.519407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 38136. [D 20:43:15.519416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 38137. [D 20:43:15.519427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 38138. [D 20:43:15.519436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 38139. [D 20:43:15.519446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 38140. [D 20:43:15.519465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 38141. [D 20:43:15.519475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 38142. [D 20:43:15.519485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 38143. [D 20:43:15.519495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 38144. [D 20:43:15.519505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 38145. [D 20:43:15.519526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 38146. [D 20:43:15.519537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 38147. [D 20:43:15.519553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 38148. [D 20:43:15.519563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 38149. [D 20:43:15.519572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 38150. [D 20:43:15.519583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 38151. [D 20:43:15.519594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 38152. [D 20:43:15.519604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 38153. [D 20:43:15.519629] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 38154. [D 20:43:15.521959] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6148 [D 20:43:15.521979] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 25/70. [D 20:43:15.527333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.527352] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.527361] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.527397] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6151 [D 20:43:15.527408] element 0: offset: 0x691fe0, size: 24 [D 20:43:15.527421] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 26/70. [D 20:43:15.527440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.527451] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.527460] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:15.527474] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6154 [D 20:43:15.527485] element 0: offset: 0x662260, size: 24 [D 20:43:15.527507] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 27/70. [D 20:43:15.530868] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38154. [D 20:43:15.530884] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 28/70. [D 20:43:15.530921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 38154. [D 20:43:15.530932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 38155. [D 20:43:15.531048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 38156. [D 20:43:15.531074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 38157. [D 20:43:15.531083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 38158. [D 20:43:15.531093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 38159. [D 20:43:15.531103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 38160. [D 20:43:15.531113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 38161. [D 20:43:15.531123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 38162. [D 20:43:15.531133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 38163. [D 20:43:15.531143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 38164. [D 20:43:15.531153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 38165. [D 20:43:15.531163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 38166. [D 20:43:15.531173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 38167. [D 20:43:15.531182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 38168. [D 20:43:15.531192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 38169. [D 20:43:15.531202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 38170. [D 20:43:15.531212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 38171. [D 20:43:15.531222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 38172. [D 20:43:15.531232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 38173. [D 20:43:15.531242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 38174. [D 20:43:15.531252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 38175. [D 20:43:15.531262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 38176. [D 20:43:15.531271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 38177. [D 20:43:15.531281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 38178. [D 20:43:15.531291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 38179. [D 20:43:15.531301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 38180. [D 20:43:15.531369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 38181. [D 20:43:15.531383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 38182. [D 20:43:15.531392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 38183. [D 20:43:15.531402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 38184. [D 20:43:15.531413] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 38185. [D 20:43:15.531457] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.531467] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.531476] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:15.535895] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6154 [D 20:43:15.535948] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 29/70. [D 20:43:15.536025] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6151 [D 20:43:15.536041] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 30/70. [D 20:43:15.542356] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 38185. [D 20:43:15.542374] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 31/70. [D 20:43:15.544763] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.544777] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.544787] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.547597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 38185. [D 20:43:15.547611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 38186. [D 20:43:15.547622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 38187. [D 20:43:15.547632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 38188. [D 20:43:15.547642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 38189. [D 20:43:15.547655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 38190. [D 20:43:15.547665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 38191. [D 20:43:15.547675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 38192. [D 20:43:15.547690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 38193. [D 20:43:15.547700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 38194. [D 20:43:15.547710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 38195. [D 20:43:15.547726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 38196. [D 20:43:15.547735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 38197. [D 20:43:15.547745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 38198. [D 20:43:15.547761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 38199. [D 20:43:15.547771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 38200. [D 20:43:15.547781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 38201. [D 20:43:15.547797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 38202. [D 20:43:15.547806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 38203. [D 20:43:15.547816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 38204. [D 20:43:15.547852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 38205. [D 20:43:15.547863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 38206. [D 20:43:15.547873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 38207. [D 20:43:15.547883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 38208. [D 20:43:15.547893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 38209. [D 20:43:15.547902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 38210. [D 20:43:15.547912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 38211. [D 20:43:15.547922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 38212. [D 20:43:15.547939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 38213. [D 20:43:15.547949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 38214. [D 20:43:15.547959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 38215. [D 20:43:15.547985] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 38216. [D 20:43:15.547996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 38217. [D 20:43:15.548006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 38218. [D 20:43:15.548016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 38219. [D 20:43:15.548026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 38220. [D 20:43:15.548036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 38221. [D 20:43:15.548046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 38222. [D 20:43:15.548056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 38223. [D 20:43:15.548065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 38224. [D 20:43:15.548099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 38225. [D 20:43:15.548114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 38226. [D 20:43:15.548124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 38227. [D 20:43:15.548134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 38228. [D 20:43:15.548150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 38229. [D 20:43:15.548160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 38230. [D 20:43:15.548170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 38231. [D 20:43:15.548185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 38232. [D 20:43:15.548195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 38233. [D 20:43:15.548205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 38234. [D 20:43:15.548236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 38235. [D 20:43:15.548246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 38236. [D 20:43:15.548256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 38237. [D 20:43:15.548267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 38238. [D 20:43:15.548276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 38239. [D 20:43:15.548286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 38240. [D 20:43:15.548296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 38241. [D 20:43:15.548306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 38242. [D 20:43:15.548316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 38243. [D 20:43:15.548332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 38244. [D 20:43:15.548342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 38245. [D 20:43:15.548352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 38246. [D 20:43:15.548382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 38247. [D 20:43:15.548392] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 38248. [D 20:43:15.559188] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.559202] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.559213] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.559228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6158 [D 20:43:15.559238] element 0: offset: 0x61f310, size: 24 [D 20:43:15.559247] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 32/70. [D 20:43:15.559263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.559273] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.559281] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:15.559299] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6160 [D 20:43:15.559308] element 0: offset: 0x6a6440, size: 24 [D 20:43:15.559324] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 33/70. [D 20:43:15.559347] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38248. [D 20:43:15.559360] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 34/70. [D 20:43:15.570842] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 38247. [D 20:43:15.570856] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 35/70. [D 20:43:15.573182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.573195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.573205] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:15.573258] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.573272] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.573282] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.575705] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6158 [D 20:43:15.575724] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 36/70. [D 20:43:15.576262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 38247. [D 20:43:15.576277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 38248. [D 20:43:15.576287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 38249. [D 20:43:15.576297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 38250. [D 20:43:15.576307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 38251. [D 20:43:15.576316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 38252. [D 20:43:15.576326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 38253. [D 20:43:15.576336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 38254. [D 20:43:15.576345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 38255. [D 20:43:15.576355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 38256. [D 20:43:15.576365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 38257. [D 20:43:15.576375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 38258. [D 20:43:15.576385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 38259. [D 20:43:15.576394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 38260. [D 20:43:15.576404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 38261. [D 20:43:15.576414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 38262. [D 20:43:15.576424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 38263. [D 20:43:15.576433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 38264. [D 20:43:15.576443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 38265. [D 20:43:15.576453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 38266. [D 20:43:15.576463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 38267. [D 20:43:15.576472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 38268. [D 20:43:15.576482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 38269. [D 20:43:15.576492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 38270. [D 20:43:15.576502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 38271. [D 20:43:15.576511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 38272. [D 20:43:15.576521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 38273. [D 20:43:15.576531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 38274. [D 20:43:15.576540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 38275. [D 20:43:15.576550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 38276. [D 20:43:15.576561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 38277. [D 20:43:15.576571] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 38278. [D 20:43:15.578890] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6160 [D 20:43:15.578901] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 37/70. [D 20:43:15.586657] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.586671] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.586680] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.586695] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6163 [D 20:43:15.586704] element 0: offset: 0x661d50, size: 24 [D 20:43:15.586713] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 38/70. [D 20:43:15.586728] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.586737] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.586745] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:15.586759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6166 [D 20:43:15.586768] element 0: offset: 0x6a6550, size: 24 [D 20:43:15.586777] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 39/70. [D 20:43:15.588164] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38278. [D 20:43:15.588180] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 40/70. [D 20:43:15.588215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 38278. [D 20:43:15.588225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 38279. [D 20:43:15.588235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 38280. [D 20:43:15.588245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 38281. [D 20:43:15.588255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 38282. [D 20:43:15.588264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 38283. [D 20:43:15.588274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 38284. [D 20:43:15.588283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 38285. [D 20:43:15.588293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 38286. [D 20:43:15.588303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 38287. [D 20:43:15.588312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 38288. [D 20:43:15.588322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 38289. [D 20:43:15.588331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 38290. [D 20:43:15.588341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 38291. [D 20:43:15.588351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 38292. [D 20:43:15.588360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 38293. [D 20:43:15.588370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 38294. [D 20:43:15.588379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 38295. [D 20:43:15.588389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 38296. [D 20:43:15.588399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 38297. [D 20:43:15.588408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 38298. [D 20:43:15.588418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 38299. [D 20:43:15.588427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 38300. [D 20:43:15.588437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 38301. [D 20:43:15.588447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 38302. [D 20:43:15.588456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 38303. [D 20:43:15.588466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 38304. [D 20:43:15.588476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 38305. [D 20:43:15.588485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 38306. [D 20:43:15.588496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 38307. [D 20:43:15.588506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 38308. [D 20:43:15.588516] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 38309. [D 20:43:15.590875] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.590886] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.590895] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:15.592906] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6166 [D 20:43:15.592923] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 41/70. [D 20:43:15.595156] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6163 [D 20:43:15.595173] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 42/70. [D 20:43:15.598406] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 38309. [D 20:43:15.598422] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 43/70. [D 20:43:15.598433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 38309. [D 20:43:15.598443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 38310. [D 20:43:15.598453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 38311. [D 20:43:15.598463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 38312. [D 20:43:15.598473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 38313. [D 20:43:15.598482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 38314. [D 20:43:15.598492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 38315. [D 20:43:15.598502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 38316. [D 20:43:15.598512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 38317. [D 20:43:15.598522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 38318. [D 20:43:15.598532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 38319. [D 20:43:15.598542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 38320. [D 20:43:15.598551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 38321. [D 20:43:15.598561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 38322. [D 20:43:15.598571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 38323. [D 20:43:15.598581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 38324. [D 20:43:15.598591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 38325. [D 20:43:15.598601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 38326. [D 20:43:15.598611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 38327. [D 20:43:15.598620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 38328. [D 20:43:15.598630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 38329. [D 20:43:15.598640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 38330. [D 20:43:15.598650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 38331. [D 20:43:15.598663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 38332. [D 20:43:15.598673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 38333. [D 20:43:15.598682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 38334. [D 20:43:15.598693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 38335. [D 20:43:15.598703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 38336. [D 20:43:15.598712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 38337. [D 20:43:15.598723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 38338. [D 20:43:15.598733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 38339. [D 20:43:15.598743] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 38340. [D 20:43:15.598754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 38341. [D 20:43:15.598764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 38342. [D 20:43:15.598774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 38343. [D 20:43:15.598784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 38344. [D 20:43:15.598794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 38345. [D 20:43:15.598804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 38346. [D 20:43:15.598814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 38347. [D 20:43:15.598824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 38348. [D 20:43:15.598834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 38349. [D 20:43:15.598844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 38350. [D 20:43:15.598853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 38351. [D 20:43:15.598864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 38352. [D 20:43:15.598873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 38353. [D 20:43:15.598883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 38354. [D 20:43:15.598893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 38355. [D 20:43:15.598903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 38356. [D 20:43:15.598913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 38357. [D 20:43:15.598923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 38358. [D 20:43:15.598933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 38359. [D 20:43:15.598943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 38360. [D 20:43:15.598953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 38361. [D 20:43:15.598963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 38362. [D 20:43:15.598973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 38363. [D 20:43:15.598983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 38364. [D 20:43:15.598993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 38365. [D 20:43:15.599003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 38366. [D 20:43:15.599013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 38367. [D 20:43:15.599023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 38368. [D 20:43:15.599033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 38369. [D 20:43:15.599042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 38370. [D 20:43:15.599052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 38371. [D 20:43:15.599062] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 38372. [D 20:43:15.599327] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.599338] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.599346] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.604358] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38372. [D 20:43:15.604374] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 44/70. [D 20:43:15.610194] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 38371. [D 20:43:15.610209] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 45/70. [D 20:43:15.612355] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.612365] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.612374] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:15.612386] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.612395] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.612403] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.656534] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.656547] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.656556] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.656571] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6170 [D 20:43:15.656581] element 0: offset: 0x5b0030, size: 24 [D 20:43:15.656590] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 46/70. [D 20:43:15.656604] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.656613] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.656621] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:15.656634] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6172 [D 20:43:15.656643] element 0: offset: 0x62d650, size: 24 [D 20:43:15.656652] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 47/70. [D 20:43:15.661226] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6170 [D 20:43:15.661243] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 48/70. [D 20:43:15.661375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 38371. [D 20:43:15.661389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 38372. [D 20:43:15.661409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 38373. [D 20:43:15.661418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 38374. [D 20:43:15.661428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 38375. [D 20:43:15.661438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 38376. [D 20:43:15.661448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 38377. [D 20:43:15.661458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 38378. [D 20:43:15.661468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 38379. [D 20:43:15.661477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 38380. [D 20:43:15.661487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 38381. [D 20:43:15.661497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 38382. [D 20:43:15.661507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 38383. [D 20:43:15.661517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 38384. [D 20:43:15.661527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 38385. [D 20:43:15.661536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 38386. [D 20:43:15.661546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 38387. [D 20:43:15.661556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 38388. [D 20:43:15.661566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 38389. [D 20:43:15.661575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 38390. [D 20:43:15.661585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 38391. [D 20:43:15.661595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 38392. [D 20:43:15.661605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 38393. [D 20:43:15.661614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 38394. [D 20:43:15.661624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 38395. [D 20:43:15.661634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 38396. [D 20:43:15.661643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 38397. [D 20:43:15.661653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 38398. [D 20:43:15.661663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 38399. [D 20:43:15.661673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 38400. [D 20:43:15.661683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 38401. [D 20:43:15.661693] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 38402. [D 20:43:15.664017] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6172 [D 20:43:15.664029] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 49/70. [D 20:43:15.669725] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38402. [D 20:43:15.669740] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 50/70. [D 20:43:15.671335] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.671346] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.671355] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:15.671455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 38402. [D 20:43:15.671466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 38403. [D 20:43:15.671476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 38404. [D 20:43:15.671485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 38405. [D 20:43:15.671495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 38406. [D 20:43:15.671506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 38407. [D 20:43:15.671515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 38408. [D 20:43:15.671525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 38409. [D 20:43:15.671535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 38410. [D 20:43:15.671545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 38411. [D 20:43:15.671555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 38412. [D 20:43:15.671565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 38413. [D 20:43:15.671575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 38414. [D 20:43:15.671585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 38415. [D 20:43:15.671595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 38416. [D 20:43:15.671605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 38417. [D 20:43:15.671615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 38418. [D 20:43:15.671625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 38419. [D 20:43:15.671635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 38420. [D 20:43:15.671645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 38421. [D 20:43:15.671655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 38422. [D 20:43:15.671665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 38423. [D 20:43:15.671675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 38424. [D 20:43:15.671684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 38425. [D 20:43:15.671694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 38426. [D 20:43:15.671704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 38427. [D 20:43:15.671714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 38428. [D 20:43:15.671725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 38429. [D 20:43:15.671735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 38430. [D 20:43:15.671745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 38431. [D 20:43:15.671755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 38432. [D 20:43:15.671765] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 38433. [D 20:43:15.677960] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 38433. [D 20:43:15.677975] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 51/70. [D 20:43:15.681684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.681695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.681704] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.681717] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.681726] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.681735] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.681749] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6175 [D 20:43:15.681758] element 0: offset: 0x691fe0, size: 24 [D 20:43:15.681768] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 52/70. [D 20:43:15.681783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.681792] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.681800] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:15.681813] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6178 [D 20:43:15.681823] element 0: offset: 0x625390, size: 24 [D 20:43:15.681832] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 53/70. [D 20:43:15.686248] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6178 [D 20:43:15.686265] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 54/70. [D 20:43:15.686400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 38433. [D 20:43:15.686416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 38434. [D 20:43:15.686426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 38435. [D 20:43:15.686436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 38436. [D 20:43:15.686446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 38437. [D 20:43:15.686456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 38438. [D 20:43:15.686466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 38439. [D 20:43:15.686476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 38440. [D 20:43:15.686486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 38441. [D 20:43:15.686496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 38442. [D 20:43:15.686506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 38443. [D 20:43:15.686516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 38444. [D 20:43:15.686526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 38445. [D 20:43:15.686535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 38446. [D 20:43:15.686546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 38447. [D 20:43:15.686556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 38448. [D 20:43:15.686565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 38449. [D 20:43:15.686575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 38450. [D 20:43:15.686585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 38451. [D 20:43:15.686595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 38452. [D 20:43:15.686605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 38453. [D 20:43:15.686615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 38454. [D 20:43:15.686625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 38455. [D 20:43:15.686635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 38456. [D 20:43:15.686645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 38457. [D 20:43:15.686655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 38458. [D 20:43:15.686665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 38459. [D 20:43:15.686678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 38460. [D 20:43:15.686688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 38461. [D 20:43:15.686698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 38462. [D 20:43:15.686709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 38463. [D 20:43:15.686719] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 38464. [D 20:43:15.688415] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6175 [D 20:43:15.688474] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 55/70. [D 20:43:15.695099] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38464. [D 20:43:15.695117] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 56/70. [D 20:43:15.695339] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.695349] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.695358] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:15.697543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 38464. [D 20:43:15.697558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 38465. [D 20:43:15.697568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 38466. [D 20:43:15.697578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 38467. [D 20:43:15.697588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 38468. [D 20:43:15.697598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 38469. [D 20:43:15.697608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 38470. [D 20:43:15.697618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 38471. [D 20:43:15.697628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 38472. [D 20:43:15.697638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 38473. [D 20:43:15.697648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 38474. [D 20:43:15.697657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 38475. [D 20:43:15.697668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 38476. [D 20:43:15.697677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 38477. [D 20:43:15.697687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 38478. [D 20:43:15.697697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 38479. [D 20:43:15.697707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 38480. [D 20:43:15.697717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 38481. [D 20:43:15.697727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 38482. [D 20:43:15.697737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 38483. [D 20:43:15.697747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 38484. [D 20:43:15.697757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 38485. [D 20:43:15.697767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 38486. [D 20:43:15.697776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 38487. [D 20:43:15.697787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 38488. [D 20:43:15.697796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 38489. [D 20:43:15.697806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 38490. [D 20:43:15.697816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 38491. [D 20:43:15.697826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 38492. [D 20:43:15.697836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 38493. [D 20:43:15.697847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 38494. [D 20:43:15.697856] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 38495. [D 20:43:15.709180] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.709194] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.709202] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:15.709218] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6182 [D 20:43:15.709227] element 0: offset: 0x61f310, size: 24 [D 20:43:15.709237] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 57/70. [D 20:43:15.709251] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.709264] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.709273] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.709286] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6184 [D 20:43:15.709295] element 0: offset: 0x661d50, size: 24 [D 20:43:15.709304] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 58/70. [D 20:43:15.709340] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 38495. [D 20:43:15.709351] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 59/70. [D 20:43:15.711718] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.711730] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.711736] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6182 [D 20:43:15.711738] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.711847] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 60/70. [D 20:43:15.713850] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6184 [D 20:43:15.713889] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 0/70. [D 20:43:15.715072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 38495. [D 20:43:15.715090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 38496. [D 20:43:15.715100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 38497. [D 20:43:15.715110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 38498. [D 20:43:15.715120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 38499. [D 20:43:15.715130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 38500. [D 20:43:15.715139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 38501. [D 20:43:15.715149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 38502. [D 20:43:15.715159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 38503. [D 20:43:15.715168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 38504. [D 20:43:15.715178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 38505. [D 20:43:15.715188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 38506. [D 20:43:15.715198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 38507. [D 20:43:15.715208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 38508. [D 20:43:15.715217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 38509. [D 20:43:15.715227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 38510. [D 20:43:15.715237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 38511. [D 20:43:15.715246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 38512. [D 20:43:15.715256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 38513. [D 20:43:15.715266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 38514. [D 20:43:15.715276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 38515. [D 20:43:15.715285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 38516. [D 20:43:15.715295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 38517. [D 20:43:15.715305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 38518. [D 20:43:15.715315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 38519. [D 20:43:15.715324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 38520. [D 20:43:15.715345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 38521. [D 20:43:15.715355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 38522. [D 20:43:15.715365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 38523. [D 20:43:15.715376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 38524. [D 20:43:15.715386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 38525. [D 20:43:15.715395] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 38526. [D 20:43:15.715406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 38527. [D 20:43:15.715417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 38528. [D 20:43:15.715426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 38529. [D 20:43:15.715436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 38530. [D 20:43:15.715446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 38531. [D 20:43:15.715456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 38532. [D 20:43:15.715466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 38533. [D 20:43:15.715475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 38534. [D 20:43:15.715485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 38535. [D 20:43:15.715495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 38536. [D 20:43:15.715505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 38537. [D 20:43:15.715515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 38538. [D 20:43:15.715525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 38539. [D 20:43:15.715534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 38540. [D 20:43:15.715544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 38541. [D 20:43:15.715554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 38542. [D 20:43:15.715564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 38543. [D 20:43:15.715574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 38544. [D 20:43:15.715584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 38545. [D 20:43:15.715593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 38546. [D 20:43:15.715603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 38547. [D 20:43:15.715613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 38548. [D 20:43:15.715623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 38549. [D 20:43:15.715633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 38550. [D 20:43:15.715643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 38551. [D 20:43:15.715652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 38552. [D 20:43:15.715662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 38553. [D 20:43:15.715672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 38554. [D 20:43:15.715682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 38555. [D 20:43:15.715692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 38556. [D 20:43:15.715702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 38557. [D 20:43:15.715712] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 38558. [D 20:43:15.723290] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.723304] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.723313] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.723328] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6186 [D 20:43:15.723426] element 0: offset: 0x5b0030, size: 24 [D 20:43:15.723436] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 1/70. [D 20:43:15.726042] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.726056] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.726064] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:15.726079] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6190 [D 20:43:15.726088] element 0: offset: 0x64dce0, size: 24 [D 20:43:15.726098] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 2/70. [D 20:43:15.726878] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38558. [D 20:43:15.726893] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 3/70. [D 20:43:15.738395] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 38557. [D 20:43:15.738410] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 4/70. [D 20:43:15.740744] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.740755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.740763] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:15.740817] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.740828] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.740836] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.744979] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6190 [D 20:43:15.744997] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 5/70. [D 20:43:15.745011] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6186 [D 20:43:15.745021] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 6/70. [D 20:43:15.750475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 38557. [D 20:43:15.750490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 38558. [D 20:43:15.750500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 38559. [D 20:43:15.750510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 38560. [D 20:43:15.750519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 38561. [D 20:43:15.750529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 38562. [D 20:43:15.750538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 38563. [D 20:43:15.750548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 38564. [D 20:43:15.750557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 38565. [D 20:43:15.750567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 38566. [D 20:43:15.750577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 38567. [D 20:43:15.750587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 38568. [D 20:43:15.750596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 38569. [D 20:43:15.750606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 38570. [D 20:43:15.750615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 38571. [D 20:43:15.750625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 38572. [D 20:43:15.750635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 38573. [D 20:43:15.750644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 38574. [D 20:43:15.750654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 38575. [D 20:43:15.750664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 38576. [D 20:43:15.750673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 38577. [D 20:43:15.750685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 38578. [D 20:43:15.750695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 38579. [D 20:43:15.750705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 38580. [D 20:43:15.750715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 38581. [D 20:43:15.750724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 38582. [D 20:43:15.750734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 38583. [D 20:43:15.750743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 38584. [D 20:43:15.750753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 38585. [D 20:43:15.750763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 38586. [D 20:43:15.750773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 38587. [D 20:43:15.750783] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 38588. [D 20:43:15.750794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 38589. [D 20:43:15.750804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 38590. [D 20:43:15.750813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 38591. [D 20:43:15.750823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 38592. [D 20:43:15.750833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 38593. [D 20:43:15.750842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 38594. [D 20:43:15.750852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 38595. [D 20:43:15.750862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 38596. [D 20:43:15.750872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 38597. [D 20:43:15.750881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 38598. [D 20:43:15.750891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 38599. [D 20:43:15.750901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 38600. [D 20:43:15.750910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 38601. [D 20:43:15.750920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 38602. [D 20:43:15.750930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 38603. [D 20:43:15.750939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 38604. [D 20:43:15.750949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 38605. [D 20:43:15.750959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 38606. [D 20:43:15.750968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 38607. [D 20:43:15.750978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 38608. [D 20:43:15.750988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 38609. [D 20:43:15.750998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 38610. [D 20:43:15.751007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 38611. [D 20:43:15.751017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 38612. [D 20:43:15.751027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 38613. [D 20:43:15.751036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 38614. [D 20:43:15.751046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 38615. [D 20:43:15.751056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 38616. [D 20:43:15.751066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 38617. [D 20:43:15.751075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 38618. [D 20:43:15.751085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 38619. [D 20:43:15.751095] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 38620. [D 20:43:15.755348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.755359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.755367] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.755382] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6194 [D 20:43:15.755391] element 0: offset: 0x62d650, size: 24 [D 20:43:15.755400] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 7/70. [D 20:43:15.755415] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.755424] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.755432] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:15.755445] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6196 [D 20:43:15.755454] element 0: offset: 0x6a6440, size: 24 [D 20:43:15.755464] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 8/70. [D 20:43:15.761562] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38620. [D 20:43:15.761577] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 9/70. [D 20:43:15.769280] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 38619. [D 20:43:15.769294] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 10/70. [D 20:43:15.771628] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.771638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.771647] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:15.771712] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.771723] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.771731] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.775967] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6194 [D 20:43:15.775984] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 11/70. [D 20:43:15.775997] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6196 [D 20:43:15.776008] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 12/70. [D 20:43:15.780056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 38619. [D 20:43:15.780071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 38620. [D 20:43:15.780081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 38621. [D 20:43:15.780091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 38622. [D 20:43:15.780100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 38623. [D 20:43:15.780110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 38624. [D 20:43:15.780119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 38625. [D 20:43:15.780129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 38626. [D 20:43:15.780139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 38627. [D 20:43:15.780148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 38628. [D 20:43:15.780158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 38629. [D 20:43:15.780168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 38630. [D 20:43:15.780177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 38631. [D 20:43:15.780187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 38632. [D 20:43:15.780197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 38633. [D 20:43:15.780206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 38634. [D 20:43:15.780216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 38635. [D 20:43:15.780225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 38636. [D 20:43:15.780235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 38637. [D 20:43:15.780245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 38638. [D 20:43:15.780254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 38639. [D 20:43:15.780264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 38640. [D 20:43:15.780273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 38641. [D 20:43:15.780283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 38642. [D 20:43:15.780293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 38643. [D 20:43:15.780302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 38644. [D 20:43:15.780312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 38645. [D 20:43:15.780321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 38646. [D 20:43:15.780331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 38647. [D 20:43:15.780341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 38648. [D 20:43:15.780351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 38649. [D 20:43:15.780361] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 38650. [D 20:43:15.780372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 38651. [D 20:43:15.780382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 38652. [D 20:43:15.780392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 38653. [D 20:43:15.780401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 38654. [D 20:43:15.780411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 38655. [D 20:43:15.780420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 38656. [D 20:43:15.780430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 38657. [D 20:43:15.780440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 38658. [D 20:43:15.780449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 38659. [D 20:43:15.780459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 38660. [D 20:43:15.780469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 38661. [D 20:43:15.780478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 38662. [D 20:43:15.780488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 38663. [D 20:43:15.780498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 38664. [D 20:43:15.780508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 38665. [D 20:43:15.780517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 38666. [D 20:43:15.780527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 38667. [D 20:43:15.780536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 38668. [D 20:43:15.780546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 38669. [D 20:43:15.780556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 38670. [D 20:43:15.780565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 38671. [D 20:43:15.780575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 38672. [D 20:43:15.780585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 38673. [D 20:43:15.780594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 38674. [D 20:43:15.780604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 38675. [D 20:43:15.780614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 38676. [D 20:43:15.780623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 38677. [D 20:43:15.780634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 38678. [D 20:43:15.780643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 38679. [D 20:43:15.780653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 38680. [D 20:43:15.780663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 38681. [D 20:43:15.780672] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 38682. [D 20:43:15.785161] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.785172] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.785180] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.785195] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6200 [D 20:43:15.785204] element 0: offset: 0x632820, size: 24 [D 20:43:15.785213] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 13/70. [D 20:43:15.785227] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.785236] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.785244] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:15.785257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6201 [D 20:43:15.785267] element 0: offset: 0x631a20, size: 24 [D 20:43:15.785276] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 14/70. [D 20:43:15.786421] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38682. [D 20:43:15.786436] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 15/70. [D 20:43:15.795050] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 38681. [D 20:43:15.795066] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 16/70. [D 20:43:15.795352] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.795362] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.795371] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:15.795423] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.795433] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.795442] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.799512] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6201 [D 20:43:15.799528] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 17/70. [D 20:43:15.799542] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6200 [D 20:43:15.799552] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 18/70. [D 20:43:15.800792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 38681. [D 20:43:15.800803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 38682. [D 20:43:15.800812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 38683. [D 20:43:15.800822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 38684. [D 20:43:15.800832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 38685. [D 20:43:15.800842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 38686. [D 20:43:15.800852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 38687. [D 20:43:15.800861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 38688. [D 20:43:15.800871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 38689. [D 20:43:15.800881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 38690. [D 20:43:15.800891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 38691. [D 20:43:15.800900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 38692. [D 20:43:15.800910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 38693. [D 20:43:15.800920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 38694. [D 20:43:15.800930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 38695. [D 20:43:15.800939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 38696. [D 20:43:15.800949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 38697. [D 20:43:15.800959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 38698. [D 20:43:15.800969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 38699. [D 20:43:15.800978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 38700. [D 20:43:15.800988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 38701. [D 20:43:15.800998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 38702. [D 20:43:15.801008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 38703. [D 20:43:15.801018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 38704. [D 20:43:15.801027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 38705. [D 20:43:15.801037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 38706. [D 20:43:15.801047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 38707. [D 20:43:15.801057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 38708. [D 20:43:15.801067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 38709. [D 20:43:15.801077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 38710. [D 20:43:15.801087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 38711. [D 20:43:15.801096] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 38712. [D 20:43:15.801107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 38713. [D 20:43:15.801117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 38714. [D 20:43:15.801127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 38715. [D 20:43:15.801137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 38716. [D 20:43:15.801146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 38717. [D 20:43:15.801156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 38718. [D 20:43:15.801166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 38719. [D 20:43:15.801176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 38720. [D 20:43:15.801185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 38721. [D 20:43:15.801195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 38722. [D 20:43:15.801205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 38723. [D 20:43:15.801215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 38724. [D 20:43:15.801225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 38725. [D 20:43:15.801234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 38726. [D 20:43:15.801244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 38727. [D 20:43:15.801254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 38728. [D 20:43:15.801263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 38729. [D 20:43:15.801273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 38730. [D 20:43:15.801283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 38731. [D 20:43:15.801293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 38732. [D 20:43:15.801303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 38733. [D 20:43:15.801312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 38734. [D 20:43:15.801322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 38735. [D 20:43:15.801332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 38736. [D 20:43:15.801342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 38737. [D 20:43:15.801352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 38738. [D 20:43:15.801362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 38739. [D 20:43:15.801372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 38740. [D 20:43:15.801381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 38741. [D 20:43:15.801391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 38742. [D 20:43:15.801401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 38743. [D 20:43:15.801411] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 38744. [D 20:43:15.812412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.812426] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.812434] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:15.812449] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6206 [D 20:43:15.812459] element 0: offset: 0x61f310, size: 24 [D 20:43:15.812468] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 19/70. [D 20:43:15.812482] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.812492] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.812500] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:15.812517] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6208 [D 20:43:15.812527] element 0: offset: 0x625390, size: 24 [D 20:43:15.812536] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 20/70. [D 20:43:15.812557] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38744. [D 20:43:15.812567] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 21/70. [D 20:43:15.819287] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 38743. [D 20:43:15.819302] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 22/70. [D 20:43:15.821582] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.821592] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.821601] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:15.821663] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.821673] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.821682] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:15.823717] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6208 [D 20:43:15.823734] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 23/70. [D 20:43:15.825960] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6206 [D 20:43:15.825974] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 24/70. [D 20:43:15.827830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 38743. [D 20:43:15.827846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 38744. [D 20:43:15.827865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 38745. [D 20:43:15.827875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 38746. [D 20:43:15.827889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 38747. [D 20:43:15.827898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 38748. [D 20:43:15.827908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 38749. [D 20:43:15.827919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 38750. [D 20:43:15.827928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 38751. [D 20:43:15.827938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 38752. [D 20:43:15.827948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 38753. [D 20:43:15.827971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 38754. [D 20:43:15.827986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 38755. [D 20:43:15.827995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 38756. [D 20:43:15.828005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 38757. [D 20:43:15.828015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 38758. [D 20:43:15.828038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 38759. [D 20:43:15.828050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 38760. [D 20:43:15.828060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 38761. [D 20:43:15.828074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 38762. [D 20:43:15.828084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 38763. [D 20:43:15.828094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 38764. [D 20:43:15.828104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 38765. [D 20:43:15.828114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 38766. [D 20:43:15.828134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 38767. [D 20:43:15.828144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 38768. [D 20:43:15.828167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 38769. [D 20:43:15.828179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 38770. [D 20:43:15.828189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 38771. [D 20:43:15.828204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 38772. [D 20:43:15.828214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 38773. [D 20:43:15.828224] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 38774. [D 20:43:15.828236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 38775. [D 20:43:15.828246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 38776. [D 20:43:15.828267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 38777. [D 20:43:15.828277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 38778. [D 20:43:15.828293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 38779. [D 20:43:15.828303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 38780. [D 20:43:15.828313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 38781. [D 20:43:15.828336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 38782. [D 20:43:15.828347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 38783. [D 20:43:15.828357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 38784. [D 20:43:15.828367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 38785. [D 20:43:15.828377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 38786. [D 20:43:15.828392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 38787. [D 20:43:15.828402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 38788. [D 20:43:15.828412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 38789. [D 20:43:15.828422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 38790. [D 20:43:15.828439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 38791. [D 20:43:15.828449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 38792. [D 20:43:15.828459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 38793. [D 20:43:15.828469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 38794. [D 20:43:15.828478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 38795. [D 20:43:15.828489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 38796. [D 20:43:15.828509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 38797. [D 20:43:15.828519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 38798. [D 20:43:15.828529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 38799. [D 20:43:15.828555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 38800. [D 20:43:15.828566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 38801. [D 20:43:15.828575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 38802. [D 20:43:15.828590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 38803. [D 20:43:15.828600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 38804. [D 20:43:15.828610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 38805. [D 20:43:15.828639] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 38806. [D 20:43:15.833802] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38806. [D 20:43:15.833851] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 25/70. [D 20:43:15.839707] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 38805. [D 20:43:15.839724] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 26/70. [D 20:43:15.841997] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.842010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.842019] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:15.842033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.842043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.842052] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.964691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.964706] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.964717] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.964732] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6210 [D 20:43:15.964742] element 0: offset: 0x5b0030, size: 24 [D 20:43:15.964752] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 27/70. [D 20:43:15.967018] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6210 [D 20:43:15.967123] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 28/70. [D 20:43:15.967177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 38805. [D 20:43:15.967190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 38806. [D 20:43:15.967202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 38807. [D 20:43:15.967212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 38808. [D 20:43:15.967222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 38809. [D 20:43:15.967232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 38810. [D 20:43:15.967242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 38811. [D 20:43:15.967252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 38812. [D 20:43:15.967272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 38813. [D 20:43:15.967282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 38814. [D 20:43:15.967291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 38815. [D 20:43:15.967301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 38816. [D 20:43:15.967317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 38817. [D 20:43:15.967327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 38818. [D 20:43:15.967356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 38819. [D 20:43:15.967369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 38820. [D 20:43:15.967379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 38821. [D 20:43:15.967389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 38822. [D 20:43:15.967399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 38823. [D 20:43:15.967409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 38824. [D 20:43:15.967419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 38825. [D 20:43:15.967451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 38826. [D 20:43:15.967461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 38827. [D 20:43:15.967471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 38828. [D 20:43:15.967481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 38829. [D 20:43:15.967499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 38830. [D 20:43:15.967509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 38831. [D 20:43:15.967519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 38832. [D 20:43:15.967529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 38833. [D 20:43:15.967540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 38834. [D 20:43:15.967550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 38835. [D 20:43:15.967565] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 38836. [D 20:43:15.973047] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38836. [D 20:43:15.973061] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 29/70. [D 20:43:15.975355] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.975371] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.975380] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:15.978876] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:15.978890] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.978899] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:15.978913] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6214 [D 20:43:15.978924] element 0: offset: 0x6a6610, size: 24 [D 20:43:15.978934] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 30/70. [D 20:43:15.981092] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6214 [D 20:43:15.981110] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 31/70. [D 20:43:15.981158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 38836. [D 20:43:15.981168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 38837. [D 20:43:15.981179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 38838. [D 20:43:15.981189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 38839. [D 20:43:15.981199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 38840. [D 20:43:15.981209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 38841. [D 20:43:15.981220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 38842. [D 20:43:15.981230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 38843. [D 20:43:15.981240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 38844. [D 20:43:15.981255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 38845. [D 20:43:15.981267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 38846. [D 20:43:15.981276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 38847. [D 20:43:15.981297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 38848. [D 20:43:15.981308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 38849. [D 20:43:15.981318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 38850. [D 20:43:15.981328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 38851. [D 20:43:15.981338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 38852. [D 20:43:15.981348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 38853. [D 20:43:15.981358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 38854. [D 20:43:15.981368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 38855. [D 20:43:15.981377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 38856. [D 20:43:15.981403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 38857. [D 20:43:15.981413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 38858. [D 20:43:15.981423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 38859. [D 20:43:15.981433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 38860. [D 20:43:15.981450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 38861. [D 20:43:15.981460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 38862. [D 20:43:15.981470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 38863. [D 20:43:15.981480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 38864. [D 20:43:15.981490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 38865. [D 20:43:15.981500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 38866. [D 20:43:15.981512] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 38867. [D 20:43:15.987027] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38867. [D 20:43:15.987041] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 32/70. [D 20:43:15.989339] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:15.989353] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:15.989362] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:16.100347] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.100362] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.100373] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:16.100387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6217 [D 20:43:16.100398] element 0: offset: 0x632820, size: 24 [D 20:43:16.100408] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 33/70. [D 20:43:16.102694] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6217 [D 20:43:16.102711] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 34/70. [D 20:43:16.102840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 38867. [D 20:43:16.102854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 38868. [D 20:43:16.102865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 38869. [D 20:43:16.102875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 38870. [D 20:43:16.102898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 38871. [D 20:43:16.102908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 38872. [D 20:43:16.102931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 38873. [D 20:43:16.102941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 38874. [D 20:43:16.102952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 38875. [D 20:43:16.102965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 38876. [D 20:43:16.102986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 38877. [D 20:43:16.103002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 38878. [D 20:43:16.103022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 38879. [D 20:43:16.103032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 38880. [D 20:43:16.103060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 38881. [D 20:43:16.103070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 38882. [D 20:43:16.103084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 38883. [D 20:43:16.103094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 38884. [D 20:43:16.103116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 38885. [D 20:43:16.103126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 38886. [D 20:43:16.103136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 38887. [D 20:43:16.103151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 38888. [D 20:43:16.103161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 38889. [D 20:43:16.103170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 38890. [D 20:43:16.103192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 38891. [D 20:43:16.103202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 38892. [D 20:43:16.103223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 38893. [D 20:43:16.103233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 38894. [D 20:43:16.103256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 38895. [D 20:43:16.103266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 38896. [D 20:43:16.103276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 38897. [D 20:43:16.103286] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 38898. [D 20:43:16.113768] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38898. [D 20:43:16.113782] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 35/70. [D 20:43:16.116085] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.116099] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.116109] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:16.128557] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.128571] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.128582] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:16.128596] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6220 [D 20:43:16.128606] element 0: offset: 0x61f310, size: 24 [D 20:43:16.128616] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 36/70. [D 20:43:16.128631] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.128643] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.128651] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:16.128665] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6223 [D 20:43:16.128675] element 0: offset: 0x625390, size: 24 [D 20:43:16.128684] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 37/70. [D 20:43:16.132997] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6223 [D 20:43:16.133014] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 38/70. [D 20:43:16.133026] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6220 [D 20:43:16.133038] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 39/70. [D 20:43:16.135766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 38898. [D 20:43:16.135781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 38899. [D 20:43:16.135794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 38900. [D 20:43:16.135804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 38901. [D 20:43:16.135814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 38902. [D 20:43:16.135830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 38903. [D 20:43:16.135840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 38904. [D 20:43:16.135849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 38905. [D 20:43:16.135866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 38906. [D 20:43:16.135876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 38907. [D 20:43:16.135886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 38908. [D 20:43:16.135917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 38909. [D 20:43:16.135927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 38910. [D 20:43:16.135939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 38911. [D 20:43:16.135949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 38912. [D 20:43:16.135959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 38913. [D 20:43:16.135984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 38914. [D 20:43:16.135994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 38915. [D 20:43:16.136019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 38916. [D 20:43:16.136029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 38917. [D 20:43:16.136041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 38918. [D 20:43:16.136051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 38919. [D 20:43:16.136061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 38920. [D 20:43:16.136082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 38921. [D 20:43:16.136102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 38922. [D 20:43:16.136115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 38923. [D 20:43:16.136124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 38924. [D 20:43:16.136134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 38925. [D 20:43:16.136144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 38926. [D 20:43:16.136154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 38927. [D 20:43:16.136194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 38928. [D 20:43:16.136205] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 38929. [D 20:43:16.136216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 38930. [D 20:43:16.136236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 38931. [D 20:43:16.136246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 38932. [D 20:43:16.136256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 38933. [D 20:43:16.136267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 38934. [D 20:43:16.136277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 38935. [D 20:43:16.136287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 38936. [D 20:43:16.136297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 38937. [D 20:43:16.136307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 38938. [D 20:43:16.136317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 38939. [D 20:43:16.136348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 38940. [D 20:43:16.136359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 38941. [D 20:43:16.136372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 38942. [D 20:43:16.136382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 38943. [D 20:43:16.136392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 38944. [D 20:43:16.136415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 38945. [D 20:43:16.136425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 38946. [D 20:43:16.136435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 38947. [D 20:43:16.136450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 38948. [D 20:43:16.136460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 38949. [D 20:43:16.136486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 38950. [D 20:43:16.136496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 38951. [D 20:43:16.136506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 38952. [D 20:43:16.136519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 38953. [D 20:43:16.136529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 38954. [D 20:43:16.136539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 38955. [D 20:43:16.136549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 38956. [D 20:43:16.136572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 38957. [D 20:43:16.136582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 38958. [D 20:43:16.136596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 38959. [D 20:43:16.136606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 38960. [D 20:43:16.136615] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 38961. [D 20:43:16.146899] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38961. [D 20:43:16.146913] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 40/70. [D 20:43:16.158430] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 38960. [D 20:43:16.158444] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 41/70. [D 20:43:16.160775] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.160789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.160799] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:16.160812] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.160822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.160830] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:16.174913] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.174927] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.174938] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:16.174952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6226 [D 20:43:16.174962] element 0: offset: 0x662390, size: 24 [D 20:43:16.174972] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 42/70. [D 20:43:16.174987] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.175001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.175010] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:16.177282] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6229 [D 20:43:16.177294] element 0: offset: 0x6a6610, size: 24 [D 20:43:16.177303] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 43/70. [D 20:43:16.179737] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6226 [D 20:43:16.179752] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 44/70. [D 20:43:16.179880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 38960. [D 20:43:16.179892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 38961. [D 20:43:16.179902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 38962. [D 20:43:16.179912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 38963. [D 20:43:16.179922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 38964. [D 20:43:16.179932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 38965. [D 20:43:16.179942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 38966. [D 20:43:16.179952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 38967. [D 20:43:16.179961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 38968. [D 20:43:16.179971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 38969. [D 20:43:16.179981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 38970. [D 20:43:16.179991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 38971. [D 20:43:16.180001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 38972. [D 20:43:16.180011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 38973. [D 20:43:16.180021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 38974. [D 20:43:16.180030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 38975. [D 20:43:16.180040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 38976. [D 20:43:16.180050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 38977. [D 20:43:16.180060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 38978. [D 20:43:16.180070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 38979. [D 20:43:16.180080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 38980. [D 20:43:16.180089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 38981. [D 20:43:16.180099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 38982. [D 20:43:16.180109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 38983. [D 20:43:16.180119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 38984. [D 20:43:16.180129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 38985. [D 20:43:16.180138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 38986. [D 20:43:16.180148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 38987. [D 20:43:16.180158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 38988. [D 20:43:16.180169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 38989. [D 20:43:16.180179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 38990. [D 20:43:16.180189] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 38991. [D 20:43:16.182576] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6229 [D 20:43:16.182591] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 45/70. [D 20:43:16.191502] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 38991. [D 20:43:16.191517] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 46/70. [D 20:43:16.191553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 38991. [D 20:43:16.191564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 38992. [D 20:43:16.191574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 38993. [D 20:43:16.191584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 38994. [D 20:43:16.191595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 38995. [D 20:43:16.191605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 38996. [D 20:43:16.191615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 38997. [D 20:43:16.191625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 38998. [D 20:43:16.191646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 38999. [D 20:43:16.191657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39000. [D 20:43:16.191679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39001. [D 20:43:16.191695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39002. [D 20:43:16.191715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39003. [D 20:43:16.191730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39004. [D 20:43:16.191751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39005. [D 20:43:16.191761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39006. [D 20:43:16.191771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39007. [D 20:43:16.191781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 39008. [D 20:43:16.191796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 39009. [D 20:43:16.191806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 39010. [D 20:43:16.191816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 39011. [D 20:43:16.191842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 39012. [D 20:43:16.191853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 39013. [D 20:43:16.191862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 39014. [D 20:43:16.191889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 39015. [D 20:43:16.191900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 39016. [D 20:43:16.191913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 39017. [D 20:43:16.191933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 39018. [D 20:43:16.191947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 39019. [D 20:43:16.191968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 39020. [D 20:43:16.191982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 39021. [D 20:43:16.192002] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 39022. [D 20:43:16.194345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.194359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.194368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:16.199881] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 39022. [D 20:43:16.199896] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 47/70. [D 20:43:16.202168] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.202181] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.202190] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:16.207409] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.207423] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.207434] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:16.207448] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6231 [D 20:43:16.207459] element 0: offset: 0x62d750, size: 24 [D 20:43:16.207469] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 48/70. [D 20:43:16.210844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.210859] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.210867] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:16.210881] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6235 [D 20:43:16.210890] element 0: offset: 0x691fe0, size: 24 [D 20:43:16.210900] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 49/70. [D 20:43:16.212814] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6231 [D 20:43:16.212828] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 50/70. [D 20:43:16.212956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 39022. [D 20:43:16.212970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 39023. [D 20:43:16.212981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 39024. [D 20:43:16.212991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 39025. [D 20:43:16.213002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 39026. [D 20:43:16.213012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 39027. [D 20:43:16.213022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 39028. [D 20:43:16.215032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39029. [D 20:43:16.215075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39030. [D 20:43:16.215086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39031. [D 20:43:16.215096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 39032. [D 20:43:16.215107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 39033. [D 20:43:16.215117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 39034. [D 20:43:16.215126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 39035. [D 20:43:16.215155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 39036. [D 20:43:16.215165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39037. [D 20:43:16.215176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39038. [D 20:43:16.215186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39039. [D 20:43:16.215221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 39040. [D 20:43:16.215231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 39041. [D 20:43:16.215241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 39042. [D 20:43:16.215252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 39043. [D 20:43:16.215275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 39044. [D 20:43:16.215285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39045. [D 20:43:16.215299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39046. [D 20:43:16.215309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39047. [D 20:43:16.215319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 39048. [D 20:43:16.215348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 39049. [D 20:43:16.215364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 39050. [D 20:43:16.215375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 39051. [D 20:43:16.215385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 39052. [D 20:43:16.215400] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39053. [D 20:43:16.217631] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6235 [D 20:43:16.217652] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 51/70. [D 20:43:16.223355] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.223371] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.223382] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:16.223418] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6238 [D 20:43:16.223429] element 0: offset: 0x61f310, size: 24 [D 20:43:16.223441] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 52/70. [D 20:43:16.224589] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39053. [D 20:43:16.224604] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 53/70. [D 20:43:16.224637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 39053. [D 20:43:16.224649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 39054. [D 20:43:16.224659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 39055. [D 20:43:16.224670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 39056. [D 20:43:16.224680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 39057. [D 20:43:16.224690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 39058. [D 20:43:16.224701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 39059. [D 20:43:16.224711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 39060. [D 20:43:16.224782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 39061. [D 20:43:16.224793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39062. [D 20:43:16.224829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39063. [D 20:43:16.224839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39064. [D 20:43:16.224849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39065. [D 20:43:16.224858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39066. [D 20:43:16.224868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39067. [D 20:43:16.224878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39068. [D 20:43:16.224888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39069. [D 20:43:16.224898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 39070. [D 20:43:16.224908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 39071. [D 20:43:16.224918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 39072. [D 20:43:16.224928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 39073. [D 20:43:16.224938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 39074. [D 20:43:16.224948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 39075. [D 20:43:16.224958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 39076. [D 20:43:16.224968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 39077. [D 20:43:16.224977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 39078. [D 20:43:16.224987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 39079. [D 20:43:16.224997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 39080. [D 20:43:16.225007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 39081. [D 20:43:16.225017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 39082. [D 20:43:16.225027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 39083. [D 20:43:16.225037] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 39084. [D 20:43:16.225080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.225090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.225098] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:16.227125] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6238 [D 20:43:16.227312] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 54/70. [D 20:43:16.236254] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 39084. [D 20:43:16.236270] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 55/70. [D 20:43:16.238533] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.238546] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.238555] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:16.240891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 39084. [D 20:43:16.240906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 39085. [D 20:43:16.240918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 39086. [D 20:43:16.240928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 39087. [D 20:43:16.240938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 39088. [D 20:43:16.240953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 39089. [D 20:43:16.240963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 39090. [D 20:43:16.240973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 39091. [D 20:43:16.240988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 39092. [D 20:43:16.240997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 39093. [D 20:43:16.241008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 39094. [D 20:43:16.241023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 39095. [D 20:43:16.241033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 39096. [D 20:43:16.241042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 39097. [D 20:43:16.241058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 39098. [D 20:43:16.241068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 39099. [D 20:43:16.241092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 39100. [D 20:43:16.241103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 39101. [D 20:43:16.241115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 39102. [D 20:43:16.241130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 39103. [D 20:43:16.241152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 39104. [D 20:43:16.241165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 39105. [D 20:43:16.241175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 39106. [D 20:43:16.241185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 39107. [D 20:43:16.241198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 39108. [D 20:43:16.241208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 39109. [D 20:43:16.241234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 39110. [D 20:43:16.241244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 39111. [D 20:43:16.241254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 39112. [D 20:43:16.241267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 39113. [D 20:43:16.241277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 39114. [D 20:43:16.241297] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 39115. [D 20:43:16.247372] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39115. [D 20:43:16.247386] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 56/70. [D 20:43:16.249546] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.249560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.249569] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:16.255417] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.255431] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.255441] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:16.255457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6241 [D 20:43:16.255467] element 0: offset: 0x631a20, size: 24 [D 20:43:16.255687] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 57/70. [D 20:43:16.255707] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.255719] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.255729] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:16.255744] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6244 [D 20:43:16.255756] element 0: offset: 0x662390, size: 24 [D 20:43:16.255769] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 58/70. [D 20:43:16.258258] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.258272] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.258280] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:16.258294] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6247 [D 20:43:16.258304] element 0: offset: 0x620d50, size: 24 [D 20:43:16.258313] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 59/70. [D 20:43:16.263278] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6241 [D 20:43:16.263328] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 60/70. [D 20:43:16.265650] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6247 [D 20:43:16.265663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 39115. [D 20:43:16.265764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 39116. [D 20:43:16.265775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 39117. [D 20:43:16.265786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 39118. [D 20:43:16.265801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 39119. [D 20:43:16.265811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 39120. [D 20:43:16.265821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 39121. [D 20:43:16.265835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39122. [D 20:43:16.265871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39123. [D 20:43:16.265881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39124. [D 20:43:16.265892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 39125. [D 20:43:16.265902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 39126. [D 20:43:16.265912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 39127. [D 20:43:16.265923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 39128. [D 20:43:16.265950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 39129. [D 20:43:16.265961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39130. [D 20:43:16.265971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39131. [D 20:43:16.265981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39132. [D 20:43:16.266003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 39133. [D 20:43:16.266018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 39134. [D 20:43:16.266028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 39135. [D 20:43:16.266038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 39136. [D 20:43:16.266054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 39137. [D 20:43:16.266064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39138. [D 20:43:16.266089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39139. [D 20:43:16.266099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39140. [D 20:43:16.266110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 39141. [D 20:43:16.266123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 39142. [D 20:43:16.266133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 39143. [D 20:43:16.266143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 39144. [D 20:43:16.266158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 39145. [D 20:43:16.266168] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39146. [D 20:43:16.266220] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 0/70. [D 20:43:16.266250] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6244 [D 20:43:16.266262] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 1/70. [D 20:43:16.270217] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.270236] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.270245] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:16.270281] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6250 [D 20:43:16.270295] element 0: offset: 0x625390, size: 24 [D 20:43:16.270308] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 2/70. [D 20:43:16.275254] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39146. [D 20:43:16.275270] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 3/70. [D 20:43:16.275283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 39146. [D 20:43:16.275294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 39147. [D 20:43:16.275304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 39148. [D 20:43:16.275314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 39149. [D 20:43:16.275325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 39150. [D 20:43:16.275335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 39151. [D 20:43:16.275352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 39152. [D 20:43:16.275362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 39153. [D 20:43:16.275372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 39154. [D 20:43:16.275397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 39155. [D 20:43:16.275408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 39156. [D 20:43:16.275420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 39157. [D 20:43:16.275434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 39158. [D 20:43:16.275444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 39159. [D 20:43:16.275454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 39160. [D 20:43:16.275484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 39161. [D 20:43:16.275497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 39162. [D 20:43:16.275510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 39163. [D 20:43:16.275520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 39164. [D 20:43:16.275530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 39165. [D 20:43:16.275543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 39166. [D 20:43:16.275563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 39167. [D 20:43:16.275573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 39168. [D 20:43:16.275588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 39169. [D 20:43:16.275598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 39170. [D 20:43:16.275608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 39171. [D 20:43:16.275624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 39172. [D 20:43:16.275648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 39173. [D 20:43:16.275662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 39174. [D 20:43:16.275672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 39175. [D 20:43:16.275687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 39176. [D 20:43:16.275698] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 39177. [D 20:43:16.275720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 39178. [D 20:43:16.275732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 39179. [D 20:43:16.275743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 39180. [D 20:43:16.275753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 39181. [D 20:43:16.275763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 39182. [D 20:43:16.275773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 39183. [D 20:43:16.275793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 39184. [D 20:43:16.275803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 39185. [D 20:43:16.275813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 39186. [D 20:43:16.275823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39187. [D 20:43:16.275833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39188. [D 20:43:16.275863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39189. [D 20:43:16.275874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39190. [D 20:43:16.275887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39191. [D 20:43:16.275897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39192. [D 20:43:16.275910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39193. [D 20:43:16.275924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39194. [D 20:43:16.275948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 39195. [D 20:43:16.275960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 39196. [D 20:43:16.275970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 39197. [D 20:43:16.275983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 39198. [D 20:43:16.275997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 39199. [D 20:43:16.276007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 39200. [D 20:43:16.276030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 39201. [D 20:43:16.276040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 39202. [D 20:43:16.276050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 39203. [D 20:43:16.276077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 39204. [D 20:43:16.276087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 39205. [D 20:43:16.276100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 39206. [D 20:43:16.276110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 39207. [D 20:43:16.276121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 39208. [D 20:43:16.276133] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 39209. [D 20:43:16.276189] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.276202] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.276212] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:16.280811] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6250 [D 20:43:16.280868] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 4/70. [D 20:43:16.281259] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 39209. [D 20:43:16.281277] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 5/70. [D 20:43:16.285962] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.285975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.285986] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:16.286001] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6252 [D 20:43:16.286011] element 0: offset: 0x63fd30, size: 24 [D 20:43:16.286021] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 6/70. [D 20:43:16.287092] openib_check_cq: completed rdma wr_id 2aaaab23ce20, nic_wr_credit 39208. [D 20:43:16.287106] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 7/70. [D 20:43:16.287118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 39208. [D 20:43:16.287129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 39209. [D 20:43:16.287139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 39210. [D 20:43:16.287151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 39211. [D 20:43:16.287160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 39212. [D 20:43:16.287171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 39213. [D 20:43:16.287181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 39214. [D 20:43:16.287191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 39215. [D 20:43:16.287201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 39216. [D 20:43:16.287219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 39217. [D 20:43:16.287229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 39218. [D 20:43:16.287239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 39219. [D 20:43:16.287263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 39220. [D 20:43:16.287274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 39221. [D 20:43:16.287284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 39222. [D 20:43:16.287294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 39223. [D 20:43:16.287304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 39224. [D 20:43:16.287319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 39225. [D 20:43:16.287329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 39226. [D 20:43:16.287339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 39227. [D 20:43:16.287350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 39228. [D 20:43:16.287359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 39229. [D 20:43:16.287370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 39230. [D 20:43:16.287380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 39231. [D 20:43:16.287390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 39232. [D 20:43:16.287400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 39233. [D 20:43:16.287426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 39234. [D 20:43:16.287436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 39235. [D 20:43:16.287450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 39236. [D 20:43:16.287473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 39237. [D 20:43:16.287483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 39238. [D 20:43:16.287493] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 39239. [D 20:43:16.287522] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.287532] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.287545] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:16.289719] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.289732] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.289742] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:16.291863] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6252 [D 20:43:16.291883] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 8/70. [D 20:43:16.293012] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39239. [D 20:43:16.293071] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 9/70. [D 20:43:16.293088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 39239. [D 20:43:16.293100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 39240. [D 20:43:16.293111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 39241. [D 20:43:16.293127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 39242. [D 20:43:16.293138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 39243. [D 20:43:16.293148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 39244. [D 20:43:16.293158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 39245. [D 20:43:16.293168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39246. [D 20:43:16.293178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39247. [D 20:43:16.293188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39248. [D 20:43:16.293198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 39249. [D 20:43:16.293217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 39250. [D 20:43:16.293227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 39251. [D 20:43:16.293236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 39252. [D 20:43:16.293271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 39253. [D 20:43:16.293281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39254. [D 20:43:16.293291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39255. [D 20:43:16.293302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39256. [D 20:43:16.293312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 39257. [D 20:43:16.293322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 39258. [D 20:43:16.293332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 39259. [D 20:43:16.293353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 39260. [D 20:43:16.293364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 39261. [D 20:43:16.293375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39262. [D 20:43:16.293385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39263. [D 20:43:16.293397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39264. [D 20:43:16.293414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 39265. [D 20:43:16.293438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 39266. [D 20:43:16.293449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 39267. [D 20:43:16.293459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 39268. [D 20:43:16.293469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 39269. [D 20:43:16.293479] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39270. [D 20:43:16.293549] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.293564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.293574] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:16.299022] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 39270. [D 20:43:16.299036] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 10/70. [D 20:43:16.301154] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.301167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.301177] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:16.549971] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.549987] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.549998] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:16.550030] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6256 [D 20:43:16.550041] element 0: offset: 0x61f310, size: 24 [D 20:43:16.550053] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 11/70. [D 20:43:16.552373] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6256 [D 20:43:16.552426] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 12/70. [D 20:43:16.553533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 39270. [D 20:43:16.553551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 39271. [D 20:43:16.553563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 39272. [D 20:43:16.553573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 39273. [D 20:43:16.553588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 39274. [D 20:43:16.553599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 39275. [D 20:43:16.553609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 39276. [D 20:43:16.553619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 39277. [D 20:43:16.553630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 39278. [D 20:43:16.553639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39279. [D 20:43:16.553649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39280. [D 20:43:16.553667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39281. [D 20:43:16.553677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39282. [D 20:43:16.553687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39283. [D 20:43:16.553697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39284. [D 20:43:16.553707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39285. [D 20:43:16.553717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39286. [D 20:43:16.553732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 39287. [D 20:43:16.553742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 39288. [D 20:43:16.553752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 39289. [D 20:43:16.553763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 39290. [D 20:43:16.553810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 39291. [D 20:43:16.553822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 39292. [D 20:43:16.553831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 39293. [D 20:43:16.553841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 39294. [D 20:43:16.553855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 39295. [D 20:43:16.553865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 39296. [D 20:43:16.553875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 39297. [D 20:43:16.553890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 39298. [D 20:43:16.553900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 39299. [D 20:43:16.553910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 39300. [D 20:43:16.553920] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 39301. [D 20:43:16.553970] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.553981] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.553989] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:16.554007] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6259 [D 20:43:16.554017] element 0: offset: 0x631a20, size: 24 [D 20:43:16.554030] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 13/70. [D 20:43:16.556313] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.556327] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.556337] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:16.556352] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6262 [D 20:43:16.556362] element 0: offset: 0x62d750, size: 24 [D 20:43:16.556372] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 14/70. [D 20:43:16.565070] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39301. [D 20:43:16.565084] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 15/70. [D 20:43:16.567452] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.567466] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.567475] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:16.570208] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6262 [D 20:43:16.570262] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 16/70. [D 20:43:16.570301] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6259 [D 20:43:16.570313] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 17/70. [D 20:43:16.570844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 39301. [D 20:43:16.570887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 39302. [D 20:43:16.570898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 39303. [D 20:43:16.570909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 39304. [D 20:43:16.570919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 39305. [D 20:43:16.570930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 39306. [D 20:43:16.570940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 39307. [D 20:43:16.570950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 39308. [D 20:43:16.570960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 39309. [D 20:43:16.570970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 39310. [D 20:43:16.570980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 39311. [D 20:43:16.571021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 39312. [D 20:43:16.571032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 39313. [D 20:43:16.571045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 39314. [D 20:43:16.571055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 39315. [D 20:43:16.571065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 39316. [D 20:43:16.571099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 39317. [D 20:43:16.571111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 39318. [D 20:43:16.571122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 39319. [D 20:43:16.571132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 39320. [D 20:43:16.571142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 39321. [D 20:43:16.571157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 39322. [D 20:43:16.571167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 39323. [D 20:43:16.571177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 39324. [D 20:43:16.571193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 39325. [D 20:43:16.571203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 39326. [D 20:43:16.571213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 39327. [D 20:43:16.571239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 39328. [D 20:43:16.571249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 39329. [D 20:43:16.571264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 39330. [D 20:43:16.571274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 39331. [D 20:43:16.571284] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 39332. [D 20:43:16.571301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 39333. [D 20:43:16.571311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 39334. [D 20:43:16.571321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 39335. [D 20:43:16.571350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 39336. [D 20:43:16.571365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 39337. [D 20:43:16.571375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 39338. [D 20:43:16.571391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 39339. [D 20:43:16.571402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 39340. [D 20:43:16.571412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 39341. [D 20:43:16.571422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 39342. [D 20:43:16.571432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 39343. [D 20:43:16.571451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 39344. [D 20:43:16.571461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 39345. [D 20:43:16.571476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 39346. [D 20:43:16.571486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 39347. [D 20:43:16.571518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 39348. [D 20:43:16.571529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 39349. [D 20:43:16.571539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 39350. [D 20:43:16.571553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 39351. [D 20:43:16.571563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 39352. [D 20:43:16.571573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 39353. [D 20:43:16.571588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 39354. [D 20:43:16.571598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 39355. [D 20:43:16.571608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 39356. [D 20:43:16.571623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 39357. [D 20:43:16.571633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 39358. [D 20:43:16.571643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 39359. [D 20:43:16.571677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 39360. [D 20:43:16.571687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 39361. [D 20:43:16.571697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 39362. [D 20:43:16.571711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 39363. [D 20:43:16.571721] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 39364. [D 20:43:16.577000] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 39364. [D 20:43:16.577016] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 18/70. [D 20:43:16.579411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.579426] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.579436] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:16.579474] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6264 [D 20:43:16.579489] element 0: offset: 0x625390, size: 24 [D 20:43:16.579502] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 19/70. [D 20:43:16.581926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.581939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.581948] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:16.581964] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6268 [D 20:43:16.581977] element 0: offset: 0x620d50, size: 24 [D 20:43:16.581987] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 20/70. [D 20:43:16.588635] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39363. [D 20:43:16.588650] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 21/70. [D 20:43:16.590966] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.590979] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.590989] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:16.591067] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.591079] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.591088] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:16.593873] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6268 [D 20:43:16.593922] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 22/70. [D 20:43:16.594060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 39363. [D 20:43:16.594075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 39364. [D 20:43:16.594086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 39365. [D 20:43:16.594096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 39366. [D 20:43:16.594106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 39367. [D 20:43:16.594116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 39368. [D 20:43:16.594126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 39369. [D 20:43:16.594136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 39370. [D 20:43:16.594146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 39371. [D 20:43:16.594157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39372. [D 20:43:16.594167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39373. [D 20:43:16.594177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39374. [D 20:43:16.594187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39375. [D 20:43:16.594197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39376. [D 20:43:16.594207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39377. [D 20:43:16.594218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39378. [D 20:43:16.594261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39379. [D 20:43:16.594271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 39380. [D 20:43:16.594281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 39381. [D 20:43:16.594290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 39382. [D 20:43:16.594300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 39383. [D 20:43:16.594310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 39384. [D 20:43:16.594320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 39385. [D 20:43:16.594330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 39386. [D 20:43:16.594339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 39387. [D 20:43:16.594350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 39388. [D 20:43:16.594359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 39389. [D 20:43:16.594371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 39390. [D 20:43:16.594381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 39391. [D 20:43:16.594391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 39392. [D 20:43:16.594401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 39393. [D 20:43:16.594429] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cd70 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 39394. [D 20:43:16.596668] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6264 [D 20:43:16.596686] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 23/70. [D 20:43:16.600200] openib_check_cq: completed rdma wr_id 2aaaab23cd70, nic_wr_credit 39394. [D 20:43:16.600216] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 24/70. [D 20:43:16.600339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 39394. [D 20:43:16.600366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 39395. [D 20:43:16.600377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 39396. [D 20:43:16.600387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 39397. [D 20:43:16.600421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.600441] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.600450] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:16.600470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 39398. [D 20:43:16.600481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 39399. [D 20:43:16.600492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 39400. [D 20:43:16.600502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39401. [D 20:43:16.600525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39402. [D 20:43:16.600535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39403. [D 20:43:16.600551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 39404. [D 20:43:16.600561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 39405. [D 20:43:16.600571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 39406. [D 20:43:16.600607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 39407. [D 20:43:16.600618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 39408. [D 20:43:16.600628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39409. [D 20:43:16.600638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39410. [D 20:43:16.600648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39411. [D 20:43:16.600658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 39412. [D 20:43:16.600683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 39413. [D 20:43:16.600693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 39414. [D 20:43:16.600703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 39415. [D 20:43:16.600713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 39416. [D 20:43:16.600723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39417. [D 20:43:16.600734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39418. [D 20:43:16.600743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39419. [D 20:43:16.600753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 39420. [D 20:43:16.600778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 39421. [D 20:43:16.600788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 39422. [D 20:43:16.600798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 39423. [D 20:43:16.600812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 39424. [D 20:43:16.600822] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39425. [D 20:43:16.606252] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39425. [D 20:43:16.606266] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 25/70. [D 20:43:16.608402] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.608416] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.608426] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:16.611110] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.611124] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.611133] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:16.611164] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6272 [D 20:43:16.611174] element 0: offset: 0x5b0030, size: 24 [D 20:43:16.611185] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 26/70. [D 20:43:16.611204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.611217] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.611225] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:16.611239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6274 [D 20:43:16.611250] element 0: offset: 0x6a6610, size: 24 [D 20:43:16.611260] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 27/70. [D 20:43:16.615830] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6274 [D 20:43:16.615848] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 28/70. [D 20:43:16.615908] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6272 [D 20:43:16.615920] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 29/70. [D 20:43:16.615981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 39425. [D 20:43:16.615993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 39426. [D 20:43:16.616003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 39427. [D 20:43:16.616013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 39428. [D 20:43:16.616023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 39429. [D 20:43:16.616038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 39430. [D 20:43:16.616050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 39431. [D 20:43:16.616060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 39432. [D 20:43:16.616070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 39433. [D 20:43:16.616080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 39434. [D 20:43:16.616090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 39435. [D 20:43:16.616103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 39436. [D 20:43:16.616127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 39437. [D 20:43:16.616138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 39438. [D 20:43:16.616148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 39439. [D 20:43:16.616158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 39440. [D 20:43:16.616168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 39441. [D 20:43:16.616185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 39442. [D 20:43:16.616195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 39443. [D 20:43:16.616205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 39444. [D 20:43:16.616215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 39445. [D 20:43:16.616238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 39446. [D 20:43:16.616249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 39447. [D 20:43:16.616259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 39448. [D 20:43:16.616269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 39449. [D 20:43:16.616283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 39450. [D 20:43:16.616307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 39451. [D 20:43:16.616317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 39452. [D 20:43:16.616330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 39453. [D 20:43:16.616340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 39454. [D 20:43:16.616350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 39455. [D 20:43:16.616372] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 39456. [D 20:43:16.616384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 39457. [D 20:43:16.616394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 39458. [D 20:43:16.616405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 39459. [D 20:43:16.616414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 39460. [D 20:43:16.616424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 39461. [D 20:43:16.616455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 39462. [D 20:43:16.616465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 39463. [D 20:43:16.616478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 39464. [D 20:43:16.616488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 39465. [D 20:43:16.616509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 39466. [D 20:43:16.616519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 39467. [D 20:43:16.616529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 39468. [D 20:43:16.616544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 39469. [D 20:43:16.616554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 39470. [D 20:43:16.616563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 39471. [D 20:43:16.616592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 39472. [D 20:43:16.616607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 39473. [D 20:43:16.616618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 39474. [D 20:43:16.616627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 39475. [D 20:43:16.616655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 39476. [D 20:43:16.616666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 39477. [D 20:43:16.616680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 39478. [D 20:43:16.616690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 39479. [D 20:43:16.616704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 39480. [D 20:43:16.616730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 39481. [D 20:43:16.616740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 39482. [D 20:43:16.616754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 39483. [D 20:43:16.616764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 39484. [D 20:43:16.616784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 39485. [D 20:43:16.616795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 39486. [D 20:43:16.616805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 39487. [D 20:43:16.616815] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 39488. [D 20:43:16.623857] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39488. [D 20:43:16.623871] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 30/70. [D 20:43:16.629737] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 39487. [D 20:43:16.629750] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 31/70. [D 20:43:16.632029] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.632042] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.632053] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:16.632066] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.632076] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.632084] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:16.636188] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.636202] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.636211] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:16.636225] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6277 [D 20:43:16.636235] element 0: offset: 0x662390, size: 24 [D 20:43:16.636245] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 32/70. [D 20:43:16.636260] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.636270] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.636279] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:16.636292] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6280 [D 20:43:16.636303] element 0: offset: 0x62d750, size: 24 [D 20:43:16.636329] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 33/70. [D 20:43:16.641427] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6280 [D 20:43:16.641499] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 34/70. [D 20:43:16.641642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 39487. [D 20:43:16.641656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 39488. [D 20:43:16.641667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 39489. [D 20:43:16.641677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 39490. [D 20:43:16.641687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 39491. [D 20:43:16.641697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 39492. [D 20:43:16.641707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 39493. [D 20:43:16.641717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 39494. [D 20:43:16.641727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 39495. [D 20:43:16.641737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39496. [D 20:43:16.641746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39497. [D 20:43:16.641757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39498. [D 20:43:16.641767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39499. [D 20:43:16.641777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39500. [D 20:43:16.641787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39501. [D 20:43:16.641797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39502. [D 20:43:16.641807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39503. [D 20:43:16.641817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 39504. [D 20:43:16.641827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 39505. [D 20:43:16.641837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 39506. [D 20:43:16.641880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 39507. [D 20:43:16.641889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 39508. [D 20:43:16.641899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 39509. [D 20:43:16.641909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 39510. [D 20:43:16.641919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 39511. [D 20:43:16.641929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 39512. [D 20:43:16.641939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 39513. [D 20:43:16.641948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 39514. [D 20:43:16.641958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 39515. [D 20:43:16.641968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 39516. [D 20:43:16.641978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 39517. [D 20:43:16.641995] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 39518. [D 20:43:16.644311] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6277 [D 20:43:16.644327] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 35/70. [D 20:43:16.648677] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39518. [D 20:43:16.648693] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 36/70. [D 20:43:16.651020] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.651034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.651044] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:16.655317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 39518. [D 20:43:16.655333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 39519. [D 20:43:16.655344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 39520. [D 20:43:16.655354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 39521. [D 20:43:16.655364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 39522. [D 20:43:16.655378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 39523. [D 20:43:16.655388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 39524. [D 20:43:16.655397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39525. [D 20:43:16.655412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39526. [D 20:43:16.655422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39527. [D 20:43:16.655432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 39528. [D 20:43:16.655443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 39529. [D 20:43:16.655458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 39530. [D 20:43:16.655468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 39531. [D 20:43:16.655478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 39532. [D 20:43:16.655504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39533. [D 20:43:16.655516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39534. [D 20:43:16.655526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39535. [D 20:43:16.655536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 39536. [D 20:43:16.655546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 39537. [D 20:43:16.655557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 39538. [D 20:43:16.655567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 39539. [D 20:43:16.655586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 39540. [D 20:43:16.655596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39541. [D 20:43:16.655606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39542. [D 20:43:16.655616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39543. [D 20:43:16.655626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 39544. [D 20:43:16.655636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 39545. [D 20:43:16.655646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 39546. [D 20:43:16.655656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 39547. [D 20:43:16.655680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 39548. [D 20:43:16.655691] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39549. [D 20:43:16.660412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.660427] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.660436] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:16.660468] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6284 [D 20:43:16.660479] element 0: offset: 0x691fe0, size: 24 [D 20:43:16.660491] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 37/70. [D 20:43:16.660513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:16.660525] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.660533] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:16.660547] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6286 [D 20:43:16.660558] element 0: offset: 0x5b0030, size: 24 [D 20:43:16.660568] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 38/70. [D 20:43:16.666984] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 39549. [D 20:43:16.666998] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 39/70. [D 20:43:16.669411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.669424] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.669433] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:16.671904] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6286 [D 20:43:16.671954] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 40/70. [D 20:43:16.672032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 39549. [D 20:43:16.672048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 39550. [D 20:43:16.672058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 39551. [D 20:43:16.672068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 39552. [D 20:43:16.672078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 39553. [D 20:43:16.672088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 39554. [D 20:43:16.672098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 39555. [D 20:43:16.672108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 39556. [D 20:43:16.672118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 39557. [D 20:43:16.672141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 39558. [D 20:43:16.672151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 39559. [D 20:43:16.672161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 39560. [D 20:43:16.672171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 39561. [D 20:43:16.672182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 39562. [D 20:43:16.672191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 39563. [D 20:43:16.672201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 39564. [D 20:43:16.672211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 39565. [D 20:43:16.672222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 39566. [D 20:43:16.672232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 39567. [D 20:43:16.672242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 39568. [D 20:43:16.672252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 39569. [D 20:43:16.672262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 39570. [D 20:43:16.672272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 39571. [D 20:43:16.672304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 39572. [D 20:43:16.672314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 39573. [D 20:43:16.672323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 39574. [D 20:43:16.672369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 39575. [D 20:43:16.672379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 39576. [D 20:43:16.672393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 39577. [D 20:43:16.672403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 39578. [D 20:43:16.672413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 39579. [D 20:43:16.672428] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 39580. [D 20:43:16.674625] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6284 [D 20:43:16.674641] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 41/70. [D 20:43:16.677992] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39580. [D 20:43:16.678007] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 42/70. [D 20:43:16.678019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 39580. [D 20:43:16.678029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 39581. [D 20:43:16.678039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 39582. [D 20:43:16.678050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 39583. [D 20:43:16.678060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 39584. [D 20:43:16.678071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 39585. [D 20:43:16.678080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 39586. [D 20:43:16.678090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 39587. [D 20:43:16.678100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 39588. [D 20:43:16.678131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 39589. [D 20:43:16.678141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 39590. [D 20:43:16.678154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 39591. [D 20:43:16.678164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 39592. [D 20:43:16.678174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 39593. [D 20:43:16.678188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 39594. [D 20:43:16.678198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 39595. [D 20:43:16.678228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 39596. [D 20:43:16.678238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 39597. [D 20:43:16.678248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 39598. [D 20:43:16.678277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 39599. [D 20:43:16.678287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 39600. [D 20:43:16.678297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 39601. [D 20:43:16.678307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 39602. [D 20:43:16.678318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 39603. [D 20:43:16.678343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 39604. [D 20:43:16.678359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 39605. [D 20:43:16.678369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 39606. [D 20:43:16.678379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 39607. [D 20:43:16.678395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 39608. [D 20:43:16.678404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 39609. [D 20:43:16.678414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 39610. [D 20:43:16.678447] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 39611. [D 20:43:16.680780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.680795] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.680807] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:16.683937] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 39611. [D 20:43:16.683951] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 43/70. [D 20:43:16.686209] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:16.686222] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:16.686231] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:17.031409] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.031425] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.031436] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:17.031467] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6290 [D 20:43:17.031478] element 0: offset: 0x625390, size: 24 [D 20:43:17.031491] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 44/70. [D 20:43:17.033803] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.033817] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.033826] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.033841] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6292 [D 20:43:17.033851] element 0: offset: 0x61f310, size: 24 [D 20:43:17.033861] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 45/70. [D 20:43:17.035909] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6290 [D 20:43:17.035960] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 46/70. [D 20:43:17.036044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 39611. [D 20:43:17.036097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 39612. [D 20:43:17.036131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 39613. [D 20:43:17.036142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 39614. [D 20:43:17.036152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 39615. [D 20:43:17.036161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 39616. [D 20:43:17.036172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39617. [D 20:43:17.036181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39618. [D 20:43:17.036191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39619. [D 20:43:17.036201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 39620. [D 20:43:17.036211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 39621. [D 20:43:17.036221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 39622. [D 20:43:17.036231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 39623. [D 20:43:17.036241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 39624. [D 20:43:17.036251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39625. [D 20:43:17.036261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39626. [D 20:43:17.036271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39627. [D 20:43:17.036281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 39628. [D 20:43:17.036291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 39629. [D 20:43:17.036301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 39630. [D 20:43:17.036311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 39631. [D 20:43:17.036320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 39632. [D 20:43:17.036330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39633. [D 20:43:17.036340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39634. [D 20:43:17.036350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39635. [D 20:43:17.036360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 39636. [D 20:43:17.036370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 39637. [D 20:43:17.036380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 39638. [D 20:43:17.036390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 39639. [D 20:43:17.036400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 39640. [D 20:43:17.036411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39641. [D 20:43:17.036421] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39642. [D 20:43:17.038320] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6292 [D 20:43:17.038372] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 47/70. [D 20:43:17.047726] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39642. [D 20:43:17.047746] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 48/70. [D 20:43:17.047775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 39642. [D 20:43:17.047787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 39643. [D 20:43:17.047797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 39644. [D 20:43:17.047808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 39645. [D 20:43:17.047819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 39646. [D 20:43:17.047829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 39647. [D 20:43:17.047839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 39648. [D 20:43:17.047863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 39649. [D 20:43:17.047885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 39650. [D 20:43:17.047895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39651. [D 20:43:17.047905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39652. [D 20:43:17.047928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39653. [D 20:43:17.047938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39654. [D 20:43:17.047948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39655. [D 20:43:17.047970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39656. [D 20:43:17.047981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39657. [D 20:43:17.047991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39658. [D 20:43:17.048001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 39659. [D 20:43:17.048012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 39660. [D 20:43:17.048022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 39661. [D 20:43:17.048033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 39662. [D 20:43:17.048048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 39663. [D 20:43:17.048058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 39664. [D 20:43:17.048068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 39665. [D 20:43:17.048079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 39666. [D 20:43:17.048090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 39667. [D 20:43:17.048099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 39668. [D 20:43:17.048114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 39669. [D 20:43:17.048146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 39670. [D 20:43:17.048157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 39671. [D 20:43:17.048168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 39672. [D 20:43:17.048178] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 39673. [D 20:43:17.048223] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.048236] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.048244] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.059459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.059473] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.059484] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.059515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6295 [D 20:43:17.059526] element 0: offset: 0x6a6610, size: 24 [D 20:43:17.059537] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 49/70. [D 20:43:17.059560] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 39673. [D 20:43:17.059573] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 50/70. [D 20:43:17.061690] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.061747] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.061756] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.063521] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6295 [D 20:43:17.063542] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 51/70. [D 20:43:17.066251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 39673. [D 20:43:17.066273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 39674. [D 20:43:17.066284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 39675. [D 20:43:17.066295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 39676. [D 20:43:17.066305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 39677. [D 20:43:17.066316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 39678. [D 20:43:17.066326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39679. [D 20:43:17.066336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39680. [D 20:43:17.066346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39681. [D 20:43:17.066356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 39682. [D 20:43:17.066366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 39683. [D 20:43:17.066383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 39684. [D 20:43:17.066408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 39685. [D 20:43:17.066433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 39686. [D 20:43:17.066444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39687. [D 20:43:17.066455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39688. [D 20:43:17.066465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39689. [D 20:43:17.066475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 39690. [D 20:43:17.066486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 39691. [D 20:43:17.066511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 39692. [D 20:43:17.066526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 39693. [D 20:43:17.066548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 39694. [D 20:43:17.066562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39695. [D 20:43:17.066572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39696. [D 20:43:17.066595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39697. [D 20:43:17.066614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 39698. [D 20:43:17.066626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 39699. [D 20:43:17.066636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 39700. [D 20:43:17.066649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 39701. [D 20:43:17.066663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 39702. [D 20:43:17.066687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39703. [D 20:43:17.066702] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39704. [D 20:43:17.071208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.071223] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.071233] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.071265] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6298 [D 20:43:17.071276] element 0: offset: 0x5b0030, size: 24 [D 20:43:17.071289] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 52/70. [D 20:43:17.077955] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39704. [D 20:43:17.077970] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 53/70. [D 20:43:17.080312] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.080326] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.080335] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.082535] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6298 [D 20:43:17.082588] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 54/70. [D 20:43:17.084287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 39704. [D 20:43:17.084304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 39705. [D 20:43:17.084315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 39706. [D 20:43:17.084325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 39707. [D 20:43:17.084335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 39708. [D 20:43:17.084350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 39709. [D 20:43:17.084360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 39710. [D 20:43:17.084370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 39711. [D 20:43:17.084380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 39712. [D 20:43:17.084398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39713. [D 20:43:17.084408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39714. [D 20:43:17.084418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39715. [D 20:43:17.084441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39716. [D 20:43:17.084451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39717. [D 20:43:17.084460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39718. [D 20:43:17.084475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39719. [D 20:43:17.084498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39720. [D 20:43:17.084511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 39721. [D 20:43:17.084521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 39722. [D 20:43:17.084534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 39723. [D 20:43:17.084550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 39724. [D 20:43:17.084572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 39725. [D 20:43:17.084585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 39726. [D 20:43:17.084595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 39727. [D 20:43:17.084605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 39728. [D 20:43:17.084629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 39729. [D 20:43:17.084639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 39730. [D 20:43:17.084659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 39731. [D 20:43:17.084679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 39732. [D 20:43:17.084689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 39733. [D 20:43:17.084710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 39734. [D 20:43:17.084721] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 39735. [D 20:43:17.089280] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.089294] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.089305] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.089320] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6301 [D 20:43:17.089331] element 0: offset: 0x620d50, size: 24 [D 20:43:17.089341] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 55/70. [D 20:43:17.096015] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39735. [D 20:43:17.096029] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 56/70. [D 20:43:17.098324] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.098338] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.098347] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.100346] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6301 [D 20:43:17.100365] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 57/70. [D 20:43:17.102567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 39735. [D 20:43:17.102620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 39736. [D 20:43:17.102632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 39737. [D 20:43:17.102642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 39738. [D 20:43:17.102657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 39739. [D 20:43:17.102667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 39740. [D 20:43:17.102676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 39741. [D 20:43:17.102691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 39742. [D 20:43:17.102701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 39743. [D 20:43:17.102710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 39744. [D 20:43:17.102726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 39745. [D 20:43:17.102748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 39746. [D 20:43:17.102758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 39747. [D 20:43:17.102784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 39748. [D 20:43:17.102794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 39749. [D 20:43:17.102807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 39750. [D 20:43:17.102817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 39751. [D 20:43:17.102827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 39752. [D 20:43:17.102853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 39753. [D 20:43:17.102863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 39754. [D 20:43:17.102875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 39755. [D 20:43:17.102885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 39756. [D 20:43:17.102908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 39757. [D 20:43:17.102934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 39758. [D 20:43:17.102945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 39759. [D 20:43:17.102955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 39760. [D 20:43:17.102971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 39761. [D 20:43:17.102981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 39762. [D 20:43:17.102990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 39763. [D 20:43:17.103015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 39764. [D 20:43:17.103025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 39765. [D 20:43:17.103035] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 39766. [D 20:43:17.107512] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.107528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.107539] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.107573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6304 [D 20:43:17.107584] element 0: offset: 0x61f310, size: 24 [D 20:43:17.107600] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 58/70. [D 20:43:17.114284] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39766. [D 20:43:17.114300] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 59/70. [D 20:43:17.116658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.116672] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.116681] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.118763] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6304 [D 20:43:17.118819] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 60/70. [D 20:43:17.123886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 39766. [D 20:43:17.123903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 39767. [D 20:43:17.123916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 39768. [D 20:43:17.123926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 39769. [D 20:43:17.123936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 39770. [D 20:43:17.123950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 39771. [D 20:43:17.123960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 39772. [D 20:43:17.123970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 39773. [D 20:43:17.123987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 39774. [D 20:43:17.123997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39775. [D 20:43:17.124007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39776. [D 20:43:17.124023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39777. [D 20:43:17.124044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39778. [D 20:43:17.124054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39779. [D 20:43:17.124069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39780. [D 20:43:17.124079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39781. [D 20:43:17.124089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39782. [D 20:43:17.124099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 39783. [D 20:43:17.124117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 39784. [D 20:43:17.124127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 39785. [D 20:43:17.124153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 39786. [D 20:43:17.124164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 39787. [D 20:43:17.124174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 39788. [D 20:43:17.124189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 39789. [D 20:43:17.124199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 39790. [D 20:43:17.124209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 39791. [D 20:43:17.124224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 39792. [D 20:43:17.124234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 39793. [D 20:43:17.124244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 39794. [D 20:43:17.124259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 39795. [D 20:43:17.124286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 39796. [D 20:43:17.124296] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 39797. [D 20:43:17.129520] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.129534] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.129545] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.129560] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6306 [D 20:43:17.129570] element 0: offset: 0x6a6610, size: 24 [D 20:43:17.129581] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 0/70. [D 20:43:17.135581] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39797. [D 20:43:17.135595] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 1/70. [D 20:43:17.137890] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.137904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.137913] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.139929] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6306 [D 20:43:17.139947] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 2/70. [D 20:43:17.142095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 39797. [D 20:43:17.142147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 39798. [D 20:43:17.142158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 39799. [D 20:43:17.142169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 39800. [D 20:43:17.142183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 39801. [D 20:43:17.142193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 39802. [D 20:43:17.142203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 39803. [D 20:43:17.142214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39804. [D 20:43:17.142224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39805. [D 20:43:17.142234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39806. [D 20:43:17.142244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 39807. [D 20:43:17.142255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 39808. [D 20:43:17.142287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 39809. [D 20:43:17.142298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 39810. [D 20:43:17.142308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 39811. [D 20:43:17.142318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39812. [D 20:43:17.142328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39813. [D 20:43:17.142339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39814. [D 20:43:17.142349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 39815. [D 20:43:17.142376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 39816. [D 20:43:17.142387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 39817. [D 20:43:17.142397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 39818. [D 20:43:17.142411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 39819. [D 20:43:17.142430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39820. [D 20:43:17.142441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39821. [D 20:43:17.142452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39822. [D 20:43:17.142462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 39823. [D 20:43:17.142472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 39824. [D 20:43:17.142482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 39825. [D 20:43:17.142492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 39826. [D 20:43:17.142502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 39827. [D 20:43:17.142537] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39828. [D 20:43:17.143504] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.143519] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.143528] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.143563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6310 [D 20:43:17.143574] element 0: offset: 0x5b0030, size: 24 [D 20:43:17.147177] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 3/70. [D 20:43:17.147208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.147218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.147228] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:17.147244] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6313 [D 20:43:17.147256] element 0: offset: 0x62d750, size: 24 [D 20:43:17.147266] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 4/70. [D 20:43:17.153769] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39828. [D 20:43:17.153785] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 5/70. [D 20:43:17.156129] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.156144] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.156152] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:17.158928] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6313 [D 20:43:17.158982] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 6/70. [D 20:43:17.159035] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6310 [D 20:43:17.159048] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 7/70. [D 20:43:17.159768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 39828. [D 20:43:17.159811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 39829. [D 20:43:17.159823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 39830. [D 20:43:17.159834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 39831. [D 20:43:17.159844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 39832. [D 20:43:17.159854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 39833. [D 20:43:17.159864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 39834. [D 20:43:17.159873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 39835. [D 20:43:17.159889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 39836. [D 20:43:17.159899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39837. [D 20:43:17.159909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39838. [D 20:43:17.159919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39839. [D 20:43:17.159930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39840. [D 20:43:17.159940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39841. [D 20:43:17.159994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39842. [D 20:43:17.160018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39843. [D 20:43:17.160029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39844. [D 20:43:17.160038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 39845. [D 20:43:17.160048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 39846. [D 20:43:17.160065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 39847. [D 20:43:17.160075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 39848. [D 20:43:17.160085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 39849. [D 20:43:17.160095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 39850. [D 20:43:17.160105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 39851. [D 20:43:17.160116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 39852. [D 20:43:17.160125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 39853. [D 20:43:17.160136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 39854. [D 20:43:17.160146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 39855. [D 20:43:17.160156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 39856. [D 20:43:17.160202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 39857. [D 20:43:17.160215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 39858. [D 20:43:17.160226] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 39859. [D 20:43:17.160239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 39860. [D 20:43:17.160254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 39861. [D 20:43:17.160264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 39862. [D 20:43:17.160274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 39863. [D 20:43:17.160288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 39864. [D 20:43:17.160315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 39865. [D 20:43:17.160338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 39866. [D 20:43:17.160348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 39867. [D 20:43:17.160361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 39868. [D 20:43:17.160371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 39869. [D 20:43:17.160381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 39870. [D 20:43:17.160394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 39871. [D 20:43:17.160421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 39872. [D 20:43:17.160434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 39873. [D 20:43:17.160444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 39874. [D 20:43:17.160454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 39875. [D 20:43:17.160476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 39876. [D 20:43:17.160486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 39877. [D 20:43:17.160501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 39878. [D 20:43:17.160512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 39879. [D 20:43:17.160522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 39880. [D 20:43:17.160546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 39881. [D 20:43:17.160556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 39882. [D 20:43:17.160566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 39883. [D 20:43:17.160580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 39884. [D 20:43:17.160589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 39885. [D 20:43:17.160599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 39886. [D 20:43:17.160615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 39887. [D 20:43:17.160638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 39888. [D 20:43:17.160650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 39889. [D 20:43:17.160660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 39890. [D 20:43:17.160670] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 39891. [D 20:43:17.164737] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.164752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.164762] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:17.164797] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6315 [D 20:43:17.164808] element 0: offset: 0x6a6530, size: 24 [D 20:43:17.164822] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 8/70. [D 20:43:17.171489] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39891. [D 20:43:17.171512] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 9/70. [D 20:43:17.182972] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 39890. [D 20:43:17.182988] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 10/70. [D 20:43:17.185335] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.185349] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.185359] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:17.185416] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.185429] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.185438] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.187471] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6315 [D 20:43:17.187491] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 11/70. [D 20:43:17.188587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 39890. [D 20:43:17.188637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 39891. [D 20:43:17.188649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 39892. [D 20:43:17.188660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 39893. [D 20:43:17.188674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 39894. [D 20:43:17.188684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 39895. [D 20:43:17.188694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 39896. [D 20:43:17.188704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39897. [D 20:43:17.188714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39898. [D 20:43:17.188724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39899. [D 20:43:17.188734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 39900. [D 20:43:17.188772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 39901. [D 20:43:17.188785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 39902. [D 20:43:17.188795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 39903. [D 20:43:17.188805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 39904. [D 20:43:17.188828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39905. [D 20:43:17.188839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39906. [D 20:43:17.188850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39907. [D 20:43:17.188860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 39908. [D 20:43:17.188870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 39909. [D 20:43:17.188880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 39910. [D 20:43:17.188903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 39911. [D 20:43:17.188917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 39912. [D 20:43:17.188927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39913. [D 20:43:17.188937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39914. [D 20:43:17.188962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39915. [D 20:43:17.188972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 39916. [D 20:43:17.188986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 39917. [D 20:43:17.188996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 39918. [D 20:43:17.189006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 39919. [D 20:43:17.189034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 39920. [D 20:43:17.189049] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cd70 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39921. [D 20:43:17.200340] openib_check_cq: completed rdma wr_id 2aaaab23cd70, nic_wr_credit 39921. [D 20:43:17.200357] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 12/70. [D 20:43:17.202753] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.202768] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.202778] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:17.202800] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.202811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.202819] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:17.202853] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6319 [D 20:43:17.202864] element 0: offset: 0x632820, size: 24 [D 20:43:17.202876] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 13/70. [D 20:43:17.207384] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6319 [D 20:43:17.207438] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 14/70. [D 20:43:17.207488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 39921. [D 20:43:17.207504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 39922. [D 20:43:17.207517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 39923. [D 20:43:17.207529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 39924. [D 20:43:17.207539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 39925. [D 20:43:17.207549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 39926. [D 20:43:17.207559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 39927. [D 20:43:17.207568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 39928. [D 20:43:17.207578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 39929. [D 20:43:17.207588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 39930. [D 20:43:17.207598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 39931. [D 20:43:17.207608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 39932. [D 20:43:17.207618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 39933. [D 20:43:17.207628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 39934. [D 20:43:17.207638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 39935. [D 20:43:17.207649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 39936. [D 20:43:17.207678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 39937. [D 20:43:17.207687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 39938. [D 20:43:17.207697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 39939. [D 20:43:17.207707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 39940. [D 20:43:17.207717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 39941. [D 20:43:17.207727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 39942. [D 20:43:17.207737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 39943. [D 20:43:17.207754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 39944. [D 20:43:17.207764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 39945. [D 20:43:17.207774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 39946. [D 20:43:17.207784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 39947. [D 20:43:17.207803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 39948. [D 20:43:17.207813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 39949. [D 20:43:17.207823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 39950. [D 20:43:17.207833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 39951. [D 20:43:17.207860] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 39952. [D 20:43:17.211515] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.211528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.211538] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.211554] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6321 [D 20:43:17.211564] element 0: offset: 0x691fe0, size: 24 [D 20:43:17.211574] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 15/70. [D 20:43:17.213371] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39952. [D 20:43:17.213385] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 16/70. [D 20:43:17.215681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.215695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.215706] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.217683] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6321 [D 20:43:17.217702] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 17/70. [D 20:43:17.217765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 39952. [D 20:43:17.217816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 39953. [D 20:43:17.217828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 39954. [D 20:43:17.217845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 39955. [D 20:43:17.217856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 39956. [D 20:43:17.217866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 39957. [D 20:43:17.217882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 39958. [D 20:43:17.217892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 39959. [D 20:43:17.217902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 39960. [D 20:43:17.217918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 39961. [D 20:43:17.217952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 39962. [D 20:43:17.217964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 39963. [D 20:43:17.217975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 39964. [D 20:43:17.217985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 39965. [D 20:43:17.218015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 39966. [D 20:43:17.218025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 39967. [D 20:43:17.218038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 39968. [D 20:43:17.218048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 39969. [D 20:43:17.218058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 39970. [D 20:43:17.218072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 39971. [D 20:43:17.218096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 39972. [D 20:43:17.218108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 39973. [D 20:43:17.218118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 39974. [D 20:43:17.218130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 39975. [D 20:43:17.218145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 39976. [D 20:43:17.218170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 39977. [D 20:43:17.218184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 39978. [D 20:43:17.218194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 39979. [D 20:43:17.218204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 39980. [D 20:43:17.218218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 39981. [D 20:43:17.218238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 39982. [D 20:43:17.218248] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 39983. [D 20:43:17.223674] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 39983. [D 20:43:17.223690] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 18/70. [D 20:43:17.225841] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.225856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.225866] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:17.248165] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.248179] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.248189] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:17.248220] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6325 [D 20:43:17.248232] element 0: offset: 0x6a6610, size: 24 [D 20:43:17.248244] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 19/70. [D 20:43:17.250312] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6325 [D 20:43:17.250367] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 20/70. [D 20:43:17.250416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 39983. [D 20:43:17.250437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 39984. [D 20:43:17.250448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 39985. [D 20:43:17.250458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 39986. [D 20:43:17.250468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 39987. [D 20:43:17.250478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 39988. [D 20:43:17.250488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 39989. [D 20:43:17.250498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 39990. [D 20:43:17.250513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 39991. [D 20:43:17.250530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 39992. [D 20:43:17.250540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 39993. [D 20:43:17.250550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 39994. [D 20:43:17.250560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 39995. [D 20:43:17.250570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 39996. [D 20:43:17.250591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 39997. [D 20:43:17.250601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 39998. [D 20:43:17.250611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 39999. [D 20:43:17.250626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 40000. [D 20:43:17.250636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 40001. [D 20:43:17.250646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 40002. [D 20:43:17.250656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 40003. [D 20:43:17.250684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 40004. [D 20:43:17.250694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 40005. [D 20:43:17.250705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 40006. [D 20:43:17.250715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 40007. [D 20:43:17.250725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 40008. [D 20:43:17.250735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 40009. [D 20:43:17.250745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 40010. [D 20:43:17.250755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 40011. [D 20:43:17.250765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 40012. [D 20:43:17.250788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 40013. [D 20:43:17.250798] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 40014. [D 20:43:17.256293] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40014. [D 20:43:17.256308] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 21/70. [D 20:43:17.258586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.258599] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.258608] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:17.334617] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.334631] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.334642] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:17.334659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6328 [D 20:43:17.334669] element 0: offset: 0x5b0030, size: 24 [D 20:43:17.334679] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 22/70. [D 20:43:17.336653] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6328 [D 20:43:17.336672] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 23/70. [D 20:43:17.336727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 40014. [D 20:43:17.336794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 40015. [D 20:43:17.336805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 40016. [D 20:43:17.336840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 40017. [D 20:43:17.336855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 40018. [D 20:43:17.336866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 40019. [D 20:43:17.336876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 40020. [D 20:43:17.336892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 40021. [D 20:43:17.336913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 40022. [D 20:43:17.336923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 40023. [D 20:43:17.336949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 40024. [D 20:43:17.336959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 40025. [D 20:43:17.336984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 40026. [D 20:43:17.336994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 40027. [D 20:43:17.337018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 40028. [D 20:43:17.337031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 40029. [D 20:43:17.337044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 40030. [D 20:43:17.337062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 40031. [D 20:43:17.337073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 40032. [D 20:43:17.337084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 40033. [D 20:43:17.337108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 40034. [D 20:43:17.337118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 40035. [D 20:43:17.337140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 40036. [D 20:43:17.337152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 40037. [D 20:43:17.337162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 40038. [D 20:43:17.337187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 40039. [D 20:43:17.337197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 40040. [D 20:43:17.337207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 40041. [D 20:43:17.337233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 40042. [D 20:43:17.337244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 40043. [D 20:43:17.337256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 40044. [D 20:43:17.337266] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 40045. [D 20:43:17.342658] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40045. [D 20:43:17.342674] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 24/70. [D 20:43:17.344934] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.344950] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.344960] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:17.470201] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.470216] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.470227] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:17.470258] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6331 [D 20:43:17.470270] element 0: offset: 0x61f310, size: 24 [D 20:43:17.470282] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 25/70. [D 20:43:17.472660] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6331 [D 20:43:17.472715] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 26/70. [D 20:43:17.472856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 40045. [D 20:43:17.472874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 40046. [D 20:43:17.472884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 40047. [D 20:43:17.472894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 40048. [D 20:43:17.472909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 40049. [D 20:43:17.472919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 40050. [D 20:43:17.472929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 40051. [D 20:43:17.472943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 40052. [D 20:43:17.472954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 40053. [D 20:43:17.472964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 40054. [D 20:43:17.472974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 40055. [D 20:43:17.472989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 40056. [D 20:43:17.472999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 40057. [D 20:43:17.473009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 40058. [D 20:43:17.473025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 40059. [D 20:43:17.473035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 40060. [D 20:43:17.473045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 40061. [D 20:43:17.473057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 40062. [D 20:43:17.473074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 40063. [D 20:43:17.473084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 40064. [D 20:43:17.473094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 40065. [D 20:43:17.473109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 40066. [D 20:43:17.473119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 40067. [D 20:43:17.473129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 40068. [D 20:43:17.473139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 40069. [D 20:43:17.473149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 40070. [D 20:43:17.473159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 40071. [D 20:43:17.473170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 40072. [D 20:43:17.473180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 40073. [D 20:43:17.473195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 40074. [D 20:43:17.473205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 40075. [D 20:43:17.473215] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 40076. [D 20:43:17.483470] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.483484] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.483495] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.483511] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6333 [D 20:43:17.483521] element 0: offset: 0x691fe0, size: 24 [D 20:43:17.483532] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 27/70. [D 20:43:17.483607] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40076. [D 20:43:17.483621] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 28/70. [D 20:43:17.485715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.485772] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.485782] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.487959] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6333 [D 20:43:17.487980] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 29/70. [D 20:43:17.488183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 40076. [D 20:43:17.488205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 40077. [D 20:43:17.488216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 40078. [D 20:43:17.488226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 40079. [D 20:43:17.488236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 40080. [D 20:43:17.488252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 40081. [D 20:43:17.488262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 40082. [D 20:43:17.488272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 40083. [D 20:43:17.488287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 40084. [D 20:43:17.488297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 40085. [D 20:43:17.488307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 40086. [D 20:43:17.488336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 40087. [D 20:43:17.488347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 40088. [D 20:43:17.488359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 40089. [D 20:43:17.488368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 40090. [D 20:43:17.488378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 40091. [D 20:43:17.488400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 40092. [D 20:43:17.488409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 40093. [D 20:43:17.488432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 40094. [D 20:43:17.488442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 40095. [D 20:43:17.488466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 40096. [D 20:43:17.488485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 40097. [D 20:43:17.488495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 40098. [D 20:43:17.488506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 40099. [D 20:43:17.488516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 40100. [D 20:43:17.488526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 40101. [D 20:43:17.488536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 40102. [D 20:43:17.488560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 40103. [D 20:43:17.488576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 40104. [D 20:43:17.488597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 40105. [D 20:43:17.488608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 40106. [D 20:43:17.488629] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 40107. [D 20:43:17.494096] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40107. [D 20:43:17.494113] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 30/70. [D 20:43:17.496417] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.496431] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.496442] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:17.498925] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.498938] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.498947] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:17.498979] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6338 [D 20:43:17.498993] element 0: offset: 0x6a6530, size: 24 [D 20:43:17.499006] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 31/70. [D 20:43:17.499028] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.499038] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.499047] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.499077] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6340 [D 20:43:17.499103] element 0: offset: 0x5b0030, size: 24 [D 20:43:17.499123] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 32/70. [D 20:43:17.504325] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6340 [D 20:43:17.504378] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 33/70. [D 20:43:17.504432] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6338 [D 20:43:17.504445] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 34/70. [D 20:43:17.505286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 40107. [D 20:43:17.505345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 40108. [D 20:43:17.505357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 40109. [D 20:43:17.505368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 40110. [D 20:43:17.505379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 40111. [D 20:43:17.505389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 40112. [D 20:43:17.505399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 40113. [D 20:43:17.505409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 40114. [D 20:43:17.505419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 40115. [D 20:43:17.505429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 40116. [D 20:43:17.505438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 40117. [D 20:43:17.505456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 40118. [D 20:43:17.505466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 40119. [D 20:43:17.505476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 40120. [D 20:43:17.505486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 40121. [D 20:43:17.505496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 40122. [D 20:43:17.505523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 40123. [D 20:43:17.505533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 40124. [D 20:43:17.505543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 40125. [D 20:43:17.505559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 40126. [D 20:43:17.505570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 40127. [D 20:43:17.505580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 40128. [D 20:43:17.505607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 40129. [D 20:43:17.505617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 40130. [D 20:43:17.505627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 40131. [D 20:43:17.505637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 40132. [D 20:43:17.505647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 40133. [D 20:43:17.505657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 40134. [D 20:43:17.505667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 40135. [D 20:43:17.505677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 40136. [D 20:43:17.505701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 40137. [D 20:43:17.505711] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 40138. [D 20:43:17.505724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 40139. [D 20:43:17.505736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 40140. [D 20:43:17.505746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 40141. [D 20:43:17.505771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 40142. [D 20:43:17.505781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 40143. [D 20:43:17.505801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 40144. [D 20:43:17.505812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 40145. [D 20:43:17.505822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 40146. [D 20:43:17.505837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 40147. [D 20:43:17.505857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 40148. [D 20:43:17.505868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 40149. [D 20:43:17.505883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 40150. [D 20:43:17.505893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 40151. [D 20:43:17.505917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 40152. [D 20:43:17.505927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 40153. [D 20:43:17.505937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 40154. [D 20:43:17.505947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 40155. [D 20:43:17.505957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 40156. [D 20:43:17.505967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 40157. [D 20:43:17.505977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 40158. [D 20:43:17.505987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 40159. [D 20:43:17.505997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 40160. [D 20:43:17.506008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 40161. [D 20:43:17.506035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 40162. [D 20:43:17.506044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 40163. [D 20:43:17.506072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 40164. [D 20:43:17.506082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 40165. [D 20:43:17.506092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 40166. [D 20:43:17.506102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 40167. [D 20:43:17.506112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 40168. [D 20:43:17.506131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 40169. [D 20:43:17.506140] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 40170. [D 20:43:17.511784] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40170. [D 20:43:17.511800] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 35/70. [D 20:43:17.514808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.514824] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.514833] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:17.514867] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6343 [D 20:43:17.514879] element 0: offset: 0x620d50, size: 24 [D 20:43:17.514893] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 36/70. [D 20:43:17.514963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.514976] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.514985] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:17.515003] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6345 [D 20:43:17.515014] element 0: offset: 0x6a66d0, size: 24 [D 20:43:17.515024] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 37/70. [D 20:43:17.517638] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 40169. [D 20:43:17.517652] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 38/70. [D 20:43:17.517693] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.517703] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.517714] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:17.519932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.519946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.519955] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:17.522393] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6345 [D 20:43:17.522449] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 39/70. [D 20:43:17.522591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 40169. [D 20:43:17.522636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 40170. [D 20:43:17.522647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 40171. [D 20:43:17.522656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 40172. [D 20:43:17.522666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 40173. [D 20:43:17.522676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 40174. [D 20:43:17.522686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 40175. [D 20:43:17.522697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 40176. [D 20:43:17.522706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 40177. [D 20:43:17.522717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 40178. [D 20:43:17.522752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 40179. [D 20:43:17.522762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 40180. [D 20:43:17.522773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 40181. [D 20:43:17.522783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 40182. [D 20:43:17.522793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 40183. [D 20:43:17.522802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 40184. [D 20:43:17.522812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 40185. [D 20:43:17.522822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 40186. [D 20:43:17.522832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 40187. [D 20:43:17.522842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 40188. [D 20:43:17.522851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 40189. [D 20:43:17.522862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 40190. [D 20:43:17.522885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 40191. [D 20:43:17.522895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 40192. [D 20:43:17.522905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 40193. [D 20:43:17.522915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 40194. [D 20:43:17.522924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 40195. [D 20:43:17.522934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 40196. [D 20:43:17.522944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 40197. [D 20:43:17.522959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 40198. [D 20:43:17.522969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 40199. [D 20:43:17.522979] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 40200. [D 20:43:17.523100] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6343 [D 20:43:17.523121] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 40/70. [D 20:43:17.534329] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40200. [D 20:43:17.534351] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 41/70. [D 20:43:17.534408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 40200. [D 20:43:17.534421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 40201. [D 20:43:17.534432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 40202. [D 20:43:17.534442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 40203. [D 20:43:17.534452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 40204. [D 20:43:17.534462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 40205. [D 20:43:17.534489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 40206. [D 20:43:17.534498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 40207. [D 20:43:17.534508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 40208. [D 20:43:17.534523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 40209. [D 20:43:17.534549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 40210. [D 20:43:17.534560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 40211. [D 20:43:17.534570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 40212. [D 20:43:17.534580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 40213. [D 20:43:17.534590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 40214. [D 20:43:17.534601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 40215. [D 20:43:17.534624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 40216. [D 20:43:17.534639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 40217. [D 20:43:17.534649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 40218. [D 20:43:17.534659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 40219. [D 20:43:17.534674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 40220. [D 20:43:17.534684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 40221. [D 20:43:17.534708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 40222. [D 20:43:17.534718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 40223. [D 20:43:17.534728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 40224. [D 20:43:17.534743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 40225. [D 20:43:17.534765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 40226. [D 20:43:17.534776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 40227. [D 20:43:17.534786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 40228. [D 20:43:17.534796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 40229. [D 20:43:17.534825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 40230. [D 20:43:17.534836] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 40231. [D 20:43:17.534886] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.534898] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.534910] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.539189] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.539203] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.539213] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.539246] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6349 [D 20:43:17.539257] element 0: offset: 0x6328e0, size: 24 [D 20:43:17.539270] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 42/70. [D 20:43:17.546173] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 40231. [D 20:43:17.546187] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 43/70. [D 20:43:17.547595] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.547610] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.547619] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.550497] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6349 [D 20:43:17.550516] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 44/70. [D 20:43:17.555848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 40231. [D 20:43:17.555901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 40232. [D 20:43:17.555912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 40233. [D 20:43:17.555923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 40234. [D 20:43:17.555933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 40235. [D 20:43:17.555943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 40236. [D 20:43:17.555953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 40237. [D 20:43:17.555965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 40238. [D 20:43:17.555982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 40239. [D 20:43:17.555992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 40240. [D 20:43:17.556001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 40241. [D 20:43:17.556012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 40242. [D 20:43:17.556022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 40243. [D 20:43:17.556032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 40244. [D 20:43:17.556042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 40245. [D 20:43:17.556060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 40246. [D 20:43:17.556070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 40247. [D 20:43:17.556079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 40248. [D 20:43:17.556090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 40249. [D 20:43:17.556100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 40250. [D 20:43:17.556110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 40251. [D 20:43:17.556119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 40252. [D 20:43:17.556135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 40253. [D 20:43:17.556166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 40254. [D 20:43:17.556177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 40255. [D 20:43:17.556187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 40256. [D 20:43:17.556197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 40257. [D 20:43:17.556208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 40258. [D 20:43:17.556218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 40259. [D 20:43:17.556227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 40260. [D 20:43:17.556237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 40261. [D 20:43:17.556247] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 40262. [D 20:43:17.561837] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40262. [D 20:43:17.561854] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 45/70. [D 20:43:17.564141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.564156] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.564167] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:17.572060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.572074] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.572084] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:17.572116] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6354 [D 20:43:17.572127] element 0: offset: 0x625390, size: 24 [D 20:43:17.572139] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 46/70. [D 20:43:17.572158] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.572169] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.572178] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.572192] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6356 [D 20:43:17.572203] element 0: offset: 0x691fe0, size: 24 [D 20:43:17.572213] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 47/70. [D 20:43:17.572232] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.572244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.572253] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:17.572266] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6357 [D 20:43:17.572277] element 0: offset: 0x62f810, size: 24 [D 20:43:17.572286] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 48/70. [D 20:43:17.577651] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6354 [D 20:43:17.577709] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 49/70. [D 20:43:17.577871] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6356 [D 20:43:17.577888] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 50/70. [D 20:43:17.578613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 40262. [D 20:43:17.578678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 40263. [D 20:43:17.578689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 40264. [D 20:43:17.578700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 40265. [D 20:43:17.578711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 40266. [D 20:43:17.578721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 40267. [D 20:43:17.578731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 40268. [D 20:43:17.578754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 40269. [D 20:43:17.578771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 40270. [D 20:43:17.578781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 40271. [D 20:43:17.578791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 40272. [D 20:43:17.578800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 40273. [D 20:43:17.578810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 40274. [D 20:43:17.578819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 40275. [D 20:43:17.578829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 40276. [D 20:43:17.578838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 40277. [D 20:43:17.578848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 40278. [D 20:43:17.578857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 40279. [D 20:43:17.578866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 40280. [D 20:43:17.578876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 40281. [D 20:43:17.578885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 40282. [D 20:43:17.578895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 40283. [D 20:43:17.578904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 40284. [D 20:43:17.578914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 40285. [D 20:43:17.578923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 40286. [D 20:43:17.578933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 40287. [D 20:43:17.578942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 40288. [D 20:43:17.578951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 40289. [D 20:43:17.578961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 40290. [D 20:43:17.578970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 40291. [D 20:43:17.578980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 40292. [D 20:43:17.578989] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 40293. [D 20:43:17.579006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 40294. [D 20:43:17.579016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 40295. [D 20:43:17.579025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 40296. [D 20:43:17.579035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 40297. [D 20:43:17.579046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 40298. [D 20:43:17.579056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 40299. [D 20:43:17.579065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 40300. [D 20:43:17.579075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 40301. [D 20:43:17.579084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 40302. [D 20:43:17.579094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 40303. [D 20:43:17.579104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 40304. [D 20:43:17.579113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 40305. [D 20:43:17.579123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 40306. [D 20:43:17.579132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 40307. [D 20:43:17.579142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 40308. [D 20:43:17.579151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 40309. [D 20:43:17.579161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 40310. [D 20:43:17.579170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 40311. [D 20:43:17.579180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 40312. [D 20:43:17.579190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 40313. [D 20:43:17.579199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 40314. [D 20:43:17.579209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 40315. [D 20:43:17.579218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 40316. [D 20:43:17.579228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 40317. [D 20:43:17.579237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 40318. [D 20:43:17.579247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 40319. [D 20:43:17.579256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 40320. [D 20:43:17.579266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 40321. [D 20:43:17.579275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 40322. [D 20:43:17.579285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 40323. [D 20:43:17.579295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 40324. [D 20:43:17.579304] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 40325. [D 20:43:17.580695] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6357 [D 20:43:17.581281] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.581319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.581328] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:17.581365] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6361 [D 20:43:17.581375] element 0: offset: 0x620d50, size: 24 [D 20:43:17.581390] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 51/70. [D 20:43:17.581434] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 52/70. [D 20:43:17.590366] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40325. [D 20:43:17.590389] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 53/70. [D 20:43:17.602079] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 40324. [D 20:43:17.602096] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 54/70. [D 20:43:17.602142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 40324. [D 20:43:17.602156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 40325. [D 20:43:17.602168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 40326. [D 20:43:17.602181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 40327. [D 20:43:17.602193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 40328. [D 20:43:17.602205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 40329. [D 20:43:17.602217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 40330. [D 20:43:17.602230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 40331. [D 20:43:17.602242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 40332. [D 20:43:17.602254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 40333. [D 20:43:17.602265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 40334. [D 20:43:17.602277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 40335. [D 20:43:17.602289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 40336. [D 20:43:17.602301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 40337. [D 20:43:17.602313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 40338. [D 20:43:17.602326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 40339. [D 20:43:17.602338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 40340. [D 20:43:17.602350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 40341. [D 20:43:17.602363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 40342. [D 20:43:17.602375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 40343. [D 20:43:17.602387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 40344. [D 20:43:17.602399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 40345. [D 20:43:17.602412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 40346. [D 20:43:17.602424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 40347. [D 20:43:17.602436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 40348. [D 20:43:17.602448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 40349. [D 20:43:17.602460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 40350. [D 20:43:17.602473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 40351. [D 20:43:17.602485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 40352. [D 20:43:17.602497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 40353. [D 20:43:17.602508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 40354. [D 20:43:17.602518] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d340 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 40355. [D 20:43:17.604975] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.604990] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.605003] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:17.605088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.605101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.605109] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:17.607364] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6361 [D 20:43:17.607418] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 55/70. [D 20:43:17.612651] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.612669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.612684] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:17.612703] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6364 [D 20:43:17.612715] element 0: offset: 0x62d530, size: 24 [D 20:43:17.612728] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 56/70. [D 20:43:17.613916] openib_check_cq: completed rdma wr_id 2aaaab23d340, nic_wr_credit 40355. [D 20:43:17.613931] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 57/70. [D 20:43:17.613983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 40355. [D 20:43:17.613996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 40356. [D 20:43:17.614009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 40357. [D 20:43:17.614022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 40358. [D 20:43:17.614034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 40359. [D 20:43:17.614047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 40360. [D 20:43:17.614059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 40361. [D 20:43:17.614071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 40362. [D 20:43:17.614084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 40363. [D 20:43:17.614096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 40364. [D 20:43:17.614108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 40365. [D 20:43:17.614121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 40366. [D 20:43:17.614133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 40367. [D 20:43:17.614145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 40368. [D 20:43:17.614157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 40369. [D 20:43:17.614170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 40370. [D 20:43:17.614182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 40371. [D 20:43:17.614194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 40372. [D 20:43:17.614207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 40373. [D 20:43:17.614219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 40374. [D 20:43:17.614231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 40375. [D 20:43:17.614243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 40376. [D 20:43:17.614256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 40377. [D 20:43:17.614268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 40378. [D 20:43:17.614281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 40379. [D 20:43:17.614293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 40380. [D 20:43:17.614305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 40381. [D 20:43:17.614318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 40382. [D 20:43:17.614331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 40383. [D 20:43:17.614344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 40384. [D 20:43:17.614354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 40385. [D 20:43:17.614364] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 40386. [D 20:43:17.616814] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.616829] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.616840] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:17.619067] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6364 [D 20:43:17.619087] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 58/70. [D 20:43:17.622245] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40386. [D 20:43:17.622299] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 59/70. [D 20:43:17.624516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.624531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.624543] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.624992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 40386. [D 20:43:17.625007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 40387. [D 20:43:17.625017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 40388. [D 20:43:17.625028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 40389. [D 20:43:17.625038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 40390. [D 20:43:17.625052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 40391. [D 20:43:17.625061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 40392. [D 20:43:17.625071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 40393. [D 20:43:17.625088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 40394. [D 20:43:17.625098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 40395. [D 20:43:17.625108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 40396. [D 20:43:17.625137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 40397. [D 20:43:17.625147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 40398. [D 20:43:17.625160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 40399. [D 20:43:17.625170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 40400. [D 20:43:17.625180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 40401. [D 20:43:17.625193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 40402. [D 20:43:17.625203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 40403. [D 20:43:17.625231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 40404. [D 20:43:17.625241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 40405. [D 20:43:17.625252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 40406. [D 20:43:17.625262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 40407. [D 20:43:17.625272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 40408. [D 20:43:17.625295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 40409. [D 20:43:17.625306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 40410. [D 20:43:17.625316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 40411. [D 20:43:17.625326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 40412. [D 20:43:17.625336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 40413. [D 20:43:17.625346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 40414. [D 20:43:17.625369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 40415. [D 20:43:17.625380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 40416. [D 20:43:17.625390] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 40417. [D 20:43:17.630060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.630074] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.630084] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.630117] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6368 [D 20:43:17.630128] element 0: offset: 0x61f310, size: 24 [D 20:43:17.630141] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 60/70. [D 20:43:17.630160] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.630170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.630178] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:17.630209] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6369 [D 20:43:17.630219] element 0: offset: 0x5b0030, size: 24 [D 20:43:17.630229] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 0/70. [D 20:43:17.630874] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 40417. [D 20:43:17.630887] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 1/70. [D 20:43:17.631627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.631641] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.631649] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:17.633677] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6368 [D 20:43:17.633737] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 2/70. [D 20:43:17.633799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 40417. [D 20:43:17.633836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 40418. [D 20:43:17.633847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 40419. [D 20:43:17.633857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 40420. [D 20:43:17.633868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 40421. [D 20:43:17.633878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 40422. [D 20:43:17.633888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 40423. [D 20:43:17.633931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 40424. [D 20:43:17.633942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 40425. [D 20:43:17.633956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 40426. [D 20:43:17.633966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 40427. [D 20:43:17.633976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 40428. [D 20:43:17.634001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 40429. [D 20:43:17.634011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 40430. [D 20:43:17.634026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 40431. [D 20:43:17.634036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 40432. [D 20:43:17.634046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 40433. [D 20:43:17.634061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 40434. [D 20:43:17.634086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 40435. [D 20:43:17.634097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 40436. [D 20:43:17.634107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 40437. [D 20:43:17.634118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 40438. [D 20:43:17.634128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 40439. [D 20:43:17.634138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 40440. [D 20:43:17.634163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 40441. [D 20:43:17.634173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 40442. [D 20:43:17.634183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 40443. [D 20:43:17.634225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 40444. [D 20:43:17.634235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 40445. [D 20:43:17.634245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 40446. [D 20:43:17.634261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 40447. [D 20:43:17.634271] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 40448. [D 20:43:17.638066] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6369 [D 20:43:17.638085] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 3/70. [D 20:43:17.639791] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40448. [D 20:43:17.639842] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 4/70. [D 20:43:17.639857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 40448. [D 20:43:17.639869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 40449. [D 20:43:17.639882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 40450. [D 20:43:17.639892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 40451. [D 20:43:17.639902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 40452. [D 20:43:17.639913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 40453. [D 20:43:17.639922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 40454. [D 20:43:17.639932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 40455. [D 20:43:17.639942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 40456. [D 20:43:17.639979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 40457. [D 20:43:17.639990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 40458. [D 20:43:17.640001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 40459. [D 20:43:17.640010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 40460. [D 20:43:17.640021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 40461. [D 20:43:17.640047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 40462. [D 20:43:17.640058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 40463. [D 20:43:17.640068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 40464. [D 20:43:17.640077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 40465. [D 20:43:17.640088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 40466. [D 20:43:17.640098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 40467. [D 20:43:17.640123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 40468. [D 20:43:17.640133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 40469. [D 20:43:17.640143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 40470. [D 20:43:17.640158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 40471. [D 20:43:17.640169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 40472. [D 20:43:17.640179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 40473. [D 20:43:17.640188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 40474. [D 20:43:17.640213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 40475. [D 20:43:17.640223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 40476. [D 20:43:17.640233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 40477. [D 20:43:17.640243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 40478. [D 20:43:17.640253] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 40479. [D 20:43:17.640313] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.640344] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.640354] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.645767] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 40479. [D 20:43:17.645781] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 5/70. [D 20:43:17.647954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.647968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.647979] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:17.909500] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.909515] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.909527] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:17.909560] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6373 [D 20:43:17.909571] element 0: offset: 0x691fe0, size: 24 [D 20:43:17.909598] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 6/70. [D 20:43:17.911577] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.911592] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.911600] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.911617] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6376 [D 20:43:17.911626] element 0: offset: 0x64d990, size: 24 [D 20:43:17.911635] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 7/70. [D 20:43:17.911947] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6373 [D 20:43:17.912000] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 8/70. [D 20:43:17.914240] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6376 [D 20:43:17.914253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 40479. [D 20:43:17.914317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 40480. [D 20:43:17.914329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 40481. [D 20:43:17.914340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 40482. [D 20:43:17.914354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 40483. [D 20:43:17.914364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 40484. [D 20:43:17.914399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 40485. [D 20:43:17.914409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 40486. [D 20:43:17.914435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 40487. [D 20:43:17.914446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 40488. [D 20:43:17.914467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 40489. [D 20:43:17.914478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 40490. [D 20:43:17.914500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 40491. [D 20:43:17.914511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 40492. [D 20:43:17.914532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 40493. [D 20:43:17.914543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 40494. [D 20:43:17.914576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 40495. [D 20:43:17.914597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 40496. [D 20:43:17.914607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 40497. [D 20:43:17.914630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 40498. [D 20:43:17.914640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 40499. [D 20:43:17.914650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 40500. [D 20:43:17.914665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 40501. [D 20:43:17.914684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 40502. [D 20:43:17.914695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 40503. [D 20:43:17.914705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 40504. [D 20:43:17.914715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 40505. [D 20:43:17.914752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 40506. [D 20:43:17.914763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 40507. [D 20:43:17.914773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 40508. [D 20:43:17.914784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 40509. [D 20:43:17.914794] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 40510. [D 20:43:17.914837] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 9/70. [D 20:43:17.925195] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40510. [D 20:43:17.925215] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 10/70. [D 20:43:17.925248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 40510. [D 20:43:17.925258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 40511. [D 20:43:17.925269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 40512. [D 20:43:17.925282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 40513. [D 20:43:17.925292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 40514. [D 20:43:17.925305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 40515. [D 20:43:17.925319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 40516. [D 20:43:17.925329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 40517. [D 20:43:17.925339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 40518. [D 20:43:17.925355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 40519. [D 20:43:17.925382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 40520. [D 20:43:17.925392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 40521. [D 20:43:17.925402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 40522. [D 20:43:17.925413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 40523. [D 20:43:17.925424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 40524. [D 20:43:17.925433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 40525. [D 20:43:17.925443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 40526. [D 20:43:17.925474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 40527. [D 20:43:17.925485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 40528. [D 20:43:17.925500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 40529. [D 20:43:17.925510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 40530. [D 20:43:17.925519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 40531. [D 20:43:17.925529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 40532. [D 20:43:17.925546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 40533. [D 20:43:17.925555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 40534. [D 20:43:17.925565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 40535. [D 20:43:17.925576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 40536. [D 20:43:17.925586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 40537. [D 20:43:17.925596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 40538. [D 20:43:17.925607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 40539. [D 20:43:17.925618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 40540. [D 20:43:17.925645] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 40541. [D 20:43:17.927960] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.927975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.927986] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:17.937023] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 40541. [D 20:43:17.937037] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 11/70. [D 20:43:17.939330] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.939343] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.939353] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:17.963974] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.963989] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.963999] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:17.964028] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6381 [D 20:43:17.964039] element 0: offset: 0x620d50, size: 24 [D 20:43:17.964051] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 12/70. [D 20:43:17.964398] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.964411] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.964420] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:17.964434] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6384 [D 20:43:17.964444] element 0: offset: 0x6328e0, size: 24 [D 20:43:17.964453] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 13/70. [D 20:43:17.965986] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6381 [D 20:43:17.966043] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 14/70. [D 20:43:17.966047] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.966063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.966072] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:17.966087] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6385 [D 20:43:17.966097] element 0: offset: 0x61f310, size: 24 [D 20:43:17.966124] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 15/70. [D 20:43:17.966163] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:17.966173] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.966182] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:17.966195] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6388 [D 20:43:17.966205] element 0: offset: 0x5b0030, size: 24 [D 20:43:17.966219] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 16/70. [D 20:43:17.968192] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6384 [D 20:43:17.968205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 40541. [D 20:43:17.968263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 40542. [D 20:43:17.968274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 40543. [D 20:43:17.968285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 40544. [D 20:43:17.968300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 40545. [D 20:43:17.968309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 40546. [D 20:43:17.968320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 40547. [D 20:43:17.968334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 40548. [D 20:43:17.968344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 40549. [D 20:43:17.968354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 40550. [D 20:43:17.968399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 40551. [D 20:43:17.968410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 40552. [D 20:43:17.968428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 40553. [D 20:43:17.968439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 40554. [D 20:43:17.968449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 40555. [D 20:43:17.968474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 40556. [D 20:43:17.968485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 40557. [D 20:43:17.968501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 40558. [D 20:43:17.968512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 40559. [D 20:43:17.968522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 40560. [D 20:43:17.968533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 40561. [D 20:43:17.968556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 40562. [D 20:43:17.968567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 40563. [D 20:43:17.968577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 40564. [D 20:43:17.968593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 40565. [D 20:43:17.968603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 40566. [D 20:43:17.968613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 40567. [D 20:43:17.968637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 40568. [D 20:43:17.968648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 40569. [D 20:43:17.968658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 40570. [D 20:43:17.968670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 40571. [D 20:43:17.968680] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 40572. [D 20:43:17.968724] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 17/70. [D 20:43:17.971529] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6385 [D 20:43:17.971597] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 18/70. [D 20:43:17.973601] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6388 [D 20:43:17.973618] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 19/70. [D 20:43:17.978733] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40572. [D 20:43:17.978797] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 20/70. [D 20:43:17.978816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 40572. [D 20:43:17.978828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 40573. [D 20:43:17.978839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 40574. [D 20:43:17.978849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 40575. [D 20:43:17.978865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 40576. [D 20:43:17.978875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 40577. [D 20:43:17.978885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 40578. [D 20:43:17.978895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 40579. [D 20:43:17.978906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 40580. [D 20:43:17.978916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 40581. [D 20:43:17.978931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 40582. [D 20:43:17.978959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 40583. [D 20:43:17.978969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 40584. [D 20:43:17.978980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 40585. [D 20:43:17.978990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 40586. [D 20:43:17.979000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 40587. [D 20:43:17.979010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 40588. [D 20:43:17.979020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 40589. [D 20:43:17.979030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 40590. [D 20:43:17.979051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 40591. [D 20:43:17.979069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 40592. [D 20:43:17.979082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 40593. [D 20:43:17.979092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 40594. [D 20:43:17.979118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 40595. [D 20:43:17.979128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 40596. [D 20:43:17.979138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 40597. [D 20:43:17.979148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 40598. [D 20:43:17.979158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 40599. [D 20:43:17.979169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 40600. [D 20:43:17.979194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 40601. [D 20:43:17.979205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 40602. [D 20:43:17.979215] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 40603. [D 20:43:17.979228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 40604. [D 20:43:17.979260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 40605. [D 20:43:17.979271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 40606. [D 20:43:17.979281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 40607. [D 20:43:17.979292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 40608. [D 20:43:17.979320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 40609. [D 20:43:17.979331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 40610. [D 20:43:17.979344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 40611. [D 20:43:17.979354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 40612. [D 20:43:17.979364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 40613. [D 20:43:17.979388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 40614. [D 20:43:17.979398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 40615. [D 20:43:17.979409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 40616. [D 20:43:17.979420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 40617. [D 20:43:17.979430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 40618. [D 20:43:17.979452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 40619. [D 20:43:17.979462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 40620. [D 20:43:17.979472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 40621. [D 20:43:17.979487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 40622. [D 20:43:17.979497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 40623. [D 20:43:17.979507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 40624. [D 20:43:17.979530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 40625. [D 20:43:17.979540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 40626. [D 20:43:17.979551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 40627. [D 20:43:17.979561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 40628. [D 20:43:17.979571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 40629. [D 20:43:17.979598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 40630. [D 20:43:17.979609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 40631. [D 20:43:17.979619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 40632. [D 20:43:17.979630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 40633. [D 20:43:17.979640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 40634. [D 20:43:17.979662] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d220 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 40635. [D 20:43:17.979674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 40636. [D 20:43:17.979690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 40637. [D 20:43:17.979700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 40638. [D 20:43:17.979710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 40639. [D 20:43:17.979732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 40640. [D 20:43:17.979743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 40641. [E 20:43:17.979756] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 40642, block for 10 ms. [D 20:43:17.979782] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 40641. [D 20:43:17.979807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 40642. [E 20:43:17.979819] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 40643, block for 10 ms. [D 20:43:17.990516] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 40642. [D 20:43:17.990530] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 21/70. [D 20:43:17.990542] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 40641. [D 20:43:17.990553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 40642. [D 20:43:17.990567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 40643. [D 20:43:17.990579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 40644. [D 20:43:17.990589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 40645. [D 20:43:17.990599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 40646. [D 20:43:17.990609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 40647. [D 20:43:17.990619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 40648. [D 20:43:17.990629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 40649. [D 20:43:17.990645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 40650. [D 20:43:17.990655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 40651. [D 20:43:17.990665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 40652. [D 20:43:17.990696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 40653. [D 20:43:17.990706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 40654. [D 20:43:17.990718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 40655. [D 20:43:17.990728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 40656. [D 20:43:17.990743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 40657. [D 20:43:17.990766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 40658. [D 20:43:17.990777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 40659. [D 20:43:17.990788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 40660. [D 20:43:17.990798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 40661. [D 20:43:17.990808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 40662. [D 20:43:17.990833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 40663. [D 20:43:17.990843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 40664. [D 20:43:17.990854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 40665. [D 20:43:17.990864] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d360 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 40666. [D 20:43:17.990934] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:17.990960] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:17.990970] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:18.002146] openib_check_cq: completed rdma wr_id 2aaaab23d220, nic_wr_credit 40666. [D 20:43:18.002162] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 22/70. [D 20:43:18.006560] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.006573] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.006584] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:18.006615] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6391 [D 20:43:18.006626] element 0: offset: 0x63c160, size: 24 [D 20:43:18.006638] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 23/70. [D 20:43:18.006658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.006668] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.006676] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:18.013850] openib_check_cq: completed rdma wr_id 2aaaab23d360, nic_wr_credit 40665. [D 20:43:18.013864] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 24/70. [D 20:43:18.016198] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.016212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.016222] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:18.016237] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6394 [D 20:43:18.016247] element 0: offset: 0x62d530, size: 24 [D 20:43:18.016257] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 25/70. [D 20:43:18.016273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.016286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.016295] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:18.016345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.016371] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.016381] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:18.020303] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6394 [D 20:43:18.020359] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 26/70. [D 20:43:18.020400] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6391 [D 20:43:18.020414] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 27/70. [D 20:43:18.023829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 40665. [D 20:43:18.023848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 40666. [D 20:43:18.023860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 40667. [D 20:43:18.023870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 40668. [D 20:43:18.023881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 40669. [D 20:43:18.023898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 40670. [D 20:43:18.023908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 40671. [D 20:43:18.023917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 40672. [D 20:43:18.023934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 40673. [D 20:43:18.023944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 40674. [D 20:43:18.023954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 40675. [D 20:43:18.023969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 40676. [D 20:43:18.023979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 40677. [D 20:43:18.023989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 40678. [D 20:43:18.024017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 40679. [D 20:43:18.024027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 40680. [D 20:43:18.024038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 40681. [D 20:43:18.024051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 40682. [D 20:43:18.024061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 40683. [D 20:43:18.024083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 40684. [D 20:43:18.024093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 40685. [D 20:43:18.024103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 40686. [D 20:43:18.024119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 40687. [D 20:43:18.024129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 40688. [D 20:43:18.024140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 40689. [D 20:43:18.024167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 40690. [D 20:43:18.024178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 40691. [D 20:43:18.024190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 40692. [D 20:43:18.024200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 40693. [D 20:43:18.024212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 40694. [D 20:43:18.024238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 40695. [D 20:43:18.024248] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 40696. [D 20:43:18.024264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 40697. [D 20:43:18.024274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 40698. [D 20:43:18.024296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 40699. [D 20:43:18.024307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 40700. [D 20:43:18.024317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 40701. [D 20:43:18.024327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 40702. [D 20:43:18.024337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 40703. [D 20:43:18.024352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 40704. [D 20:43:18.024375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 40705. [D 20:43:18.024386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 40706. [D 20:43:18.024402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 40707. [D 20:43:18.024412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 40708. [D 20:43:18.024433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 40709. [D 20:43:18.024443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 40710. [D 20:43:18.024454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 40711. [D 20:43:18.024470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 40712. [D 20:43:18.024480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 40713. [D 20:43:18.024490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 40714. [D 20:43:18.024518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 40715. [D 20:43:18.024529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 40716. [D 20:43:18.024541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 40717. [D 20:43:18.024552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 40718. [D 20:43:18.024567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 40719. [D 20:43:18.024589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 40720. [D 20:43:18.024600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 40721. [D 20:43:18.024611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 40722. [D 20:43:18.024621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 40723. [D 20:43:18.024631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 40724. [D 20:43:18.024654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 40725. [D 20:43:18.024669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 40726. [D 20:43:18.024680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 40727. [D 20:43:18.024690] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 40728. [D 20:43:18.034908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.034922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.034933] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:18.034949] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6397 [D 20:43:18.034962] element 0: offset: 0x691fe0, size: 24 [D 20:43:18.034972] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 28/70. [D 20:43:18.035619] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 40728. [D 20:43:18.035633] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 29/70. [D 20:43:18.047297] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40727. [D 20:43:18.047311] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 30/70. [D 20:43:18.049607] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.049621] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.049631] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:18.049666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.049677] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.049686] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.051953] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6397 [D 20:43:18.051975] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 31/70. [D 20:43:18.053716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 40727. [D 20:43:18.053731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 40728. [D 20:43:18.053743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 40729. [D 20:43:18.053753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 40730. [D 20:43:18.053763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 40731. [D 20:43:18.053777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 40732. [D 20:43:18.053787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 40733. [D 20:43:18.053797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 40734. [D 20:43:18.053813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 40735. [D 20:43:18.053824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 40736. [D 20:43:18.053833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 40737. [D 20:43:18.053849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 40738. [D 20:43:18.053859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 40739. [D 20:43:18.053869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 40740. [D 20:43:18.053897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 40741. [D 20:43:18.053908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 40742. [D 20:43:18.053920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 40743. [D 20:43:18.053930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 40744. [D 20:43:18.053945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 40745. [D 20:43:18.053967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 40746. [D 20:43:18.053978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 40747. [D 20:43:18.053988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 40748. [D 20:43:18.053998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 40749. [D 20:43:18.054009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 40750. [D 20:43:18.054031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 40751. [D 20:43:18.054041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 40752. [D 20:43:18.054051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 40753. [D 20:43:18.054068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 40754. [D 20:43:18.054078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 40755. [D 20:43:18.054100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 40756. [D 20:43:18.054110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 40757. [D 20:43:18.054120] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 40758. [D 20:43:18.060368] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40758. [D 20:43:18.060382] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 32/70. [D 20:43:18.064060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.064073] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.064084] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:18.064099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.064108] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.064117] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:18.064131] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6400 [D 20:43:18.064144] element 0: offset: 0x620d50, size: 24 [D 20:43:18.064153] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 33/70. [D 20:43:18.066491] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6400 [D 20:43:18.066507] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 34/70. [D 20:43:18.066555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 40758. [D 20:43:18.066567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 40759. [D 20:43:18.066577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 40760. [D 20:43:18.066587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 40761. [D 20:43:18.066598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 40762. [D 20:43:18.066610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 40763. [D 20:43:18.066621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 40764. [D 20:43:18.066630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 40765. [D 20:43:18.066641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 40766. [D 20:43:18.066651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 40767. [D 20:43:18.066661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 40768. [D 20:43:18.066684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 40769. [D 20:43:18.066695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 40770. [D 20:43:18.066705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 40771. [D 20:43:18.066720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 40772. [D 20:43:18.066730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 40773. [D 20:43:18.066740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 40774. [D 20:43:18.066750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 40775. [D 20:43:18.066776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 40776. [D 20:43:18.066786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 40777. [D 20:43:18.066796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 40778. [D 20:43:18.066807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 40779. [D 20:43:18.066817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 40780. [D 20:43:18.066827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 40781. [D 20:43:18.066846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 40782. [D 20:43:18.066861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 40783. [D 20:43:18.066871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 40784. [D 20:43:18.066881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 40785. [D 20:43:18.066892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 40786. [D 20:43:18.066903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 40787. [D 20:43:18.066913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 40788. [D 20:43:18.066936] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 40789. [D 20:43:18.072447] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40789. [D 20:43:18.072462] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 35/70. [D 20:43:18.074754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.074768] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.074777] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:18.160728] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.160742] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.160753] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:18.160768] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6402 [D 20:43:18.160778] element 0: offset: 0x6328e0, size: 24 [D 20:43:18.160788] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 36/70. [D 20:43:18.162966] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6402 [D 20:43:18.162983] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 37/70. [D 20:43:18.163031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 40789. [D 20:43:18.163043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 40790. [D 20:43:18.163053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 40791. [D 20:43:18.163063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 40792. [D 20:43:18.163073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 40793. [D 20:43:18.163086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 40794. [D 20:43:18.163096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 40795. [D 20:43:18.163109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 40796. [D 20:43:18.163119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 40797. [D 20:43:18.163130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 40798. [D 20:43:18.163157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 40799. [D 20:43:18.163168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 40800. [D 20:43:18.163179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 40801. [D 20:43:18.163189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 40802. [D 20:43:18.163199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 40803. [D 20:43:18.163209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 40804. [D 20:43:18.163225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 40805. [D 20:43:18.163235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 40806. [D 20:43:18.163245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 40807. [D 20:43:18.163275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 40808. [D 20:43:18.163286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 40809. [D 20:43:18.163298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 40810. [D 20:43:18.163308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 40811. [D 20:43:18.163321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 40812. [D 20:43:18.163348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 40813. [D 20:43:18.163358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 40814. [D 20:43:18.163372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 40815. [D 20:43:18.163382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 40816. [D 20:43:18.163403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 40817. [D 20:43:18.163414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 40818. [D 20:43:18.163424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 40819. [D 20:43:18.163439] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 40820. [D 20:43:18.168904] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40820. [D 20:43:18.168918] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 38/70. [D 20:43:18.171194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.171207] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.171217] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:18.190177] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.190192] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.190203] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:18.190218] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6406 [D 20:43:18.190228] element 0: offset: 0x5b0030, size: 24 [D 20:43:18.190239] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 39/70. [D 20:43:18.192479] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6406 [D 20:43:18.192496] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 40/70. [D 20:43:18.192543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 40820. [D 20:43:18.192555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 40821. [D 20:43:18.192565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 40822. [D 20:43:18.192575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 40823. [D 20:43:18.192585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 40824. [D 20:43:18.192601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 40825. [D 20:43:18.192614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 40826. [D 20:43:18.192624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 40827. [D 20:43:18.192634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 40828. [D 20:43:18.192645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 40829. [D 20:43:18.192657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 40830. [D 20:43:18.192667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 40831. [D 20:43:18.192676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 40832. [D 20:43:18.192687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 40833. [D 20:43:18.192697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 40834. [D 20:43:18.192707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 40835. [D 20:43:18.192717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 40836. [D 20:43:18.192742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 40837. [D 20:43:18.192753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 40838. [D 20:43:18.192762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 40839. [D 20:43:18.192777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 40840. [D 20:43:18.192787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 40841. [D 20:43:18.192797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 40842. [D 20:43:18.192842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 40843. [D 20:43:18.192852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 40844. [D 20:43:18.192862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 40845. [D 20:43:18.192871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 40846. [D 20:43:18.192895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 40847. [D 20:43:18.192906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 40848. [D 20:43:18.192916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 40849. [D 20:43:18.192929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 40850. [D 20:43:18.192939] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 40851. [D 20:43:18.198410] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40851. [D 20:43:18.198424] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 41/70. [D 20:43:18.200702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.200716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.200727] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:18.358401] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.358423] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.358434] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:18.358456] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6409 [D 20:43:18.358467] element 0: offset: 0x64dd10, size: 24 [D 20:43:18.358478] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 42/70. [D 20:43:18.360824] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6409 [D 20:43:18.360842] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 43/70. [D 20:43:18.360938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 40851. [D 20:43:18.360950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 40852. [D 20:43:18.360961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 40853. [D 20:43:18.360971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 40854. [D 20:43:18.360981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 40855. [D 20:43:18.360998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 40856. [D 20:43:18.361008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 40857. [D 20:43:18.361018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 40858. [D 20:43:18.361034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 40859. [D 20:43:18.361044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 40860. [D 20:43:18.361054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 40861. [D 20:43:18.361071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 40862. [D 20:43:18.361081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 40863. [D 20:43:18.361091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 40864. [D 20:43:18.361135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 40865. [D 20:43:18.361145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 40866. [D 20:43:18.361155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 40867. [D 20:43:18.361165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 40868. [D 20:43:18.361196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 40869. [D 20:43:18.361206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 40870. [D 20:43:18.361221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 40871. [D 20:43:18.361231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 40872. [D 20:43:18.361240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 40873. [D 20:43:18.361254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 40874. [D 20:43:18.361264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 40875. [D 20:43:18.361274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 40876. [D 20:43:18.361304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 40877. [D 20:43:18.361316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 40878. [D 20:43:18.361326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 40879. [D 20:43:18.361335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 40880. [D 20:43:18.361346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 40881. [D 20:43:18.361370] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 40882. [D 20:43:18.373706] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40882. [D 20:43:18.373751] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 44/70. [D 20:43:18.376097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.376112] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.376124] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:18.407128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.407142] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.407154] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:18.407183] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6412 [D 20:43:18.407194] element 0: offset: 0x62f810, size: 24 [D 20:43:18.407205] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 45/70. [D 20:43:18.407225] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.407238] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.407247] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:18.407261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6415 [D 20:43:18.407272] element 0: offset: 0x63c160, size: 24 [D 20:43:18.407282] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 46/70. [D 20:43:18.412374] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6412 [D 20:43:18.412450] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 47/70. [D 20:43:18.412515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 40882. [D 20:43:18.412529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 40883. [D 20:43:18.412540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 40884. [D 20:43:18.412550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 40885. [D 20:43:18.412560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 40886. [D 20:43:18.412571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 40887. [D 20:43:18.412581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 40888. [D 20:43:18.412598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 40889. [D 20:43:18.412608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 40890. [D 20:43:18.412618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 40891. [D 20:43:18.412629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 40892. [D 20:43:18.412638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 40893. [D 20:43:18.412648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 40894. [D 20:43:18.412658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 40895. [D 20:43:18.412717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 40896. [D 20:43:18.412728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 40897. [D 20:43:18.412753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 40898. [D 20:43:18.412763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 40899. [D 20:43:18.412773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 40900. [D 20:43:18.412790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 40901. [D 20:43:18.412800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 40902. [D 20:43:18.412810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 40903. [D 20:43:18.412839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 40904. [D 20:43:18.412849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 40905. [D 20:43:18.412863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 40906. [D 20:43:18.412872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 40907. [D 20:43:18.412882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 40908. [D 20:43:18.412911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 40909. [D 20:43:18.412921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 40910. [D 20:43:18.412932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 40911. [D 20:43:18.412942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 40912. [D 20:43:18.412952] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 40913. [D 20:43:18.415378] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6415 [D 20:43:18.415395] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 48/70. [D 20:43:18.423236] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40913. [D 20:43:18.423251] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 49/70. [D 20:43:18.423293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 40913. [D 20:43:18.423304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 40914. [D 20:43:18.423318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 40915. [D 20:43:18.423328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 40916. [D 20:43:18.423338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 40917. [D 20:43:18.423348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 40918. [D 20:43:18.423358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 40919. [D 20:43:18.423373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 40920. [D 20:43:18.423383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 40921. [D 20:43:18.423407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 40922. [D 20:43:18.423423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 40923. [D 20:43:18.423434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 40924. [D 20:43:18.423443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 40925. [D 20:43:18.423472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 40926. [D 20:43:18.423484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 40927. [D 20:43:18.423496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 40928. [D 20:43:18.423506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 40929. [D 20:43:18.423520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 40930. [D 20:43:18.423543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 40931. [D 20:43:18.423554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 40932. [D 20:43:18.423565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 40933. [D 20:43:18.423575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 40934. [D 20:43:18.423585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 40935. [D 20:43:18.423612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 40936. [D 20:43:18.423624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 40937. [D 20:43:18.423634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 40938. [D 20:43:18.423644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 40939. [D 20:43:18.423654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 40940. [D 20:43:18.423675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 40941. [D 20:43:18.423685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 40942. [D 20:43:18.423695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 40943. [D 20:43:18.423705] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 40944. [D 20:43:18.423757] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.423771] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.423781] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.434968] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 40944. [D 20:43:18.434983] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 50/70. [D 20:43:18.435617] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.435631] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.435641] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:18.435672] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6417 [D 20:43:18.435683] element 0: offset: 0x657310, size: 24 [D 20:43:18.437302] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 51/70. [D 20:43:18.437327] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.437340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.437351] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.441534] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6417 [D 20:43:18.441551] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 52/70. [D 20:43:18.441802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 40944. [D 20:43:18.441817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 40945. [D 20:43:18.441828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 40946. [D 20:43:18.441838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 40947. [D 20:43:18.441854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 40948. [D 20:43:18.441865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 40949. [D 20:43:18.441875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 40950. [D 20:43:18.441885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 40951. [D 20:43:18.441896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 40952. [D 20:43:18.441906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 40953. [D 20:43:18.441916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 40954. [D 20:43:18.441949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 40955. [D 20:43:18.441959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 40956. [D 20:43:18.441973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 40957. [D 20:43:18.441982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 40958. [D 20:43:18.441993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 40959. [D 20:43:18.442003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 40960. [D 20:43:18.442026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 40961. [D 20:43:18.442036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 40962. [D 20:43:18.442052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 40963. [D 20:43:18.442062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 40964. [D 20:43:18.442087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 40965. [D 20:43:18.442097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 40966. [D 20:43:18.442107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 40967. [D 20:43:18.442121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 40968. [D 20:43:18.442131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 40969. [D 20:43:18.442141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 40970. [D 20:43:18.442158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 40971. [D 20:43:18.442167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 40972. [D 20:43:18.442177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 40973. [D 20:43:18.442187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 40974. [D 20:43:18.442197] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 40975. [D 20:43:18.444436] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.444450] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.444460] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:18.444475] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6421 [D 20:43:18.444485] element 0: offset: 0x6328e0, size: 24 [D 20:43:18.444495] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 53/70. [D 20:43:18.453425] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 40975. [D 20:43:18.453439] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 54/70. [D 20:43:18.455756] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.455770] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.455780] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.457878] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6421 [D 20:43:18.457935] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 55/70. [D 20:43:18.459529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 40975. [D 20:43:18.459545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 40976. [D 20:43:18.459556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 40977. [D 20:43:18.459567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 40978. [D 20:43:18.459577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 40979. [D 20:43:18.459592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 40980. [D 20:43:18.459602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 40981. [D 20:43:18.459630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 40982. [D 20:43:18.459640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 40983. [D 20:43:18.459655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 40984. [D 20:43:18.459666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 40985. [D 20:43:18.459676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 40986. [D 20:43:18.459687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 40987. [D 20:43:18.459697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 40988. [D 20:43:18.459707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 40989. [D 20:43:18.459717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 40990. [D 20:43:18.459727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 40991. [D 20:43:18.459746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 40992. [D 20:43:18.459756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 40993. [D 20:43:18.459766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 40994. [D 20:43:18.459792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 40995. [D 20:43:18.459802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 40996. [D 20:43:18.459812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 40997. [D 20:43:18.459823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 40998. [D 20:43:18.459833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 40999. [D 20:43:18.459844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 41000. [D 20:43:18.459854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 41001. [D 20:43:18.459879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 41002. [D 20:43:18.459894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 41003. [D 20:43:18.459904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 41004. [D 20:43:18.459914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 41005. [D 20:43:18.459944] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 41006. [D 20:43:18.463611] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.463627] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.463638] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:18.463670] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6423 [D 20:43:18.463681] element 0: offset: 0x64dd10, size: 24 [D 20:43:18.464607] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 56/70. [D 20:43:18.471179] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41006. [D 20:43:18.471194] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 57/70. [D 20:43:18.479231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.479285] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.479295] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.481853] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.481867] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.481878] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:18.481908] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6427 [D 20:43:18.481918] element 0: offset: 0x62f810, size: 24 [D 20:43:18.481931] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 58/70. [D 20:43:18.481959] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6423 [D 20:43:18.481974] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 59/70. [D 20:43:18.482137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 41006. [D 20:43:18.482153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 41007. [D 20:43:18.482164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 41008. [D 20:43:18.482174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 41009. [D 20:43:18.482185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 41010. [D 20:43:18.482194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 41011. [D 20:43:18.482205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 41012. [D 20:43:18.482217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 41013. [D 20:43:18.482234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 41014. [D 20:43:18.482244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 41015. [D 20:43:18.482254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 41016. [D 20:43:18.482279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 41017. [D 20:43:18.482290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 41018. [D 20:43:18.482300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 41019. [D 20:43:18.482311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 41020. [D 20:43:18.482321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 41021. [D 20:43:18.482331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 41022. [D 20:43:18.482354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 41023. [D 20:43:18.482365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 41024. [D 20:43:18.482379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 41025. [D 20:43:18.482389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 41026. [D 20:43:18.482398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 41027. [D 20:43:18.482409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 41028. [D 20:43:18.482436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 41029. [D 20:43:18.482446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 41030. [D 20:43:18.482460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 41031. [D 20:43:18.482471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 41032. [D 20:43:18.482494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 41033. [D 20:43:18.482505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 41034. [D 20:43:18.482515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 41035. [D 20:43:18.482528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 41036. [D 20:43:18.482538] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 41037. [D 20:43:18.486851] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6427 [D 20:43:18.486912] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 60/70. [D 20:43:18.490415] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41037. [D 20:43:18.490433] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 0/70. [D 20:43:18.490452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 41037. [D 20:43:18.490463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 41038. [D 20:43:18.490475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 41039. [D 20:43:18.490486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 41040. [D 20:43:18.490496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 41041. [D 20:43:18.490506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 41042. [D 20:43:18.490516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 41043. [D 20:43:18.490527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 41044. [D 20:43:18.490537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 41045. [D 20:43:18.490547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 41046. [D 20:43:18.490557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 41047. [D 20:43:18.490575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 41048. [D 20:43:18.490585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 41049. [D 20:43:18.490595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 41050. [D 20:43:18.490623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 41051. [D 20:43:18.490633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 41052. [D 20:43:18.490644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 41053. [D 20:43:18.490655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 41054. [D 20:43:18.490680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 41055. [D 20:43:18.490690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 41056. [D 20:43:18.490700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 41057. [D 20:43:18.490711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 41058. [D 20:43:18.490740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 41059. [D 20:43:18.490754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 41060. [D 20:43:18.490763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 41061. [D 20:43:18.490779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 41062. [D 20:43:18.490790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 41063. [D 20:43:18.490799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 41064. [D 20:43:18.490824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 41065. [D 20:43:18.490834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 41066. [D 20:43:18.490849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 41067. [D 20:43:18.490859] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 41068. [D 20:43:18.490923] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.490937] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.490947] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.500499] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 41068. [D 20:43:18.500513] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 1/70. [D 20:43:18.502655] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.502669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.502678] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:18.502708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6429 [D 20:43:18.502719] element 0: offset: 0x620d50, size: 24 [D 20:43:18.502730] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 2/70. [D 20:43:18.502750] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.502765] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.502773] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.505688] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6429 [D 20:43:18.505705] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 3/70. [D 20:43:18.506238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 41068. [D 20:43:18.506253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 41069. [D 20:43:18.506264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 41070. [D 20:43:18.506274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 41071. [D 20:43:18.506284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 41072. [D 20:43:18.506298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 41073. [D 20:43:18.506307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 41074. [D 20:43:18.506317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 41075. [D 20:43:18.506333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 41076. [D 20:43:18.506343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 41077. [D 20:43:18.506353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 41078. [D 20:43:18.506369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 41079. [D 20:43:18.506379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 41080. [D 20:43:18.506389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 41081. [D 20:43:18.506405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 41082. [D 20:43:18.506415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 41083. [D 20:43:18.506442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 41084. [D 20:43:18.506452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 41085. [D 20:43:18.506467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 41086. [D 20:43:18.506490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 41087. [D 20:43:18.506501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 41088. [D 20:43:18.506512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 41089. [D 20:43:18.506521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 41090. [D 20:43:18.506532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 41091. [D 20:43:18.506543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 41092. [D 20:43:18.506566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 41093. [D 20:43:18.506580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 41094. [D 20:43:18.506590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 41095. [D 20:43:18.506600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 41096. [D 20:43:18.506615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 41097. [D 20:43:18.506625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 41098. [D 20:43:18.506635] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 41099. [D 20:43:18.508841] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.508855] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.508866] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:18.508881] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6433 [D 20:43:18.508891] element 0: offset: 0x5b0030, size: 24 [D 20:43:18.508901] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 4/70. [D 20:43:18.512441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.512455] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.512464] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:18.512478] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6436 [D 20:43:18.512488] element 0: offset: 0x64d990, size: 24 [D 20:43:18.512498] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 5/70. [D 20:43:18.517818] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41099. [D 20:43:18.517832] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 6/70. [D 20:43:18.520169] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.520183] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.520192] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:18.522703] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6436 [D 20:43:18.522754] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 7/70. [D 20:43:18.523628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 41099. [D 20:43:18.523647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 41100. [D 20:43:18.523660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 41101. [D 20:43:18.523670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 41102. [D 20:43:18.523680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 41103. [D 20:43:18.523695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 41104. [D 20:43:18.523705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 41105. [D 20:43:18.523715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 41106. [D 20:43:18.523731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 41107. [D 20:43:18.523741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 41108. [D 20:43:18.523751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 41109. [D 20:43:18.523767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 41110. [D 20:43:18.523777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 41111. [D 20:43:18.523787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 41112. [D 20:43:18.523802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 41113. [D 20:43:18.523812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 41114. [D 20:43:18.523841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 41115. [D 20:43:18.523851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 41116. [D 20:43:18.523862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 41117. [D 20:43:18.523885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 41118. [D 20:43:18.523896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 41119. [D 20:43:18.523913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 41120. [D 20:43:18.523923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 41121. [D 20:43:18.523933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 41122. [D 20:43:18.523949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 41123. [D 20:43:18.523959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 41124. [D 20:43:18.523985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 41125. [D 20:43:18.523995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 41126. [D 20:43:18.524005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 41127. [D 20:43:18.524016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 41128. [D 20:43:18.524025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 41129. [D 20:43:18.524035] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 41130. [D 20:43:18.527623] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6433 [D 20:43:18.527639] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 8/70. [D 20:43:18.527673] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.527687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.527697] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:18.527729] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6438 [D 20:43:18.527740] element 0: offset: 0x61f900, size: 24 [D 20:43:18.527753] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 9/70. [D 20:43:18.533555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.533570] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.533579] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:18.533596] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6442 [D 20:43:18.533608] element 0: offset: 0x62f810, size: 24 [D 20:43:18.533618] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 10/70. [D 20:43:18.535326] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41130. [D 20:43:18.535341] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 11/70. [D 20:43:18.535363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 41130. [D 20:43:18.535374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 41131. [D 20:43:18.535384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 41132. [D 20:43:18.535394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 41133. [D 20:43:18.535409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 41134. [D 20:43:18.535419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 41135. [D 20:43:18.535429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 41136. [D 20:43:18.535445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 41137. [D 20:43:18.535455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 41138. [D 20:43:18.535465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 41139. [D 20:43:18.535475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 41140. [D 20:43:18.535485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 41141. [D 20:43:18.535495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 41142. [D 20:43:18.535505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 41143. [D 20:43:18.535521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 41144. [D 20:43:18.535531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 41145. [D 20:43:18.535541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 41146. [D 20:43:18.535576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 41147. [D 20:43:18.535586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 41148. [D 20:43:18.535596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 41149. [D 20:43:18.535615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 41150. [D 20:43:18.535625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 41151. [D 20:43:18.535648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 41152. [D 20:43:18.535658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 41153. [D 20:43:18.535668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 41154. [D 20:43:18.535688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 41155. [D 20:43:18.535698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 41156. [D 20:43:18.535708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 41157. [D 20:43:18.535733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 41158. [D 20:43:18.535743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 41159. [D 20:43:18.535753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 41160. [D 20:43:18.535769] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 41161. [D 20:43:18.538183] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.538197] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.538206] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:18.540595] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6438 [D 20:43:18.540652] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 12/70. [D 20:43:18.540764] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6442 [D 20:43:18.540823] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 13/70. [D 20:43:18.542156] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 41161. [D 20:43:18.542174] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 14/70. [D 20:43:18.542187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 41161. [D 20:43:18.542199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 41162. [D 20:43:18.542212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 41163. [D 20:43:18.542223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 41164. [D 20:43:18.542233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 41165. [D 20:43:18.542243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 41166. [D 20:43:18.542254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 41167. [D 20:43:18.542264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 41168. [D 20:43:18.542275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 41169. [D 20:43:18.542285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 41170. [D 20:43:18.542295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 41171. [D 20:43:18.542312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 41172. [D 20:43:18.542345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 41173. [D 20:43:18.542355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 41174. [D 20:43:18.542365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 41175. [D 20:43:18.542381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 41176. [D 20:43:18.542391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 41177. [D 20:43:18.542401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 41178. [D 20:43:18.542448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 41179. [D 20:43:18.542471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 41180. [D 20:43:18.542486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 41181. [D 20:43:18.542496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 41182. [D 20:43:18.542510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 41183. [D 20:43:18.542521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 41184. [D 20:43:18.542531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 41185. [D 20:43:18.542542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 41186. [D 20:43:18.542566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 41187. [D 20:43:18.542581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 41188. [D 20:43:18.542592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 41189. [D 20:43:18.542602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 41190. [D 20:43:18.542612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 41191. [D 20:43:18.542628] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 41192. [D 20:43:18.542654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 41193. [D 20:43:18.542666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 41194. [D 20:43:18.542676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 41195. [D 20:43:18.542686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 41196. [D 20:43:18.542712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 41197. [D 20:43:18.542722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 41198. [D 20:43:18.542734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 41199. [D 20:43:18.542744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 41200. [D 20:43:18.542754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 41201. [D 20:43:18.542779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 41202. [D 20:43:18.542789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 41203. [D 20:43:18.542803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 41204. [D 20:43:18.542813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 41205. [D 20:43:18.542826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 41206. [D 20:43:18.542841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 41207. [D 20:43:18.542850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 41208. [D 20:43:18.542860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 41209. [D 20:43:18.542887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 41210. [D 20:43:18.542897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 41211. [D 20:43:18.542907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 41212. [D 20:43:18.542922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 41213. [D 20:43:18.542932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 41214. [D 20:43:18.542943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 41215. [D 20:43:18.542972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 41216. [D 20:43:18.542988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 41217. [D 20:43:18.542998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 41218. [D 20:43:18.543008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 41219. [D 20:43:18.543036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 41220. [D 20:43:18.543046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 41221. [D 20:43:18.543057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 41222. [D 20:43:18.543067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 41223. [D 20:43:18.543077] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d340 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 41224. [D 20:43:18.543131] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.543145] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.543154] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:18.548141] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41224. [D 20:43:18.548193] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 15/70. [D 20:43:18.549830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.549845] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.549853] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:18.549884] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6445 [D 20:43:18.549895] element 0: offset: 0x643630, size: 24 [D 20:43:18.549906] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 16/70. [D 20:43:18.553966] openib_check_cq: completed rdma wr_id 2aaaab23d340, nic_wr_credit 41223. [D 20:43:18.553982] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 17/70. [D 20:43:18.556251] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.556265] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.556275] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:18.556333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.556346] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.556354] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.558579] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6445 [D 20:43:18.558594] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 18/70. [D 20:43:18.558642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 41223. [D 20:43:18.558656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 41224. [D 20:43:18.558668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 41225. [D 20:43:18.558678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 41226. [D 20:43:18.558688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 41227. [D 20:43:18.558698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 41228. [D 20:43:18.558720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 41229. [D 20:43:18.558730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 41230. [D 20:43:18.558746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 41231. [D 20:43:18.558756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 41232. [D 20:43:18.558775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 41233. [D 20:43:18.558790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 41234. [D 20:43:18.558799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 41235. [D 20:43:18.558810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 41236. [D 20:43:18.558819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 41237. [D 20:43:18.558836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 41238. [D 20:43:18.558846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 41239. [D 20:43:18.558872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 41240. [D 20:43:18.558883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 41241. [D 20:43:18.558893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 41242. [D 20:43:18.558908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 41243. [D 20:43:18.558918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 41244. [D 20:43:18.558927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 41245. [D 20:43:18.558957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 41246. [D 20:43:18.558967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 41247. [D 20:43:18.558980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 41248. [D 20:43:18.558990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 41249. [D 20:43:18.559000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 41250. [D 20:43:18.559014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 41251. [D 20:43:18.559024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 41252. [D 20:43:18.559049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 41253. [D 20:43:18.559059] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 41254. [D 20:43:18.564591] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41254. [D 20:43:18.564604] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 19/70. [D 20:43:18.566861] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.566874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.566883] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:18.813242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.813257] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.813268] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:18.813284] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6448 [D 20:43:18.813294] element 0: offset: 0x62d530, size: 24 [D 20:43:18.813304] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 20/70. [D 20:43:18.815313] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6448 [D 20:43:18.815361] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 21/70. [D 20:43:18.819649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 41254. [D 20:43:18.819709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 41255. [D 20:43:18.819720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 41256. [D 20:43:18.819731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 41257. [D 20:43:18.819742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 41258. [D 20:43:18.819753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 41259. [D 20:43:18.819763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 41260. [D 20:43:18.819773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 41261. [D 20:43:18.819783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 41262. [D 20:43:18.819793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 41263. [D 20:43:18.819803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 41264. [D 20:43:18.819836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 41265. [D 20:43:18.819858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 41266. [D 20:43:18.819868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 41267. [D 20:43:18.819879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 41268. [D 20:43:18.819901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 41269. [D 20:43:18.819916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 41270. [D 20:43:18.819926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 41271. [D 20:43:18.819936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 41272. [D 20:43:18.819951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 41273. [D 20:43:18.819983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 41274. [D 20:43:18.820005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 41275. [D 20:43:18.820029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 41276. [D 20:43:18.820039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 41277. [D 20:43:18.820053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 41278. [D 20:43:18.820075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 41279. [D 20:43:18.820097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 41280. [D 20:43:18.820107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 41281. [D 20:43:18.820120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 41282. [D 20:43:18.820138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 41283. [D 20:43:18.820160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 41284. [D 20:43:18.820170] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 41285. [D 20:43:18.826190] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41285. [D 20:43:18.826206] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 22/70. [D 20:43:18.828547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.828563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.828573] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:18.833214] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.833228] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.833239] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:18.833270] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6452 [D 20:43:18.833281] element 0: offset: 0x620d50, size: 24 [D 20:43:18.833293] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 23/70. [D 20:43:18.835494] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6452 [D 20:43:18.835549] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 24/70. [D 20:43:18.837630] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.837647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.837656] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:18.837671] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6454 [D 20:43:18.837681] element 0: offset: 0x5b0030, size: 24 [D 20:43:18.837691] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 25/70. [D 20:43:18.837711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 41285. [D 20:43:18.837723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 41286. [D 20:43:18.837734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 41287. [D 20:43:18.837748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 41288. [D 20:43:18.837758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 41289. [D 20:43:18.837768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 41290. [D 20:43:18.837782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 41291. [D 20:43:18.837792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 41292. [D 20:43:18.837802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 41293. [D 20:43:18.837816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 41294. [D 20:43:18.837826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 41295. [D 20:43:18.837880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 41296. [D 20:43:18.837892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 41297. [D 20:43:18.837902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 41298. [D 20:43:18.837912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 41299. [D 20:43:18.837928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 41300. [D 20:43:18.837938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 41301. [D 20:43:18.837947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 41302. [D 20:43:18.837963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 41303. [D 20:43:18.837973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 41304. [D 20:43:18.837983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 41305. [D 20:43:18.837994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 41306. [D 20:43:18.838004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 41307. [D 20:43:18.838014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 41308. [D 20:43:18.838029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 41309. [D 20:43:18.838044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 41310. [D 20:43:18.838054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 41311. [D 20:43:18.838076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 41312. [D 20:43:18.838094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 41313. [D 20:43:18.838104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 41314. [D 20:43:18.838114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 41315. [D 20:43:18.838125] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 41316. [D 20:43:18.838155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.838166] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.838175] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:18.838189] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6457 [D 20:43:18.838214] element 0: offset: 0x62f810, size: 24 [D 20:43:18.838225] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 26/70. [D 20:43:18.842164] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6454 [D 20:43:18.842184] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 27/70. [D 20:43:18.843591] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41316. [D 20:43:18.843661] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 28/70. [D 20:43:18.843678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 41316. [D 20:43:18.843690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 41317. [D 20:43:18.843701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 41318. [D 20:43:18.843713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 41319. [D 20:43:18.843728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 41320. [D 20:43:18.843738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 41321. [D 20:43:18.843748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 41322. [D 20:43:18.843764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 41323. [D 20:43:18.843774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 41324. [D 20:43:18.843784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 41325. [D 20:43:18.843799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 41326. [D 20:43:18.843809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 41327. [D 20:43:18.843819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 41328. [D 20:43:18.843829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 41329. [D 20:43:18.843839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 41330. [D 20:43:18.843849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 41331. [D 20:43:18.843928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 41332. [D 20:43:18.843939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 41333. [D 20:43:18.843949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 41334. [D 20:43:18.843960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 41335. [D 20:43:18.843971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 41336. [D 20:43:18.843980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 41337. [D 20:43:18.843991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 41338. [D 20:43:18.844018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 41339. [D 20:43:18.844030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 41340. [D 20:43:18.844040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 41341. [D 20:43:18.844049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 41342. [D 20:43:18.844060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 41343. [D 20:43:18.844071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 41344. [D 20:43:18.844081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 41345. [D 20:43:18.843909] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.844097] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.844122] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:18.844158] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6460 [D 20:43:18.844171] element 0: offset: 0x691fe0, size: 24 [D 20:43:18.844183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 41346. [D 20:43:18.844194] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 41347. [D 20:43:18.844223] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 29/70. [D 20:43:18.844278] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.844290] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.844300] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:18.848995] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6457 [D 20:43:18.849052] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 30/70. [D 20:43:18.849602] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 41347. [D 20:43:18.849620] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 31/70. [D 20:43:18.849643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 41347. [D 20:43:18.849654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 41348. [D 20:43:18.849665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 41349. [D 20:43:18.849675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 41350. [D 20:43:18.849690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 41351. [D 20:43:18.849700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 41352. [D 20:43:18.849710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 41353. [D 20:43:18.849726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 41354. [D 20:43:18.849736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 41355. [D 20:43:18.849746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 41356. [D 20:43:18.849771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 41357. [D 20:43:18.849781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 41358. [D 20:43:18.849796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 41359. [D 20:43:18.849816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 41360. [D 20:43:18.849826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 41361. [D 20:43:18.849840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 41362. [D 20:43:18.849850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 41363. [D 20:43:18.849860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 41364. [D 20:43:18.849889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 41365. [D 20:43:18.849900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 41366. [D 20:43:18.849912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 41367. [D 20:43:18.849922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 41368. [D 20:43:18.849932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 41369. [D 20:43:18.849946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 41370. [D 20:43:18.849956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 41371. [D 20:43:18.849966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 41372. [D 20:43:18.849996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 41373. [D 20:43:18.852061] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6460 [D 20:43:18.852103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 41374. [D 20:43:18.852157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 41375. [D 20:43:18.852169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 41376. [D 20:43:18.852179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 41377. [D 20:43:18.852190] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 41378. [D 20:43:18.852226] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 32/70. [D 20:43:18.852266] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.852281] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.852319] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:18.861414] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41378. [D 20:43:18.861431] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 33/70. [D 20:43:18.861460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 41378. [D 20:43:18.861472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 41379. [D 20:43:18.861482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 41380. [D 20:43:18.861493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 41381. [D 20:43:18.861503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 41382. [D 20:43:18.861514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 41383. [D 20:43:18.861524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 41384. [D 20:43:18.861535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 41385. [D 20:43:18.861545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 41386. [D 20:43:18.861560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 41387. [D 20:43:18.861571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 41388. [D 20:43:18.861581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 41389. [D 20:43:18.861591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 41390. [D 20:43:18.861607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 41391. [D 20:43:18.861616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 41392. [D 20:43:18.861626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 41393. [D 20:43:18.861637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 41394. [D 20:43:18.861669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 41395. [D 20:43:18.861684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 41396. [D 20:43:18.861693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 41397. [D 20:43:18.861708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 41398. [D 20:43:18.861732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 41399. [D 20:43:18.861743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 41400. [D 20:43:18.861753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 41401. [D 20:43:18.861763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 41402. [D 20:43:18.861773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 41403. [D 20:43:18.861790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 41404. [D 20:43:18.861800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 41405. [D 20:43:18.861810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 41406. [D 20:43:18.861820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 41407. [D 20:43:18.861830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 41408. [D 20:43:18.861840] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 41409. [D 20:43:18.861872] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.864017] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.864028] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.873154] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 41409. [D 20:43:18.873169] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 34/70. [D 20:43:18.875459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.875472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.875481] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:18.892504] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.892519] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.892530] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:18.892562] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6464 [D 20:43:18.892573] element 0: offset: 0x6328e0, size: 24 [D 20:43:18.892585] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 35/70. [D 20:43:18.892604] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.892618] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.892627] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:18.892641] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6465 [D 20:43:18.892651] element 0: offset: 0x62d630, size: 24 [D 20:43:18.892660] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 36/70. [D 20:43:18.897884] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6465 [D 20:43:18.897938] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 37/70. [D 20:43:18.897991] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6464 [D 20:43:18.898003] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 38/70. [D 20:43:18.898089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 41409. [D 20:43:18.898152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 41410. [D 20:43:18.898164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 41411. [D 20:43:18.898174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 41412. [D 20:43:18.898189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 41413. [D 20:43:18.898199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 41414. [D 20:43:18.898209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 41415. [D 20:43:18.898219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 41416. [D 20:43:18.898229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 41417. [D 20:43:18.898239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 41418. [D 20:43:18.898249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 41419. [D 20:43:18.898264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 41420. [D 20:43:18.898274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 41421. [D 20:43:18.898319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 41422. [D 20:43:18.898330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 41423. [D 20:43:18.898345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 41424. [D 20:43:18.898355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 41425. [D 20:43:18.898364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 41426. [D 20:43:18.898378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 41427. [D 20:43:18.898388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 41428. [D 20:43:18.898398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 41429. [D 20:43:18.898435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 41430. [D 20:43:18.898448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 41431. [D 20:43:18.898458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 41432. [D 20:43:18.898469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 41433. [D 20:43:18.898479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 41434. [D 20:43:18.898489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 41435. [D 20:43:18.898514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 41436. [D 20:43:18.898524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 41437. [D 20:43:18.898547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 41438. [D 20:43:18.898557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 41439. [D 20:43:18.898567] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 41440. [D 20:43:18.898585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 41441. [D 20:43:18.898595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 41442. [D 20:43:18.898611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 41443. [D 20:43:18.898621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 41444. [D 20:43:18.898632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 41445. [D 20:43:18.898641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 41446. [D 20:43:18.898670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 41447. [D 20:43:18.898680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 41448. [D 20:43:18.898694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 41449. [D 20:43:18.898704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 41450. [D 20:43:18.898714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 41451. [D 20:43:18.898727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 41452. [D 20:43:18.898737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 41453. [D 20:43:18.898747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 41454. [D 20:43:18.898763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 41455. [D 20:43:18.898773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 41456. [D 20:43:18.898783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 41457. [D 20:43:18.898798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 41458. [D 20:43:18.898825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 41459. [D 20:43:18.898835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 41460. [D 20:43:18.898857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 41461. [D 20:43:18.898868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 41462. [D 20:43:18.898878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 41463. [D 20:43:18.898888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 41464. [D 20:43:18.898898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 41465. [D 20:43:18.898908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 41466. [D 20:43:18.898933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 41467. [D 20:43:18.898944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 41468. [D 20:43:18.898954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 41469. [D 20:43:18.898967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 41470. [D 20:43:18.898977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 41471. [D 20:43:18.898987] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 41472. [D 20:43:18.899636] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.899652] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.899663] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:18.899697] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6470 [D 20:43:18.899708] element 0: offset: 0x61f310, size: 24 [D 20:43:18.899721] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 39/70. [D 20:43:18.899745] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.899755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.899763] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:18.899778] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6472 [D 20:43:18.899788] element 0: offset: 0x657310, size: 24 [D 20:43:18.899801] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 40/70. [D 20:43:18.909853] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41472. [D 20:43:18.909869] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 41/70. [D 20:43:18.919839] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 41471. [D 20:43:18.919853] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 42/70. [D 20:43:18.922130] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.922143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.922152] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:18.922224] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.922237] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.922245] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:18.924856] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6472 [D 20:43:18.924918] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 43/70. [D 20:43:18.925619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 41471. [D 20:43:18.925637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 41472. [D 20:43:18.925648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 41473. [D 20:43:18.925658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 41474. [D 20:43:18.925684] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6470 [D 20:43:18.925710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 41475. [D 20:43:18.925721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 41476. [D 20:43:18.925731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 41477. [D 20:43:18.925745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 41478. [D 20:43:18.925755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 41479. [D 20:43:18.925765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 41480. [D 20:43:18.925781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 41481. [D 20:43:18.925791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 41482. [D 20:43:18.925801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 41483. [D 20:43:18.925811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 41484. [D 20:43:18.925821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 41485. [D 20:43:18.925831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 41486. [D 20:43:18.925851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 41487. [D 20:43:18.925861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 41488. [D 20:43:18.925871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 41489. [D 20:43:18.925881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 41490. [D 20:43:18.925892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 41491. [D 20:43:18.925904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 41492. [D 20:43:18.925932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 41493. [D 20:43:18.925949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 41494. [D 20:43:18.925958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 41495. [D 20:43:18.925968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 41496. [D 20:43:18.925984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 41497. [D 20:43:18.925994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 41498. [D 20:43:18.926004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 41499. [D 20:43:18.926037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 41500. [D 20:43:18.926048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 41501. [D 20:43:18.926058] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cd70 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 41502. [D 20:43:18.926074] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 44/70. [D 20:43:18.936345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.936361] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.936373] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:18.936406] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6475 [D 20:43:18.936417] element 0: offset: 0x5b0030, size: 24 [D 20:43:18.936428] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 45/70. [D 20:43:18.937266] openib_check_cq: completed rdma wr_id 2aaaab23cd70, nic_wr_credit 41502. [D 20:43:18.937280] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 46/70. [D 20:43:18.937313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 41502. [D 20:43:18.937342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 41503. [D 20:43:18.937353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 41504. [D 20:43:18.937363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 41505. [D 20:43:18.937373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 41506. [D 20:43:18.937383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 41507. [D 20:43:18.937393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 41508. [D 20:43:18.937404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 41509. [D 20:43:18.937415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 41510. [D 20:43:18.937435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 41511. [D 20:43:18.937445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 41512. [D 20:43:18.937462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 41513. [D 20:43:18.937472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 41514. [D 20:43:18.937482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 41515. [D 20:43:18.937505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 41516. [D 20:43:18.937515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 41517. [D 20:43:18.937586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 41518. [D 20:43:18.937598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 41519. [D 20:43:18.937608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 41520. [D 20:43:18.937618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 41521. [D 20:43:18.937630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 41522. [D 20:43:18.937639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 41523. [D 20:43:18.937650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 41524. [D 20:43:18.937676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 41525. [D 20:43:18.937686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 41526. [D 20:43:18.937697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 41527. [D 20:43:18.937707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 41528. [D 20:43:18.937718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 41529. [D 20:43:18.937728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 41530. [D 20:43:18.937747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 41531. [D 20:43:18.937758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 41532. [D 20:43:18.937768] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 41533. [D 20:43:18.937818] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.937832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.937842] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:18.942324] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6475 [D 20:43:18.942387] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 47/70. [D 20:43:18.948481] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41533. [D 20:43:18.948499] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 48/70. [D 20:43:18.948524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 41533. [D 20:43:18.948536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 41534. [D 20:43:18.948546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 41535. [D 20:43:18.948557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 41536. [D 20:43:18.948567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 41537. [D 20:43:18.948577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 41538. [D 20:43:18.948593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 41539. [D 20:43:18.948603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 41540. [D 20:43:18.948614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 41541. [D 20:43:18.948624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 41542. [D 20:43:18.948664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 41543. [D 20:43:18.948675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 41544. [D 20:43:18.948685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 41545. [D 20:43:18.948696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 41546. [D 20:43:18.948707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 41547. [D 20:43:18.948717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 41548. [D 20:43:18.948742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 41549. [D 20:43:18.948752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 41550. [D 20:43:18.948763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 41551. [D 20:43:18.948773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 41552. [D 20:43:18.948783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 41553. [D 20:43:18.948793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 41554. [D 20:43:18.948821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 41555. [D 20:43:18.948831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 41556. [D 20:43:18.948842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 41557. [D 20:43:18.948851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 41558. [D 20:43:18.948862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 41559. [D 20:43:18.948873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 41560. [D 20:43:18.948883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 41561. [D 20:43:18.948909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 41562. [D 20:43:18.948919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 41563. [D 20:43:18.948929] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cd70 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 41564. [D 20:43:18.948994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.949009] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.949032] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.955820] openib_check_cq: completed rdma wr_id 2aaaab23cd70, nic_wr_credit 41564. [D 20:43:18.955836] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 49/70. [D 20:43:18.958155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.958168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.958178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:18.969916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.969930] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.969941] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:18.969972] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6478 [D 20:43:18.969983] element 0: offset: 0x691fe0, size: 24 [D 20:43:18.969994] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 50/70. [D 20:43:18.970260] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:18.970274] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.970282] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:18.970297] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6481 [D 20:43:18.970307] element 0: offset: 0x62d630, size: 24 [D 20:43:18.970316] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 51/70. [D 20:43:18.974344] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6478 [D 20:43:18.974361] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 52/70. [D 20:43:18.974374] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6481 [D 20:43:18.974386] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 53/70. [D 20:43:18.974461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 41564. [D 20:43:18.974475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 41565. [D 20:43:18.974486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 41566. [D 20:43:18.974496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 41567. [D 20:43:18.974522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 41568. [D 20:43:18.974532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 41569. [D 20:43:18.974542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 41570. [D 20:43:18.974553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 41571. [D 20:43:18.974563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 41572. [D 20:43:18.974573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 41573. [D 20:43:18.974584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 41574. [D 20:43:18.974594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 41575. [D 20:43:18.974603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 41576. [D 20:43:18.974621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 41577. [D 20:43:18.974631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 41578. [D 20:43:18.974641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 41579. [D 20:43:18.974651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 41580. [D 20:43:18.974661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 41581. [D 20:43:18.974671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 41582. [D 20:43:18.974681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 41583. [D 20:43:18.974704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 41584. [D 20:43:18.974714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 41585. [D 20:43:18.974724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 41586. [D 20:43:18.974734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 41587. [D 20:43:18.974752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 41588. [D 20:43:18.974779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 41589. [D 20:43:18.974793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 41590. [D 20:43:18.974803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 41591. [D 20:43:18.974813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 41592. [D 20:43:18.974826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 41593. [D 20:43:18.974836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 41594. [D 20:43:18.974846] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 41595. [D 20:43:18.974876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 41596. [D 20:43:18.974888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 41597. [D 20:43:18.974898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 41598. [D 20:43:18.974908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 41599. [D 20:43:18.974919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 41600. [D 20:43:18.974929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 41601. [D 20:43:18.974940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 41602. [D 20:43:18.974950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 41603. [D 20:43:18.974961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 41604. [D 20:43:18.974988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 41605. [D 20:43:18.975002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 41606. [D 20:43:18.975012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 41607. [D 20:43:18.975022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 41608. [D 20:43:18.975033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 41609. [D 20:43:18.975044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 41610. [D 20:43:18.975054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 41611. [D 20:43:18.975078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 41612. [D 20:43:18.975088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 41613. [D 20:43:18.975098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 41614. [D 20:43:18.975113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 41615. [D 20:43:18.975123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 41616. [D 20:43:18.975133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 41617. [D 20:43:18.975148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 41618. [D 20:43:18.975169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 41619. [D 20:43:18.975180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 41620. [D 20:43:18.975190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 41621. [D 20:43:18.975200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 41622. [D 20:43:18.975211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 41623. [D 20:43:18.975221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 41624. [D 20:43:18.975231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 41625. [D 20:43:18.975241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 41626. [D 20:43:18.975259] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 41627. [D 20:43:18.980377] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41627. [D 20:43:18.980427] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 54/70. [D 20:43:18.986213] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 41626. [D 20:43:18.986231] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 55/70. [D 20:43:18.988484] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.988497] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.988507] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:18.988520] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:18.988529] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:18.988539] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.063578] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.063593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.063604] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.063619] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6483 [D 20:43:19.063629] element 0: offset: 0x657310, size: 24 [D 20:43:19.063641] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 56/70. [D 20:43:19.065971] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6483 [D 20:43:19.065987] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 57/70. [D 20:43:19.066040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 41626. [D 20:43:19.066053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 41627. [D 20:43:19.066063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 41628. [D 20:43:19.066078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 41629. [D 20:43:19.066088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 41630. [D 20:43:19.066098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 41631. [D 20:43:19.066115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 41632. [D 20:43:19.066125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 41633. [D 20:43:19.066135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 41634. [D 20:43:19.066163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 41635. [D 20:43:19.066173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 41636. [D 20:43:19.066187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 41637. [D 20:43:19.066197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 41638. [D 20:43:19.066212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 41639. [D 20:43:19.066223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 41640. [D 20:43:19.066233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 41641. [D 20:43:19.066256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 41642. [D 20:43:19.066267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 41643. [D 20:43:19.066277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 41644. [D 20:43:19.066292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 41645. [D 20:43:19.066302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 41646. [D 20:43:19.066322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 41647. [D 20:43:19.066332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 41648. [D 20:43:19.066343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 41649. [D 20:43:19.066353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 41650. [D 20:43:19.066368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 41651. [D 20:43:19.066378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 41652. [D 20:43:19.066388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 41653. [D 20:43:19.066398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 41654. [D 20:43:19.066408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 41655. [D 20:43:19.066419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 41656. [D 20:43:19.066429] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 41657. [D 20:43:19.071918] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41657. [D 20:43:19.071932] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 58/70. [D 20:43:19.074181] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.074194] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.074203] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.087644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.087657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.087668] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.087683] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6487 [D 20:43:19.087693] element 0: offset: 0x5b0030, size: 24 [D 20:43:19.087703] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 59/70. [D 20:43:19.092187] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6487 [D 20:43:19.092202] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 60/70. [D 20:43:19.092250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 41657. [D 20:43:19.092262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 41658. [D 20:43:19.092272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 41659. [D 20:43:19.092282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 41660. [D 20:43:19.092293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 41661. [D 20:43:19.092311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 41662. [D 20:43:19.092321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 41663. [D 20:43:19.092331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 41664. [D 20:43:19.092341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 41665. [D 20:43:19.092352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 41666. [D 20:43:19.092362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 41667. [D 20:43:19.092390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 41668. [D 20:43:19.092401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 41669. [D 20:43:19.092410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 41670. [D 20:43:19.092427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 41671. [D 20:43:19.092436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 41672. [D 20:43:19.092446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 41673. [D 20:43:19.092472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 41674. [D 20:43:19.092482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 41675. [D 20:43:19.092492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 41676. [D 20:43:19.092508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 41677. [D 20:43:19.092518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 41678. [D 20:43:19.092528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 41679. [D 20:43:19.092551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 41680. [D 20:43:19.092561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 41681. [D 20:43:19.092571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 41682. [D 20:43:19.092581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 41683. [D 20:43:19.092591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 41684. [D 20:43:19.092604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 41685. [D 20:43:19.092621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 41686. [D 20:43:19.092644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 41687. [D 20:43:19.092658] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 41688. [D 20:43:19.098117] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41688. [D 20:43:19.098131] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 0/70. [D 20:43:19.100393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.100406] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.100416] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.277321] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.277335] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.277346] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.277361] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6491 [D 20:43:19.277371] element 0: offset: 0x62d630, size: 24 [D 20:43:19.277381] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 1/70. [D 20:43:19.277396] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.277407] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.277416] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:19.277429] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6493 [D 20:43:19.277439] element 0: offset: 0x691fe0, size: 24 [D 20:43:19.277448] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 2/70. [D 20:43:19.282463] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6491 [D 20:43:19.282538] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 3/70. [D 20:43:19.282624] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6493 [D 20:43:19.282649] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 4/70. [D 20:43:19.282685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 41688. [D 20:43:19.282699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 41689. [D 20:43:19.282710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 41690. [D 20:43:19.282720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 41691. [D 20:43:19.282730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 41692. [D 20:43:19.282787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 41693. [D 20:43:19.282810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 41694. [D 20:43:19.282820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 41695. [D 20:43:19.282830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 41696. [D 20:43:19.282840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 41697. [D 20:43:19.282850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 41698. [D 20:43:19.282861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 41699. [D 20:43:19.282871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 41700. [D 20:43:19.282896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 41701. [D 20:43:19.282906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 41702. [D 20:43:19.282916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 41703. [D 20:43:19.282942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 41704. [D 20:43:19.282952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 41705. [D 20:43:19.282966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 41706. [D 20:43:19.282976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 41707. [D 20:43:19.282986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 41708. [D 20:43:19.283000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 41709. [D 20:43:19.283010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 41710. [D 20:43:19.283036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 41711. [D 20:43:19.283046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 41712. [D 20:43:19.283056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 41713. [D 20:43:19.283070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 41714. [D 20:43:19.283093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 41715. [D 20:43:19.283105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 41716. [D 20:43:19.283115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 41717. [D 20:43:19.283131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 41718. [D 20:43:19.283142] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 41719. [D 20:43:19.283165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 41720. [D 20:43:19.283182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 41721. [D 20:43:19.283192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 41722. [D 20:43:19.283202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 41723. [D 20:43:19.283228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 41724. [D 20:43:19.283238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 41725. [D 20:43:19.283248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 41726. [D 20:43:19.283259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 41727. [D 20:43:19.283269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 41728. [D 20:43:19.283279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 41729. [D 20:43:19.283290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 41730. [D 20:43:19.283307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 41731. [D 20:43:19.283318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 41732. [D 20:43:19.283345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 41733. [D 20:43:19.283360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 41734. [D 20:43:19.283370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 41735. [D 20:43:19.283380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 41736. [D 20:43:19.283393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 41737. [D 20:43:19.283404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 41738. [D 20:43:19.283413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 41739. [D 20:43:19.283441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 41740. [D 20:43:19.283451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 41741. [D 20:43:19.283463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 41742. [D 20:43:19.283474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 41743. [D 20:43:19.283528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 41744. [D 20:43:19.283540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 41745. [D 20:43:19.283550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 41746. [D 20:43:19.283561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 41747. [D 20:43:19.283571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 41748. [D 20:43:19.283581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 41749. [D 20:43:19.283616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 41750. [D 20:43:19.283627] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 41751. [D 20:43:19.290681] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41751. [D 20:43:19.290696] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 5/70. [D 20:43:19.296562] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 41750. [D 20:43:19.296576] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 6/70. [D 20:43:19.298835] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.298849] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.298859] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:19.298876] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.298888] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.298897] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.302313] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.302327] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.302336] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.302366] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6496 [D 20:43:19.302377] element 0: offset: 0x657310, size: 24 [D 20:43:19.302388] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 7/70. [D 20:43:19.302405] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.302415] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.302423] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:19.302437] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6499 [D 20:43:19.302449] element 0: offset: 0x620d50, size: 24 [D 20:43:19.302459] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 8/70. [D 20:43:19.304588] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6496 [D 20:43:19.304645] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 9/70. [D 20:43:19.304779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 41750. [D 20:43:19.304798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 41751. [D 20:43:19.304809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 41752. [D 20:43:19.304819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 41753. [D 20:43:19.304829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 41754. [D 20:43:19.304839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 41755. [D 20:43:19.304849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 41756. [D 20:43:19.304859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 41757. [D 20:43:19.304875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 41758. [D 20:43:19.304884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 41759. [D 20:43:19.304895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 41760. [D 20:43:19.304905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 41761. [D 20:43:19.304916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 41762. [D 20:43:19.304926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 41763. [D 20:43:19.304938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 41764. [D 20:43:19.304954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 41765. [D 20:43:19.304965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 41766. [D 20:43:19.304974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 41767. [D 20:43:19.305006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 41768. [D 20:43:19.305016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 41769. [D 20:43:19.305026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 41770. [D 20:43:19.305041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 41771. [D 20:43:19.305051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 41772. [D 20:43:19.305073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 41773. [D 20:43:19.305083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 41774. [D 20:43:19.305093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 41775. [D 20:43:19.305109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 41776. [D 20:43:19.305119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 41777. [D 20:43:19.305128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 41778. [D 20:43:19.305144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 41779. [D 20:43:19.305154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 41780. [D 20:43:19.305164] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 41781. [D 20:43:19.309317] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6499 [D 20:43:19.309335] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 10/70. [D 20:43:19.315020] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41781. [D 20:43:19.315071] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 11/70. [D 20:43:19.317415] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.317431] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.317441] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:19.319510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 41781. [D 20:43:19.319525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 41782. [D 20:43:19.319536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 41783. [D 20:43:19.319546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 41784. [D 20:43:19.319562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 41785. [D 20:43:19.319573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 41786. [D 20:43:19.319583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 41787. [D 20:43:19.319594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 41788. [D 20:43:19.319604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 41789. [D 20:43:19.319614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 41790. [D 20:43:19.319624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 41791. [D 20:43:19.319634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 41792. [D 20:43:19.319645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 41793. [D 20:43:19.319658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 41794. [D 20:43:19.319668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 41795. [D 20:43:19.319678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 41796. [D 20:43:19.319689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 41797. [D 20:43:19.319717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 41798. [D 20:43:19.319728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 41799. [D 20:43:19.319738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 41800. [D 20:43:19.319748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 41801. [D 20:43:19.319770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 41802. [D 20:43:19.319780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 41803. [D 20:43:19.319790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 41804. [D 20:43:19.319800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 41805. [D 20:43:19.319818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 41806. [D 20:43:19.319828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 41807. [D 20:43:19.319838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 41808. [D 20:43:19.319848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 41809. [D 20:43:19.319859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 41810. [D 20:43:19.319869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 41811. [D 20:43:19.319885] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 41812. [D 20:43:19.325398] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 41812. [D 20:43:19.325413] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 12/70. [D 20:43:19.327677] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.327691] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.327702] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.330532] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.330545] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.330555] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.330585] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6503 [D 20:43:19.330597] element 0: offset: 0x691fe0, size: 24 [D 20:43:19.330608] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 13/70. [D 20:43:19.330628] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.330638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.330646] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:19.330660] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6505 [D 20:43:19.330671] element 0: offset: 0x6537d0, size: 24 [D 20:43:19.330681] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 14/70. [D 20:43:19.334170] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6503 [D 20:43:19.334236] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 15/70. [D 20:43:19.334390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 41812. [D 20:43:19.334451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 41813. [D 20:43:19.334463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 41814. [D 20:43:19.334504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 41815. [D 20:43:19.334517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 41816. [D 20:43:19.334528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 41817. [D 20:43:19.334538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 41818. [D 20:43:19.334548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 41819. [D 20:43:19.334558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 41820. [D 20:43:19.334569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 41821. [D 20:43:19.334584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 41822. [D 20:43:19.334612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 41823. [D 20:43:19.334624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 41824. [D 20:43:19.334634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 41825. [D 20:43:19.334644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 41826. [D 20:43:19.334658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 41827. [D 20:43:19.334668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 41828. [D 20:43:19.334692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 41829. [D 20:43:19.334703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 41830. [D 20:43:19.334713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 41831. [D 20:43:19.334740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 41832. [D 20:43:19.334760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 41833. [D 20:43:19.334771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 41834. [D 20:43:19.334780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 41835. [D 20:43:19.334806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 41836. [D 20:43:19.334816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 41837. [D 20:43:19.334826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 41838. [D 20:43:19.334841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 41839. [D 20:43:19.334851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 41840. [D 20:43:19.334870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 41841. [D 20:43:19.334886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 41842. [D 20:43:19.334896] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 41843. [D 20:43:19.338309] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6505 [D 20:43:19.338328] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 16/70. [D 20:43:19.343201] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41843. [D 20:43:19.343253] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 17/70. [D 20:43:19.343328] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.343344] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.343353] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:19.345362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 41843. [D 20:43:19.345380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 41844. [D 20:43:19.345392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 41845. [D 20:43:19.345402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 41846. [D 20:43:19.345415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 41847. [D 20:43:19.345430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 41848. [D 20:43:19.345440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 41849. [D 20:43:19.345450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 41850. [D 20:43:19.345465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 41851. [D 20:43:19.345475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 41852. [D 20:43:19.345485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 41853. [D 20:43:19.345501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 41854. [D 20:43:19.345510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 41855. [D 20:43:19.345520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 41856. [D 20:43:19.345536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 41857. [D 20:43:19.345546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 41858. [D 20:43:19.345556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 41859. [D 20:43:19.345566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 41860. [D 20:43:19.345576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 41861. [D 20:43:19.345587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 41862. [D 20:43:19.345598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 41863. [D 20:43:19.345621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 41864. [D 20:43:19.345631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 41865. [D 20:43:19.345648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 41866. [D 20:43:19.345658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 41867. [D 20:43:19.345668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 41868. [D 20:43:19.345679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 41869. [D 20:43:19.345689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 41870. [D 20:43:19.345699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 41871. [D 20:43:19.345727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 41872. [D 20:43:19.345737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 41873. [D 20:43:19.345748] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 41874. [D 20:43:19.351736] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 41874. [D 20:43:19.351750] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 18/70. [D 20:43:19.351848] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.351864] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.351872] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.353283] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.353296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.353304] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.353330] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6508 [D 20:43:19.353340] element 0: offset: 0x62d630, size: 24 [D 20:43:19.353351] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 19/70. [D 20:43:19.353431] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.353443] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.353451] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:19.353467] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6511 [D 20:43:19.353476] element 0: offset: 0x5b0030, size: 24 [D 20:43:19.353487] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 20/70. [D 20:43:19.355535] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6508 [D 20:43:19.355576] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 21/70. [D 20:43:19.355710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 41874. [D 20:43:19.355725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 41875. [D 20:43:19.355735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 41876. [D 20:43:19.355746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 41877. [D 20:43:19.355756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 41878. [D 20:43:19.355766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 41879. [D 20:43:19.355779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 41880. [D 20:43:19.355789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 41881. [D 20:43:19.355799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 41882. [D 20:43:19.355809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 41883. [D 20:43:19.355829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 41884. [D 20:43:19.355839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 41885. [D 20:43:19.355861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 41886. [D 20:43:19.355878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 41887. [D 20:43:19.355889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 41888. [D 20:43:19.355899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 41889. [D 20:43:19.355916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 41890. [D 20:43:19.355928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 41891. [D 20:43:19.355937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 41892. [D 20:43:19.355962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 41893. [D 20:43:19.355972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 41894. [D 20:43:19.355982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 41895. [D 20:43:19.355997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 41896. [D 20:43:19.356007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 41897. [D 20:43:19.356017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 41898. [D 20:43:19.356045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 41899. [D 20:43:19.356055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 41900. [D 20:43:19.356068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 41901. [D 20:43:19.356078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 41902. [D 20:43:19.356088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 41903. [D 20:43:19.356102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 41904. [D 20:43:19.356112] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 41905. [D 20:43:19.360288] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6511 [D 20:43:19.360308] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 22/70. [D 20:43:19.367459] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41905. [D 20:43:19.367510] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 23/70. [D 20:43:19.367526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 41905. [D 20:43:19.367539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 41906. [D 20:43:19.367552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 41907. [D 20:43:19.367562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 41908. [D 20:43:19.367577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 41909. [D 20:43:19.367588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 41910. [D 20:43:19.367598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 41911. [D 20:43:19.367608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 41912. [D 20:43:19.367618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 41913. [D 20:43:19.367659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 41914. [D 20:43:19.367671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 41915. [D 20:43:19.367681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 41916. [D 20:43:19.367703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 41917. [D 20:43:19.367713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 41918. [D 20:43:19.367724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 41919. [D 20:43:19.367734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 41920. [D 20:43:19.367746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 41921. [D 20:43:19.367756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 41922. [D 20:43:19.367782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 41923. [D 20:43:19.367792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 41924. [D 20:43:19.367802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 41925. [D 20:43:19.367812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 41926. [D 20:43:19.367829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 41927. [D 20:43:19.367839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 41928. [D 20:43:19.367849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 41929. [D 20:43:19.367865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 41930. [D 20:43:19.367875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 41931. [D 20:43:19.367885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 41932. [D 20:43:19.367912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 41933. [D 20:43:19.367922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 41934. [D 20:43:19.367933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 41935. [D 20:43:19.367944] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 41936. [D 20:43:19.368021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.368036] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.368059] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:19.374777] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 41936. [D 20:43:19.374793] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 24/70. [D 20:43:19.375663] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.375676] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.375685] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.389746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.389760] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.389771] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.389803] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6515 [D 20:43:19.389814] element 0: offset: 0x691fe0, size: 24 [D 20:43:19.389826] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 25/70. [D 20:43:19.390275] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.390288] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.390297] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:19.390311] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6518 [D 20:43:19.390321] element 0: offset: 0x620d50, size: 24 [D 20:43:19.390330] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 26/70. [D 20:43:19.392263] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6515 [D 20:43:19.392318] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 27/70. [D 20:43:19.392323] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.392337] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.392346] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:19.392361] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6519 [D 20:43:19.392371] element 0: offset: 0x6537d0, size: 24 [D 20:43:19.392397] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 28/70. [D 20:43:19.392444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 41936. [D 20:43:19.392457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 41937. [D 20:43:19.392467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 41938. [D 20:43:19.392477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 41939. [D 20:43:19.392498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 41940. [D 20:43:19.392508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 41941. [D 20:43:19.392518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 41942. [D 20:43:19.392528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 41943. [D 20:43:19.392539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 41944. [D 20:43:19.392549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 41945. [D 20:43:19.392559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 41946. [D 20:43:19.392589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 41947. [D 20:43:19.392599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 41948. [D 20:43:19.392609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 41949. [D 20:43:19.392626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 41950. [D 20:43:19.392636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 41951. [D 20:43:19.392662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 41952. [D 20:43:19.392672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 41953. [D 20:43:19.392682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 41954. [D 20:43:19.392696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 41955. [D 20:43:19.392706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 41956. [D 20:43:19.392716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 41957. [D 20:43:19.392745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 41958. [D 20:43:19.392759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 41959. [D 20:43:19.392773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 41960. [D 20:43:19.392783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 41961. [D 20:43:19.392793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 41962. [D 20:43:19.392806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 41963. [D 20:43:19.392816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 41964. [D 20:43:19.392826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 41965. [D 20:43:19.392870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 41966. [D 20:43:19.392881] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 41967. [D 20:43:19.397287] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6519 [D 20:43:19.397305] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 29/70. [D 20:43:19.397320] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6518 [D 20:43:19.397339] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 30/70. [D 20:43:19.398313] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 41967. [D 20:43:19.398327] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 31/70. [D 20:43:19.398340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 41967. [D 20:43:19.398351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 41968. [D 20:43:19.398361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 41969. [D 20:43:19.398372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 41970. [D 20:43:19.398382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 41971. [D 20:43:19.398392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 41972. [D 20:43:19.398411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 41973. [D 20:43:19.398421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 41974. [D 20:43:19.398431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 41975. [D 20:43:19.398441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 41976. [D 20:43:19.398451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 41977. [D 20:43:19.398461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 41978. [D 20:43:19.398487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 41979. [D 20:43:19.398497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 41980. [D 20:43:19.398507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 41981. [D 20:43:19.398524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 41982. [D 20:43:19.398534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 41983. [D 20:43:19.398543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 41984. [D 20:43:19.398569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 41985. [D 20:43:19.398579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 41986. [D 20:43:19.398589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 41987. [D 20:43:19.398600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 41988. [D 20:43:19.398610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 41989. [D 20:43:19.398620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 41990. [D 20:43:19.398644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 41991. [D 20:43:19.398655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 41992. [D 20:43:19.398665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 41993. [D 20:43:19.398692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 41994. [D 20:43:19.398704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 41995. [D 20:43:19.398714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 41996. [D 20:43:19.398724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 41997. [D 20:43:19.398734] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 41998. [D 20:43:19.398746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 41999. [D 20:43:19.398773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 42000. [D 20:43:19.398784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 42001. [D 20:43:19.398800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 42002. [D 20:43:19.398810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 42003. [D 20:43:19.398820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 42004. [D 20:43:19.398836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42005. [D 20:43:19.398846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42006. [D 20:43:19.398856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42007. [D 20:43:19.398882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 42008. [D 20:43:19.398892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 42009. [D 20:43:19.398902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 42010. [D 20:43:19.398918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 42011. [D 20:43:19.398928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 42012. [D 20:43:19.398951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42013. [D 20:43:19.398961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42014. [D 20:43:19.398971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42015. [D 20:43:19.398987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 42016. [D 20:43:19.398997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 42017. [D 20:43:19.399007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 42018. [D 20:43:19.399035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 42019. [D 20:43:19.399046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 42020. [D 20:43:19.399056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42021. [D 20:43:19.399070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42022. [D 20:43:19.399080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42023. [D 20:43:19.399090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 42024. [D 20:43:19.399105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 42025. [D 20:43:19.399128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 42026. [D 20:43:19.399143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 42027. [D 20:43:19.399153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 42028. [D 20:43:19.399168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42029. [D 20:43:19.399191] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42030. [D 20:43:19.399220] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.399231] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.399240] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:19.404251] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 42030. [D 20:43:19.404265] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 32/70. [D 20:43:19.410169] openib_check_cq: completed rdma wr_id 2aaaab23ce20, nic_wr_credit 42029. [D 20:43:19.410182] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 33/70. [D 20:43:19.412342] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.412356] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.412365] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:19.412379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.412388] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.412397] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.703680] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.703695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.703706] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.703721] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6523 [D 20:43:19.703731] element 0: offset: 0x643630, size: 24 [D 20:43:19.703741] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 34/70. [D 20:43:19.708004] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6523 [D 20:43:19.708021] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 35/70. [D 20:43:19.708152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 42029. [D 20:43:19.708166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 42030. [D 20:43:19.708177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 42031. [D 20:43:19.708201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 42032. [D 20:43:19.708221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 42033. [D 20:43:19.708231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 42034. [D 20:43:19.708241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 42035. [D 20:43:19.708252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 42036. [D 20:43:19.708262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 42037. [D 20:43:19.708283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 42038. [D 20:43:19.708293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 42039. [D 20:43:19.708313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 42040. [D 20:43:19.708323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 42041. [D 20:43:19.708347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 42042. [D 20:43:19.708358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 42043. [D 20:43:19.708367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 42044. [D 20:43:19.708390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 42045. [D 20:43:19.708400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 42046. [D 20:43:19.708419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 42047. [D 20:43:19.708430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 42048. [D 20:43:19.708440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 42049. [D 20:43:19.708463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 42050. [D 20:43:19.708473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 42051. [D 20:43:19.708492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 42052. [D 20:43:19.708504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 42053. [D 20:43:19.708514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 42054. [D 20:43:19.708535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 42055. [D 20:43:19.708546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 42056. [D 20:43:19.708561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 42057. [D 20:43:19.708583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 42058. [D 20:43:19.708594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 42059. [D 20:43:19.708642] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 42060. [D 20:43:19.719970] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42060. [D 20:43:19.719984] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 36/70. [D 20:43:19.722317] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.722330] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.722339] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.750154] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.750168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.750180] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.750194] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6526 [D 20:43:19.750204] element 0: offset: 0x61f310, size: 24 [D 20:43:19.750213] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 37/70. [D 20:43:19.750228] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.750244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.750253] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:19.750269] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6529 [D 20:43:19.750279] element 0: offset: 0x5b0030, size: 24 [D 20:43:19.750289] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 38/70. [D 20:43:19.754795] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6526 [D 20:43:19.754867] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 39/70. [D 20:43:19.754894] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6529 [D 20:43:19.754906] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 40/70. [D 20:43:19.755005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 42060. [D 20:43:19.755021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 42061. [D 20:43:19.755032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 42062. [D 20:43:19.755042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 42063. [D 20:43:19.755053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 42064. [D 20:43:19.755063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 42065. [D 20:43:19.755072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 42066. [D 20:43:19.755088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 42067. [D 20:43:19.755098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 42068. [D 20:43:19.755107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 42069. [D 20:43:19.755117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 42070. [D 20:43:19.755135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 42071. [D 20:43:19.755145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 42072. [D 20:43:19.755213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 42073. [D 20:43:19.755227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 42074. [D 20:43:19.755238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 42075. [D 20:43:19.755248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 42076. [D 20:43:19.755258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 42077. [D 20:43:19.755268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 42078. [D 20:43:19.755278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 42079. [D 20:43:19.755288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 42080. [D 20:43:19.755318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 42081. [D 20:43:19.755329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 42082. [D 20:43:19.755341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 42083. [D 20:43:19.755350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 42084. [D 20:43:19.755361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42085. [D 20:43:19.755393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 42086. [D 20:43:19.755403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 42087. [D 20:43:19.755413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 42088. [D 20:43:19.755423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 42089. [D 20:43:19.755453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 42090. [D 20:43:19.755463] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42091. [D 20:43:19.755477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 42092. [D 20:43:19.755491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 42093. [D 20:43:19.755501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 42094. [D 20:43:19.755511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 42095. [D 20:43:19.755526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 42096. [D 20:43:19.755536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 42097. [D 20:43:19.755546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 42098. [D 20:43:19.755576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 42099. [D 20:43:19.755587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 42100. [D 20:43:19.755598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 42101. [D 20:43:19.755608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 42102. [D 20:43:19.755618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 42103. [D 20:43:19.755643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 42104. [D 20:43:19.755654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 42105. [D 20:43:19.755665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 42106. [D 20:43:19.755681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 42107. [D 20:43:19.755692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 42108. [D 20:43:19.755702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 42109. [D 20:43:19.755711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 42110. [D 20:43:19.755722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 42111. [D 20:43:19.755747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 42112. [D 20:43:19.755757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 42113. [D 20:43:19.755772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 42114. [D 20:43:19.755783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 42115. [D 20:43:19.755792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 42116. [D 20:43:19.755803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 42117. [D 20:43:19.755813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 42118. [D 20:43:19.755823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 42119. [D 20:43:19.755833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 42120. [D 20:43:19.755866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 42121. [D 20:43:19.755877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 42122. [D 20:43:19.755891] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 42123. [D 20:43:19.766632] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42123. [D 20:43:19.766684] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 41/70. [D 20:43:19.776693] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 42122. [D 20:43:19.776711] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 42/70. [D 20:43:19.778986] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.779001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.779011] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:19.779028] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.779039] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.779048] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.791693] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.791708] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.791719] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.791750] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6532 [D 20:43:19.791762] element 0: offset: 0x6537d0, size: 24 [D 20:43:19.793620] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 43/70. [D 20:43:19.793643] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.793657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.793667] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:19.793681] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6535 [D 20:43:19.793691] element 0: offset: 0x657310, size: 24 [D 20:43:19.793701] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 44/70. [D 20:43:19.798564] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6532 [D 20:43:19.798632] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 45/70. [D 20:43:19.798656] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6535 [D 20:43:19.798668] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 46/70. [D 20:43:19.798772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 42122. [D 20:43:19.798788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 42123. [D 20:43:19.798798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 42124. [D 20:43:19.798808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 42125. [D 20:43:19.798819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 42126. [D 20:43:19.798829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 42127. [D 20:43:19.798874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 42128. [D 20:43:19.798884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 42129. [D 20:43:19.798895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 42130. [D 20:43:19.798919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 42131. [D 20:43:19.798930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 42132. [D 20:43:19.798939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 42133. [D 20:43:19.798977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 42134. [D 20:43:19.798988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 42135. [D 20:43:19.799009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 42136. [D 20:43:19.799019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 42137. [D 20:43:19.799030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 42138. [D 20:43:19.799053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 42139. [D 20:43:19.799068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 42140. [D 20:43:19.799078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 42141. [D 20:43:19.799100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 42142. [D 20:43:19.799110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 42143. [D 20:43:19.799135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 42144. [D 20:43:19.799145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 42145. [D 20:43:19.799170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 42146. [D 20:43:19.799195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42147. [D 20:43:19.799206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 42148. [D 20:43:19.799225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 42149. [D 20:43:19.799241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 42150. [D 20:43:19.799262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 42151. [D 20:43:19.799286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 42152. [D 20:43:19.799297] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42153. [D 20:43:19.799320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 42154. [D 20:43:19.799331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 42155. [D 20:43:19.799343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 42156. [D 20:43:19.799353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 42157. [D 20:43:19.799376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 42158. [D 20:43:19.799403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 42159. [D 20:43:19.799415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 42160. [D 20:43:19.799440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 42161. [D 20:43:19.799459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 42162. [D 20:43:19.799470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 42163. [D 20:43:19.799481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 42164. [D 20:43:19.799502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 42165. [D 20:43:19.799515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 42166. [D 20:43:19.799536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 42167. [D 20:43:19.799561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 42168. [D 20:43:19.799571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 42169. [D 20:43:19.799581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 42170. [D 20:43:19.799600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 42171. [D 20:43:19.799611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 42172. [D 20:43:19.799625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 42173. [D 20:43:19.799635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 42174. [D 20:43:19.799645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 42175. [D 20:43:19.799672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 42176. [D 20:43:19.799689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 42177. [D 20:43:19.799857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 42178. [D 20:43:19.799873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 42179. [D 20:43:19.799886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 42180. [D 20:43:19.799898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 42181. [D 20:43:19.799910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 42182. [D 20:43:19.799932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 42183. [D 20:43:19.799945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 42184. [D 20:43:19.799957] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 42185. [D 20:43:19.810364] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42185. [D 20:43:19.810381] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 47/70. [D 20:43:19.820703] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 42184. [D 20:43:19.820719] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 48/70. [D 20:43:19.823012] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.823028] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.823039] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:19.823062] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.823073] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.823084] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.835692] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.835707] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.835720] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.835750] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6538 [D 20:43:19.835762] element 0: offset: 0x691fe0, size: 24 [D 20:43:19.835773] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 49/70. [D 20:43:19.835791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.835800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.837952] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:19.837969] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6541 [D 20:43:19.837979] element 0: offset: 0x657310, size: 24 [D 20:43:19.837991] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 50/70. [D 20:43:19.839953] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6538 [D 20:43:19.839972] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 51/70. [D 20:43:19.840109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 42184. [D 20:43:19.840123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 42185. [D 20:43:19.840134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 42186. [D 20:43:19.840143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 42187. [D 20:43:19.840159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 42188. [D 20:43:19.840168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 42189. [D 20:43:19.840188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 42190. [D 20:43:19.840198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 42191. [D 20:43:19.840208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 42192. [D 20:43:19.840218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 42193. [D 20:43:19.840228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 42194. [D 20:43:19.840246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 42195. [D 20:43:19.840256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 42196. [D 20:43:19.840265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 42197. [D 20:43:19.840276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 42198. [D 20:43:19.840300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 42199. [D 20:43:19.840311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 42200. [D 20:43:19.840321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 42201. [D 20:43:19.840331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 42202. [D 20:43:19.840341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 42203. [D 20:43:19.840352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 42204. [D 20:43:19.840362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 42205. [D 20:43:19.840372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 42206. [D 20:43:19.840404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 42207. [D 20:43:19.840414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 42208. [D 20:43:19.840424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42209. [D 20:43:19.840439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 42210. [D 20:43:19.840449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 42211. [D 20:43:19.840458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 42212. [D 20:43:19.840482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 42213. [D 20:43:19.840492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 42214. [D 20:43:19.840502] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42215. [D 20:43:19.844752] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6541 [D 20:43:19.844819] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 52/70. [D 20:43:19.851742] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42215. [D 20:43:19.851760] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 53/70. [D 20:43:19.851787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 42215. [D 20:43:19.851801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 42216. [D 20:43:19.851811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 42217. [D 20:43:19.851822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 42218. [D 20:43:19.851832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 42219. [D 20:43:19.851842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 42220. [D 20:43:19.851853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 42221. [D 20:43:19.851864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 42222. [D 20:43:19.851873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 42223. [D 20:43:19.851885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 42224. [D 20:43:19.851920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 42225. [D 20:43:19.851931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 42226. [D 20:43:19.851942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 42227. [D 20:43:19.851951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 42228. [D 20:43:19.851962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 42229. [D 20:43:19.851973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 42230. [D 20:43:19.851982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 42231. [D 20:43:19.852007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 42232. [D 20:43:19.852017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 42233. [D 20:43:19.852027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 42234. [D 20:43:19.852037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 42235. [D 20:43:19.852047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 42236. [D 20:43:19.852071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 42237. [D 20:43:19.852085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 42238. [D 20:43:19.852095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 42239. [D 20:43:19.852105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 42240. [D 20:43:19.852134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 42241. [D 20:43:19.852145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 42242. [D 20:43:19.852156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 42243. [D 20:43:19.852166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 42244. [D 20:43:19.852182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 42245. [D 20:43:19.852201] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 42246. [D 20:43:19.854532] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.854547] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.854557] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:19.862406] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 42246. [D 20:43:19.862420] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 54/70. [D 20:43:19.864684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.864697] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.864707] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.870204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.870218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.870227] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.870257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6545 [D 20:43:19.870268] element 0: offset: 0x5b0030, size: 24 [D 20:43:19.870278] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 55/70. [D 20:43:19.870297] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.870312] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.870320] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:19.870336] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6548 [D 20:43:19.870347] element 0: offset: 0x6537d0, size: 24 [D 20:43:19.870357] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 56/70. [D 20:43:19.870372] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.870381] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.870389] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:19.870407] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6550 [D 20:43:19.870417] element 0: offset: 0x61f310, size: 24 [D 20:43:19.872844] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 57/70. [D 20:43:19.872926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.872937] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.872946] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:19.872977] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6553 [D 20:43:19.872986] element 0: offset: 0x691fe0, size: 24 [D 20:43:19.872996] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 58/70. [D 20:43:19.877376] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6545 [D 20:43:19.877460] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 59/70. [D 20:43:19.877519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 42246. [D 20:43:19.877534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 42247. [D 20:43:19.877545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 42248. [D 20:43:19.877555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 42249. [D 20:43:19.877565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 42250. [D 20:43:19.877582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 42251. [D 20:43:19.877592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 42252. [D 20:43:19.877602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 42253. [D 20:43:19.877660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 42254. [D 20:43:19.877672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 42255. [D 20:43:19.877682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 42256. [D 20:43:19.879737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 42257. [D 20:43:19.879789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 42258. [D 20:43:19.879800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 42259. [D 20:43:19.879810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 42260. [D 20:43:19.879820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 42261. [D 20:43:19.879830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 42262. [D 20:43:19.879840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 42263. [D 20:43:19.879877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 42264. [D 20:43:19.879933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 42265. [D 20:43:19.879943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 42266. [D 20:43:19.879953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 42267. [D 20:43:19.879962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 42268. [D 20:43:19.879972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 42269. [D 20:43:19.879981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 42270. [D 20:43:19.879991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 42271. [D 20:43:19.880000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 42272. [D 20:43:19.880009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 42273. [D 20:43:19.880019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 42274. [D 20:43:19.880028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 42275. [D 20:43:19.880038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 42276. [D 20:43:19.880047] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 42277. [D 20:43:19.880254] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6548 [D 20:43:19.880278] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 60/70. [D 20:43:19.880343] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6550 [D 20:43:19.880356] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 0/70. [D 20:43:19.882640] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6553 [D 20:43:19.882657] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 1/70. [D 20:43:19.888230] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42277. [D 20:43:19.888247] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 2/70. [D 20:43:19.888266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 42277. [D 20:43:19.888276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 42278. [D 20:43:19.888288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 42279. [D 20:43:19.888298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 42280. [D 20:43:19.888309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 42281. [D 20:43:19.888318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 42282. [D 20:43:19.888328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 42283. [D 20:43:19.888340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 42284. [D 20:43:19.888356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 42285. [D 20:43:19.888366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 42286. [D 20:43:19.888376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 42287. [D 20:43:19.888386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 42288. [D 20:43:19.888397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 42289. [D 20:43:19.888423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 42290. [D 20:43:19.888434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 42291. [D 20:43:19.888444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 42292. [D 20:43:19.888454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 42293. [D 20:43:19.888464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 42294. [D 20:43:19.888474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 42295. [D 20:43:19.888497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 42296. [D 20:43:19.888508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 42297. [D 20:43:19.888517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 42298. [D 20:43:19.888528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 42299. [D 20:43:19.888538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 42300. [D 20:43:19.888548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 42301. [D 20:43:19.888558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 42302. [D 20:43:19.888567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 42303. [D 20:43:19.888578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 42304. [D 20:43:19.888588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 42305. [D 20:43:19.888598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 42306. [D 20:43:19.888608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 42307. [D 20:43:19.888618] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 42308. [D 20:43:19.888649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 42309. [D 20:43:19.888660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 42310. [D 20:43:19.888670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 42311. [D 20:43:19.888685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 42312. [D 20:43:19.888695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 42313. [D 20:43:19.888704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 42314. [D 20:43:19.888729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 42315. [D 20:43:19.888740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 42316. [D 20:43:19.888749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 42317. [D 20:43:19.888759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 42318. [D 20:43:19.888775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 42319. [D 20:43:19.888785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 42320. [D 20:43:19.888810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 42321. [D 20:43:19.888821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 42322. [D 20:43:19.888830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 42323. [D 20:43:19.888840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 42324. [D 20:43:19.888857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 42325. [D 20:43:19.888867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 42326. [D 20:43:19.888877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 42327. [D 20:43:19.888900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 42328. [D 20:43:19.888910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 42329. [D 20:43:19.888920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 42330. [D 20:43:19.888930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 42331. [D 20:43:19.888951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 42332. [D 20:43:19.888961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 42333. [D 20:43:19.888970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 42334. [D 20:43:19.888981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 42335. [D 20:43:19.888993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 42336. [D 20:43:19.889016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 42337. [D 20:43:19.889027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 42338. [D 20:43:19.889038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 42339. [D 20:43:19.889047] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d220 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 42340. [D 20:43:19.889063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 42341. [D 20:43:19.889073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 42342. [D 20:43:19.889083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 42343. [D 20:43:19.889093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 42344. [D 20:43:19.889109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 42345. [D 20:43:19.889133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 42346. [E 20:43:19.889149] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 42347, block for 10 ms. [D 20:43:19.889185] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 42346. [D 20:43:19.889197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 42347. [E 20:43:19.889209] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 42348, block for 10 ms. [D 20:43:19.899875] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 42347. [D 20:43:19.899892] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 3/70. [D 20:43:19.899903] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 42346. [D 20:43:19.899913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 42347. [D 20:43:19.899923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 42348. [D 20:43:19.899937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 42349. [D 20:43:19.899947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 42350. [D 20:43:19.899956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 42351. [D 20:43:19.899971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 42352. [D 20:43:19.899981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 42353. [D 20:43:19.899991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 42354. [D 20:43:19.900006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 42355. [D 20:43:19.900016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 42356. [D 20:43:19.900026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 42357. [D 20:43:19.900042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 42358. [D 20:43:19.900068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 42359. [D 20:43:19.900079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 42360. [D 20:43:19.900089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 42361. [D 20:43:19.900099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 42362. [D 20:43:19.900123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 42363. [D 20:43:19.900134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 42364. [D 20:43:19.900144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 42365. [D 20:43:19.900154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 42366. [D 20:43:19.900165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 42367. [D 20:43:19.900174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 42368. [D 20:43:19.900197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 42369. [D 20:43:19.900211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 42370. [D 20:43:19.900221] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d360 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 42371. [D 20:43:19.902628] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.902643] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.902654] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:19.911497] openib_check_cq: completed rdma wr_id 2aaaab23d220, nic_wr_credit 42371. [D 20:43:19.911511] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 4/70. [D 20:43:19.915851] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.915865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.915876] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:19.923271] openib_check_cq: completed rdma wr_id 2aaaab23d360, nic_wr_credit 42370. [D 20:43:19.923285] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 5/70. [D 20:43:19.925577] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.925590] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.925600] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:19.925614] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.925623] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.925632] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:19.945630] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.945644] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.945655] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:19.945685] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6557 [D 20:43:19.945696] element 0: offset: 0x62d730, size: 24 [D 20:43:19.945707] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 6/70. [D 20:43:19.945725] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:19.945738] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.945747] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:19.945761] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6559 [D 20:43:19.945772] element 0: offset: 0x64d970, size: 24 [D 20:43:19.945781] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 7/70. [D 20:43:19.949912] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6557 [D 20:43:19.949981] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 8/70. [D 20:43:19.950121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 42370. [D 20:43:19.950138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 42371. [D 20:43:19.950149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 42372. [D 20:43:19.950160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 42373. [D 20:43:19.950170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 42374. [D 20:43:19.950180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 42375. [D 20:43:19.950190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42376. [D 20:43:19.950200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42377. [D 20:43:19.950210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42378. [D 20:43:19.950264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 42379. [D 20:43:19.950276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 42380. [D 20:43:19.950286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 42381. [D 20:43:19.950296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 42382. [D 20:43:19.950306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 42383. [D 20:43:19.950316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42384. [D 20:43:19.950344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42385. [D 20:43:19.950354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42386. [D 20:43:19.950364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 42387. [D 20:43:19.950374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 42388. [D 20:43:19.950384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 42389. [D 20:43:19.950394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 42390. [D 20:43:19.950415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 42391. [D 20:43:19.950425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42392. [D 20:43:19.950434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42393. [D 20:43:19.950457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42394. [D 20:43:19.950468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 42395. [D 20:43:19.950477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 42396. [D 20:43:19.950487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 42397. [D 20:43:19.950498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 42398. [D 20:43:19.950508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 42399. [D 20:43:19.950518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42400. [D 20:43:19.950533] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42401. [D 20:43:19.953213] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6559 [D 20:43:19.953237] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 9/70. [D 20:43:19.958602] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42401. [D 20:43:19.958617] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 10/70. [D 20:43:19.958628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 42401. [D 20:43:19.958639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 42402. [D 20:43:19.958649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 42403. [D 20:43:19.958659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 42404. [D 20:43:19.958669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 42405. [D 20:43:19.958680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 42406. [D 20:43:19.958691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 42407. [D 20:43:19.958700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 42408. [D 20:43:19.958711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 42409. [D 20:43:19.958746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 42410. [D 20:43:19.958757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 42411. [D 20:43:19.958767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 42412. [D 20:43:19.958777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 42413. [D 20:43:19.958787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 42414. [D 20:43:19.958798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 42415. [D 20:43:19.958829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 42416. [D 20:43:19.958840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 42417. [D 20:43:19.958850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 42418. [D 20:43:19.958860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 42419. [D 20:43:19.958870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 42420. [D 20:43:19.958880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 42421. [D 20:43:19.958890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 42422. [D 20:43:19.958925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 42423. [D 20:43:19.958936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 42424. [D 20:43:19.958947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 42425. [D 20:43:19.958957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 42426. [D 20:43:19.958973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 42427. [D 20:43:19.958983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 42428. [D 20:43:19.958993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 42429. [D 20:43:19.959009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 42430. [D 20:43:19.959030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 42431. [D 20:43:19.959041] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 42432. [D 20:43:19.961399] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.961415] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.961426] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:19.964515] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 42432. [D 20:43:19.964529] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 11/70. [D 20:43:19.966785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:19.966798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:19.966807] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:20.064606] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.064622] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.064633] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:20.064663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6561 [D 20:43:20.064674] element 0: offset: 0x657310, size: 24 [D 20:43:20.064684] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 12/70. [D 20:43:20.069001] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6561 [D 20:43:20.069071] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 13/70. [D 20:43:20.069135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 42432. [D 20:43:20.069150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 42433. [D 20:43:20.069161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 42434. [D 20:43:20.069172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 42435. [D 20:43:20.069182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 42436. [D 20:43:20.069193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 42437. [D 20:43:20.069238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 42438. [D 20:43:20.069249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 42439. [D 20:43:20.069259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 42440. [D 20:43:20.069268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 42441. [D 20:43:20.069284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 42442. [D 20:43:20.069294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 42443. [D 20:43:20.069321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 42444. [D 20:43:20.069331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 42445. [D 20:43:20.069341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 42446. [D 20:43:20.069355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 42447. [D 20:43:20.069365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 42448. [D 20:43:20.069395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 42449. [D 20:43:20.069404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 42450. [D 20:43:20.069415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 42451. [D 20:43:20.069425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 42452. [D 20:43:20.069435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 42453. [D 20:43:20.069465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 42454. [D 20:43:20.069475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 42455. [D 20:43:20.069485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 42456. [D 20:43:20.069501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 42457. [D 20:43:20.069511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 42458. [D 20:43:20.069538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 42459. [D 20:43:20.069548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 42460. [D 20:43:20.069561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 42461. [D 20:43:20.069576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 42462. [D 20:43:20.069585] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 42463. [D 20:43:20.075004] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42463. [D 20:43:20.075020] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 14/70. [D 20:43:20.077312] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.077328] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.077338] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:20.077370] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6565 [D 20:43:20.077381] element 0: offset: 0x5b0030, size: 24 [D 20:43:20.077394] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 15/70. [D 20:43:20.077429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.077457] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.077466] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:20.082007] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6565 [D 20:43:20.082024] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 16/70. [D 20:43:20.082069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 42463. [D 20:43:20.082081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 42464. [D 20:43:20.082091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 42465. [D 20:43:20.082101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 42466. [D 20:43:20.082111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 42467. [D 20:43:20.082121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 42468. [D 20:43:20.082142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 42469. [D 20:43:20.082152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 42470. [D 20:43:20.082161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 42471. [D 20:43:20.082171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 42472. [D 20:43:20.082187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 42473. [D 20:43:20.082197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 42474. [D 20:43:20.082207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 42475. [D 20:43:20.082217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 42476. [D 20:43:20.082227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 42477. [D 20:43:20.082237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 42478. [D 20:43:20.082247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 42479. [D 20:43:20.082280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 42480. [D 20:43:20.082290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 42481. [D 20:43:20.082302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 42482. [D 20:43:20.082312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 42483. [D 20:43:20.082322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 42484. [D 20:43:20.082345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 42485. [D 20:43:20.082355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 42486. [D 20:43:20.082365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 42487. [D 20:43:20.082381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 42488. [D 20:43:20.082391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 42489. [D 20:43:20.082417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 42490. [D 20:43:20.082427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 42491. [D 20:43:20.082436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 42492. [D 20:43:20.082450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 42493. [D 20:43:20.082460] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 42494. [D 20:43:20.087935] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42494. [D 20:43:20.087949] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 17/70. [D 20:43:20.090224] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.090237] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.090246] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:20.170707] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.170721] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.170732] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:20.170748] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6568 [D 20:43:20.170758] element 0: offset: 0x61f310, size: 24 [D 20:43:20.170768] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 18/70. [D 20:43:20.172872] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6568 [D 20:43:20.172920] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 19/70. [D 20:43:20.174037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 42494. [D 20:43:20.174099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 42495. [D 20:43:20.174111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 42496. [D 20:43:20.174122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 42497. [D 20:43:20.174136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 42498. [D 20:43:20.174146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 42499. [D 20:43:20.174156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42500. [D 20:43:20.174169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42501. [D 20:43:20.174179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42502. [D 20:43:20.174189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 42503. [D 20:43:20.174204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 42504. [D 20:43:20.174233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 42505. [D 20:43:20.174243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 42506. [D 20:43:20.174253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 42507. [D 20:43:20.174263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42508. [D 20:43:20.174274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42509. [D 20:43:20.174297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42510. [D 20:43:20.174312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 42511. [D 20:43:20.174322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 42512. [D 20:43:20.174332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 42513. [D 20:43:20.174343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 42514. [D 20:43:20.174352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 42515. [D 20:43:20.174372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42516. [D 20:43:20.174383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42517. [D 20:43:20.174399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42518. [D 20:43:20.174409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 42519. [D 20:43:20.174419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 42520. [D 20:43:20.174429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 42521. [D 20:43:20.174454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 42522. [D 20:43:20.174465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 42523. [D 20:43:20.174475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42524. [D 20:43:20.174485] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42525. [D 20:43:20.180251] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42525. [D 20:43:20.180268] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 20/70. [D 20:43:20.182678] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.182693] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.182703] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:20.182724] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.182735] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.182743] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:20.182774] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6572 [D 20:43:20.182785] element 0: offset: 0x62d730, size: 24 [D 20:43:20.182796] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 21/70. [D 20:43:20.182816] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.182829] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.182838] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:20.182854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6574 [D 20:43:20.182863] element 0: offset: 0x64d970, size: 24 [D 20:43:20.182876] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 22/70. [D 20:43:20.185080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.185095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.185104] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:20.185119] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6576 [D 20:43:20.185128] element 0: offset: 0x6acf80, size: 24 [D 20:43:20.185137] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 23/70. [D 20:43:20.187766] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6572 [D 20:43:20.187822] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 24/70. [D 20:43:20.187920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 42525. [D 20:43:20.187963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 42526. [D 20:43:20.187974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 42527. [D 20:43:20.187985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 42528. [D 20:43:20.187995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 42529. [D 20:43:20.188005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 42530. [D 20:43:20.188015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 42531. [D 20:43:20.188024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 42532. [D 20:43:20.188034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 42533. [D 20:43:20.188044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 42534. [D 20:43:20.188067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 42535. [D 20:43:20.188077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 42536. [D 20:43:20.188086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 42537. [D 20:43:20.188096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 42538. [D 20:43:20.188106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 42539. [D 20:43:20.188116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 42540. [D 20:43:20.188126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 42541. [D 20:43:20.188136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 42542. [D 20:43:20.188146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 42543. [D 20:43:20.188156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 42544. [D 20:43:20.188166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 42545. [D 20:43:20.188176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 42546. [D 20:43:20.188185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 42547. [D 20:43:20.188195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 42548. [D 20:43:20.188205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 42549. [D 20:43:20.188215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 42550. [D 20:43:20.188225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 42551. [D 20:43:20.188235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 42552. [D 20:43:20.188245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 42553. [D 20:43:20.188254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 42554. [D 20:43:20.188266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 42555. [D 20:43:20.188276] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 42556. [D 20:43:20.190192] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6576 [D 20:43:20.190244] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 25/70. [D 20:43:20.190271] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6574 [D 20:43:20.190282] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 26/70. [D 20:43:20.199525] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42556. [D 20:43:20.199545] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 27/70. [D 20:43:20.201952] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.201967] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.201978] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:20.204530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 42556. [D 20:43:20.204545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 42557. [D 20:43:20.204557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 42558. [D 20:43:20.204567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 42559. [D 20:43:20.204582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 42560. [D 20:43:20.204594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 42561. [D 20:43:20.204604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 42562. [D 20:43:20.204614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 42563. [D 20:43:20.204624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 42564. [D 20:43:20.204634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 42565. [D 20:43:20.204644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 42566. [D 20:43:20.204662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 42567. [D 20:43:20.204672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 42568. [D 20:43:20.204682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 42569. [D 20:43:20.204692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 42570. [D 20:43:20.204703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 42571. [D 20:43:20.204713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 42572. [D 20:43:20.204740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 42573. [D 20:43:20.204751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 42574. [D 20:43:20.204761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 42575. [D 20:43:20.204776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 42576. [D 20:43:20.204796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 42577. [D 20:43:20.204807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 42578. [D 20:43:20.204823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 42579. [D 20:43:20.204833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 42580. [D 20:43:20.204842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 42581. [D 20:43:20.204872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 42582. [D 20:43:20.204884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 42583. [D 20:43:20.204898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 42584. [D 20:43:20.204908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 42585. [D 20:43:20.204918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 42586. [D 20:43:20.204931] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209000 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 42587. [D 20:43:20.204942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 42588. [D 20:43:20.204953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 42589. [D 20:43:20.204966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 42590. [D 20:43:20.204976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 42591. [D 20:43:20.204986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 42592. [D 20:43:20.205015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 42593. [D 20:43:20.205025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 42594. [D 20:43:20.205037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 42595. [D 20:43:20.205047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 42596. [D 20:43:20.205057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 42597. [D 20:43:20.205070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 42598. [D 20:43:20.205080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 42599. [D 20:43:20.205090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 42600. [D 20:43:20.205100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 42601. [D 20:43:20.205110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 42602. [D 20:43:20.205120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 42603. [D 20:43:20.205145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 42604. [D 20:43:20.205157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 42605. [D 20:43:20.205166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 42606. [D 20:43:20.205177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 42607. [D 20:43:20.205188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 42608. [D 20:43:20.205198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 42609. [D 20:43:20.205208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 42610. [D 20:43:20.205219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 42611. [D 20:43:20.205229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 42612. [D 20:43:20.205241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 42613. [D 20:43:20.205275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 42614. [D 20:43:20.205286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 42615. [D 20:43:20.205296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 42616. [D 20:43:20.205307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 42617. [D 20:43:20.205322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 42618. [D 20:43:20.205333] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce20 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 42619. [D 20:43:20.209472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.209487] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.209498] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:20.209525] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6580 [D 20:43:20.209536] element 0: offset: 0x643630, size: 24 [D 20:43:20.209547] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 28/70. [D 20:43:20.216352] openib_check_cq: completed rdma wr_id 2aaaab209000, nic_wr_credit 42619. [D 20:43:20.216367] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 29/70. [D 20:43:20.227976] openib_check_cq: completed rdma wr_id 2aaaab23ce20, nic_wr_credit 42618. [D 20:43:20.227989] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 30/70. [D 20:43:20.230289] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.230301] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.230311] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:20.230348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.230359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.230368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:20.232738] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6580 [D 20:43:20.232757] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 31/70. [D 20:43:20.233310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 42618. [D 20:43:20.233363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 42619. [D 20:43:20.233375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 42620. [D 20:43:20.233385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 42621. [D 20:43:20.233400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 42622. [D 20:43:20.233410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 42623. [D 20:43:20.233420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42624. [D 20:43:20.233435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42625. [D 20:43:20.233444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42626. [D 20:43:20.233454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 42627. [D 20:43:20.233470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 42628. [D 20:43:20.233480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 42629. [D 20:43:20.233489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 42630. [D 20:43:20.233499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 42631. [D 20:43:20.233516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42632. [D 20:43:20.233526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42633. [D 20:43:20.233536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42634. [D 20:43:20.233546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 42635. [D 20:43:20.233585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 42636. [D 20:43:20.233595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 42637. [D 20:43:20.233605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 42638. [D 20:43:20.233621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 42639. [D 20:43:20.233631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42640. [D 20:43:20.233641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42641. [D 20:43:20.233666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42642. [D 20:43:20.233675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 42643. [D 20:43:20.233686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 42644. [D 20:43:20.233696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 42645. [D 20:43:20.233706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 42646. [D 20:43:20.233716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 42647. [D 20:43:20.233731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42648. [D 20:43:20.233742] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42649. [D 20:43:20.244930] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42649. [D 20:43:20.244947] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 32/70. [D 20:43:20.247248] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.247263] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.247273] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:20.251732] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.251747] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.251758] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:20.251788] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6584 [D 20:43:20.251799] element 0: offset: 0x61f310, size: 24 [D 20:43:20.251821] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 33/70. [D 20:43:20.251860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.251871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.251880] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:20.251909] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6587 [D 20:43:20.251919] element 0: offset: 0x657310, size: 24 [D 20:43:20.251929] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 34/70. [D 20:43:20.251949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.251958] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.251967] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:20.251982] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6589 [D 20:43:20.251991] element 0: offset: 0x691fe0, size: 24 [D 20:43:20.252001] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 35/70. [D 20:43:20.253844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.253883] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.253892] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:20.253919] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6592 [D 20:43:20.253929] element 0: offset: 0x6537d0, size: 24 [D 20:43:20.253941] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 36/70. [D 20:43:20.256926] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 6584 [D 20:43:20.256973] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 37/70. [D 20:43:20.257027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 42649. [D 20:43:20.257085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 42650. [D 20:43:20.257096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 42651. [D 20:43:20.257106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 42652. [D 20:43:20.257116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 42653. [D 20:43:20.257126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 42654. [D 20:43:20.257136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 42655. [D 20:43:20.257146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 42656. [D 20:43:20.257156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 42657. [D 20:43:20.257166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 42658. [D 20:43:20.257175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 42659. [D 20:43:20.257185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 42660. [D 20:43:20.257195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 42661. [D 20:43:20.257205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 42662. [D 20:43:20.257215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 42663. [D 20:43:20.257225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 42664. [D 20:43:20.257235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 42665. [D 20:43:20.257244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 42666. [D 20:43:20.257254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 42667. [D 20:43:20.257264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 42668. [D 20:43:20.257274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 42669. [D 20:43:20.257284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 42670. [D 20:43:20.257294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 42671. [D 20:43:20.257304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 42672. [D 20:43:20.257314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 42673. [D 20:43:20.257323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 42674. [D 20:43:20.257333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 42675. [D 20:43:20.257343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 42676. [D 20:43:20.257353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 42677. [D 20:43:20.257364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 42678. [D 20:43:20.257375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 42679. [D 20:43:20.257385] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208f20 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 42680. [D 20:43:20.259664] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6589 [D 20:43:20.259712] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 38/70. [D 20:43:20.259765] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6587 [D 20:43:20.259778] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 39/70. [D 20:43:20.259805] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6592 [D 20:43:20.259816] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 40/70. [D 20:43:20.264401] openib_check_cq: completed rdma wr_id 2aaaab208f20, nic_wr_credit 42680. [D 20:43:20.264423] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 41/70. [D 20:43:20.264446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 42680. [D 20:43:20.264457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 42681. [D 20:43:20.264467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 42682. [D 20:43:20.264477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 42683. [D 20:43:20.264491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 42684. [D 20:43:20.264501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 42685. [D 20:43:20.264511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 42686. [D 20:43:20.264526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 42687. [D 20:43:20.264536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 42688. [D 20:43:20.264546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 42689. [D 20:43:20.264561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 42690. [D 20:43:20.264571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 42691. [D 20:43:20.264581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 42692. [D 20:43:20.264616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 42693. [D 20:43:20.264626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 42694. [D 20:43:20.264636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 42695. [D 20:43:20.264646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 42696. [D 20:43:20.264673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 42697. [D 20:43:20.264684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 42698. [D 20:43:20.264696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 42699. [D 20:43:20.264706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 42700. [D 20:43:20.264716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 42701. [D 20:43:20.264739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 42702. [D 20:43:20.264748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 42703. [D 20:43:20.264759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 42704. [D 20:43:20.264769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 42705. [D 20:43:20.264779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 42706. [D 20:43:20.264789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 42707. [D 20:43:20.264808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 42708. [D 20:43:20.264818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 42709. [D 20:43:20.264828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 42710. [D 20:43:20.264845] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 42711. [D 20:43:20.264857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 42712. [D 20:43:20.264877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 42713. [D 20:43:20.264891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 42714. [D 20:43:20.264901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 42715. [D 20:43:20.264911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 42716. [D 20:43:20.264927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 42717. [D 20:43:20.264937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 42718. [D 20:43:20.264947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 42719. [D 20:43:20.264972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 42720. [D 20:43:20.264982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 42721. [D 20:43:20.264997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 42722. [D 20:43:20.265007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 42723. [D 20:43:20.265016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 42724. [D 20:43:20.265044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 42725. [D 20:43:20.265057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 42726. [D 20:43:20.265071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 42727. [D 20:43:20.265081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 42728. [D 20:43:20.265090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 42729. [D 20:43:20.265114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 42730. [D 20:43:20.265123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 42731. [D 20:43:20.265134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 42732. [D 20:43:20.265144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 42733. [D 20:43:20.265154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 42734. [D 20:43:20.265177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 42735. [D 20:43:20.265188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 42736. [D 20:43:20.265198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 42737. [D 20:43:20.265208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 42738. [D 20:43:20.265218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 42739. [D 20:43:20.265245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 42740. [D 20:43:20.265256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 42741. [D 20:43:20.265266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 42742. [D 20:43:20.265282] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d220 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 42743. [D 20:43:20.265293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 42744. [D 20:43:20.265318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 42745. [D 20:43:20.265328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 42746. [D 20:43:20.265338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 42747. [D 20:43:20.265352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 42748. [D 20:43:20.265362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 42749. [E 20:43:20.265375] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 42750, block for 10 ms. [D 20:43:20.265402] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 42749. [D 20:43:20.265413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42750. [E 20:43:20.265424] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 42751, block for 10 ms. [D 20:43:20.276187] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 42750. [D 20:43:20.276201] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 42/70. [D 20:43:20.276213] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42749. [D 20:43:20.276223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42750. [D 20:43:20.276238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42751. [D 20:43:20.276249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 42752. [D 20:43:20.276259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 42753. [D 20:43:20.276269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 42754. [D 20:43:20.276280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 42755. [D 20:43:20.276290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 42756. [D 20:43:20.276304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42757. [D 20:43:20.276314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42758. [D 20:43:20.276324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42759. [D 20:43:20.276334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 42760. [D 20:43:20.276366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 42761. [D 20:43:20.276376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 42762. [D 20:43:20.276391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 42763. [D 20:43:20.276400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 42764. [D 20:43:20.276410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42765. [D 20:43:20.276433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42766. [D 20:43:20.276443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42767. [D 20:43:20.276453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 42768. [D 20:43:20.276463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 42769. [D 20:43:20.276473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 42770. [D 20:43:20.276483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 42771. [D 20:43:20.276507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 42772. [D 20:43:20.276521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42773. [D 20:43:20.276533] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d360 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42774. [D 20:43:20.276613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.276629] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.276638] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:20.287764] openib_check_cq: completed rdma wr_id 2aaaab23d220, nic_wr_credit 42774. [D 20:43:20.287781] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 43/70. [D 20:43:20.289991] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.290007] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.290016] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:20.292645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.292659] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.292667] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:20.292693] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6594 [D 20:43:20.292703] element 0: offset: 0x6acf80, size: 24 [D 20:43:20.292714] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 44/70. [D 20:43:20.299478] openib_check_cq: completed rdma wr_id 2aaaab23d360, nic_wr_credit 42773. [D 20:43:20.299496] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 45/70. [D 20:43:20.299540] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.299555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.299563] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:20.299629] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.299639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.299647] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:20.301890] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6594 [D 20:43:20.301925] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 46/70. [D 20:43:20.305326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 42773. [D 20:43:20.305341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 42774. [D 20:43:20.305354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 42775. [D 20:43:20.305364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 42776. [D 20:43:20.305375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 42777. [D 20:43:20.305387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 42778. [D 20:43:20.305405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 42779. [D 20:43:20.305415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 42780. [D 20:43:20.305425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 42781. [D 20:43:20.305435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 42782. [D 20:43:20.305445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 42783. [D 20:43:20.305466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 42784. [D 20:43:20.305476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 42785. [D 20:43:20.305494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 42786. [D 20:43:20.305504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 42787. [D 20:43:20.305514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 42788. [D 20:43:20.305525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 42789. [D 20:43:20.305535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 42790. [D 20:43:20.305559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 42791. [D 20:43:20.305570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 42792. [D 20:43:20.305580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 42793. [D 20:43:20.305590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 42794. [D 20:43:20.305605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 42795. [D 20:43:20.305615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 42796. [D 20:43:20.305625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 42797. [D 20:43:20.305654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 42798. [D 20:43:20.305665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 42799. [D 20:43:20.305676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 42800. [D 20:43:20.305686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 42801. [D 20:43:20.305699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 42802. [D 20:43:20.305736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 42803. [D 20:43:20.305746] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208880 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 42804. [D 20:43:20.307930] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.307963] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.307972] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:20.308002] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6598 [D 20:43:20.308012] element 0: offset: 0x2aaaab208910, size: 24 [D 20:43:20.308025] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 47/70. [D 20:43:20.311204] openib_check_cq: completed rdma wr_id 2aaaab208880, nic_wr_credit 42804. [D 20:43:20.311222] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 48/70. [D 20:43:20.311306] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.311321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.311329] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:20.315386] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6598 [D 20:43:20.315443] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 49/70. [D 20:43:20.315498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 42804. [D 20:43:20.315514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 42805. [D 20:43:20.315526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 42806. [D 20:43:20.315536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 42807. [D 20:43:20.315546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 42808. [D 20:43:20.315579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 42809. [D 20:43:20.315593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 42810. [D 20:43:20.315603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 42811. [D 20:43:20.315616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 42812. [D 20:43:20.315630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 42813. [D 20:43:20.315660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 42814. [D 20:43:20.315675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 42815. [D 20:43:20.315693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 42816. [D 20:43:20.315704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 42817. [D 20:43:20.315715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 42818. [D 20:43:20.315738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 42819. [D 20:43:20.315749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 42820. [D 20:43:20.315759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 42821. [D 20:43:20.315785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 42822. [D 20:43:20.315795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 42823. [D 20:43:20.315806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 42824. [D 20:43:20.315817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 42825. [D 20:43:20.315827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 42826. [D 20:43:20.315837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 42827. [D 20:43:20.315863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 42828. [D 20:43:20.315872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 42829. [D 20:43:20.315883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 42830. [D 20:43:20.315893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 42831. [D 20:43:20.315903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 42832. [D 20:43:20.315930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 42833. [D 20:43:20.315940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 42834. [D 20:43:20.315950] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208880 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 42835. [D 20:43:20.321451] openib_check_cq: completed rdma wr_id 2aaaab208880, nic_wr_credit 42835. [D 20:43:20.321466] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 50/70. [D 20:43:20.321514] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.321529] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.321537] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:20.618247] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.618261] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.618269] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:20.618286] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6602 [D 20:43:20.618296] element 0: offset: 0x2aaaab208fb0, size: 24 [D 20:43:20.618306] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 51/70. [D 20:43:20.618335] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.618345] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.618353] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:20.618368] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6604 [D 20:43:20.618377] element 0: offset: 0x2aaaab23d1d0, size: 24 [D 20:43:20.618390] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 52/70. [D 20:43:20.620771] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6602 [D 20:43:20.620792] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 53/70. [D 20:43:20.622989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 42835. [D 20:43:20.623046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 42836. [D 20:43:20.623058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 42837. [D 20:43:20.623068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 42838. [D 20:43:20.623079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 42839. [D 20:43:20.623089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 42840. [D 20:43:20.623099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 42841. [D 20:43:20.623110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 42842. [D 20:43:20.623119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 42843. [D 20:43:20.623129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 42844. [D 20:43:20.623139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 42845. [D 20:43:20.623186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 42846. [D 20:43:20.623197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 42847. [D 20:43:20.623208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 42848. [D 20:43:20.623218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 42849. [D 20:43:20.623237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 42850. [D 20:43:20.623248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 42851. [D 20:43:20.623263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 42852. [D 20:43:20.623273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 42853. [D 20:43:20.623283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 42854. [D 20:43:20.623300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 42855. [D 20:43:20.623309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 42856. [D 20:43:20.623319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 42857. [D 20:43:20.623335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 42858. [D 20:43:20.623392] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6604 [D 20:43:20.623457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 42859. [D 20:43:20.623468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 42860. [D 20:43:20.623478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 42861. [D 20:43:20.623503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 42862. [D 20:43:20.623513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 42863. [D 20:43:20.623527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 42864. [D 20:43:20.623543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 42865. [D 20:43:20.623558] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230270 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 42866. [D 20:43:20.623578] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 54/70. [D 20:43:20.629635] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.629673] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.629682] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:20.629709] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6606 [D 20:43:20.629719] element 0: offset: 0x62d730, size: 24 [D 20:43:20.629732] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 55/70. [D 20:43:20.633098] openib_check_cq: completed rdma wr_id 2aaaab230270, nic_wr_credit 42866. [D 20:43:20.633116] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 56/70. [D 20:43:20.633145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 42866. [D 20:43:20.633156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 42867. [D 20:43:20.633166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 42868. [D 20:43:20.633177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 42869. [D 20:43:20.633187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 42870. [D 20:43:20.633197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 42871. [D 20:43:20.633207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42872. [D 20:43:20.633220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42873. [D 20:43:20.633230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42874. [D 20:43:20.633240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 42875. [D 20:43:20.633250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 42876. [D 20:43:20.633260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 42877. [D 20:43:20.633270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 42878. [D 20:43:20.633280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 42879. [D 20:43:20.633290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42880. [D 20:43:20.633300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42881. [D 20:43:20.633310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42882. [D 20:43:20.633320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 42883. [D 20:43:20.633330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 42884. [D 20:43:20.633340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 42885. [D 20:43:20.633350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 42886. [D 20:43:20.633360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 42887. [D 20:43:20.633370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42888. [D 20:43:20.633380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42889. [D 20:43:20.633390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42890. [D 20:43:20.633400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 42891. [D 20:43:20.633410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 42892. [D 20:43:20.633420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 42893. [D 20:43:20.633430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 42894. [D 20:43:20.633441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 42895. [D 20:43:20.633451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42896. [D 20:43:20.633461] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42897. [D 20:43:20.635493] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.635542] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.635551] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:20.635868] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6606 [D 20:43:20.635897] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 57/70. [D 20:43:20.644853] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 42897. [D 20:43:20.644867] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 58/70. [D 20:43:20.644912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 42897. [D 20:43:20.644923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 42898. [D 20:43:20.644934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 42899. [D 20:43:20.644944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 42900. [D 20:43:20.644955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 42901. [D 20:43:20.644965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 42902. [D 20:43:20.644975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 42903. [D 20:43:20.644985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 42904. [D 20:43:20.644995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 42905. [D 20:43:20.645005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 42906. [D 20:43:20.645015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 42907. [D 20:43:20.645033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 42908. [D 20:43:20.645062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 42909. [D 20:43:20.645073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 42910. [D 20:43:20.645083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 42911. [D 20:43:20.645107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 42912. [D 20:43:20.645117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 42913. [D 20:43:20.645127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 42914. [D 20:43:20.645138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 42915. [D 20:43:20.645147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 42916. [D 20:43:20.645160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 42917. [D 20:43:20.645176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 42918. [D 20:43:20.645200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 42919. [D 20:43:20.645214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 42920. [D 20:43:20.645224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 42921. [D 20:43:20.645234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 42922. [D 20:43:20.645250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 42923. [D 20:43:20.645260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 42924. [D 20:43:20.645269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 42925. [D 20:43:20.645280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 42926. [D 20:43:20.645291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 42927. [D 20:43:20.645300] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2089f0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 42928. [D 20:43:20.645360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.645376] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.645385] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:20.645404] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.645413] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.645421] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:20.645447] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6610 [D 20:43:20.645457] element 0: offset: 0x61f310, size: 24 [D 20:43:20.645471] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 59/70. [D 20:43:20.656694] openib_check_cq: completed rdma wr_id 2aaaab2089f0, nic_wr_credit 42928. [D 20:43:20.656711] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 60/70. [D 20:43:20.656805] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.656821] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.656830] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:20.661291] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6610 [D 20:43:20.661352] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 0/70. [D 20:43:20.664237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 42928. [D 20:43:20.664254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 42929. [D 20:43:20.664266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 42930. [D 20:43:20.664277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 42931. [D 20:43:20.664287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 42932. [D 20:43:20.664301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 42933. [D 20:43:20.664311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 42934. [D 20:43:20.664321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 42935. [D 20:43:20.664336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 42936. [D 20:43:20.664346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 42937. [D 20:43:20.664356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 42938. [D 20:43:20.664371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 42939. [D 20:43:20.664381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 42940. [D 20:43:20.664391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 42941. [D 20:43:20.664401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 42942. [D 20:43:20.664413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 42943. [D 20:43:20.664423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 42944. [D 20:43:20.664438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 42945. [D 20:43:20.664448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 42946. [D 20:43:20.664458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 42947. [D 20:43:20.664468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 42948. [D 20:43:20.664503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 42949. [D 20:43:20.664513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 42950. [D 20:43:20.664524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 42951. [D 20:43:20.664534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 42952. [D 20:43:20.664550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 42953. [D 20:43:20.664560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 42954. [D 20:43:20.664570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 42955. [D 20:43:20.664600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 42956. [D 20:43:20.664610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 42957. [D 20:43:20.664622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 42958. [D 20:43:20.664633] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230270 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 42959. [D 20:43:20.670703] openib_check_cq: completed rdma wr_id 2aaaab230270, nic_wr_credit 42959. [D 20:43:20.670718] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 1/70. [D 20:43:20.670815] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.670832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.670840] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:20.675235] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.675249] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.675257] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:20.675274] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6614 [D 20:43:20.675283] element 0: offset: 0x657310, size: 24 [D 20:43:20.675294] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 2/70. [D 20:43:20.677669] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6614 [D 20:43:20.677686] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 3/70. [D 20:43:20.682064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 42959. [D 20:43:20.682079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 42960. [D 20:43:20.682092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 42961. [D 20:43:20.682101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 42962. [D 20:43:20.682112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 42963. [D 20:43:20.682128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 42964. [D 20:43:20.682137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 42965. [D 20:43:20.682147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 42966. [D 20:43:20.682164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 42967. [D 20:43:20.682174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 42968. [D 20:43:20.682184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 42969. [D 20:43:20.682199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 42970. [D 20:43:20.682209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 42971. [D 20:43:20.682219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 42972. [D 20:43:20.682235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 42973. [D 20:43:20.682262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 42974. [D 20:43:20.682273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 42975. [D 20:43:20.682283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 42976. [D 20:43:20.682299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 42977. [D 20:43:20.682309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 42978. [D 20:43:20.682319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 42979. [D 20:43:20.682335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 42980. [D 20:43:20.682361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 42981. [D 20:43:20.682374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 42982. [D 20:43:20.682398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 42983. [D 20:43:20.682409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 42984. [D 20:43:20.682419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 42985. [D 20:43:20.682432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 42986. [D 20:43:20.682446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 42987. [D 20:43:20.682456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 42988. [D 20:43:20.682466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 42989. [D 20:43:20.682482] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230270 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 42990. [D 20:43:20.682567] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.682613] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.682622] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:20.682652] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6617 [D 20:43:20.682662] element 0: offset: 0x661780, size: 24 [D 20:43:20.682675] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 4/70. [D 20:43:20.682702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.682712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.682720] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:20.682736] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6618 [D 20:43:20.682745] element 0: offset: 0x5b0030, size: 24 [D 20:43:20.682757] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 5/70. [D 20:43:20.684903] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.684917] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.684925] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:20.684941] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6622 [D 20:43:20.684950] element 0: offset: 0x643630, size: 24 [D 20:43:20.684961] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 6/70. [D 20:43:20.693744] openib_check_cq: completed rdma wr_id 2aaaab230270, nic_wr_credit 42990. [D 20:43:20.693761] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 7/70. [D 20:43:20.693894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.693909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.693918] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:20.698534] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6622 [D 20:43:20.698594] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 8/70. [D 20:43:20.698615] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6617 [D 20:43:20.698634] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 9/70. [D 20:43:20.698648] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6618 [D 20:43:20.698668] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 10/70. [D 20:43:20.699948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 42990. [D 20:43:20.699965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 42991. [D 20:43:20.699977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 42992. [D 20:43:20.699986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 42993. [D 20:43:20.700025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 42994. [D 20:43:20.700037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 42995. [D 20:43:20.700047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 42996. [D 20:43:20.700057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 42997. [D 20:43:20.700072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 42998. [D 20:43:20.700082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 42999. [D 20:43:20.700092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 43000. [D 20:43:20.700108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 43001. [D 20:43:20.700118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 43002. [D 20:43:20.700128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 43003. [D 20:43:20.700175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 43004. [D 20:43:20.700187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 43005. [D 20:43:20.700197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 43006. [D 20:43:20.700207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 43007. [D 20:43:20.700217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 43008. [D 20:43:20.700227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 43009. [D 20:43:20.700238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 43010. [D 20:43:20.700249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 43011. [D 20:43:20.700259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 43012. [D 20:43:20.700269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 43013. [D 20:43:20.700300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 43014. [D 20:43:20.700310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 43015. [D 20:43:20.700324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 43016. [D 20:43:20.700334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 43017. [D 20:43:20.700344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 43018. [D 20:43:20.700358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 43019. [D 20:43:20.700367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 43020. [D 20:43:20.700377] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 43021. [D 20:43:20.700396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 43022. [D 20:43:20.700406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 43023. [D 20:43:20.700416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 43024. [D 20:43:20.700445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 43025. [D 20:43:20.700460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 43026. [D 20:43:20.700470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 43027. [D 20:43:20.700488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 43028. [D 20:43:20.700499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 43029. [D 20:43:20.700509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 43030. [D 20:43:20.700519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 43031. [D 20:43:20.700529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 43032. [D 20:43:20.700539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 43033. [D 20:43:20.700549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 43034. [D 20:43:20.700577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 43035. [D 20:43:20.700587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 43036. [D 20:43:20.700597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 43037. [D 20:43:20.700607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 43038. [D 20:43:20.700617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 43039. [D 20:43:20.700632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 43040. [D 20:43:20.700642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 43041. [D 20:43:20.700652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 43042. [D 20:43:20.700662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 43043. [D 20:43:20.700679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 43044. [D 20:43:20.700689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 43045. [D 20:43:20.700699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 43046. [D 20:43:20.700726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 43047. [D 20:43:20.700736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 43048. [D 20:43:20.700747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 43049. [D 20:43:20.700757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 43050. [D 20:43:20.700767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 43051. [D 20:43:20.700777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 43052. [D 20:43:20.700788] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 43053. [D 20:43:20.700800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 43054. [D 20:43:20.700810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 43055. [D 20:43:20.700820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 43056. [D 20:43:20.700830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 43057. [D 20:43:20.700840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 43058. [D 20:43:20.700857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 43059. [D 20:43:20.700867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 43060. [E 20:43:20.700880] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 43061, block for 10 ms. [D 20:43:20.702539] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 43060. [E 20:43:20.702553] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 43061, block for 10 ms. [D 20:43:20.711660] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43060. [D 20:43:20.711678] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 11/70. [D 20:43:20.711693] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 43059. [D 20:43:20.711705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 43060. [D 20:43:20.711718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 43061. [D 20:43:20.711730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 43062. [D 20:43:20.711742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 43063. [D 20:43:20.711759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 43064. [D 20:43:20.711769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 43065. [D 20:43:20.711779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 43066. [D 20:43:20.711794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 43067. [D 20:43:20.711807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 43068. [D 20:43:20.711819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 43069. [D 20:43:20.711831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 43070. [D 20:43:20.711843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 43071. [D 20:43:20.711856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 43072. [D 20:43:20.711868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 43073. [D 20:43:20.711880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 43074. [D 20:43:20.711893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 43075. [D 20:43:20.711905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 43076. [D 20:43:20.711917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 43077. [D 20:43:20.711929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 43078. [D 20:43:20.711941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 43079. [D 20:43:20.711953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 43080. [D 20:43:20.711966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 43081. [D 20:43:20.711978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 43082. [D 20:43:20.711988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 43083. [D 20:43:20.712002] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 43084. [D 20:43:20.712049] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.712087] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.712096] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:20.712125] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6625 [D 20:43:20.712135] element 0: offset: 0x653800, size: 24 [D 20:43:20.712149] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 12/70. [D 20:43:20.723200] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 43084. [D 20:43:20.723219] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 13/70. [D 20:43:20.725412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.725427] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.725435] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:20.734874] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 43083. [D 20:43:20.734893] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 14/70. [D 20:43:20.734931] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.734946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.734955] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:20.735018] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.735028] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.735037] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:20.739512] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6625 [D 20:43:20.739593] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 15/70. [D 20:43:20.740000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 43083. [D 20:43:20.740018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 43084. [D 20:43:20.740033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 43085. [D 20:43:20.740046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 43086. [D 20:43:20.740058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 43087. [D 20:43:20.740070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 43088. [D 20:43:20.740082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43089. [D 20:43:20.740095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43090. [D 20:43:20.740107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43091. [D 20:43:20.740120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 43092. [D 20:43:20.740132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 43093. [D 20:43:20.740145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 43094. [D 20:43:20.740157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 43095. [D 20:43:20.740169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 43096. [D 20:43:20.740182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43097. [D 20:43:20.740194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43098. [D 20:43:20.740207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43099. [D 20:43:20.740219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 43100. [D 20:43:20.740232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 43101. [D 20:43:20.740244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 43102. [D 20:43:20.740257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 43103. [D 20:43:20.740269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 43104. [D 20:43:20.740282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43105. [D 20:43:20.740294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43106. [D 20:43:20.740306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43107. [D 20:43:20.740319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 43108. [D 20:43:20.740331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 43109. [D 20:43:20.740344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 43110. [D 20:43:20.740356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 43111. [D 20:43:20.740368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 43112. [D 20:43:20.740381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43113. [D 20:43:20.740391] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230270 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43114. [D 20:43:20.751827] openib_check_cq: completed rdma wr_id 2aaaab230270, nic_wr_credit 43114. [D 20:43:20.751844] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 16/70. [D 20:43:20.751893] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.751909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.751918] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:20.757864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.757877] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.757885] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:20.757902] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6630 [D 20:43:20.757911] element 0: offset: 0x64d970, size: 24 [D 20:43:20.757922] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 17/70. [D 20:43:20.757949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.757959] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.757967] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:20.757982] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6631 [D 20:43:20.757991] element 0: offset: 0x2aaaab208910, size: 24 [D 20:43:20.758002] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 18/70. [D 20:43:20.758082] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.758092] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.758100] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:20.758114] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6634 [D 20:43:20.758123] element 0: offset: 0x61f310, size: 24 [D 20:43:20.758134] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 19/70. [D 20:43:20.763238] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6630 [D 20:43:20.763312] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 20/70. [D 20:43:20.763333] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6631 [D 20:43:20.763352] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 21/70. [D 20:43:20.763371] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6634 [D 20:43:20.763384] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 22/70. [D 20:43:20.763446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 43114. [D 20:43:20.763464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 43115. [D 20:43:20.763478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 43116. [D 20:43:20.763490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 43117. [D 20:43:20.763503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 43118. [D 20:43:20.763541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 43119. [D 20:43:20.763554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 43120. [D 20:43:20.763570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 43121. [D 20:43:20.763583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 43122. [D 20:43:20.763595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 43123. [D 20:43:20.763608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 43124. [D 20:43:20.763621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 43125. [D 20:43:20.763633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 43126. [D 20:43:20.763645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 43127. [D 20:43:20.763658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 43128. [D 20:43:20.763670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 43129. [D 20:43:20.763682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 43130. [D 20:43:20.763695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 43131. [D 20:43:20.763707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 43132. [D 20:43:20.763720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 43133. [D 20:43:20.763732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 43134. [D 20:43:20.763744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 43135. [D 20:43:20.763762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 43136. [D 20:43:20.763776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 43137. [D 20:43:20.763789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 43138. [D 20:43:20.763801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 43139. [D 20:43:20.763811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 43140. [D 20:43:20.763822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 43141. [D 20:43:20.763834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 43142. [D 20:43:20.763847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 43143. [D 20:43:20.763859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 43144. [D 20:43:20.763870] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230270 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 43145. [D 20:43:20.763882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 43146. [D 20:43:20.763892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 43147. [D 20:43:20.763902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 43148. [D 20:43:20.763912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 43149. [D 20:43:20.763922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 43150. [D 20:43:20.763932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 43151. [D 20:43:20.763941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 43152. [D 20:43:20.763951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 43153. [D 20:43:20.763961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 43154. [D 20:43:20.763971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 43155. [D 20:43:20.763980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 43156. [D 20:43:20.763990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 43157. [D 20:43:20.764000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 43158. [D 20:43:20.764010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 43159. [D 20:43:20.764020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 43160. [D 20:43:20.764029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 43161. [D 20:43:20.764039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 43162. [D 20:43:20.764049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 43163. [D 20:43:20.764059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 43164. [D 20:43:20.764068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 43165. [D 20:43:20.764078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 43166. [D 20:43:20.764088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 43167. [D 20:43:20.764098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 43168. [D 20:43:20.764108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 43169. [D 20:43:20.764117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 43170. [D 20:43:20.764127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 43171. [D 20:43:20.764137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 43172. [D 20:43:20.764147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 43173. [D 20:43:20.764158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 43174. [D 20:43:20.764167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 43175. [D 20:43:20.764177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 43176. [D 20:43:20.764187] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208d20 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 43177. [D 20:43:20.764198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 43178. [D 20:43:20.764208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 43179. [D 20:43:20.764218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 43180. [D 20:43:20.764228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 43181. [D 20:43:20.764238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 43182. [D 20:43:20.764248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 43183. [D 20:43:20.764258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 43184. [E 20:43:20.764271] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 43185, block for 10 ms. [D 20:43:20.773025] openib_check_cq: completed rdma wr_id 2aaaab230270, nic_wr_credit 43184. [D 20:43:20.773042] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 23/70. [D 20:43:20.773058] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 43183. [D 20:43:20.773071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 43184. [D 20:43:20.773084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 43185. [D 20:43:20.773096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 43186. [D 20:43:20.773109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 43187. [D 20:43:20.773121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 43188. [D 20:43:20.773134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 43189. [D 20:43:20.773146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 43190. [D 20:43:20.773159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 43191. [D 20:43:20.773171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 43192. [D 20:43:20.773184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 43193. [D 20:43:20.773197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 43194. [D 20:43:20.773209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 43195. [D 20:43:20.773222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 43196. [D 20:43:20.773234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 43197. [D 20:43:20.773246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 43198. [D 20:43:20.773259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 43199. [D 20:43:20.773272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 43200. [D 20:43:20.773284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 43201. [D 20:43:20.773297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 43202. [D 20:43:20.773309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 43203. [D 20:43:20.773322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 43204. [D 20:43:20.773334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 43205. [D 20:43:20.773346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 43206. [D 20:43:20.773359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 43207. [D 20:43:20.773371] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab203710 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 43208. [D 20:43:20.779505] openib_check_cq: completed rdma wr_id 2aaaab208d20, nic_wr_credit 43208. [D 20:43:20.779521] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 24/70. [D 20:43:20.780639] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.780682] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.780691] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:20.785391] openib_check_cq: completed rdma wr_id 2aaaab203710, nic_wr_credit 43207. [D 20:43:20.785409] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 25/70. [D 20:43:20.785452] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.785467] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.785476] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:20.785491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.785500] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.785508] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:20.894177] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:20.894191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.894199] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:20.894226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6637 [D 20:43:20.894235] element 0: offset: 0x643630, size: 24 [D 20:43:20.894248] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 26/70. [D 20:43:20.898403] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6637 [D 20:43:20.898470] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 27/70. [D 20:43:20.898521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 43207. [D 20:43:20.898538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 43208. [D 20:43:20.898549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 43209. [D 20:43:20.898559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 43210. [D 20:43:20.898570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 43211. [D 20:43:20.898603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 43212. [D 20:43:20.898631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43213. [D 20:43:20.898642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43214. [D 20:43:20.898665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43215. [D 20:43:20.898674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 43216. [D 20:43:20.898701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 43217. [D 20:43:20.898711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 43218. [D 20:43:20.898722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 43219. [D 20:43:20.898747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 43220. [D 20:43:20.898758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43221. [D 20:43:20.898778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43222. [D 20:43:20.898793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43223. [D 20:43:20.898815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 43224. [D 20:43:20.898830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 43225. [D 20:43:20.898851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 43226. [D 20:43:20.898866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 43227. [D 20:43:20.898887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 43228. [D 20:43:20.898899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43229. [D 20:43:20.898909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43230. [D 20:43:20.898931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43231. [D 20:43:20.898941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 43232. [D 20:43:20.898961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 43233. [D 20:43:20.898973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 43234. [D 20:43:20.898982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 43235. [D 20:43:20.898993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 43236. [D 20:43:20.899017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43237. [D 20:43:20.899032] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43238. [D 20:43:20.904391] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43238. [D 20:43:20.904406] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 28/70. [D 20:43:20.904456] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:20.904471] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:20.904480] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.059938] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.059952] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.059961] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.059977] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6640 [D 20:43:21.059986] element 0: offset: 0x5b0030, size: 24 [D 20:43:21.059997] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 29/70. [D 20:43:21.062365] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6640 [D 20:43:21.062384] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 30/70. [D 20:43:21.062504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 43238. [D 20:43:21.062518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 43239. [D 20:43:21.062529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 43240. [D 20:43:21.062539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 43241. [D 20:43:21.062549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 43242. [D 20:43:21.062563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 43243. [D 20:43:21.062594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 43244. [D 20:43:21.062604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 43245. [D 20:43:21.062614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 43246. [D 20:43:21.062630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 43247. [D 20:43:21.062640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 43248. [D 20:43:21.062651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 43249. [D 20:43:21.062674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 43250. [D 20:43:21.062684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 43251. [D 20:43:21.062694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 43252. [D 20:43:21.062704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 43253. [D 20:43:21.062723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 43254. [D 20:43:21.062733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 43255. [D 20:43:21.062750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 43256. [D 20:43:21.062760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 43257. [D 20:43:21.062770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 43258. [D 20:43:21.062794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 43259. [D 20:43:21.062804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 43260. [D 20:43:21.062814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 43261. [D 20:43:21.062824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 43262. [D 20:43:21.062834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 43263. [D 20:43:21.062844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 43264. [D 20:43:21.062854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 43265. [D 20:43:21.062866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 43266. [D 20:43:21.062876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 43267. [D 20:43:21.062886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 43268. [D 20:43:21.062896] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 43269. [D 20:43:21.074314] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43269. [D 20:43:21.074328] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 31/70. [D 20:43:21.074446] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.074488] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.074497] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.082207] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.082221] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.082229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.082256] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6642 [D 20:43:21.082266] element 0: offset: 0x6acf80, size: 24 [D 20:43:21.082278] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 32/70. [D 20:43:21.086412] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6642 [D 20:43:21.086431] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 33/70. [D 20:43:21.086462] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.086473] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.086481] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.086497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6646 [D 20:43:21.086507] element 0: offset: 0x61f310, size: 24 [D 20:43:21.086517] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 34/70. [D 20:43:21.086571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 43269. [D 20:43:21.086627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 43270. [D 20:43:21.086639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 43271. [D 20:43:21.086649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 43272. [D 20:43:21.086664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 43273. [D 20:43:21.086673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 43274. [D 20:43:21.086683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 43275. [D 20:43:21.086697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 43276. [D 20:43:21.086707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 43277. [D 20:43:21.086717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 43278. [D 20:43:21.086765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 43279. [D 20:43:21.086777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 43280. [D 20:43:21.086787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 43281. [D 20:43:21.086810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 43282. [D 20:43:21.086821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 43283. [D 20:43:21.086831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 43284. [D 20:43:21.086842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 43285. [D 20:43:21.086852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 43286. [D 20:43:21.086862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 43287. [D 20:43:21.086872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 43288. [D 20:43:21.086882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 43289. [D 20:43:21.086892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 43290. [D 20:43:21.086924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 43291. [D 20:43:21.086934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 43292. [D 20:43:21.086946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 43293. [D 20:43:21.086956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 43294. [D 20:43:21.086969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 43295. [D 20:43:21.086992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 43296. [D 20:43:21.087003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 43297. [D 20:43:21.087013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 43298. [D 20:43:21.087023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 43299. [D 20:43:21.087033] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 43300. [D 20:43:21.089427] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6646 [D 20:43:21.089484] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 35/70. [D 20:43:21.093741] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43300. [D 20:43:21.093761] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 36/70. [D 20:43:21.093823] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.093839] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.093848] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:21.094478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 43300. [D 20:43:21.094494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 43301. [D 20:43:21.094505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 43302. [D 20:43:21.094515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 43303. [D 20:43:21.094525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 43304. [D 20:43:21.094536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 43305. [D 20:43:21.094546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43306. [D 20:43:21.094556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43307. [D 20:43:21.094566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43308. [D 20:43:21.094584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 43309. [D 20:43:21.094594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 43310. [D 20:43:21.094604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 43311. [D 20:43:21.094614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 43312. [D 20:43:21.094625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 43313. [D 20:43:21.094635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43314. [D 20:43:21.094651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43315. [D 20:43:21.094661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43316. [D 20:43:21.094671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 43317. [D 20:43:21.094681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 43318. [D 20:43:21.094691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 43319. [D 20:43:21.094701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 43320. [D 20:43:21.094711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 43321. [D 20:43:21.094745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43322. [D 20:43:21.094755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43323. [D 20:43:21.094765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43324. [D 20:43:21.094781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 43325. [D 20:43:21.094791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 43326. [D 20:43:21.094801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 43327. [D 20:43:21.094816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 43328. [D 20:43:21.094826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 43329. [D 20:43:21.094836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43330. [D 20:43:21.094851] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209130 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43331. [D 20:43:21.097183] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.097199] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.097208] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.097234] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6649 [D 20:43:21.097244] element 0: offset: 0x691fe0, size: 24 [D 20:43:21.097255] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 37/70. [D 20:43:21.106012] openib_check_cq: completed rdma wr_id 2aaaab209130, nic_wr_credit 43331. [D 20:43:21.106030] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 38/70. [D 20:43:21.106125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.106140] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.106149] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:21.109759] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6649 [D 20:43:21.109777] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 39/70. [D 20:43:21.111967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 43331. [D 20:43:21.112020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 43332. [D 20:43:21.112031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 43333. [D 20:43:21.112041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 43334. [D 20:43:21.112057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 43335. [D 20:43:21.112068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 43336. [D 20:43:21.112077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 43337. [D 20:43:21.112088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 43338. [D 20:43:21.112098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 43339. [D 20:43:21.112108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 43340. [D 20:43:21.112117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 43341. [D 20:43:21.112134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 43342. [D 20:43:21.112144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 43343. [D 20:43:21.112154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 43344. [D 20:43:21.112189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 43345. [D 20:43:21.112200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 43346. [D 20:43:21.112210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 43347. [D 20:43:21.112220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 43348. [D 20:43:21.112247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 43349. [D 20:43:21.112257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 43350. [D 20:43:21.112271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 43351. [D 20:43:21.112281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 43352. [D 20:43:21.112291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 43353. [D 20:43:21.112305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 43354. [D 20:43:21.112330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 43355. [D 20:43:21.112344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 43356. [D 20:43:21.112354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 43357. [D 20:43:21.112378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 43358. [D 20:43:21.112393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 43359. [D 20:43:21.112403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 43360. [D 20:43:21.112412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 43361. [D 20:43:21.112428] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 43362. [D 20:43:21.118141] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43362. [D 20:43:21.118157] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 40/70. [D 20:43:21.118220] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.118236] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.118244] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.121696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.121709] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.121717] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.121733] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6652 [D 20:43:21.121743] element 0: offset: 0x5b0030, size: 24 [D 20:43:21.121753] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 41/70. [D 20:43:21.124120] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6652 [D 20:43:21.124171] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 42/70. [D 20:43:21.124306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 43362. [D 20:43:21.124323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 43363. [D 20:43:21.124335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 43364. [D 20:43:21.124345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 43365. [D 20:43:21.124357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 43366. [D 20:43:21.124373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 43367. [D 20:43:21.124382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43368. [D 20:43:21.124392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43369. [D 20:43:21.124409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43370. [D 20:43:21.124419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 43371. [D 20:43:21.124428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 43372. [D 20:43:21.124445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 43373. [D 20:43:21.124472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 43374. [D 20:43:21.124483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 43375. [D 20:43:21.124493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43376. [D 20:43:21.124503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43377. [D 20:43:21.124520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43378. [D 20:43:21.124530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 43379. [D 20:43:21.124550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 43380. [D 20:43:21.124561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 43381. [D 20:43:21.124571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 43382. [D 20:43:21.124581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 43383. [D 20:43:21.124608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43384. [D 20:43:21.124618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43385. [D 20:43:21.124628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43386. [D 20:43:21.124644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 43387. [D 20:43:21.124654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 43388. [D 20:43:21.124664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 43389. [D 20:43:21.124693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 43390. [D 20:43:21.124703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 43391. [D 20:43:21.124715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43392. [D 20:43:21.124725] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43393. [D 20:43:21.130828] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43393. [D 20:43:21.130842] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 43/70. [D 20:43:21.130904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.130920] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.130929] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.146210] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.146224] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.146232] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.146258] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6655 [D 20:43:21.146268] element 0: offset: 0x6acf80, size: 24 [D 20:43:21.146279] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 44/70. [D 20:43:21.150337] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6655 [D 20:43:21.150354] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 45/70. [D 20:43:21.150417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 43393. [D 20:43:21.150476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 43394. [D 20:43:21.150495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 43395. [D 20:43:21.150505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 43396. [D 20:43:21.150517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 43397. [D 20:43:21.150527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 43398. [D 20:43:21.150571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43399. [D 20:43:21.150584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43400. [D 20:43:21.150595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43401. [D 20:43:21.150605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 43402. [D 20:43:21.150616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 43403. [D 20:43:21.150626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 43404. [D 20:43:21.150651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 43405. [D 20:43:21.150661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 43406. [D 20:43:21.150671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43407. [D 20:43:21.150686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43408. [D 20:43:21.150696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43409. [D 20:43:21.150706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 43410. [D 20:43:21.150716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 43411. [D 20:43:21.150732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 43412. [D 20:43:21.150742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 43413. [D 20:43:21.150752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 43414. [D 20:43:21.150762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43415. [D 20:43:21.150771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43416. [D 20:43:21.150786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43417. [D 20:43:21.150799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 43418. [D 20:43:21.150823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 43419. [D 20:43:21.150839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 43420. [D 20:43:21.150849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 43421. [D 20:43:21.150859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 43422. [D 20:43:21.150875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43423. [D 20:43:21.150884] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43424. [D 20:43:21.159481] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43424. [D 20:43:21.159498] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 46/70. [D 20:43:21.159599] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.159615] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.159629] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.171248] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.171262] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.171270] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.171285] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6658 [D 20:43:21.171295] element 0: offset: 0x62b130, size: 24 [D 20:43:21.171305] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 47/70. [D 20:43:21.173624] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6658 [D 20:43:21.173677] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 48/70. [D 20:43:21.173729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 43424. [D 20:43:21.173745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 43425. [D 20:43:21.173755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 43426. [D 20:43:21.173765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 43427. [D 20:43:21.173775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 43428. [D 20:43:21.173785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 43429. [D 20:43:21.173802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43430. [D 20:43:21.173812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43431. [D 20:43:21.173822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43432. [D 20:43:21.173837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 43433. [D 20:43:21.173847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 43434. [D 20:43:21.173857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 43435. [D 20:43:21.173867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 43436. [D 20:43:21.173884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 43437. [D 20:43:21.173894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43438. [D 20:43:21.173904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43439. [D 20:43:21.173914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43440. [D 20:43:21.173944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 43441. [D 20:43:21.173958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 43442. [D 20:43:21.173968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 43443. [D 20:43:21.173978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 43444. [D 20:43:21.174008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 43445. [D 20:43:21.174018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43446. [D 20:43:21.174029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43447. [D 20:43:21.174040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43448. [D 20:43:21.174050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 43449. [D 20:43:21.174060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 43450. [D 20:43:21.174070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 43451. [D 20:43:21.174080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 43452. [D 20:43:21.174090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 43453. [D 20:43:21.174115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43454. [D 20:43:21.174125] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43455. [D 20:43:21.184341] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43455. [D 20:43:21.184355] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 49/70. [D 20:43:21.184468] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.184485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.184494] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.194489] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.194502] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.194511] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.194536] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6661 [D 20:43:21.194547] element 0: offset: 0x64da70, size: 24 [D 20:43:21.194557] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 50/70. [D 20:43:21.198635] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6661 [D 20:43:21.198652] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 51/70. [D 20:43:21.198786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 43455. [D 20:43:21.198850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 43456. [D 20:43:21.198861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 43457. [D 20:43:21.198871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 43458. [D 20:43:21.198882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 43459. [D 20:43:21.198892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 43460. [D 20:43:21.198902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43461. [D 20:43:21.198913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43462. [D 20:43:21.198923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43463. [D 20:43:21.198932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 43464. [D 20:43:21.198942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 43465. [D 20:43:21.198959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 43466. [D 20:43:21.198968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 43467. [D 20:43:21.199008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 43468. [D 20:43:21.199018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43469. [D 20:43:21.199041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43470. [D 20:43:21.199052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43471. [D 20:43:21.199062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 43472. [D 20:43:21.199073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 43473. [D 20:43:21.199082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 43474. [D 20:43:21.199093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 43475. [D 20:43:21.199104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 43476. [D 20:43:21.199114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43477. [D 20:43:21.199129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43478. [D 20:43:21.199156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43479. [D 20:43:21.199166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 43480. [D 20:43:21.199175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 43481. [D 20:43:21.199197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 43482. [D 20:43:21.199207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 43483. [D 20:43:21.199217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 43484. [D 20:43:21.199232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43485. [D 20:43:21.199241] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43486. [D 20:43:21.209741] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43486. [D 20:43:21.209757] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 52/70. [D 20:43:21.209825] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.209840] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.209849] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.218641] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.218654] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.218663] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.218679] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6665 [D 20:43:21.218688] element 0: offset: 0x657310, size: 24 [D 20:43:21.218698] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 53/70. [D 20:43:21.218769] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.218782] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.218790] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.218805] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6667 [D 20:43:21.218814] element 0: offset: 0x5b0030, size: 24 [D 20:43:21.218824] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 54/70. [D 20:43:21.223013] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6665 [D 20:43:21.223059] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 55/70. [D 20:43:21.223075] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6667 [D 20:43:21.223086] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 56/70. [D 20:43:21.223119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 43486. [D 20:43:21.223173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 43487. [D 20:43:21.223185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 43488. [D 20:43:21.223195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 43489. [D 20:43:21.223210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 43490. [D 20:43:21.223220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 43491. [D 20:43:21.223230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 43492. [D 20:43:21.223246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 43493. [D 20:43:21.223255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 43494. [D 20:43:21.223265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 43495. [D 20:43:21.223281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 43496. [D 20:43:21.223291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 43497. [D 20:43:21.223300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 43498. [D 20:43:21.223316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 43499. [D 20:43:21.223326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 43500. [D 20:43:21.223335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 43501. [D 20:43:21.223379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 43502. [D 20:43:21.223391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 43503. [D 20:43:21.223410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 43504. [D 20:43:21.223421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 43505. [D 20:43:21.223431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 43506. [D 20:43:21.223441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 43507. [D 20:43:21.223451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 43508. [D 20:43:21.223467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 43509. [D 20:43:21.223477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 43510. [D 20:43:21.223498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 43511. [D 20:43:21.223508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 43512. [D 20:43:21.223519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 43513. [D 20:43:21.223529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 43514. [D 20:43:21.223539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 43515. [D 20:43:21.223557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 43516. [D 20:43:21.223567] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 43517. [D 20:43:21.223579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 43518. [D 20:43:21.223612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 43519. [D 20:43:21.223623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 43520. [D 20:43:21.223633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 43521. [D 20:43:21.223650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 43522. [D 20:43:21.223660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 43523. [D 20:43:21.223690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43524. [D 20:43:21.223701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43525. [D 20:43:21.223711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43526. [D 20:43:21.223721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 43527. [D 20:43:21.223731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 43528. [D 20:43:21.223741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 43529. [D 20:43:21.223768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 43530. [D 20:43:21.223778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 43531. [D 20:43:21.223788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43532. [D 20:43:21.223806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43533. [D 20:43:21.223831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43534. [D 20:43:21.223841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 43535. [D 20:43:21.223851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 43536. [D 20:43:21.223874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 43537. [D 20:43:21.223885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 43538. [D 20:43:21.223894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 43539. [D 20:43:21.223904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43540. [D 20:43:21.223914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43541. [D 20:43:21.223925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43542. [D 20:43:21.223935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 43543. [D 20:43:21.223945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 43544. [D 20:43:21.223959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 43545. [D 20:43:21.223971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 43546. [D 20:43:21.223981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 43547. [D 20:43:21.223990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43548. [D 20:43:21.224001] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209310 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43549. [D 20:43:21.232318] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43549. [D 20:43:21.232334] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 57/70. [D 20:43:21.238167] openib_check_cq: completed rdma wr_id 2aaaab209310, nic_wr_credit 43548. [D 20:43:21.238181] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 58/70. [D 20:43:21.238232] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.238248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.238257] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:21.238273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.238282] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.238290] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.247089] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.247103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.247111] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.247136] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6669 [D 20:43:21.247146] element 0: offset: 0x62b130, size: 24 [D 20:43:21.247157] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 59/70. [D 20:43:21.249445] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6669 [D 20:43:21.249497] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 60/70. [D 20:43:21.249552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 43548. [D 20:43:21.249570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 43549. [D 20:43:21.249580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 43550. [D 20:43:21.249590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 43551. [D 20:43:21.249599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 43552. [D 20:43:21.249609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 43553. [D 20:43:21.249619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 43554. [D 20:43:21.249630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 43555. [D 20:43:21.249646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 43556. [D 20:43:21.249655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 43557. [D 20:43:21.249665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 43558. [D 20:43:21.249675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 43559. [D 20:43:21.249694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 43560. [D 20:43:21.249719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 43561. [D 20:43:21.249729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 43562. [D 20:43:21.249744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 43563. [D 20:43:21.249753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 43564. [D 20:43:21.249763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 43565. [D 20:43:21.249779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 43566. [D 20:43:21.249789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 43567. [D 20:43:21.249799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 43568. [D 20:43:21.249824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 43569. [D 20:43:21.249834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 43570. [D 20:43:21.249844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 43571. [D 20:43:21.249855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 43572. [D 20:43:21.249864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 43573. [D 20:43:21.249875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 43574. [D 20:43:21.249898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 43575. [D 20:43:21.249914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 43576. [D 20:43:21.249929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 43577. [D 20:43:21.249939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 43578. [D 20:43:21.249949] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 43579. [D 20:43:21.255435] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43579. [D 20:43:21.255450] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 0/70. [D 20:43:21.255511] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.255527] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.255536] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.271980] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.271994] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.272002] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.272028] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6673 [D 20:43:21.272038] element 0: offset: 0x5b0030, size: 24 [D 20:43:21.272049] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 1/70. [D 20:43:21.276162] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6673 [D 20:43:21.276179] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 2/70. [D 20:43:21.276235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 43579. [D 20:43:21.276293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 43580. [D 20:43:21.276304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 43581. [D 20:43:21.276315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 43582. [D 20:43:21.276325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 43583. [D 20:43:21.276340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 43584. [D 20:43:21.276350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 43585. [D 20:43:21.276360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 43586. [D 20:43:21.276375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 43587. [D 20:43:21.276385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 43588. [D 20:43:21.276395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 43589. [D 20:43:21.276440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 43590. [D 20:43:21.276451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 43591. [D 20:43:21.276460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 43592. [D 20:43:21.276471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 43593. [D 20:43:21.276495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 43594. [D 20:43:21.276505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 43595. [D 20:43:21.276515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 43596. [D 20:43:21.276525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 43597. [D 20:43:21.276536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 43598. [D 20:43:21.276545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 43599. [D 20:43:21.276555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 43600. [D 20:43:21.276565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 43601. [D 20:43:21.276597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 43602. [D 20:43:21.276607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 43603. [D 20:43:21.276629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 43604. [D 20:43:21.276640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 43605. [D 20:43:21.276649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 43606. [D 20:43:21.276660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 43607. [D 20:43:21.276671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 43608. [D 20:43:21.276680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 43609. [D 20:43:21.276695] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 43610. [D 20:43:21.282149] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43610. [D 20:43:21.282165] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 3/70. [D 20:43:21.282231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.282245] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.282254] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.501057] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.501071] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.501079] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.501095] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6676 [D 20:43:21.501105] element 0: offset: 0x64da70, size: 24 [D 20:43:21.501115] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 4/70. [D 20:43:21.503258] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6676 [D 20:43:21.503309] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 5/70. [D 20:43:21.503452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 43610. [D 20:43:21.503470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 43611. [D 20:43:21.503482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 43612. [D 20:43:21.503492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 43613. [D 20:43:21.503507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 43614. [D 20:43:21.503518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 43615. [D 20:43:21.503541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 43616. [D 20:43:21.503552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 43617. [D 20:43:21.503561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 43618. [D 20:43:21.503583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 43619. [D 20:43:21.503594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 43620. [D 20:43:21.503604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 43621. [D 20:43:21.503630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 43622. [D 20:43:21.503640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 43623. [D 20:43:21.503650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 43624. [D 20:43:21.503660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 43625. [D 20:43:21.503670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 43626. [D 20:43:21.503680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 43627. [D 20:43:21.503696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 43628. [D 20:43:21.503706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 43629. [D 20:43:21.503715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 43630. [D 20:43:21.503737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 43631. [D 20:43:21.503747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 43632. [D 20:43:21.503757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 43633. [D 20:43:21.503767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 43634. [D 20:43:21.503778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 43635. [D 20:43:21.503787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 43636. [D 20:43:21.503797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 43637. [D 20:43:21.503807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 43638. [D 20:43:21.503833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 43639. [D 20:43:21.503843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 43640. [D 20:43:21.503863] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 43641. [D 20:43:21.503928] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.503945] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.503954] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.503981] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6679 [D 20:43:21.503992] element 0: offset: 0x691fe0, size: 24 [D 20:43:21.504002] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 6/70. [D 20:43:21.515260] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43641. [D 20:43:21.515278] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 7/70. [D 20:43:21.515379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.515394] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.515403] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:21.517603] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6679 [D 20:43:21.517621] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 8/70. [D 20:43:21.517784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 43641. [D 20:43:21.517836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 43642. [D 20:43:21.517848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 43643. [D 20:43:21.517858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 43644. [D 20:43:21.517869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 43645. [D 20:43:21.517879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 43646. [D 20:43:21.517889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 43647. [D 20:43:21.517899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 43648. [D 20:43:21.517909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 43649. [D 20:43:21.517919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 43650. [D 20:43:21.517929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 43651. [D 20:43:21.517955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 43652. [D 20:43:21.517965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 43653. [D 20:43:21.517980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 43654. [D 20:43:21.518001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 43655. [D 20:43:21.518012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 43656. [D 20:43:21.518033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 43657. [D 20:43:21.518048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 43658. [D 20:43:21.518058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 43659. [D 20:43:21.518068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 43660. [D 20:43:21.518078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 43661. [D 20:43:21.518088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 43662. [D 20:43:21.518098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 43663. [D 20:43:21.518141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 43664. [D 20:43:21.518154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 43665. [D 20:43:21.518178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 43666. [D 20:43:21.518192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 43667. [D 20:43:21.518202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 43668. [D 20:43:21.518216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 43669. [D 20:43:21.518227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 43670. [D 20:43:21.518236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 43671. [D 20:43:21.518247] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 43672. [D 20:43:21.524416] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43672. [D 20:43:21.524432] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 9/70. [D 20:43:21.524498] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.524513] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.524522] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.532186] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.532199] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.532207] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.532224] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6682 [D 20:43:21.532233] element 0: offset: 0x61f310, size: 24 [D 20:43:21.532243] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 10/70. [D 20:43:21.532320] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.532332] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.532341] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.532356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6685 [D 20:43:21.532366] element 0: offset: 0x5b0030, size: 24 [D 20:43:21.532376] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 11/70. [D 20:43:21.534637] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6682 [D 20:43:21.534680] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 12/70. [D 20:43:21.536561] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6685 [D 20:43:21.536578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 43672. [D 20:43:21.536644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 43673. [D 20:43:21.536656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 43674. [D 20:43:21.536667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 43675. [D 20:43:21.536681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 43676. [D 20:43:21.536691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 43677. [D 20:43:21.536728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 43678. [D 20:43:21.536739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 43679. [D 20:43:21.536749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 43680. [D 20:43:21.536759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 43681. [D 20:43:21.536782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 43682. [D 20:43:21.536792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 43683. [D 20:43:21.536814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 43684. [D 20:43:21.536825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 43685. [D 20:43:21.536835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 43686. [D 20:43:21.536874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 43687. [D 20:43:21.536884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 43688. [D 20:43:21.536906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 43689. [D 20:43:21.536917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 43690. [D 20:43:21.536938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 43691. [D 20:43:21.536953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 43692. [D 20:43:21.536963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 43693. [D 20:43:21.536973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 43694. [D 20:43:21.536989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 43695. [D 20:43:21.536999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 43696. [D 20:43:21.537009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 43697. [D 20:43:21.537025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 43698. [D 20:43:21.537034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 43699. [D 20:43:21.537044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 43700. [D 20:43:21.537073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 43701. [D 20:43:21.537084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 43702. [D 20:43:21.537094] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 43703. [D 20:43:21.537123] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 13/70. [D 20:43:21.547084] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43703. [D 20:43:21.547104] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 14/70. [D 20:43:21.547182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.547198] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.547207] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:21.551742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 43703. [D 20:43:21.551760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 43704. [D 20:43:21.551771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 43705. [D 20:43:21.551781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 43706. [D 20:43:21.551791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 43707. [D 20:43:21.551805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 43708. [D 20:43:21.551815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 43709. [D 20:43:21.551827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 43710. [D 20:43:21.551837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 43711. [D 20:43:21.551847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 43712. [D 20:43:21.551857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 43713. [D 20:43:21.551878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 43714. [D 20:43:21.551889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 43715. [D 20:43:21.551898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 43716. [D 20:43:21.551913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 43717. [D 20:43:21.551923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 43718. [D 20:43:21.551933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 43719. [D 20:43:21.551943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 43720. [D 20:43:21.551960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 43721. [D 20:43:21.551984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 43722. [D 20:43:21.551998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 43723. [D 20:43:21.552008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 43724. [D 20:43:21.552018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 43725. [D 20:43:21.552045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 43726. [D 20:43:21.552055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 43727. [D 20:43:21.552066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 43728. [D 20:43:21.552086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 43729. [D 20:43:21.552097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 43730. [D 20:43:21.552119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 43731. [D 20:43:21.552130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 43732. [D 20:43:21.552140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 43733. [D 20:43:21.552150] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209310 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 43734. [D 20:43:21.560300] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.560316] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.560325] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.560349] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6688 [D 20:43:21.560359] element 0: offset: 0x62b130, size: 24 [D 20:43:21.560370] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 15/70. [D 20:43:21.563409] openib_check_cq: completed rdma wr_id 2aaaab209310, nic_wr_credit 43734. [D 20:43:21.563427] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 16/70. [D 20:43:21.563493] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.563508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.563516] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:21.565818] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6688 [D 20:43:21.565839] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 17/70. [D 20:43:21.569048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 43734. [D 20:43:21.569063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 43735. [D 20:43:21.569076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 43736. [D 20:43:21.569086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 43737. [D 20:43:21.569096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 43738. [D 20:43:21.569111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 43739. [D 20:43:21.569121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 43740. [D 20:43:21.569131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 43741. [D 20:43:21.569147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 43742. [D 20:43:21.569157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 43743. [D 20:43:21.569167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 43744. [D 20:43:21.569195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 43745. [D 20:43:21.569205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 43746. [D 20:43:21.569215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 43747. [D 20:43:21.569231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 43748. [D 20:43:21.569241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 43749. [D 20:43:21.569250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 43750. [D 20:43:21.569278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 43751. [D 20:43:21.569288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 43752. [D 20:43:21.569302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 43753. [D 20:43:21.569312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 43754. [D 20:43:21.569334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 43755. [D 20:43:21.569344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 43756. [D 20:43:21.569364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 43757. [D 20:43:21.569375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 43758. [D 20:43:21.569395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 43759. [D 20:43:21.569405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 43760. [D 20:43:21.569415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 43761. [D 20:43:21.569436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 43762. [D 20:43:21.569453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 43763. [D 20:43:21.569464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 43764. [D 20:43:21.569492] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 43765. [D 20:43:21.575963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.575996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.576005] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.576034] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6690 [D 20:43:21.576045] element 0: offset: 0x691fe0, size: 24 [D 20:43:21.576058] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 18/70. [D 20:43:21.578643] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.578657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.578665] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:21.578682] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6694 [D 20:43:21.578691] element 0: offset: 0x62f7f0, size: 24 [D 20:43:21.578701] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 19/70. [D 20:43:21.580708] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43765. [D 20:43:21.580726] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 20/70. [D 20:43:21.580845] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.580860] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.580868] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:21.585209] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6694 [D 20:43:21.585226] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 21/70. [D 20:43:21.587544] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6690 [D 20:43:21.587560] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 22/70. [D 20:43:21.587744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 43765. [D 20:43:21.587758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 43766. [D 20:43:21.587769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 43767. [D 20:43:21.587779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 43768. [D 20:43:21.587791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 43769. [D 20:43:21.587800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 43770. [D 20:43:21.587810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 43771. [D 20:43:21.587820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 43772. [D 20:43:21.587840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 43773. [D 20:43:21.587850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 43774. [D 20:43:21.587859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 43775. [D 20:43:21.587870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 43776. [D 20:43:21.587881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 43777. [D 20:43:21.587890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 43778. [D 20:43:21.587900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 43779. [D 20:43:21.587916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 43780. [D 20:43:21.587926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 43781. [D 20:43:21.587936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 43782. [D 20:43:21.587985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 43783. [D 20:43:21.587996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 43784. [D 20:43:21.588006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 43785. [D 20:43:21.588016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 43786. [D 20:43:21.588026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 43787. [D 20:43:21.588036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 43788. [D 20:43:21.588051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 43789. [D 20:43:21.588061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 43790. [D 20:43:21.588071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 43791. [D 20:43:21.588081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 43792. [D 20:43:21.588106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 43793. [D 20:43:21.588117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 43794. [D 20:43:21.588126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 43795. [D 20:43:21.588137] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 43796. [D 20:43:21.588148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 43797. [D 20:43:21.588158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 43798. [D 20:43:21.588168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 43799. [D 20:43:21.588183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 43800. [D 20:43:21.588193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 43801. [D 20:43:21.588203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 43802. [D 20:43:21.588213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 43803. [D 20:43:21.588239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43804. [D 20:43:21.588249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43805. [D 20:43:21.588260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43806. [D 20:43:21.588269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 43807. [D 20:43:21.588280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 43808. [D 20:43:21.588290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 43809. [D 20:43:21.588300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 43810. [D 20:43:21.588309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 43811. [D 20:43:21.588339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43812. [D 20:43:21.588349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43813. [D 20:43:21.588363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43814. [D 20:43:21.588373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 43815. [D 20:43:21.588383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 43816. [D 20:43:21.588396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 43817. [D 20:43:21.588406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 43818. [D 20:43:21.588415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 43819. [D 20:43:21.588431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43820. [D 20:43:21.588456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43821. [D 20:43:21.588469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43822. [D 20:43:21.588479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 43823. [D 20:43:21.588488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 43824. [D 20:43:21.588502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 43825. [D 20:43:21.588512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 43826. [D 20:43:21.588521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 43827. [D 20:43:21.588551] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209130 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43828. [D 20:43:21.590434] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.590472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.590481] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:21.590510] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6697 [D 20:43:21.590521] element 0: offset: 0x5b0030, size: 24 [D 20:43:21.590534] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 23/70. [D 20:43:21.599354] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43828. [D 20:43:21.599372] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 24/70. [D 20:43:21.610978] openib_check_cq: completed rdma wr_id 2aaaab209130, nic_wr_credit 43827. [D 20:43:21.610992] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 25/70. [D 20:43:21.611043] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.611059] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.611067] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:21.611130] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.611140] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.611149] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:21.613356] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6697 [D 20:43:21.613372] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 26/70. [D 20:43:21.616964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 43827. [D 20:43:21.616978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 43828. [D 20:43:21.616992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 43829. [D 20:43:21.617002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 43830. [D 20:43:21.617012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 43831. [D 20:43:21.617028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 43832. [D 20:43:21.617038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 43833. [D 20:43:21.617047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 43834. [D 20:43:21.617064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 43835. [D 20:43:21.617073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 43836. [D 20:43:21.617083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 43837. [D 20:43:21.617093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 43838. [D 20:43:21.617110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 43839. [D 20:43:21.617120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 43840. [D 20:43:21.617130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 43841. [D 20:43:21.617140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 43842. [D 20:43:21.617150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 43843. [D 20:43:21.617160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 43844. [D 20:43:21.617187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 43845. [D 20:43:21.617197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 43846. [D 20:43:21.617207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 43847. [D 20:43:21.617223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 43848. [D 20:43:21.617233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 43849. [D 20:43:21.617242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 43850. [D 20:43:21.617259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 43851. [D 20:43:21.617268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 43852. [D 20:43:21.617278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 43853. [D 20:43:21.617307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 43854. [D 20:43:21.617317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 43855. [D 20:43:21.617330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 43856. [D 20:43:21.617340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 43857. [D 20:43:21.617350] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 43858. [D 20:43:21.625499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.625533] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.625542] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.625571] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6700 [D 20:43:21.625581] element 0: offset: 0x657310, size: 24 [D 20:43:21.625595] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 27/70. [D 20:43:21.625627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.625637] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.625645] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:21.625660] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6703 [D 20:43:21.625670] element 0: offset: 0x61f310, size: 24 [D 20:43:21.625680] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 28/70. [D 20:43:21.628640] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43858. [D 20:43:21.628658] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 29/70. [D 20:43:21.628772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.628787] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.628795] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:21.631849] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6700 [D 20:43:21.631865] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 30/70. [D 20:43:21.634235] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6703 [D 20:43:21.634250] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 31/70. [D 20:43:21.635238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 43858. [D 20:43:21.635252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 43859. [D 20:43:21.635263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 43860. [D 20:43:21.635273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 43861. [D 20:43:21.635284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 43862. [D 20:43:21.635297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 43863. [D 20:43:21.635307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 43864. [D 20:43:21.635317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43865. [D 20:43:21.635333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43866. [D 20:43:21.635343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43867. [D 20:43:21.635352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 43868. [D 20:43:21.635369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 43869. [D 20:43:21.635378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 43870. [D 20:43:21.635388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 43871. [D 20:43:21.635405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 43872. [D 20:43:21.635414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43873. [D 20:43:21.635425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43874. [D 20:43:21.635441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43875. [D 20:43:21.635467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 43876. [D 20:43:21.635478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 43877. [D 20:43:21.635496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 43878. [D 20:43:21.635507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 43879. [D 20:43:21.635517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 43880. [D 20:43:21.635527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43881. [D 20:43:21.635537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43882. [D 20:43:21.635566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43883. [D 20:43:21.635577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 43884. [D 20:43:21.635587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 43885. [D 20:43:21.635602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 43886. [D 20:43:21.635612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 43887. [D 20:43:21.635622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 43888. [D 20:43:21.635638] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43889. [D 20:43:21.635649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 43890. [D 20:43:21.635659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 43891. [D 20:43:21.635688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 43892. [D 20:43:21.635704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 43893. [D 20:43:21.635717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 43894. [D 20:43:21.635727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 43895. [D 20:43:21.635742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 43896. [D 20:43:21.635765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 43897. [D 20:43:21.635779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 43898. [D 20:43:21.635789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 43899. [D 20:43:21.635801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 43900. [D 20:43:21.635815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 43901. [D 20:43:21.635825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 43902. [D 20:43:21.635838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 43903. [D 20:43:21.635862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 43904. [D 20:43:21.635872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 43905. [D 20:43:21.635883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 43906. [D 20:43:21.635893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 43907. [D 20:43:21.635903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 43908. [D 20:43:21.635917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 43909. [D 20:43:21.635927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 43910. [D 20:43:21.635948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 43911. [D 20:43:21.635958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 43912. [D 20:43:21.635968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 43913. [D 20:43:21.635978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 43914. [D 20:43:21.635988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 43915. [D 20:43:21.635998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 43916. [D 20:43:21.636008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 43917. [D 20:43:21.636018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 43918. [D 20:43:21.636041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 43919. [D 20:43:21.636052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 43920. [D 20:43:21.636062] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209310 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 43921. [D 20:43:21.637913] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.637955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.637964] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:21.637993] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6706 [D 20:43:21.638004] element 0: offset: 0x691fe0, size: 24 [D 20:43:21.638017] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 32/70. [D 20:43:21.646866] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43921. [D 20:43:21.646883] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 33/70. [D 20:43:21.658390] openib_check_cq: completed rdma wr_id 2aaaab209310, nic_wr_credit 43920. [D 20:43:21.658408] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 34/70. [D 20:43:21.658458] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.658473] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.658482] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:21.658548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.658558] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.658566] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:21.660882] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6706 [D 20:43:21.660900] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 35/70. [D 20:43:21.664321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 43920. [D 20:43:21.664335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 43921. [D 20:43:21.664347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 43922. [D 20:43:21.664358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 43923. [D 20:43:21.664368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 43924. [D 20:43:21.664384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 43925. [D 20:43:21.664394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 43926. [D 20:43:21.664403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 43927. [D 20:43:21.664420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 43928. [D 20:43:21.664429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 43929. [D 20:43:21.664439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 43930. [D 20:43:21.664449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 43931. [D 20:43:21.664466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 43932. [D 20:43:21.664476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 43933. [D 20:43:21.664486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 43934. [D 20:43:21.664496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 43935. [D 20:43:21.664521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 43936. [D 20:43:21.664532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 43937. [D 20:43:21.664542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 43938. [D 20:43:21.664552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 43939. [D 20:43:21.664563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 43940. [D 20:43:21.664574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 43941. [D 20:43:21.664583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 43942. [D 20:43:21.664593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 43943. [D 20:43:21.664622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 43944. [D 20:43:21.664632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 43945. [D 20:43:21.664643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 43946. [D 20:43:21.664653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 43947. [D 20:43:21.664671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 43948. [D 20:43:21.664681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 43949. [D 20:43:21.664691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 43950. [D 20:43:21.664709] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 43951. [D 20:43:21.672646] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.672687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.672696] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.672726] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6709 [D 20:43:21.672736] element 0: offset: 0x5b0030, size: 24 [D 20:43:21.672749] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 36/70. [D 20:43:21.672781] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.672790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.672798] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:21.672814] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6712 [D 20:43:21.672823] element 0: offset: 0x64da70, size: 24 [D 20:43:21.672833] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 37/70. [D 20:43:21.676017] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 43951. [D 20:43:21.676035] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 38/70. [D 20:43:21.676150] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.676166] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.676174] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:21.678454] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6709 [D 20:43:21.678471] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 39/70. [D 20:43:21.680881] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6712 [D 20:43:21.680897] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 40/70. [D 20:43:21.682594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 43951. [D 20:43:21.682608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 43952. [D 20:43:21.682620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 43953. [D 20:43:21.682630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 43954. [D 20:43:21.682643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 43955. [D 20:43:21.682658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 43956. [D 20:43:21.682668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 43957. [D 20:43:21.682678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 43958. [D 20:43:21.682694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 43959. [D 20:43:21.682704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 43960. [D 20:43:21.682714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 43961. [D 20:43:21.682731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 43962. [D 20:43:21.682741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 43963. [D 20:43:21.682750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 43964. [D 20:43:21.682767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 43965. [D 20:43:21.682776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 43966. [D 20:43:21.682786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 43967. [D 20:43:21.682818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 43968. [D 20:43:21.682831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 43969. [D 20:43:21.682844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 43970. [D 20:43:21.682854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 43971. [D 20:43:21.682865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 43972. [D 20:43:21.682878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 43973. [D 20:43:21.682898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 43974. [D 20:43:21.682908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 43975. [D 20:43:21.682924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 43976. [D 20:43:21.682934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 43977. [D 20:43:21.682944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 43978. [D 20:43:21.682954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 43979. [D 20:43:21.682972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 43980. [D 20:43:21.682994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 43981. [D 20:43:21.683005] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 43982. [D 20:43:21.683017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 43983. [D 20:43:21.683027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 43984. [D 20:43:21.683038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 43985. [D 20:43:21.683048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 43986. [D 20:43:21.683058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 43987. [D 20:43:21.683073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 43988. [D 20:43:21.683083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 43989. [D 20:43:21.683093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 43990. [D 20:43:21.683119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 43991. [D 20:43:21.683129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 43992. [D 20:43:21.683139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 43993. [D 20:43:21.683155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 43994. [D 20:43:21.683165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 43995. [D 20:43:21.683175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 43996. [D 20:43:21.683205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 43997. [D 20:43:21.683217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 43998. [D 20:43:21.683230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 43999. [D 20:43:21.683239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 44000. [D 20:43:21.683249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 44001. [D 20:43:21.683263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 44002. [D 20:43:21.683273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 44003. [D 20:43:21.683283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 44004. [D 20:43:21.683322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 44005. [D 20:43:21.683332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 44006. [D 20:43:21.683354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 44007. [D 20:43:21.683365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 44008. [D 20:43:21.683375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 44009. [D 20:43:21.683385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 44010. [D 20:43:21.683395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 44011. [D 20:43:21.683405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 44012. [D 20:43:21.683415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 44013. [D 20:43:21.683432] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209130 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 44014. [D 20:43:21.685273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.685319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.685327] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:21.685358] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6715 [D 20:43:21.685368] element 0: offset: 0x630850, size: 24 [D 20:43:21.685381] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 41/70. [D 20:43:21.689579] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44014. [D 20:43:21.689598] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 42/70. [D 20:43:21.694007] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.694021] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.694030] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:21.694046] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6718 [D 20:43:21.694056] element 0: offset: 0x6ace30, size: 24 [D 20:43:21.694066] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 43/70. [D 20:43:21.695396] openib_check_cq: completed rdma wr_id 2aaaab209130, nic_wr_credit 44013. [D 20:43:21.695414] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 44/70. [D 20:43:21.695462] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.695477] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.695486] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:21.695566] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.695576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.695584] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:21.697796] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6715 [D 20:43:21.697814] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 45/70. [D 20:43:21.697860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 44013. [D 20:43:21.697872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 44014. [D 20:43:21.697882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 44015. [D 20:43:21.697891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 44016. [D 20:43:21.697901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 44017. [D 20:43:21.697912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 44018. [D 20:43:21.697922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 44019. [D 20:43:21.697944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 44020. [D 20:43:21.697953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 44021. [D 20:43:21.697963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 44022. [D 20:43:21.697973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 44023. [D 20:43:21.697983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 44024. [D 20:43:21.698001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 44025. [D 20:43:21.698011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 44026. [D 20:43:21.698021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 44027. [D 20:43:21.698031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 44028. [D 20:43:21.698041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 44029. [D 20:43:21.698051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 44030. [D 20:43:21.698061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 44031. [D 20:43:21.698086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 44032. [D 20:43:21.698096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 44033. [D 20:43:21.698107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 44034. [D 20:43:21.698117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 44035. [D 20:43:21.698127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 44036. [D 20:43:21.698137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 44037. [D 20:43:21.698159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 44038. [D 20:43:21.698169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 44039. [D 20:43:21.698179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 44040. [D 20:43:21.698192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 44041. [D 20:43:21.698202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 44042. [D 20:43:21.698212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 44043. [D 20:43:21.698228] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 44044. [D 20:43:21.700665] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6718 [D 20:43:21.700680] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 46/70. [D 20:43:21.703792] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44044. [D 20:43:21.703806] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 47/70. [D 20:43:21.703818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 44044. [D 20:43:21.703828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 44045. [D 20:43:21.703841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 44046. [D 20:43:21.703851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 44047. [D 20:43:21.703861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 44048. [D 20:43:21.703871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 44049. [D 20:43:21.703881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 44050. [D 20:43:21.703891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 44051. [D 20:43:21.703901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 44052. [D 20:43:21.703929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 44053. [D 20:43:21.703939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 44054. [D 20:43:21.703949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 44055. [D 20:43:21.703959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 44056. [D 20:43:21.703968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 44057. [D 20:43:21.703987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 44058. [D 20:43:21.703997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 44059. [D 20:43:21.704007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 44060. [D 20:43:21.704017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 44061. [D 20:43:21.704027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 44062. [D 20:43:21.704037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 44063. [D 20:43:21.704047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 44064. [D 20:43:21.704064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 44065. [D 20:43:21.704088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 44066. [D 20:43:21.704102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 44067. [D 20:43:21.704112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 44068. [D 20:43:21.704121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 44069. [D 20:43:21.704136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 44070. [D 20:43:21.704146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 44071. [D 20:43:21.704156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 44072. [D 20:43:21.704165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 44073. [D 20:43:21.704175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 44074. [D 20:43:21.704185] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 44075. [D 20:43:21.706571] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.706587] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.706597] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:21.709684] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 44075. [D 20:43:21.709698] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 48/70. [D 20:43:21.712003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.712016] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.712027] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:21.954774] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.954791] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.954803] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:21.954834] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6721 [D 20:43:21.954845] element 0: offset: 0x691fe0, size: 24 [D 20:43:21.954856] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 49/70. [D 20:43:21.954875] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.954884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.954893] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.954940] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6724 [D 20:43:21.954952] element 0: offset: 0x657310, size: 24 [D 20:43:21.954971] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 50/70. [D 20:43:21.959946] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6724 [D 20:43:21.959963] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 51/70. [D 20:43:21.960090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 44075. [D 20:43:21.960105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 44076. [D 20:43:21.960115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 44077. [D 20:43:21.960125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 44078. [D 20:43:21.960135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 44079. [D 20:43:21.960145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 44080. [D 20:43:21.960167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 44081. [D 20:43:21.960177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 44082. [D 20:43:21.960187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 44083. [D 20:43:21.960197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 44084. [D 20:43:21.960207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 44085. [D 20:43:21.960217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 44086. [D 20:43:21.960227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 44087. [D 20:43:21.960237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 44088. [D 20:43:21.960247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 44089. [D 20:43:21.960257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 44090. [D 20:43:21.960266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 44091. [D 20:43:21.960276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 44092. [D 20:43:21.960286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 44093. [D 20:43:21.960296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 44094. [D 20:43:21.960306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 44095. [D 20:43:21.960316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 44096. [D 20:43:21.960326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 44097. [D 20:43:21.960335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 44098. [D 20:43:21.960345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 44099. [D 20:43:21.960355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 44100. [D 20:43:21.960365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 44101. [D 20:43:21.960375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 44102. [D 20:43:21.960385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 44103. [D 20:43:21.960395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 44104. [D 20:43:21.960407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 44105. [D 20:43:21.960416] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 44106. [D 20:43:21.962731] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6721 [D 20:43:21.962742] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 52/70. [D 20:43:21.967809] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44106. [D 20:43:21.967824] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 53/70. [D 20:43:21.969818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 44106. [D 20:43:21.969829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 44107. [D 20:43:21.969839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 44108. [D 20:43:21.969849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 44109. [D 20:43:21.969858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 44110. [D 20:43:21.969868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 44111. [D 20:43:21.969878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 44112. [D 20:43:21.969888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 44113. [D 20:43:21.969897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 44114. [D 20:43:21.969907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 44115. [D 20:43:21.969917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 44116. [D 20:43:21.969926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 44117. [D 20:43:21.969936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 44118. [D 20:43:21.969946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 44119. [D 20:43:21.969956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 44120. [D 20:43:21.969966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 44121. [D 20:43:21.969975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 44122. [D 20:43:21.969985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 44123. [D 20:43:21.969995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 44124. [D 20:43:21.970005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 44125. [D 20:43:21.970014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 44126. [D 20:43:21.970024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 44127. [D 20:43:21.970034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 44128. [D 20:43:21.970044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 44129. [D 20:43:21.970053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 44130. [D 20:43:21.970063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 44131. [D 20:43:21.970073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 44132. [D 20:43:21.970083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 44133. [D 20:43:21.970092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 44134. [D 20:43:21.970103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 44135. [D 20:43:21.970113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 44136. [D 20:43:21.970123] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209130 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 44137. [D 20:43:21.971871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.971881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.971889] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:21.977955] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.977968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.977977] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:21.977992] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6728 [D 20:43:21.978002] element 0: offset: 0x61fa90, size: 24 [D 20:43:21.978012] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 54/70. [D 20:43:21.978035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.978044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.978052] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:21.978066] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6730 [D 20:43:21.978075] element 0: offset: 0x630850, size: 24 [D 20:43:21.978084] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 55/70. [D 20:43:21.981485] openib_check_cq: completed rdma wr_id 2aaaab209130, nic_wr_credit 44137. [D 20:43:21.981499] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 56/70. [D 20:43:21.983854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:21.983869] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.983878] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:21.988274] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6730 [D 20:43:21.988290] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 57/70. [D 20:43:21.988303] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6728 [D 20:43:21.988314] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 58/70. [D 20:43:21.992965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 44137. [D 20:43:21.992980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 44138. [D 20:43:21.992989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 44139. [D 20:43:21.992999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 44140. [D 20:43:21.993009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 44141. [D 20:43:21.993019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 44142. [D 20:43:21.993028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 44143. [D 20:43:21.993038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 44144. [D 20:43:21.993048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 44145. [D 20:43:21.993058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 44146. [D 20:43:21.993067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 44147. [D 20:43:21.993077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 44148. [D 20:43:21.993087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 44149. [D 20:43:21.993096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 44150. [D 20:43:21.993106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 44151. [D 20:43:21.993116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 44152. [D 20:43:21.993125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 44153. [D 20:43:21.993135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 44154. [D 20:43:21.993145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 44155. [D 20:43:21.993154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 44156. [D 20:43:21.993164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 44157. [D 20:43:21.993174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 44158. [D 20:43:21.993184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 44159. [D 20:43:21.993193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 44160. [D 20:43:21.993203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 44161. [D 20:43:21.993213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 44162. [D 20:43:21.993222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 44163. [D 20:43:21.993232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 44164. [D 20:43:21.993242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 44165. [D 20:43:21.993251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 44166. [D 20:43:21.993262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 44167. [D 20:43:21.993272] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 44168. [D 20:43:21.993283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 44169. [D 20:43:21.993293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 44170. [D 20:43:21.993302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 44171. [D 20:43:21.993312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 44172. [D 20:43:21.993322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 44173. [D 20:43:21.993332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 44174. [D 20:43:21.993341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 44175. [D 20:43:21.993351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 44176. [D 20:43:21.993361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 44177. [D 20:43:21.993371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 44178. [D 20:43:21.993381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 44179. [D 20:43:21.993391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 44180. [D 20:43:21.993400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 44181. [D 20:43:21.993410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 44182. [D 20:43:21.993420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 44183. [D 20:43:21.993429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 44184. [D 20:43:21.993439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 44185. [D 20:43:21.993449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 44186. [D 20:43:21.993459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 44187. [D 20:43:21.993469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 44188. [D 20:43:21.993479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 44189. [D 20:43:21.993488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 44190. [D 20:43:21.993498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 44191. [D 20:43:21.993508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 44192. [D 20:43:21.993518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 44193. [D 20:43:21.993528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 44194. [D 20:43:21.993538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 44195. [D 20:43:21.993548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 44196. [D 20:43:21.993558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 44197. [D 20:43:21.993567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 44198. [D 20:43:21.993577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 44199. [D 20:43:21.993587] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209310 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 44200. [D 20:43:21.998038] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.998049] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.998058] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:21.998072] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6733 [D 20:43:21.998082] element 0: offset: 0x61f310, size: 24 [D 20:43:21.998091] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 59/70. [D 20:43:21.998107] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:21.998115] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:21.998124] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:21.998138] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6736 [D 20:43:21.998147] element 0: offset: 0x657310, size: 24 [D 20:43:21.998156] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 60/70. [D 20:43:22.004625] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44200. [D 20:43:22.004640] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 0/70. [D 20:43:22.016294] openib_check_cq: completed rdma wr_id 2aaaab209310, nic_wr_credit 44199. [D 20:43:22.016308] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 1/70. [D 20:43:22.018636] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.018647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.018655] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:22.018726] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.018736] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.018745] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.021626] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6736 [D 20:43:22.021680] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 2/70. [D 20:43:22.021700] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6733 [D 20:43:22.021717] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 3/70. [D 20:43:22.027966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 44199. [D 20:43:22.027983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 44200. [D 20:43:22.027993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 44201. [D 20:43:22.028003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 44202. [D 20:43:22.028013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 44203. [D 20:43:22.028023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 44204. [D 20:43:22.028033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 44205. [D 20:43:22.028043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 44206. [D 20:43:22.028053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 44207. [D 20:43:22.028062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 44208. [D 20:43:22.028072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 44209. [D 20:43:22.028082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 44210. [D 20:43:22.028092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 44211. [D 20:43:22.028102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 44212. [D 20:43:22.028112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 44213. [D 20:43:22.028122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 44214. [D 20:43:22.028132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 44215. [D 20:43:22.028142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 44216. [D 20:43:22.028152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 44217. [D 20:43:22.028161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 44218. [D 20:43:22.028171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 44219. [D 20:43:22.028181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 44220. [D 20:43:22.028191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 44221. [D 20:43:22.028201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 44222. [D 20:43:22.028211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 44223. [D 20:43:22.028221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 44224. [D 20:43:22.028231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 44225. [D 20:43:22.028240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 44226. [D 20:43:22.028250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 44227. [D 20:43:22.028260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 44228. [D 20:43:22.028271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 44229. [D 20:43:22.028281] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 44230. [D 20:43:22.028294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 44231. [D 20:43:22.028304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 44232. [D 20:43:22.028314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 44233. [D 20:43:22.028324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 44234. [D 20:43:22.028334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 44235. [D 20:43:22.028344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 44236. [D 20:43:22.028354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 44237. [D 20:43:22.028364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 44238. [D 20:43:22.028374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 44239. [D 20:43:22.028384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 44240. [D 20:43:22.028394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 44241. [D 20:43:22.028404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 44242. [D 20:43:22.028414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 44243. [D 20:43:22.028424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 44244. [D 20:43:22.028434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 44245. [D 20:43:22.028444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 44246. [D 20:43:22.028454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 44247. [D 20:43:22.028464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 44248. [D 20:43:22.028474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 44249. [D 20:43:22.028484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 44250. [D 20:43:22.028494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 44251. [D 20:43:22.028504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 44252. [D 20:43:22.028514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 44253. [D 20:43:22.028524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 44254. [D 20:43:22.028534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 44255. [D 20:43:22.028544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 44256. [D 20:43:22.028554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 44257. [D 20:43:22.028565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 44258. [D 20:43:22.028575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 44259. [D 20:43:22.028585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 44260. [D 20:43:22.028595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 44261. [D 20:43:22.028604] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 44262. [D 20:43:22.031887] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.031899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.031908] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.031940] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6740 [D 20:43:22.031951] element 0: offset: 0x64da70, size: 24 [D 20:43:22.033270] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 4/70. [D 20:43:22.033291] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.033301] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.033309] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:22.033324] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6742 [D 20:43:22.033333] element 0: offset: 0x643630, size: 24 [D 20:43:22.033342] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 5/70. [D 20:43:22.039650] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44262. [D 20:43:22.039666] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 6/70. [D 20:43:22.051327] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 44261. [D 20:43:22.051341] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 7/70. [D 20:43:22.053596] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.053606] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.053615] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:22.053695] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.053706] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.053714] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.056550] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6742 [D 20:43:22.056617] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 8/70. [D 20:43:22.058749] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6740 [D 20:43:22.058762] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 9/70. [D 20:43:22.062551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 44261. [D 20:43:22.062567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 44262. [D 20:43:22.062578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 44263. [D 20:43:22.062588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 44264. [D 20:43:22.062597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 44265. [D 20:43:22.062607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 44266. [D 20:43:22.062617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 44267. [D 20:43:22.062627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 44268. [D 20:43:22.062637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 44269. [D 20:43:22.062647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 44270. [D 20:43:22.062656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 44271. [D 20:43:22.062666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 44272. [D 20:43:22.062676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 44273. [D 20:43:22.062686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 44274. [D 20:43:22.062696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 44275. [D 20:43:22.062706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 44276. [D 20:43:22.062715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 44277. [D 20:43:22.062725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 44278. [D 20:43:22.062735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 44279. [D 20:43:22.062745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 44280. [D 20:43:22.062755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 44281. [D 20:43:22.062764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 44282. [D 20:43:22.062774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 44283. [D 20:43:22.062784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 44284. [D 20:43:22.062794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 44285. [D 20:43:22.062804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 44286. [D 20:43:22.062814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 44287. [D 20:43:22.062823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 44288. [D 20:43:22.062833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 44289. [D 20:43:22.062843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 44290. [D 20:43:22.062854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 44291. [D 20:43:22.062864] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 44292. [D 20:43:22.062876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 44293. [D 20:43:22.062886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 44294. [D 20:43:22.062896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 44295. [D 20:43:22.062906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 44296. [D 20:43:22.062915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 44297. [D 20:43:22.062925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 44298. [D 20:43:22.062935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 44299. [D 20:43:22.062945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 44300. [D 20:43:22.062955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 44301. [D 20:43:22.062965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 44302. [D 20:43:22.062974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 44303. [D 20:43:22.062984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 44304. [D 20:43:22.062994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 44305. [D 20:43:22.063004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 44306. [D 20:43:22.063013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 44307. [D 20:43:22.063023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 44308. [D 20:43:22.063033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 44309. [D 20:43:22.063043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 44310. [D 20:43:22.063053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 44311. [D 20:43:22.063063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 44312. [D 20:43:22.063072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 44313. [D 20:43:22.063082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 44314. [D 20:43:22.063092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 44315. [D 20:43:22.063102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 44316. [D 20:43:22.063112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 44317. [D 20:43:22.063122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 44318. [D 20:43:22.063131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 44319. [D 20:43:22.063141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 44320. [D 20:43:22.063151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 44321. [D 20:43:22.063161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 44322. [D 20:43:22.063171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 44323. [D 20:43:22.063181] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209310 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 44324. [D 20:43:22.067719] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.067731] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.067739] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.067772] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6745 [D 20:43:22.067786] element 0: offset: 0x5b0030, size: 24 [D 20:43:22.067796] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 10/70. [D 20:43:22.067815] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.067824] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.067832] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:22.067847] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6748 [D 20:43:22.067857] element 0: offset: 0x61fa90, size: 24 [D 20:43:22.067866] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 11/70. [D 20:43:22.074195] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44324. [D 20:43:22.074211] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 12/70. [D 20:43:22.085812] openib_check_cq: completed rdma wr_id 2aaaab209310, nic_wr_credit 44323. [D 20:43:22.085825] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 13/70. [D 20:43:22.088144] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.088154] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.088163] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:22.088243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.088254] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.088262] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.091080] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6748 [D 20:43:22.091147] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 14/70. [D 20:43:22.091278] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6745 [D 20:43:22.091333] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 15/70. [D 20:43:22.103303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 44323. [D 20:43:22.103323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 44324. [D 20:43:22.103333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 44325. [D 20:43:22.103343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 44326. [D 20:43:22.103353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 44327. [D 20:43:22.103363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 44328. [D 20:43:22.103372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 44329. [D 20:43:22.103382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 44330. [D 20:43:22.103392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 44331. [D 20:43:22.103402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 44332. [D 20:43:22.103412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 44333. [D 20:43:22.103421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 44334. [D 20:43:22.103431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 44335. [D 20:43:22.103441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 44336. [D 20:43:22.103451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 44337. [D 20:43:22.103460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 44338. [D 20:43:22.103470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 44339. [D 20:43:22.103480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 44340. [D 20:43:22.103490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 44341. [D 20:43:22.103500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 44342. [D 20:43:22.103509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 44343. [D 20:43:22.103519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 44344. [D 20:43:22.103529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 44345. [D 20:43:22.103539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 44346. [D 20:43:22.103548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 44347. [D 20:43:22.103558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 44348. [D 20:43:22.103568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 44349. [D 20:43:22.103578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 44350. [D 20:43:22.103588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 44351. [D 20:43:22.103597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 44352. [D 20:43:22.103608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 44353. [D 20:43:22.103618] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 44354. [D 20:43:22.103631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 44355. [D 20:43:22.103641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 44356. [D 20:43:22.103651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 44357. [D 20:43:22.103661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 44358. [D 20:43:22.103671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 44359. [D 20:43:22.103680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 44360. [D 20:43:22.103690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 44361. [D 20:43:22.103700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 44362. [D 20:43:22.103710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 44363. [D 20:43:22.103720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 44364. [D 20:43:22.103729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 44365. [D 20:43:22.103739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 44366. [D 20:43:22.103749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 44367. [D 20:43:22.103759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 44368. [D 20:43:22.103769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 44369. [D 20:43:22.103778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 44370. [D 20:43:22.103788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 44371. [D 20:43:22.103798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 44372. [D 20:43:22.103808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 44373. [D 20:43:22.103818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 44374. [D 20:43:22.103828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 44375. [D 20:43:22.103838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 44376. [D 20:43:22.103847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 44377. [D 20:43:22.103857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 44378. [D 20:43:22.103867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 44379. [D 20:43:22.103881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 44380. [D 20:43:22.103891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 44381. [D 20:43:22.103901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 44382. [D 20:43:22.103911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 44383. [D 20:43:22.103921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 44384. [D 20:43:22.103931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 44385. [D 20:43:22.103940] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 44386. [D 20:43:22.108326] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.108338] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.108346] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.108380] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6751 [D 20:43:22.108391] element 0: offset: 0x657310, size: 24 [D 20:43:22.108402] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 16/70. [D 20:43:22.109202] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44386. [D 20:43:22.109224] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 17/70. [D 20:43:22.115034] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 44385. [D 20:43:22.115053] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 18/70. [D 20:43:22.117310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.117321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.117330] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.117390] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.117400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.117408] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:22.119387] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6751 [D 20:43:22.119407] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 19/70. [D 20:43:22.119475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 44385. [D 20:43:22.119532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 44386. [D 20:43:22.119543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 44387. [D 20:43:22.119553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 44388. [D 20:43:22.119563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 44389. [D 20:43:22.119573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 44390. [D 20:43:22.119583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 44391. [D 20:43:22.119592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 44392. [D 20:43:22.119602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 44393. [D 20:43:22.119612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 44394. [D 20:43:22.119621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 44395. [D 20:43:22.119631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 44396. [D 20:43:22.119641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 44397. [D 20:43:22.119651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 44398. [D 20:43:22.119660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 44399. [D 20:43:22.119670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 44400. [D 20:43:22.119680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 44401. [D 20:43:22.119690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 44402. [D 20:43:22.119700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 44403. [D 20:43:22.119709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 44404. [D 20:43:22.119719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 44405. [D 20:43:22.119729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 44406. [D 20:43:22.119739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 44407. [D 20:43:22.119748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 44408. [D 20:43:22.119758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 44409. [D 20:43:22.119768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 44410. [D 20:43:22.119778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 44411. [D 20:43:22.119788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 44412. [D 20:43:22.119804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 44413. [D 20:43:22.119814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 44414. [D 20:43:22.119825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 44415. [D 20:43:22.119835] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 44416. [D 20:43:22.125383] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44416. [D 20:43:22.125400] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 20/70. [D 20:43:22.127673] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.127685] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.127693] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:22.230416] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.230430] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.230439] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:22.230470] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6754 [D 20:43:22.230481] element 0: offset: 0x61f310, size: 24 [D 20:43:22.230492] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 21/70. [D 20:43:22.234939] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6754 [D 20:43:22.234994] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 22/70. [D 20:43:22.235043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 44416. [D 20:43:22.235062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 44417. [D 20:43:22.235072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 44418. [D 20:43:22.235082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 44419. [D 20:43:22.235092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 44420. [D 20:43:22.235101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 44421. [D 20:43:22.235111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 44422. [D 20:43:22.235121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 44423. [D 20:43:22.235131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 44424. [D 20:43:22.235141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 44425. [D 20:43:22.235150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 44426. [D 20:43:22.235174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 44427. [D 20:43:22.235184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 44428. [D 20:43:22.235193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 44429. [D 20:43:22.235203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 44430. [D 20:43:22.235213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 44431. [D 20:43:22.235223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 44432. [D 20:43:22.235233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 44433. [D 20:43:22.235242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 44434. [D 20:43:22.235252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 44435. [D 20:43:22.235262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 44436. [D 20:43:22.235272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 44437. [D 20:43:22.235281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 44438. [D 20:43:22.235291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 44439. [D 20:43:22.235301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 44440. [D 20:43:22.235311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 44441. [D 20:43:22.235321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 44442. [D 20:43:22.235330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 44443. [D 20:43:22.235340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 44444. [D 20:43:22.235350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 44445. [D 20:43:22.235360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 44446. [D 20:43:22.235371] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 44447. [D 20:43:22.240982] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44447. [D 20:43:22.240996] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 23/70. [D 20:43:22.243258] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.243268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.243277] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:22.425341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.425354] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.425363] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:22.425378] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6758 [D 20:43:22.425387] element 0: offset: 0x64da70, size: 24 [D 20:43:22.425397] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 24/70. [D 20:43:22.425411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.425420] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.425432] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:22.425446] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6760 [D 20:43:22.425455] element 0: offset: 0x691fe0, size: 24 [D 20:43:22.425464] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 25/70. [D 20:43:22.430617] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6760 [D 20:43:22.430670] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 26/70. [D 20:43:22.430759] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6758 [D 20:43:22.430788] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 27/70. [D 20:43:22.430824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 44447. [D 20:43:22.430878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 44448. [D 20:43:22.430888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 44449. [D 20:43:22.430898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 44450. [D 20:43:22.430908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 44451. [D 20:43:22.430921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 44452. [D 20:43:22.430931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 44453. [D 20:43:22.430941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 44454. [D 20:43:22.430950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 44455. [D 20:43:22.430960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 44456. [D 20:43:22.430970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 44457. [D 20:43:22.430980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 44458. [D 20:43:22.430989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 44459. [D 20:43:22.430999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 44460. [D 20:43:22.431009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 44461. [D 20:43:22.431019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 44462. [D 20:43:22.431029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 44463. [D 20:43:22.431038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 44464. [D 20:43:22.431048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 44465. [D 20:43:22.431058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 44466. [D 20:43:22.431068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 44467. [D 20:43:22.431077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 44468. [D 20:43:22.431087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 44469. [D 20:43:22.431097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 44470. [D 20:43:22.431107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 44471. [D 20:43:22.431116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 44472. [D 20:43:22.431126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 44473. [D 20:43:22.431136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 44474. [D 20:43:22.431146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 44475. [D 20:43:22.431155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 44476. [D 20:43:22.431166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 44477. [D 20:43:22.431176] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 44478. [D 20:43:22.431190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 44479. [D 20:43:22.431200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 44480. [D 20:43:22.431210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 44481. [D 20:43:22.431220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 44482. [D 20:43:22.431229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 44483. [D 20:43:22.431239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 44484. [D 20:43:22.431249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 44485. [D 20:43:22.431259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 44486. [D 20:43:22.431269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 44487. [D 20:43:22.431279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 44488. [D 20:43:22.431288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 44489. [D 20:43:22.431298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 44490. [D 20:43:22.431308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 44491. [D 20:43:22.431318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 44492. [D 20:43:22.431328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 44493. [D 20:43:22.431338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 44494. [D 20:43:22.431347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 44495. [D 20:43:22.431357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 44496. [D 20:43:22.431367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 44497. [D 20:43:22.431377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 44498. [D 20:43:22.431387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 44499. [D 20:43:22.431397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 44500. [D 20:43:22.431406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 44501. [D 20:43:22.431416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 44502. [D 20:43:22.431426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 44503. [D 20:43:22.431436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 44504. [D 20:43:22.431446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 44505. [D 20:43:22.431456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 44506. [D 20:43:22.431466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 44507. [D 20:43:22.431476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 44508. [D 20:43:22.431485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 44509. [D 20:43:22.431495] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 44510. [D 20:43:22.442616] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44510. [D 20:43:22.442634] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 28/70. [D 20:43:22.452810] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 44509. [D 20:43:22.452824] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 29/70. [D 20:43:22.455098] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.455110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.455119] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:22.455134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.455143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.455151] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:22.470168] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.470182] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.470191] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:22.470221] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6764 [D 20:43:22.470232] element 0: offset: 0x657310, size: 24 [D 20:43:22.470243] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 30/70. [D 20:43:22.470261] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.470273] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.470281] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:22.470296] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6766 [D 20:43:22.470305] element 0: offset: 0x6ace30, size: 24 [D 20:43:22.470314] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 31/70. [D 20:43:22.474830] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6766 [D 20:43:22.474881] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 32/70. [D 20:43:22.475020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 44509. [D 20:43:22.475036] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6764 [D 20:43:22.475097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 44510. [D 20:43:22.475111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 44511. [D 20:43:22.475122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 44512. [D 20:43:22.475131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 44513. [D 20:43:22.475141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 44514. [D 20:43:22.475151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 44515. [D 20:43:22.475161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 44516. [D 20:43:22.475170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 44517. [D 20:43:22.475180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 44518. [D 20:43:22.475190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 44519. [D 20:43:22.475200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 44520. [D 20:43:22.475209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 44521. [D 20:43:22.475219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 44522. [D 20:43:22.475229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 44523. [D 20:43:22.475239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 44524. [D 20:43:22.475248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 44525. [D 20:43:22.475258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 44526. [D 20:43:22.475268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 44527. [D 20:43:22.475278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 44528. [D 20:43:22.475287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 44529. [D 20:43:22.475297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 44530. [D 20:43:22.475307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 44531. [D 20:43:22.475316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 44532. [D 20:43:22.475326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 44533. [D 20:43:22.475336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 44534. [D 20:43:22.475346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 44535. [D 20:43:22.475356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 44536. [D 20:43:22.475365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 44537. [D 20:43:22.475376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 44538. [D 20:43:22.475386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 44539. [D 20:43:22.475396] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 44540. [D 20:43:22.475415] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 33/70. [D 20:43:22.486667] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44540. [D 20:43:22.486687] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 34/70. [D 20:43:22.486712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 44540. [D 20:43:22.486723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 44541. [D 20:43:22.486732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 44542. [D 20:43:22.486742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 44543. [D 20:43:22.486752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 44544. [D 20:43:22.486762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 44545. [D 20:43:22.486771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 44546. [D 20:43:22.486782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 44547. [D 20:43:22.486791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 44548. [D 20:43:22.486801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 44549. [D 20:43:22.486811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 44550. [D 20:43:22.486821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 44551. [D 20:43:22.486830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 44552. [D 20:43:22.486840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 44553. [D 20:43:22.486850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 44554. [D 20:43:22.486860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 44555. [D 20:43:22.486870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 44556. [D 20:43:22.486879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 44557. [D 20:43:22.486889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 44558. [D 20:43:22.486899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 44559. [D 20:43:22.486909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 44560. [D 20:43:22.486918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 44561. [D 20:43:22.486928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 44562. [D 20:43:22.486938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 44563. [D 20:43:22.486948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 44564. [D 20:43:22.486958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 44565. [D 20:43:22.486967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 44566. [D 20:43:22.486977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 44567. [D 20:43:22.486987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 44568. [D 20:43:22.486998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 44569. [D 20:43:22.487008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 44570. [D 20:43:22.487017] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 44571. [D 20:43:22.489329] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.489341] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.489349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:22.496793] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 44571. [D 20:43:22.496807] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 35/70. [D 20:43:22.498921] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.498931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.498940] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:22.512278] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.512291] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.512300] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:22.512329] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6770 [D 20:43:22.512339] element 0: offset: 0x61fa90, size: 24 [D 20:43:22.512350] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 36/70. [D 20:43:22.512368] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.512380] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.512389] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:22.512402] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6772 [D 20:43:22.512412] element 0: offset: 0x6ace30, size: 24 [D 20:43:22.512421] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 37/70. [D 20:43:22.517601] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6772 [D 20:43:22.517654] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 38/70. [D 20:43:22.517743] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6770 [D 20:43:22.517759] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 39/70. [D 20:43:22.517801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 44571. [D 20:43:22.517856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 44572. [D 20:43:22.517867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 44573. [D 20:43:22.517877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 44574. [D 20:43:22.517886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 44575. [D 20:43:22.517896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 44576. [D 20:43:22.517906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 44577. [D 20:43:22.517916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 44578. [D 20:43:22.517925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 44579. [D 20:43:22.517935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 44580. [D 20:43:22.517945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 44581. [D 20:43:22.517955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 44582. [D 20:43:22.517965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 44583. [D 20:43:22.517974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 44584. [D 20:43:22.517984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 44585. [D 20:43:22.517994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 44586. [D 20:43:22.518003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 44587. [D 20:43:22.518013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 44588. [D 20:43:22.518023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 44589. [D 20:43:22.518032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 44590. [D 20:43:22.518042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 44591. [D 20:43:22.518052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 44592. [D 20:43:22.518062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 44593. [D 20:43:22.518071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 44594. [D 20:43:22.518081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 44595. [D 20:43:22.518091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 44596. [D 20:43:22.518101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 44597. [D 20:43:22.518110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 44598. [D 20:43:22.518120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 44599. [D 20:43:22.518130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 44600. [D 20:43:22.518140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 44601. [D 20:43:22.518150] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 44602. [D 20:43:22.518164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 44603. [D 20:43:22.518174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 44604. [D 20:43:22.518183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 44605. [D 20:43:22.518193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 44606. [D 20:43:22.518203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 44607. [D 20:43:22.518212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 44608. [D 20:43:22.518222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 44609. [D 20:43:22.518232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 44610. [D 20:43:22.518241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 44611. [D 20:43:22.518251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 44612. [D 20:43:22.518261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 44613. [D 20:43:22.518270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 44614. [D 20:43:22.518280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 44615. [D 20:43:22.518290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 44616. [D 20:43:22.518299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 44617. [D 20:43:22.518309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 44618. [D 20:43:22.518319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 44619. [D 20:43:22.518328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 44620. [D 20:43:22.518338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 44621. [D 20:43:22.518348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 44622. [D 20:43:22.518357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 44623. [D 20:43:22.518367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 44624. [D 20:43:22.518376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 44625. [D 20:43:22.518386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 44626. [D 20:43:22.518396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 44627. [D 20:43:22.518405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 44628. [D 20:43:22.518415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 44629. [D 20:43:22.518425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 44630. [D 20:43:22.518435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 44631. [D 20:43:22.518445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 44632. [D 20:43:22.518454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 44633. [D 20:43:22.518464] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 44634. [D 20:43:22.522716] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.522728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.522737] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.522771] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6774 [D 20:43:22.522781] element 0: offset: 0x648d00, size: 24 [D 20:43:22.522794] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 40/70. [D 20:43:22.529481] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44634. [D 20:43:22.529498] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 41/70. [D 20:43:22.537376] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.537389] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.537398] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:22.537414] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6778 [D 20:43:22.537424] element 0: offset: 0x657310, size: 24 [D 20:43:22.537433] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 42/70. [D 20:43:22.541036] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 44633. [D 20:43:22.541050] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 43/70. [D 20:43:22.543390] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.543400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.543409] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:22.543481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.543491] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.543500] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.546477] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6778 [D 20:43:22.546530] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 44/70. [D 20:43:22.546618] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6774 [D 20:43:22.546634] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 45/70. [D 20:43:22.547062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 44633. [D 20:43:22.547105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 44634. [D 20:43:22.547115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 44635. [D 20:43:22.547125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 44636. [D 20:43:22.547135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 44637. [D 20:43:22.547145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 44638. [D 20:43:22.547155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 44639. [D 20:43:22.547164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 44640. [D 20:43:22.547174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 44641. [D 20:43:22.547184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 44642. [D 20:43:22.547193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 44643. [D 20:43:22.547203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 44644. [D 20:43:22.547213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 44645. [D 20:43:22.547223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 44646. [D 20:43:22.547232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 44647. [D 20:43:22.547242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 44648. [D 20:43:22.547251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 44649. [D 20:43:22.547261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 44650. [D 20:43:22.547271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 44651. [D 20:43:22.547280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 44652. [D 20:43:22.547290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 44653. [D 20:43:22.547300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 44654. [D 20:43:22.547309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 44655. [D 20:43:22.547319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 44656. [D 20:43:22.547329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 44657. [D 20:43:22.547338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 44658. [D 20:43:22.547348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 44659. [D 20:43:22.547358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 44660. [D 20:43:22.547367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 44661. [D 20:43:22.547377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 44662. [D 20:43:22.547388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 44663. [D 20:43:22.547397] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 44664. [D 20:43:22.547410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 44665. [D 20:43:22.547420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 44666. [D 20:43:22.547430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 44667. [D 20:43:22.547440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 44668. [D 20:43:22.547449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 44669. [D 20:43:22.547459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 44670. [D 20:43:22.547469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 44671. [D 20:43:22.547478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 44672. [D 20:43:22.547488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 44673. [D 20:43:22.547498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 44674. [D 20:43:22.547508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 44675. [D 20:43:22.547517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 44676. [D 20:43:22.547527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 44677. [D 20:43:22.547537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 44678. [D 20:43:22.547547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 44679. [D 20:43:22.547556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 44680. [D 20:43:22.547566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 44681. [D 20:43:22.547576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 44682. [D 20:43:22.547585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 44683. [D 20:43:22.547595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 44684. [D 20:43:22.547605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 44685. [D 20:43:22.547615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 44686. [D 20:43:22.547625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 44687. [D 20:43:22.547634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 44688. [D 20:43:22.547644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 44689. [D 20:43:22.547654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 44690. [D 20:43:22.547663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 44691. [D 20:43:22.547673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 44692. [D 20:43:22.547683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 44693. [D 20:43:22.547693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 44694. [D 20:43:22.547703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 44695. [D 20:43:22.547712] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 44696. [D 20:43:22.555934] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.555949] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.555958] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.555992] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6782 [D 20:43:22.556003] element 0: offset: 0x661d00, size: 24 [D 20:43:22.556015] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 46/70. [D 20:43:22.556035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.556044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.556052] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:22.556065] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6784 [D 20:43:22.556074] element 0: offset: 0x64da70, size: 24 [D 20:43:22.556084] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 47/70. [D 20:43:22.558662] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44696. [D 20:43:22.558678] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 48/70. [D 20:43:22.564668] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 44695. [D 20:43:22.564682] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 49/70. [D 20:43:22.566951] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.566962] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.566970] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:22.567049] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.567059] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.567067] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.570123] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6784 [D 20:43:22.570176] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 50/70. [D 20:43:22.570264] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6782 [D 20:43:22.570280] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 51/70. [D 20:43:22.575140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 44695. [D 20:43:22.575185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 44696. [D 20:43:22.575195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 44697. [D 20:43:22.575205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 44698. [D 20:43:22.575215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 44699. [D 20:43:22.575225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 44700. [D 20:43:22.575234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 44701. [D 20:43:22.575244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 44702. [D 20:43:22.575254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 44703. [D 20:43:22.575263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 44704. [D 20:43:22.575273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 44705. [D 20:43:22.575283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 44706. [D 20:43:22.575293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 44707. [D 20:43:22.575303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 44708. [D 20:43:22.575312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 44709. [D 20:43:22.575322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 44710. [D 20:43:22.575332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 44711. [D 20:43:22.575341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 44712. [D 20:43:22.575351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 44713. [D 20:43:22.575361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 44714. [D 20:43:22.575370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 44715. [D 20:43:22.575380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 44716. [D 20:43:22.575390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 44717. [D 20:43:22.575399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 44718. [D 20:43:22.575409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 44719. [D 20:43:22.575419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 44720. [D 20:43:22.575428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 44721. [D 20:43:22.575438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 44722. [D 20:43:22.575448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 44723. [D 20:43:22.575457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 44724. [D 20:43:22.575468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 44725. [D 20:43:22.575478] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 44726. [D 20:43:22.575491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 44727. [D 20:43:22.575501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 44728. [D 20:43:22.575511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 44729. [D 20:43:22.575521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 44730. [D 20:43:22.575530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 44731. [D 20:43:22.575540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 44732. [D 20:43:22.575550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 44733. [D 20:43:22.575559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 44734. [D 20:43:22.575569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 44735. [D 20:43:22.575579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 44736. [D 20:43:22.575589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 44737. [D 20:43:22.575598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 44738. [D 20:43:22.575608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 44739. [D 20:43:22.575617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 44740. [D 20:43:22.575627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 44741. [D 20:43:22.575637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 44742. [D 20:43:22.575647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 44743. [D 20:43:22.575656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 44744. [D 20:43:22.575666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 44745. [D 20:43:22.575676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 44746. [D 20:43:22.575686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 44747. [D 20:43:22.575695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 44748. [D 20:43:22.575705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 44749. [D 20:43:22.575715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 44750. [D 20:43:22.575724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 44751. [D 20:43:22.575734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 44752. [D 20:43:22.575744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 44753. [D 20:43:22.575754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 44754. [D 20:43:22.575763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 44755. [D 20:43:22.575773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 44756. [D 20:43:22.575783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 44757. [D 20:43:22.575793] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 44758. [D 20:43:22.580048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.580060] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.580069] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.580104] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6788 [D 20:43:22.580115] element 0: offset: 0x5b0030, size: 24 [D 20:43:22.580127] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 52/70. [D 20:43:22.580147] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.580156] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.580164] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:22.580179] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6789 [D 20:43:22.580188] element 0: offset: 0x6ace30, size: 24 [D 20:43:22.580197] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 53/70. [D 20:43:22.581053] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44758. [D 20:43:22.581069] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 54/70. [D 20:43:22.586887] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 44757. [D 20:43:22.586901] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 55/70. [D 20:43:22.589168] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.589179] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.589188] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:22.589267] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.589278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.589286] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.592095] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6789 [D 20:43:22.592150] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 56/70. [D 20:43:22.592248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 44757. [D 20:43:22.592295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 44758. [D 20:43:22.592306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 44759. [D 20:43:22.592316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 44760. [D 20:43:22.592326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 44761. [D 20:43:22.592336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 44762. [D 20:43:22.592346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 44763. [D 20:43:22.592356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 44764. [D 20:43:22.592366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 44765. [D 20:43:22.592375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 44766. [D 20:43:22.592385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 44767. [D 20:43:22.592395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 44768. [D 20:43:22.592405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 44769. [D 20:43:22.592415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 44770. [D 20:43:22.592429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 44771. [D 20:43:22.592416] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6788 [D 20:43:22.592439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 44772. [D 20:43:22.592499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 44773. [D 20:43:22.592509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 44774. [D 20:43:22.592519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 44775. [D 20:43:22.592529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 44776. [D 20:43:22.592538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 44777. [D 20:43:22.592548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 44778. [D 20:43:22.592558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 44779. [D 20:43:22.592567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 44780. [D 20:43:22.592577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 44781. [D 20:43:22.592587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 44782. [D 20:43:22.592596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 44783. [D 20:43:22.592606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 44784. [D 20:43:22.592616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 44785. [D 20:43:22.592630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 44786. [D 20:43:22.592640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 44787. [D 20:43:22.592650] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 44788. [D 20:43:22.592672] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 57/70. [D 20:43:22.598228] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44788. [D 20:43:22.598248] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 58/70. [D 20:43:22.598259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 44788. [D 20:43:22.598269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 44789. [D 20:43:22.598279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 44790. [D 20:43:22.598289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 44791. [D 20:43:22.598299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 44792. [D 20:43:22.598309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 44793. [D 20:43:22.598319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 44794. [D 20:43:22.598328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 44795. [D 20:43:22.598338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 44796. [D 20:43:22.598348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 44797. [D 20:43:22.598358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 44798. [D 20:43:22.598367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 44799. [D 20:43:22.598377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 44800. [D 20:43:22.598387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 44801. [D 20:43:22.598396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 44802. [D 20:43:22.598406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 44803. [D 20:43:22.598416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 44804. [D 20:43:22.598426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 44805. [D 20:43:22.598436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 44806. [D 20:43:22.598446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 44807. [D 20:43:22.598456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 44808. [D 20:43:22.598465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 44809. [D 20:43:22.598475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 44810. [D 20:43:22.598485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 44811. [D 20:43:22.598495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 44812. [D 20:43:22.598505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 44813. [D 20:43:22.598515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 44814. [D 20:43:22.598524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 44815. [D 20:43:22.598534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 44816. [D 20:43:22.598545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 44817. [D 20:43:22.598555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 44818. [D 20:43:22.598565] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 44819. [D 20:43:22.600883] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.600895] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.600904] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:22.604180] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 44819. [D 20:43:22.604195] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 59/70. [D 20:43:22.606309] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.606319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.606327] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:22.870368] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.870382] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.870390] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:22.870422] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6793 [D 20:43:22.870432] element 0: offset: 0x62aeb0, size: 24 [D 20:43:22.870443] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 60/70. [D 20:43:22.872546] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6793 [D 20:43:22.872566] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 0/70. [D 20:43:22.877069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 44819. [D 20:43:22.877129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 44820. [D 20:43:22.877140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 44821. [D 20:43:22.877150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 44822. [D 20:43:22.877160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 44823. [D 20:43:22.877169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 44824. [D 20:43:22.877179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 44825. [D 20:43:22.877189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 44826. [D 20:43:22.877199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 44827. [D 20:43:22.877208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 44828. [D 20:43:22.877218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 44829. [D 20:43:22.877228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 44830. [D 20:43:22.877237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 44831. [D 20:43:22.877247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 44832. [D 20:43:22.877257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 44833. [D 20:43:22.877267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 44834. [D 20:43:22.877276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 44835. [D 20:43:22.877286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 44836. [D 20:43:22.877296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 44837. [D 20:43:22.877306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 44838. [D 20:43:22.877315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 44839. [D 20:43:22.877325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 44840. [D 20:43:22.877335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 44841. [D 20:43:22.877344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 44842. [D 20:43:22.877354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 44843. [D 20:43:22.877364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 44844. [D 20:43:22.877374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 44845. [D 20:43:22.877383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 44846. [D 20:43:22.877393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 44847. [D 20:43:22.877403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 44848. [D 20:43:22.877414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 44849. [D 20:43:22.877423] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 44850. [D 20:43:22.885807] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.885822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.885831] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:22.885864] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6796 [D 20:43:22.885875] element 0: offset: 0x643630, size: 24 [D 20:43:22.885887] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 1/70. [D 20:43:22.886001] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.886014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.886022] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.886050] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6798 [D 20:43:22.886060] element 0: offset: 0x61fa90, size: 24 [D 20:43:22.886069] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 2/70. [D 20:43:22.888723] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44850. [D 20:43:22.888739] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 3/70. [D 20:43:22.891073] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6796 [D 20:43:22.891125] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 4/70. [D 20:43:22.891134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.891149] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.891161] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.893111] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6798 [D 20:43:22.893126] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 5/70. [D 20:43:22.895602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 44850. [D 20:43:22.895648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 44851. [D 20:43:22.895659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 44852. [D 20:43:22.895668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 44853. [D 20:43:22.895678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 44854. [D 20:43:22.895689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 44855. [D 20:43:22.895699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 44856. [D 20:43:22.895709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 44857. [D 20:43:22.895719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 44858. [D 20:43:22.895728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 44859. [D 20:43:22.895738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 44860. [D 20:43:22.895748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 44861. [D 20:43:22.895758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 44862. [D 20:43:22.895768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 44863. [D 20:43:22.895778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 44864. [D 20:43:22.895788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 44865. [D 20:43:22.895798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 44866. [D 20:43:22.895808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 44867. [D 20:43:22.895818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 44868. [D 20:43:22.895828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 44869. [D 20:43:22.895838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 44870. [D 20:43:22.895848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 44871. [D 20:43:22.895858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 44872. [D 20:43:22.895868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 44873. [D 20:43:22.895877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 44874. [D 20:43:22.895887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 44875. [D 20:43:22.895897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 44876. [D 20:43:22.895907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 44877. [D 20:43:22.895917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 44878. [D 20:43:22.895932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 44879. [D 20:43:22.895942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 44880. [D 20:43:22.895958] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 44881. [D 20:43:22.895971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 44882. [D 20:43:22.895981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 44883. [D 20:43:22.895991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 44884. [D 20:43:22.896001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 44885. [D 20:43:22.896011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 44886. [D 20:43:22.896021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 44887. [D 20:43:22.896031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 44888. [D 20:43:22.896041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 44889. [D 20:43:22.896051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 44890. [D 20:43:22.896061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 44891. [D 20:43:22.896071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 44892. [D 20:43:22.896081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 44893. [D 20:43:22.896091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 44894. [D 20:43:22.896101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 44895. [D 20:43:22.896111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 44896. [D 20:43:22.896121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 44897. [D 20:43:22.896131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 44898. [D 20:43:22.896141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 44899. [D 20:43:22.896151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 44900. [D 20:43:22.896162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 44901. [D 20:43:22.896172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 44902. [D 20:43:22.896182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 44903. [D 20:43:22.896192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 44904. [D 20:43:22.896201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 44905. [D 20:43:22.896212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 44906. [D 20:43:22.896222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 44907. [D 20:43:22.896232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 44908. [D 20:43:22.896242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 44909. [D 20:43:22.896252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 44910. [D 20:43:22.896262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 44911. [D 20:43:22.896272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 44912. [D 20:43:22.896282] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 44913. [D 20:43:22.900533] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.900545] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.900554] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.900589] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6802 [D 20:43:22.900600] element 0: offset: 0x655ed0, size: 24 [D 20:43:22.900612] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 6/70. [D 20:43:22.906828] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44913. [D 20:43:22.906845] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 7/70. [D 20:43:22.918245] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 44912. [D 20:43:22.918259] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 8/70. [D 20:43:22.920573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.920583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.920592] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.920650] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.920661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.920669] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:22.922946] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6802 [D 20:43:22.923000] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 9/70. [D 20:43:22.923635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 44912. [D 20:43:22.923653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 44913. [D 20:43:22.923663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 44914. [D 20:43:22.923673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 44915. [D 20:43:22.923683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 44916. [D 20:43:22.923693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 44917. [D 20:43:22.923703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 44918. [D 20:43:22.923712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 44919. [D 20:43:22.923722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 44920. [D 20:43:22.923732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 44921. [D 20:43:22.923742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 44922. [D 20:43:22.923752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 44923. [D 20:43:22.923762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 44924. [D 20:43:22.923772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 44925. [D 20:43:22.923782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 44926. [D 20:43:22.923792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 44927. [D 20:43:22.923802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 44928. [D 20:43:22.923812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 44929. [D 20:43:22.923821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 44930. [D 20:43:22.923831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 44931. [D 20:43:22.923841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 44932. [D 20:43:22.923851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 44933. [D 20:43:22.923861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 44934. [D 20:43:22.923871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 44935. [D 20:43:22.923881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 44936. [D 20:43:22.923891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 44937. [D 20:43:22.923901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 44938. [D 20:43:22.923910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 44939. [D 20:43:22.923920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 44940. [D 20:43:22.923934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 44941. [D 20:43:22.923945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 44942. [D 20:43:22.923958] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 44943. [D 20:43:22.934399] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.934412] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.934421] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:22.934437] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6805 [D 20:43:22.934446] element 0: offset: 0x6ace30, size: 24 [D 20:43:22.934456] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 10/70. [D 20:43:22.934471] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.934480] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.934488] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.934502] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6808 [D 20:43:22.934511] element 0: offset: 0x62aeb0, size: 24 [D 20:43:22.934520] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 11/70. [D 20:43:22.935357] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 44943. [D 20:43:22.935372] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 12/70. [D 20:43:22.937710] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.937721] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.937729] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.940613] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6808 [D 20:43:22.940666] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 13/70. [D 20:43:22.940750] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6805 [D 20:43:22.940767] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 14/70. [D 20:43:22.941943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 44943. [D 20:43:22.941984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 44944. [D 20:43:22.941994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 44945. [D 20:43:22.942004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 44946. [D 20:43:22.942014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 44947. [D 20:43:22.942024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 44948. [D 20:43:22.942034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 44949. [D 20:43:22.942045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 44950. [D 20:43:22.942054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 44951. [D 20:43:22.942064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 44952. [D 20:43:22.942074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 44953. [D 20:43:22.942084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 44954. [D 20:43:22.942094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 44955. [D 20:43:22.942104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 44956. [D 20:43:22.942114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 44957. [D 20:43:22.942124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 44958. [D 20:43:22.942134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 44959. [D 20:43:22.942143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 44960. [D 20:43:22.942153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 44961. [D 20:43:22.942163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 44962. [D 20:43:22.942173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 44963. [D 20:43:22.942183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 44964. [D 20:43:22.942193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 44965. [D 20:43:22.942203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 44966. [D 20:43:22.942213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 44967. [D 20:43:22.942223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 44968. [D 20:43:22.942233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 44969. [D 20:43:22.942243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 44970. [D 20:43:22.942252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 44971. [D 20:43:22.942262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 44972. [D 20:43:22.942273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 44973. [D 20:43:22.942283] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 44974. [D 20:43:22.942296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 44975. [D 20:43:22.942306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 44976. [D 20:43:22.942316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 44977. [D 20:43:22.942326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 44978. [D 20:43:22.942336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 44979. [D 20:43:22.942346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 44980. [D 20:43:22.942356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 44981. [D 20:43:22.942366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 44982. [D 20:43:22.942376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 44983. [D 20:43:22.942386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 44984. [D 20:43:22.942396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 44985. [D 20:43:22.942405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 44986. [D 20:43:22.942416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 44987. [D 20:43:22.942426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 44988. [D 20:43:22.942435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 44989. [D 20:43:22.942445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 44990. [D 20:43:22.942455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 44991. [D 20:43:22.942465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 44992. [D 20:43:22.942475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 44993. [D 20:43:22.942485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 44994. [D 20:43:22.942495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 44995. [D 20:43:22.942505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 44996. [D 20:43:22.942515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 44997. [D 20:43:22.942525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 44998. [D 20:43:22.942535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 44999. [D 20:43:22.942545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 45000. [D 20:43:22.942555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 45001. [D 20:43:22.942565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 45002. [D 20:43:22.942575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 45003. [D 20:43:22.942585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 45004. [D 20:43:22.942595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 45005. [D 20:43:22.942605] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 45006. [D 20:43:22.946807] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.946820] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.946829] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.946863] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6811 [D 20:43:22.946874] element 0: offset: 0x61fa90, size: 24 [D 20:43:22.946886] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 15/70. [D 20:43:22.953616] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45006. [D 20:43:22.953632] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 16/70. [D 20:43:22.965157] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 45005. [D 20:43:22.965172] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 17/70. [D 20:43:22.967477] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.967487] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.967495] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.967554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.967564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.967572] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:22.969513] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6811 [D 20:43:22.969531] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 18/70. [D 20:43:22.970591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45005. [D 20:43:22.970636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45006. [D 20:43:22.970646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45007. [D 20:43:22.970656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 45008. [D 20:43:22.970666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 45009. [D 20:43:22.970676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 45010. [D 20:43:22.970686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 45011. [D 20:43:22.970696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 45012. [D 20:43:22.970706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 45013. [D 20:43:22.970716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 45014. [D 20:43:22.970726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 45015. [D 20:43:22.970736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 45016. [D 20:43:22.970745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 45017. [D 20:43:22.970755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 45018. [D 20:43:22.970765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 45019. [D 20:43:22.970775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 45020. [D 20:43:22.970785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 45021. [D 20:43:22.970795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 45022. [D 20:43:22.970805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 45023. [D 20:43:22.970815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 45024. [D 20:43:22.970825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 45025. [D 20:43:22.970834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 45026. [D 20:43:22.970844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 45027. [D 20:43:22.970854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 45028. [D 20:43:22.970864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 45029. [D 20:43:22.970874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 45030. [D 20:43:22.970884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 45031. [D 20:43:22.970894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 45032. [D 20:43:22.970904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 45033. [D 20:43:22.970914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 45034. [D 20:43:22.970925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 45035. [D 20:43:22.970935] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 45036. [D 20:43:22.981331] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.981346] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.981355] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:22.981390] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6814 [D 20:43:22.981400] element 0: offset: 0x5b0030, size: 24 [D 20:43:22.981412] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 19/70. [D 20:43:22.981432] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:22.981441] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.981450] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:22.981464] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6817 [D 20:43:22.981473] element 0: offset: 0x691fe0, size: 24 [D 20:43:22.981483] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 20/70. [D 20:43:22.982365] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45036. [D 20:43:22.982381] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 21/70. [D 20:43:22.984726] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:22.984738] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:22.984746] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:22.987664] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6817 [D 20:43:22.987716] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 22/70. [D 20:43:22.987803] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6814 [D 20:43:22.987819] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 23/70. [D 20:43:22.988993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 45036. [D 20:43:22.989034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 45037. [D 20:43:22.989045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 45038. [D 20:43:22.989055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 45039. [D 20:43:22.989064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 45040. [D 20:43:22.989075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 45041. [D 20:43:22.989084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 45042. [D 20:43:22.989094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 45043. [D 20:43:22.989104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 45044. [D 20:43:22.989114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 45045. [D 20:43:22.989124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 45046. [D 20:43:22.989134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 45047. [D 20:43:22.989144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 45048. [D 20:43:22.989154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 45049. [D 20:43:22.989164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 45050. [D 20:43:22.989174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 45051. [D 20:43:22.989183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 45052. [D 20:43:22.989193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 45053. [D 20:43:22.989203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 45054. [D 20:43:22.989213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 45055. [D 20:43:22.989223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 45056. [D 20:43:22.989233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 45057. [D 20:43:22.989243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 45058. [D 20:43:22.989253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 45059. [D 20:43:22.989263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 45060. [D 20:43:22.989273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 45061. [D 20:43:22.989283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 45062. [D 20:43:22.989292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 45063. [D 20:43:22.989302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 45064. [D 20:43:22.989312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 45065. [D 20:43:22.989323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 45066. [D 20:43:22.989333] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 45067. [D 20:43:22.989346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 45068. [D 20:43:22.989356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 45069. [D 20:43:22.989366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 45070. [D 20:43:22.989376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 45071. [D 20:43:22.989385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 45072. [D 20:43:22.989395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 45073. [D 20:43:22.989405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 45074. [D 20:43:22.989414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 45075. [D 20:43:22.989424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 45076. [D 20:43:22.989434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 45077. [D 20:43:22.989444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 45078. [D 20:43:22.989454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 45079. [D 20:43:22.989463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 45080. [D 20:43:22.989473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 45081. [D 20:43:22.989483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 45082. [D 20:43:22.989492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 45083. [D 20:43:22.989502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 45084. [D 20:43:22.989512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 45085. [D 20:43:22.989522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 45086. [D 20:43:22.989532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 45087. [D 20:43:22.989541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 45088. [D 20:43:22.989551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 45089. [D 20:43:22.989561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 45090. [D 20:43:22.989570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 45091. [D 20:43:22.989580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 45092. [D 20:43:22.989590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 45093. [D 20:43:22.989600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 45094. [D 20:43:22.989610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 45095. [D 20:43:22.989620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 45096. [D 20:43:22.989630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 45097. [D 20:43:22.989640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 45098. [D 20:43:22.989649] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 45099. [D 20:43:22.999986] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.000001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.000011] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:23.000046] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6820 [D 20:43:23.000057] element 0: offset: 0x62aeb0, size: 24 [D 20:43:23.000069] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 24/70. [D 20:43:23.000667] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45099. [D 20:43:23.000679] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 25/70. [D 20:43:23.012359] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 45098. [D 20:43:23.012374] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 26/70. [D 20:43:23.014587] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.014597] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.014606] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:23.014663] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.014674] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.014682] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:23.016665] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6820 [D 20:43:23.016683] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 27/70. [D 20:43:23.023660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45098. [D 20:43:23.023703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45099. [D 20:43:23.023714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45100. [D 20:43:23.023724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 45101. [D 20:43:23.023734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 45102. [D 20:43:23.023744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 45103. [D 20:43:23.023754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 45104. [D 20:43:23.023764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 45105. [D 20:43:23.023774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 45106. [D 20:43:23.023784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 45107. [D 20:43:23.023794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 45108. [D 20:43:23.023804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 45109. [D 20:43:23.023814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 45110. [D 20:43:23.023823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 45111. [D 20:43:23.023833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 45112. [D 20:43:23.023844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 45113. [D 20:43:23.023853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 45114. [D 20:43:23.023863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 45115. [D 20:43:23.023873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 45116. [D 20:43:23.023883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 45117. [D 20:43:23.023893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 45118. [D 20:43:23.023903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 45119. [D 20:43:23.023913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 45120. [D 20:43:23.023923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 45121. [D 20:43:23.023933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 45122. [D 20:43:23.023943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 45123. [D 20:43:23.023955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 45124. [D 20:43:23.023970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 45125. [D 20:43:23.023980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 45126. [D 20:43:23.023990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 45127. [D 20:43:23.024001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 45128. [D 20:43:23.024011] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 45129. [D 20:43:23.028853] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.028868] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.028877] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:23.028912] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6823 [D 20:43:23.028922] element 0: offset: 0x655ed0, size: 24 [D 20:43:23.028935] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 28/70. [D 20:43:23.028959] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.028968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.028976] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:23.028991] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6826 [D 20:43:23.029000] element 0: offset: 0x648d00, size: 24 [D 20:43:23.029010] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 29/70. [D 20:43:23.034649] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45129. [D 20:43:23.034666] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 30/70. [D 20:43:23.036985] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.036996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.037005] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:23.039696] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6826 [D 20:43:23.039746] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 31/70. [D 20:43:23.039795] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6823 [D 20:43:23.039813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 45129. [D 20:43:23.039883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 45130. [D 20:43:23.039895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 45131. [D 20:43:23.039905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 45132. [D 20:43:23.039915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 45133. [D 20:43:23.039925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 45134. [D 20:43:23.039935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 45135. [D 20:43:23.039945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 45136. [D 20:43:23.039962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 45137. [D 20:43:23.039983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 45138. [D 20:43:23.039993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 45139. [D 20:43:23.040003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 45140. [D 20:43:23.040013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 45141. [D 20:43:23.040023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 45142. [D 20:43:23.040033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 45143. [D 20:43:23.040044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 45144. [D 20:43:23.040054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 45145. [D 20:43:23.040064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 45146. [D 20:43:23.040074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 45147. [D 20:43:23.040084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 45148. [D 20:43:23.040094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 45149. [D 20:43:23.040104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 45150. [D 20:43:23.040114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 45151. [D 20:43:23.040124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 45152. [D 20:43:23.040134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 45153. [D 20:43:23.040144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 45154. [D 20:43:23.040154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 45155. [D 20:43:23.040164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 45156. [D 20:43:23.040174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 45157. [D 20:43:23.040186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 45158. [D 20:43:23.040196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 45159. [D 20:43:23.040206] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 45160. [D 20:43:23.040229] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 32/70. [D 20:43:23.045831] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45160. [D 20:43:23.045852] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 33/70. [D 20:43:23.045863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 45160. [D 20:43:23.045874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 45161. [D 20:43:23.045884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 45162. [D 20:43:23.045894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 45163. [D 20:43:23.045903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 45164. [D 20:43:23.045913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 45165. [D 20:43:23.045923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 45166. [D 20:43:23.045933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 45167. [D 20:43:23.045943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 45168. [D 20:43:23.045953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 45169. [D 20:43:23.045963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 45170. [D 20:43:23.045973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 45171. [D 20:43:23.045983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 45172. [D 20:43:23.045992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 45173. [D 20:43:23.046003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 45174. [D 20:43:23.046012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 45175. [D 20:43:23.046022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 45176. [D 20:43:23.046032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 45177. [D 20:43:23.046042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 45178. [D 20:43:23.046052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 45179. [D 20:43:23.046062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 45180. [D 20:43:23.046072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 45181. [D 20:43:23.046082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 45182. [D 20:43:23.046092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 45183. [D 20:43:23.046102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 45184. [D 20:43:23.046112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 45185. [D 20:43:23.046122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 45186. [D 20:43:23.046132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 45187. [D 20:43:23.046141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 45188. [D 20:43:23.046152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 45189. [D 20:43:23.046162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 45190. [D 20:43:23.046172] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 45191. [D 20:43:23.048488] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.048500] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.048509] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:23.051731] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 45191. [D 20:43:23.051747] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 34/70. [D 20:43:23.053870] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.053881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.053889] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:23.130438] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.130452] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.130461] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:23.130494] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6829 [D 20:43:23.130504] element 0: offset: 0x661d30, size: 24 [D 20:43:23.130515] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 35/70. [D 20:43:23.134786] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6829 [D 20:43:23.134810] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 36/70. [D 20:43:23.134935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 45191. [D 20:43:23.135002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 45192. [D 20:43:23.135013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 45193. [D 20:43:23.135023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 45194. [D 20:43:23.135033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 45195. [D 20:43:23.135043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 45196. [D 20:43:23.135053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 45197. [D 20:43:23.135063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 45198. [D 20:43:23.135073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 45199. [D 20:43:23.135083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 45200. [D 20:43:23.135093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 45201. [D 20:43:23.135103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 45202. [D 20:43:23.135113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 45203. [D 20:43:23.135123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 45204. [D 20:43:23.135132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 45205. [D 20:43:23.135142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 45206. [D 20:43:23.135152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 45207. [D 20:43:23.135162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 45208. [D 20:43:23.135172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 45209. [D 20:43:23.135182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 45210. [D 20:43:23.135192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 45211. [D 20:43:23.135202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 45212. [D 20:43:23.135212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 45213. [D 20:43:23.135222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 45214. [D 20:43:23.135232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 45215. [D 20:43:23.135242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 45216. [D 20:43:23.135251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 45217. [D 20:43:23.135261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 45218. [D 20:43:23.135271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 45219. [D 20:43:23.135282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 45220. [D 20:43:23.135292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 45221. [D 20:43:23.135303] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 45222. [D 20:43:23.140860] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45222. [D 20:43:23.140878] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 37/70. [D 20:43:23.143156] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.143168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.143177] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:23.280648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.280663] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.280671] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:23.280702] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6832 [D 20:43:23.280713] element 0: offset: 0x691fe0, size: 24 [D 20:43:23.280723] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 38/70. [D 20:43:23.282988] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6832 [D 20:43:23.283039] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 39/70. [D 20:43:23.283092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45222. [D 20:43:23.283110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45223. [D 20:43:23.283120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45224. [D 20:43:23.283130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 45225. [D 20:43:23.283140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 45226. [D 20:43:23.283150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 45227. [D 20:43:23.283163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 45228. [D 20:43:23.283173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 45229. [D 20:43:23.283183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 45230. [D 20:43:23.283193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 45231. [D 20:43:23.283203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 45232. [D 20:43:23.283213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 45233. [D 20:43:23.283222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 45234. [D 20:43:23.283232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 45235. [D 20:43:23.283242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 45236. [D 20:43:23.283252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 45237. [D 20:43:23.283262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 45238. [D 20:43:23.283272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 45239. [D 20:43:23.283282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 45240. [D 20:43:23.283292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 45241. [D 20:43:23.283302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 45242. [D 20:43:23.283312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 45243. [D 20:43:23.283322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 45244. [D 20:43:23.283332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 45245. [D 20:43:23.283341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 45246. [D 20:43:23.283351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 45247. [D 20:43:23.283361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 45248. [D 20:43:23.283371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 45249. [D 20:43:23.283381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 45250. [D 20:43:23.283391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 45251. [D 20:43:23.283401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 45252. [D 20:43:23.283412] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 45253. [D 20:43:23.289023] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45253. [D 20:43:23.289039] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 40/70. [D 20:43:23.291302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.291312] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.291321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:23.308929] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.308943] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.308952] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:23.308966] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6835 [D 20:43:23.308976] element 0: offset: 0x632910, size: 24 [D 20:43:23.308986] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 41/70. [D 20:43:23.310988] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6835 [D 20:43:23.311008] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 42/70. [D 20:43:23.316607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45253. [D 20:43:23.316667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45254. [D 20:43:23.316678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45255. [D 20:43:23.316688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 45256. [D 20:43:23.316698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 45257. [D 20:43:23.316708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 45258. [D 20:43:23.316718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 45259. [D 20:43:23.316728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 45260. [D 20:43:23.316738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 45261. [D 20:43:23.316747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 45262. [D 20:43:23.316757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 45263. [D 20:43:23.316767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 45264. [D 20:43:23.316777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 45265. [D 20:43:23.316787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 45266. [D 20:43:23.316797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 45267. [D 20:43:23.316807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 45268. [D 20:43:23.316816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 45269. [D 20:43:23.316826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 45270. [D 20:43:23.316836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 45271. [D 20:43:23.316846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 45272. [D 20:43:23.316856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 45273. [D 20:43:23.316866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 45274. [D 20:43:23.316876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 45275. [D 20:43:23.316886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 45276. [D 20:43:23.316896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 45277. [D 20:43:23.316905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 45278. [D 20:43:23.316916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 45279. [D 20:43:23.316925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 45280. [D 20:43:23.316935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 45281. [D 20:43:23.316945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 45282. [D 20:43:23.316956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 45283. [D 20:43:23.316966] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 45284. [D 20:43:23.322587] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45284. [D 20:43:23.322605] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 43/70. [D 20:43:23.324844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.324856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.324865] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:23.332520] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.332534] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.332543] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:23.332574] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6840 [D 20:43:23.332584] element 0: offset: 0x61fa90, size: 24 [D 20:43:23.332596] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 44/70. [D 20:43:23.332614] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.332623] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.332631] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:23.332645] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6841 [D 20:43:23.332655] element 0: offset: 0x648d00, size: 24 [D 20:43:23.332664] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 45/70. [D 20:43:23.332682] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.332692] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.332700] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:23.332714] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6844 [D 20:43:23.332723] element 0: offset: 0x64da70, size: 24 [D 20:43:23.332733] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 46/70. [D 20:43:23.337863] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6840 [D 20:43:23.337916] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 47/70. [D 20:43:23.339003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 45284. [D 20:43:23.339063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 45285. [D 20:43:23.339074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 45286. [D 20:43:23.339084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 45287. [D 20:43:23.339094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 45288. [D 20:43:23.339104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 45289. [D 20:43:23.339114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 45290. [D 20:43:23.339123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 45291. [D 20:43:23.339133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 45292. [D 20:43:23.339143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 45293. [D 20:43:23.339153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 45294. [D 20:43:23.339163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 45295. [D 20:43:23.339172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 45296. [D 20:43:23.339182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 45297. [D 20:43:23.339192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 45298. [D 20:43:23.339202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 45299. [D 20:43:23.339212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 45300. [D 20:43:23.339222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 45301. [D 20:43:23.339231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 45302. [D 20:43:23.339242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 45303. [D 20:43:23.339253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 45304. [D 20:43:23.339262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 45305. [D 20:43:23.339272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 45306. [D 20:43:23.339282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 45307. [D 20:43:23.339292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 45308. [D 20:43:23.339302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 45309. [D 20:43:23.339312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 45310. [D 20:43:23.339322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 45311. [D 20:43:23.339332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 45312. [D 20:43:23.339342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 45313. [D 20:43:23.339352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 45314. [D 20:43:23.339362] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 45315. [D 20:43:23.343367] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6844 [D 20:43:23.343403] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 48/70. [D 20:43:23.343433] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.343473] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.343482] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:23.343518] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6847 [D 20:43:23.343528] element 0: offset: 0x661d30, size: 24 [D 20:43:23.343542] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 49/70. [D 20:43:23.345666] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6841 [D 20:43:23.345685] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 50/70. [D 20:43:23.349432] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45315. [D 20:43:23.349454] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 51/70. [D 20:43:23.349474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 45315. [D 20:43:23.349485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 45316. [D 20:43:23.349494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 45317. [D 20:43:23.349504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 45318. [D 20:43:23.349514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 45319. [D 20:43:23.349524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 45320. [D 20:43:23.349534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 45321. [D 20:43:23.349543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 45322. [D 20:43:23.349553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 45323. [D 20:43:23.349563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 45324. [D 20:43:23.349572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 45325. [D 20:43:23.349582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 45326. [D 20:43:23.349592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 45327. [D 20:43:23.349602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 45328. [D 20:43:23.349611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 45329. [D 20:43:23.349621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 45330. [D 20:43:23.349631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 45331. [D 20:43:23.349641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 45332. [D 20:43:23.349650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 45333. [D 20:43:23.349660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 45334. [D 20:43:23.349670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 45335. [D 20:43:23.349679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 45336. [D 20:43:23.349689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 45337. [D 20:43:23.349699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 45338. [D 20:43:23.349708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 45339. [D 20:43:23.349718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 45340. [D 20:43:23.349728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 45341. [D 20:43:23.349737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 45342. [D 20:43:23.349747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 45343. [D 20:43:23.349758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 45344. [D 20:43:23.349768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 45345. [D 20:43:23.349778] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 45346. [D 20:43:23.349789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 45347. [D 20:43:23.349798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 45348. [D 20:43:23.349808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 45349. [D 20:43:23.349818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 45350. [D 20:43:23.349828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 45351. [D 20:43:23.349838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 45352. [D 20:43:23.349847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 45353. [D 20:43:23.349857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 45354. [D 20:43:23.349867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 45355. [D 20:43:23.349877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 45356. [D 20:43:23.349886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 45357. [D 20:43:23.349896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 45358. [D 20:43:23.349906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 45359. [D 20:43:23.349915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 45360. [D 20:43:23.349925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 45361. [D 20:43:23.349935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 45362. [D 20:43:23.349945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 45363. [D 20:43:23.349954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 45364. [D 20:43:23.349964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 45365. [D 20:43:23.349974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 45366. [D 20:43:23.349983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 45367. [D 20:43:23.349993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 45368. [D 20:43:23.350003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 45369. [D 20:43:23.350013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 45370. [D 20:43:23.350022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 45371. [D 20:43:23.350032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 45372. [D 20:43:23.350043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 45373. [D 20:43:23.350052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 45374. [D 20:43:23.350062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 45375. [D 20:43:23.350072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 45376. [D 20:43:23.350082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 45377. [D 20:43:23.350091] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209130 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 45378. [D 20:43:23.352071] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.352083] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.352091] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:23.354380] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6847 [D 20:43:23.354430] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 52/70. [D 20:43:23.361224] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 45378. [D 20:43:23.361242] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 53/70. [D 20:43:23.372781] openib_check_cq: completed rdma wr_id 2aaaab209130, nic_wr_credit 45377. [D 20:43:23.372796] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 54/70. [D 20:43:23.372836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45377. [D 20:43:23.372846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45378. [D 20:43:23.372856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45379. [D 20:43:23.372866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 45380. [D 20:43:23.372876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 45381. [D 20:43:23.372885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 45382. [D 20:43:23.372895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 45383. [D 20:43:23.372904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 45384. [D 20:43:23.372914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 45385. [D 20:43:23.372924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 45386. [D 20:43:23.372933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 45387. [D 20:43:23.372943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 45388. [D 20:43:23.372953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 45389. [D 20:43:23.372962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 45390. [D 20:43:23.372972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 45391. [D 20:43:23.372982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 45392. [D 20:43:23.372991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 45393. [D 20:43:23.373001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 45394. [D 20:43:23.373011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 45395. [D 20:43:23.373020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 45396. [D 20:43:23.373030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 45397. [D 20:43:23.373040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 45398. [D 20:43:23.373049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 45399. [D 20:43:23.373059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 45400. [D 20:43:23.373069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 45401. [D 20:43:23.373078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 45402. [D 20:43:23.373088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 45403. [D 20:43:23.373097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 45404. [D 20:43:23.373107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 45405. [D 20:43:23.373117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 45406. [D 20:43:23.373128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 45407. [D 20:43:23.373137] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 45408. [D 20:43:23.375439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.375449] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.375458] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:23.375473] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6850 [D 20:43:23.375483] element 0: offset: 0x691fe0, size: 24 [D 20:43:23.375492] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 55/70. [D 20:43:23.375508] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.375517] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.375525] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:23.375538] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.375547] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.375555] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:23.381917] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45408. [D 20:43:23.381932] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 56/70. [D 20:43:23.384194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.384205] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.384213] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:23.386389] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6850 [D 20:43:23.386443] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 57/70. [D 20:43:23.391825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 45408. [D 20:43:23.391843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 45409. [D 20:43:23.391853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 45410. [D 20:43:23.391863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 45411. [D 20:43:23.391873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 45412. [D 20:43:23.391883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 45413. [D 20:43:23.391892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 45414. [D 20:43:23.391902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 45415. [D 20:43:23.391912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 45416. [D 20:43:23.391922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 45417. [D 20:43:23.391931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 45418. [D 20:43:23.391941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 45419. [D 20:43:23.391951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 45420. [D 20:43:23.391960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 45421. [D 20:43:23.391970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 45422. [D 20:43:23.391980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 45423. [D 20:43:23.391989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 45424. [D 20:43:23.391999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 45425. [D 20:43:23.392011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 45426. [D 20:43:23.392022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 45427. [D 20:43:23.392032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 45428. [D 20:43:23.392041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 45429. [D 20:43:23.392051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 45430. [D 20:43:23.392061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 45431. [D 20:43:23.392071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 45432. [D 20:43:23.392080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 45433. [D 20:43:23.392090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 45434. [D 20:43:23.392100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 45435. [D 20:43:23.392110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 45436. [D 20:43:23.392119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 45437. [D 20:43:23.392130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 45438. [D 20:43:23.392140] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 45439. [D 20:43:23.394448] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.394458] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.394467] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:23.394481] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6853 [D 20:43:23.394491] element 0: offset: 0x655ed0, size: 24 [D 20:43:23.394501] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 58/70. [D 20:43:23.394515] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.394524] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.394532] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:23.394546] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6856 [D 20:43:23.394555] element 0: offset: 0x62aeb0, size: 24 [D 20:43:23.394564] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 59/70. [D 20:43:23.396012] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.396025] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.396034] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:23.396049] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6859 [D 20:43:23.396058] element 0: offset: 0x643630, size: 24 [D 20:43:23.397236] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 60/70. [D 20:43:23.397801] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45439. [D 20:43:23.397816] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 0/70. [D 20:43:23.400161] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.400172] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.400181] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:23.403033] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6853 [D 20:43:23.403090] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 1/70. [D 20:43:23.403488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 45439. [D 20:43:23.403547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 45440. [D 20:43:23.403558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 45441. [D 20:43:23.403567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 45442. [D 20:43:23.403577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 45443. [D 20:43:23.403587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 45444. [D 20:43:23.403597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 45445. [D 20:43:23.403606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 45446. [D 20:43:23.403616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 45447. [D 20:43:23.403626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 45448. [D 20:43:23.403636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 45449. [D 20:43:23.403645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 45450. [D 20:43:23.403655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 45451. [D 20:43:23.403665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 45452. [D 20:43:23.403674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 45453. [D 20:43:23.403684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 45454. [D 20:43:23.403694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 45455. [D 20:43:23.403703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 45456. [D 20:43:23.403713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 45457. [D 20:43:23.403723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 45458. [D 20:43:23.403732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 45459. [D 20:43:23.403742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 45460. [D 20:43:23.403751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 45461. [D 20:43:23.403761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 45462. [D 20:43:23.403771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 45463. [D 20:43:23.403781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 45464. [D 20:43:23.403791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 45465. [D 20:43:23.403800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 45466. [D 20:43:23.403810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 45467. [D 20:43:23.403821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 45468. [D 20:43:23.403831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 45469. [D 20:43:23.403840] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 45470. [D 20:43:23.407768] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6859 [D 20:43:23.407785] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 2/70. [D 20:43:23.408195] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6856 [D 20:43:23.408211] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 3/70. [D 20:43:23.415184] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45470. [D 20:43:23.415226] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 4/70. [D 20:43:23.415241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45470. [D 20:43:23.415252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45471. [D 20:43:23.415261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45472. [D 20:43:23.415271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 45473. [D 20:43:23.415281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 45474. [D 20:43:23.415291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 45475. [D 20:43:23.415300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 45476. [D 20:43:23.415310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 45477. [D 20:43:23.415320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 45478. [D 20:43:23.415329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 45479. [D 20:43:23.415339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 45480. [D 20:43:23.415348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 45481. [D 20:43:23.415358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 45482. [D 20:43:23.415368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 45483. [D 20:43:23.415378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 45484. [D 20:43:23.415387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 45485. [D 20:43:23.415397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 45486. [D 20:43:23.415407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 45487. [D 20:43:23.415416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 45488. [D 20:43:23.415426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 45489. [D 20:43:23.415436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 45490. [D 20:43:23.415445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 45491. [D 20:43:23.415455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 45492. [D 20:43:23.415464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 45493. [D 20:43:23.415474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 45494. [D 20:43:23.415484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 45495. [D 20:43:23.415493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 45496. [D 20:43:23.415503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 45497. [D 20:43:23.415513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 45498. [D 20:43:23.415523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 45499. [D 20:43:23.415533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 45500. [D 20:43:23.415543] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 45501. [D 20:43:23.415554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 45502. [D 20:43:23.415564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 45503. [D 20:43:23.415574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 45504. [D 20:43:23.415583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 45505. [D 20:43:23.415593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 45506. [D 20:43:23.415603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 45507. [D 20:43:23.415613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 45508. [D 20:43:23.415623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 45509. [D 20:43:23.415632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 45510. [D 20:43:23.415642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 45511. [D 20:43:23.415652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 45512. [D 20:43:23.415662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 45513. [D 20:43:23.415671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 45514. [D 20:43:23.415681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 45515. [D 20:43:23.415691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 45516. [D 20:43:23.415701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 45517. [D 20:43:23.415711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 45518. [D 20:43:23.415720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 45519. [D 20:43:23.415730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 45520. [D 20:43:23.415740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 45521. [D 20:43:23.415750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 45522. [D 20:43:23.415759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 45523. [D 20:43:23.415769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 45524. [D 20:43:23.415779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 45525. [D 20:43:23.415789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 45526. [D 20:43:23.415798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 45527. [D 20:43:23.415809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 45528. [D 20:43:23.415819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 45529. [D 20:43:23.415829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 45530. [D 20:43:23.415839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 45531. [D 20:43:23.415848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 45532. [D 20:43:23.415858] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209310 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 45533. [D 20:43:23.418193] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.418206] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.418214] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:23.423688] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 45533. [D 20:43:23.423703] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 5/70. [D 20:43:23.429611] openib_check_cq: completed rdma wr_id 2aaaab209310, nic_wr_credit 45532. [D 20:43:23.429627] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 6/70. [D 20:43:23.431871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.431881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.431889] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:23.431903] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.431912] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.431920] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:23.545397] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.545411] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.545420] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:23.545453] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6862 [D 20:43:23.545463] element 0: offset: 0x61f310, size: 24 [D 20:43:23.545474] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 7/70. [D 20:43:23.547817] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6862 [D 20:43:23.547869] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 8/70. [D 20:43:23.547925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 45532. [D 20:43:23.547943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 45533. [D 20:43:23.547953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 45534. [D 20:43:23.547963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 45535. [D 20:43:23.547973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 45536. [D 20:43:23.547983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 45537. [D 20:43:23.547993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 45538. [D 20:43:23.548003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 45539. [D 20:43:23.548013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 45540. [D 20:43:23.548026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 45541. [D 20:43:23.548036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 45542. [D 20:43:23.548049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 45543. [D 20:43:23.548059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 45544. [D 20:43:23.548069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 45545. [D 20:43:23.548079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 45546. [D 20:43:23.548089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 45547. [D 20:43:23.548099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 45548. [D 20:43:23.548109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 45549. [D 20:43:23.548119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 45550. [D 20:43:23.548129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 45551. [D 20:43:23.548139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 45552. [D 20:43:23.548149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 45553. [D 20:43:23.548158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 45554. [D 20:43:23.548168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 45555. [D 20:43:23.548178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 45556. [D 20:43:23.548188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 45557. [D 20:43:23.548198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 45558. [D 20:43:23.548208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 45559. [D 20:43:23.548218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 45560. [D 20:43:23.548228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 45561. [D 20:43:23.548239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 45562. [D 20:43:23.548249] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 45563. [D 20:43:23.553800] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45563. [D 20:43:23.553815] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 9/70. [D 20:43:23.556083] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.556093] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.556102] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:23.708039] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.708053] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.708062] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:23.708080] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6866 [D 20:43:23.708089] element 0: offset: 0x64da70, size: 24 [D 20:43:23.709238] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 10/70. [D 20:43:23.709254] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.709264] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.709272] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:23.709285] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6868 [D 20:43:23.709295] element 0: offset: 0x661d30, size: 24 [D 20:43:23.709304] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 11/70. [D 20:43:23.714286] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6866 [D 20:43:23.714341] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 12/70. [D 20:43:23.714362] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6868 [D 20:43:23.714373] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 13/70. [D 20:43:23.715951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 45563. [D 20:43:23.716004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 45564. [D 20:43:23.716014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 45565. [D 20:43:23.716024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 45566. [D 20:43:23.716039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 45567. [D 20:43:23.716048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 45568. [D 20:43:23.716058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 45569. [D 20:43:23.716073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 45570. [D 20:43:23.716084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 45571. [D 20:43:23.716093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 45572. [D 20:43:23.716103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 45573. [D 20:43:23.716113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 45574. [D 20:43:23.716123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 45575. [D 20:43:23.716132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 45576. [D 20:43:23.716142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 45577. [D 20:43:23.716152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 45578. [D 20:43:23.716162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 45579. [D 20:43:23.716172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 45580. [D 20:43:23.716182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 45581. [D 20:43:23.716191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 45582. [D 20:43:23.716201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 45583. [D 20:43:23.716211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 45584. [D 20:43:23.716221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 45585. [D 20:43:23.716230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 45586. [D 20:43:23.716240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 45587. [D 20:43:23.716250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 45588. [D 20:43:23.716260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 45589. [D 20:43:23.716270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 45590. [D 20:43:23.716279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 45591. [D 20:43:23.716291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 45592. [D 20:43:23.716301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 45593. [D 20:43:23.716311] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 45594. [D 20:43:23.716324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45595. [D 20:43:23.716334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45596. [D 20:43:23.716344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45597. [D 20:43:23.716354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 45598. [D 20:43:23.716363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 45599. [D 20:43:23.716373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 45600. [D 20:43:23.716383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 45601. [D 20:43:23.716393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 45602. [D 20:43:23.716403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 45603. [D 20:43:23.716413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 45604. [D 20:43:23.716423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 45605. [D 20:43:23.716432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 45606. [D 20:43:23.716443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 45607. [D 20:43:23.716452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 45608. [D 20:43:23.716462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 45609. [D 20:43:23.716472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 45610. [D 20:43:23.716482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 45611. [D 20:43:23.716492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 45612. [D 20:43:23.716502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 45613. [D 20:43:23.716512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 45614. [D 20:43:23.716521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 45615. [D 20:43:23.716531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 45616. [D 20:43:23.716541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 45617. [D 20:43:23.716551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 45618. [D 20:43:23.716561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 45619. [D 20:43:23.716571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 45620. [D 20:43:23.716581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 45621. [D 20:43:23.716591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 45622. [D 20:43:23.716601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 45623. [D 20:43:23.716610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 45624. [D 20:43:23.716621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 45625. [D 20:43:23.716630] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 45626. [D 20:43:23.720985] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.720998] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.721007] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:23.721040] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6871 [D 20:43:23.721051] element 0: offset: 0x5b0030, size: 24 [D 20:43:23.721063] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 14/70. [D 20:43:23.726176] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45626. [D 20:43:23.726194] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 15/70. [D 20:43:23.737814] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 45625. [D 20:43:23.737830] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 16/70. [D 20:43:23.740056] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.740066] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.740078] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:23.740132] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.740142] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.740150] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:23.742441] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6871 [D 20:43:23.742475] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 17/70. [D 20:43:23.745045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 45625. [D 20:43:23.745088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 45626. [D 20:43:23.745099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 45627. [D 20:43:23.745109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 45628. [D 20:43:23.745119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 45629. [D 20:43:23.745128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 45630. [D 20:43:23.745138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 45631. [D 20:43:23.745148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 45632. [D 20:43:23.745158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 45633. [D 20:43:23.745167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 45634. [D 20:43:23.745177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 45635. [D 20:43:23.745187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 45636. [D 20:43:23.745196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 45637. [D 20:43:23.745206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 45638. [D 20:43:23.745216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 45639. [D 20:43:23.745226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 45640. [D 20:43:23.745236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 45641. [D 20:43:23.745245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 45642. [D 20:43:23.745255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 45643. [D 20:43:23.745265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 45644. [D 20:43:23.745274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 45645. [D 20:43:23.745284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 45646. [D 20:43:23.745294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 45647. [D 20:43:23.745304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 45648. [D 20:43:23.745314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 45649. [D 20:43:23.745323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 45650. [D 20:43:23.745333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 45651. [D 20:43:23.745343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 45652. [D 20:43:23.745353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 45653. [D 20:43:23.745362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 45654. [D 20:43:23.745373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 45655. [D 20:43:23.745383] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 45656. [D 20:43:23.756560] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.756575] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.756584] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:23.756620] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6875 [D 20:43:23.756631] element 0: offset: 0x655ed0, size: 24 [D 20:43:23.756643] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 18/70. [D 20:43:23.756662] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.756671] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.756679] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:23.756693] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6877 [D 20:43:23.756702] element 0: offset: 0x643630, size: 24 [D 20:43:23.756711] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 19/70. [D 20:43:23.756893] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45656. [D 20:43:23.756909] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 20/70. [D 20:43:23.759253] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.759264] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.759272] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:23.761533] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6875 [D 20:43:23.761584] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 21/70. [D 20:43:23.761669] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6877 [D 20:43:23.761682] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 22/70. [D 20:43:23.762726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45656. [D 20:43:23.762769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45657. [D 20:43:23.762779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45658. [D 20:43:23.762789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 45659. [D 20:43:23.762799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 45660. [D 20:43:23.762809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 45661. [D 20:43:23.762819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 45662. [D 20:43:23.762828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 45663. [D 20:43:23.762838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 45664. [D 20:43:23.762848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 45665. [D 20:43:23.762858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 45666. [D 20:43:23.762868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 45667. [D 20:43:23.762877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 45668. [D 20:43:23.762887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 45669. [D 20:43:23.762897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 45670. [D 20:43:23.762906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 45671. [D 20:43:23.762916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 45672. [D 20:43:23.762926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 45673. [D 20:43:23.762936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 45674. [D 20:43:23.762946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 45675. [D 20:43:23.762955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 45676. [D 20:43:23.762965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 45677. [D 20:43:23.762975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 45678. [D 20:43:23.762984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 45679. [D 20:43:23.762994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 45680. [D 20:43:23.763004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 45681. [D 20:43:23.763014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 45682. [D 20:43:23.763025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 45683. [D 20:43:23.763035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 45684. [D 20:43:23.763044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 45685. [D 20:43:23.763054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 45686. [D 20:43:23.763064] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 45687. [D 20:43:23.763077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 45688. [D 20:43:23.763087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 45689. [D 20:43:23.763097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 45690. [D 20:43:23.763107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 45691. [D 20:43:23.763117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 45692. [D 20:43:23.763127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 45693. [D 20:43:23.763136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 45694. [D 20:43:23.763146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 45695. [D 20:43:23.763156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 45696. [D 20:43:23.763166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 45697. [D 20:43:23.763175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 45698. [D 20:43:23.763186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 45699. [D 20:43:23.763195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 45700. [D 20:43:23.763205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 45701. [D 20:43:23.763215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 45702. [D 20:43:23.763225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 45703. [D 20:43:23.763234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 45704. [D 20:43:23.763244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 45705. [D 20:43:23.763254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 45706. [D 20:43:23.763264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 45707. [D 20:43:23.763274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 45708. [D 20:43:23.763284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 45709. [D 20:43:23.763293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 45710. [D 20:43:23.763303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 45711. [D 20:43:23.763313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 45712. [D 20:43:23.763323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 45713. [D 20:43:23.763333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 45714. [D 20:43:23.763343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 45715. [D 20:43:23.763352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 45716. [D 20:43:23.763362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 45717. [D 20:43:23.763371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 45718. [D 20:43:23.763381] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 45719. [D 20:43:23.767907] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.767924] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.767938] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:23.767974] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6880 [D 20:43:23.768001] element 0: offset: 0x61f310, size: 24 [D 20:43:23.768017] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 23/70. [D 20:43:23.774437] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45719. [D 20:43:23.774454] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 24/70. [D 20:43:23.785987] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 45718. [D 20:43:23.786003] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 25/70. [D 20:43:23.788404] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.788418] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.788430] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:23.788493] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.788504] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.788513] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:23.790730] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6880 [D 20:43:23.790782] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 26/70. [D 20:43:23.791792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 45718. [D 20:43:23.791809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 45719. [D 20:43:23.791820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 45720. [D 20:43:23.791830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 45721. [D 20:43:23.791841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 45722. [D 20:43:23.791854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 45723. [D 20:43:23.791864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 45724. [D 20:43:23.791874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 45725. [D 20:43:23.791891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 45726. [D 20:43:23.791900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 45727. [D 20:43:23.791910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 45728. [D 20:43:23.791926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 45729. [D 20:43:23.791936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 45730. [D 20:43:23.791946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 45731. [D 20:43:23.791962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 45732. [D 20:43:23.791972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 45733. [D 20:43:23.791981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 45734. [D 20:43:23.791997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 45735. [D 20:43:23.792007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 45736. [D 20:43:23.792017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 45737. [D 20:43:23.792052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 45738. [D 20:43:23.792063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 45739. [D 20:43:23.792072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 45740. [D 20:43:23.792086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 45741. [D 20:43:23.792096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 45742. [D 20:43:23.792112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 45743. [D 20:43:23.792125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 45744. [D 20:43:23.792135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 45745. [D 20:43:23.792145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 45746. [D 20:43:23.792159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 45747. [D 20:43:23.792169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 45748. [D 20:43:23.792179] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 45749. [D 20:43:23.801193] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.801207] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.801216] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:23.801232] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6884 [D 20:43:23.801241] element 0: offset: 0x691fe0, size: 24 [D 20:43:23.801252] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 27/70. [D 20:43:23.801282] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.801291] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.801300] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:23.801314] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6886 [D 20:43:23.801323] element 0: offset: 0x64da70, size: 24 [D 20:43:23.801333] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 28/70. [D 20:43:23.803579] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45749. [D 20:43:23.803598] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 29/70. [D 20:43:23.803674] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.803688] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.803697] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:23.807801] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6884 [D 20:43:23.807820] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 30/70. [D 20:43:23.807836] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6886 [D 20:43:23.807846] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 31/70. [D 20:43:23.809520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45749. [D 20:43:23.809573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45750. [D 20:43:23.809585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45751. [D 20:43:23.809596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 45752. [D 20:43:23.809606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 45753. [D 20:43:23.809617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 45754. [D 20:43:23.809626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 45755. [D 20:43:23.809637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 45756. [D 20:43:23.809647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 45757. [D 20:43:23.809657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 45758. [D 20:43:23.809666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 45759. [D 20:43:23.809682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 45760. [D 20:43:23.809692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 45761. [D 20:43:23.809702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 45762. [D 20:43:23.809712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 45763. [D 20:43:23.809740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 45764. [D 20:43:23.809755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 45765. [D 20:43:23.809764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 45766. [D 20:43:23.809775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 45767. [D 20:43:23.809789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 45768. [D 20:43:23.809799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 45769. [D 20:43:23.809809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 45770. [D 20:43:23.809819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 45771. [D 20:43:23.809828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 45772. [D 20:43:23.809839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 45773. [D 20:43:23.809865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 45774. [D 20:43:23.809875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 45775. [D 20:43:23.809885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 45776. [D 20:43:23.809895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 45777. [D 20:43:23.809909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 45778. [D 20:43:23.809919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 45779. [D 20:43:23.809929] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 45780. [D 20:43:23.809943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 45781. [D 20:43:23.809953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 45782. [D 20:43:23.809963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 45783. [D 20:43:23.809975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 45784. [D 20:43:23.810007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 45785. [D 20:43:23.810017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 45786. [D 20:43:23.810030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 45787. [D 20:43:23.810040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 45788. [D 20:43:23.810063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 45789. [D 20:43:23.810073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 45790. [D 20:43:23.810089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 45791. [D 20:43:23.810099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 45792. [D 20:43:23.810109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 45793. [D 20:43:23.810120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 45794. [D 20:43:23.810143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 45795. [D 20:43:23.810158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 45796. [D 20:43:23.810170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 45797. [D 20:43:23.810180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 45798. [D 20:43:23.810190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 45799. [D 20:43:23.810200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 45800. [D 20:43:23.810210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 45801. [D 20:43:23.810220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 45802. [D 20:43:23.810252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 45803. [D 20:43:23.810262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 45804. [D 20:43:23.810274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 45805. [D 20:43:23.810284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 45806. [D 20:43:23.810294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 45807. [D 20:43:23.810306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 45808. [D 20:43:23.810317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 45809. [D 20:43:23.810326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 45810. [D 20:43:23.810337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 45811. [D 20:43:23.810362] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 45812. [D 20:43:23.814570] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.814585] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.814597] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:23.814630] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6889 [D 20:43:23.814641] element 0: offset: 0x655ed0, size: 24 [D 20:43:23.814656] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 32/70. [D 20:43:23.820702] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45812. [D 20:43:23.820718] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 33/70. [D 20:43:23.832332] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 45811. [D 20:43:23.832347] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 34/70. [D 20:43:23.834652] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.834666] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.834675] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:23.834691] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6891 [D 20:43:23.834704] element 0: offset: 0x632910, size: 24 [D 20:43:23.834713] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 35/70. [D 20:43:23.834742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.834752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.834761] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:23.834835] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.834848] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.834857] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:23.839393] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6891 [D 20:43:23.839451] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 36/70. [D 20:43:23.839471] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6889 [D 20:43:23.839482] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 37/70. [D 20:43:23.845239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 45811. [D 20:43:23.845301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 45812. [D 20:43:23.845312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 45813. [D 20:43:23.845323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 45814. [D 20:43:23.845339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 45815. [D 20:43:23.845350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 45816. [D 20:43:23.845360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 45817. [D 20:43:23.845370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 45818. [D 20:43:23.845380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 45819. [D 20:43:23.845390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 45820. [D 20:43:23.845400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 45821. [D 20:43:23.845418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 45822. [D 20:43:23.845428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 45823. [D 20:43:23.845437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 45824. [D 20:43:23.845447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 45825. [D 20:43:23.845457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 45826. [D 20:43:23.845467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 45827. [D 20:43:23.845477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 45828. [D 20:43:23.845487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 45829. [D 20:43:23.845502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 45830. [D 20:43:23.845512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 45831. [D 20:43:23.845522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 45832. [D 20:43:23.845563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 45833. [D 20:43:23.845573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 45834. [D 20:43:23.845588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 45835. [D 20:43:23.845598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 45836. [D 20:43:23.845610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 45837. [D 20:43:23.845625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 45838. [D 20:43:23.845635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 45839. [D 20:43:23.845645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 45840. [D 20:43:23.845677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 45841. [D 20:43:23.845688] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 45842. [D 20:43:23.845702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 45843. [D 20:43:23.845712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 45844. [D 20:43:23.845726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 45845. [D 20:43:23.845736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 45846. [D 20:43:23.845746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 45847. [D 20:43:23.845762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 45848. [D 20:43:23.845788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 45849. [D 20:43:23.845799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 45850. [D 20:43:23.845808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 45851. [D 20:43:23.845819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 45852. [D 20:43:23.845830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 45853. [D 20:43:23.845840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 45854. [D 20:43:23.845850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 45855. [D 20:43:23.845884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 45856. [D 20:43:23.845899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 45857. [D 20:43:23.845909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 45858. [D 20:43:23.845919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 45859. [D 20:43:23.845935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 45860. [D 20:43:23.845945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 45861. [D 20:43:23.845955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 45862. [D 20:43:23.845970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 45863. [D 20:43:23.845980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 45864. [D 20:43:23.845990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 45865. [D 20:43:23.846018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 45866. [D 20:43:23.846028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 45867. [D 20:43:23.846042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 45868. [D 20:43:23.846052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 45869. [D 20:43:23.846061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 45870. [D 20:43:23.846091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 45871. [D 20:43:23.846101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 45872. [D 20:43:23.846112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 45873. [D 20:43:23.846122] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 45874. [D 20:43:23.850394] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.850410] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.850421] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:23.850454] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6895 [D 20:43:23.850465] element 0: offset: 0x62ae30, size: 24 [D 20:43:23.850480] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 38/70. [D 20:43:23.856961] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45874. [D 20:43:23.856976] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 39/70. [D 20:43:23.865098] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 45873. [D 20:43:23.865112] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 40/70. [D 20:43:23.867467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.867480] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.867489] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:23.867543] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.867555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.867565] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:23.869831] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6895 [D 20:43:23.869888] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 41/70. [D 20:43:23.870072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45873. [D 20:43:23.870089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45874. [D 20:43:23.870100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45875. [D 20:43:23.870110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 45876. [D 20:43:23.870121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 45877. [D 20:43:23.870131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 45878. [D 20:43:23.870141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 45879. [D 20:43:23.870151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 45880. [D 20:43:23.870167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 45881. [D 20:43:23.870177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 45882. [D 20:43:23.870187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 45883. [D 20:43:23.870197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 45884. [D 20:43:23.870232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 45885. [D 20:43:23.870242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 45886. [D 20:43:23.870252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 45887. [D 20:43:23.870263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 45888. [D 20:43:23.870273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 45889. [D 20:43:23.870283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 45890. [D 20:43:23.870293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 45891. [D 20:43:23.870302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 45892. [D 20:43:23.870322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 45893. [D 20:43:23.870332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 45894. [D 20:43:23.870342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 45895. [D 20:43:23.870352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 45896. [D 20:43:23.870362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 45897. [D 20:43:23.870372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 45898. [D 20:43:23.870382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 45899. [D 20:43:23.870407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 45900. [D 20:43:23.870417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 45901. [D 20:43:23.870427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 45902. [D 20:43:23.870437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 45903. [D 20:43:23.870447] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 45904. [D 20:43:23.875979] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45904. [D 20:43:23.875993] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 42/70. [D 20:43:23.878291] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.878304] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.878315] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:23.880943] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.880957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.880967] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:23.880982] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6898 [D 20:43:23.880992] element 0: offset: 0x691fe0, size: 24 [D 20:43:23.881002] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 43/70. [D 20:43:23.881016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.881029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.881038] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:23.883327] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6901 [D 20:43:23.883338] element 0: offset: 0x64da70, size: 24 [D 20:43:23.883347] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 44/70. [D 20:43:23.888297] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6901 [D 20:43:23.888353] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 45/70. [D 20:43:23.888420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 45904. [D 20:43:23.888489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 45905. [D 20:43:23.888501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 45906. [D 20:43:23.888512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 45907. [D 20:43:23.888522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 45908. [D 20:43:23.888532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 45909. [D 20:43:23.888551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 45910. [D 20:43:23.888561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 45911. [D 20:43:23.888571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 45912. [D 20:43:23.888581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 45913. [D 20:43:23.888591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 45914. [D 20:43:23.888601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 45915. [D 20:43:23.888611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 45916. [D 20:43:23.888661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 45917. [D 20:43:23.888671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 45918. [D 20:43:23.888683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 45919. [D 20:43:23.888693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 45920. [D 20:43:23.888703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 45921. [D 20:43:23.888713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 45922. [D 20:43:23.888723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 45923. [D 20:43:23.888739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 45924. [D 20:43:23.888752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 45925. [D 20:43:23.888762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 45926. [D 20:43:23.888771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 45927. [D 20:43:23.888782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 45928. [D 20:43:23.888794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 45929. [D 20:43:23.888820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 45930. [D 20:43:23.888833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 45931. [D 20:43:23.888843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 45932. [D 20:43:23.888853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 45933. [D 20:43:23.888869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 45934. [D 20:43:23.888879] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 45935. [D 20:43:23.888956] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6898 [D 20:43:23.888975] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 46/70. [D 20:43:23.894342] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45935. [D 20:43:23.894361] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 47/70. [D 20:43:23.894373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 45935. [D 20:43:23.894383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 45936. [D 20:43:23.894398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 45937. [D 20:43:23.894409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 45938. [D 20:43:23.894419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 45939. [D 20:43:23.894429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 45940. [D 20:43:23.894439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 45941. [D 20:43:23.894449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 45942. [D 20:43:23.894459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 45943. [D 20:43:23.894469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 45944. [D 20:43:23.894479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 45945. [D 20:43:23.894489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 45946. [D 20:43:23.894499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 45947. [D 20:43:23.894527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 45948. [D 20:43:23.894538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 45949. [D 20:43:23.894548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 45950. [D 20:43:23.894559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 45951. [D 20:43:23.894569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 45952. [D 20:43:23.894579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 45953. [D 20:43:23.894602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 45954. [D 20:43:23.894612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 45955. [D 20:43:23.894626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 45956. [D 20:43:23.894636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 45957. [D 20:43:23.894646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 45958. [D 20:43:23.894669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 45959. [D 20:43:23.894679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 45960. [D 20:43:23.894689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 45961. [D 20:43:23.894700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 45962. [D 20:43:23.894710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 45963. [D 20:43:23.894720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 45964. [D 20:43:23.894744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 45965. [D 20:43:23.894755] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 45966. [D 20:43:23.894823] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.894839] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.894848] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:23.900241] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 45966. [D 20:43:23.900255] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 48/70. [D 20:43:23.902380] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.902393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.902403] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:23.976434] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:23.976448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.976459] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:23.976491] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6904 [D 20:43:23.976502] element 0: offset: 0x643630, size: 24 [D 20:43:23.976517] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 49/70. [D 20:43:23.980776] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6904 [D 20:43:23.980795] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 50/70. [D 20:43:23.980855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 45966. [D 20:43:23.980948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 45967. [D 20:43:23.980962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 45968. [D 20:43:23.980973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 45969. [D 20:43:23.980984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 45970. [D 20:43:23.980994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 45971. [D 20:43:23.981004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 45972. [D 20:43:23.981014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 45973. [D 20:43:23.981038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 45974. [D 20:43:23.981048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 45975. [D 20:43:23.981058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 45976. [D 20:43:23.981087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 45977. [D 20:43:23.981098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 45978. [D 20:43:23.981119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 45979. [D 20:43:23.981130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 45980. [D 20:43:23.981141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 45981. [D 20:43:23.981163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 45982. [D 20:43:23.981174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 45983. [D 20:43:23.981184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 45984. [D 20:43:23.981195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 45985. [D 20:43:23.981214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 45986. [D 20:43:23.981224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 45987. [D 20:43:23.981234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 45988. [D 20:43:23.981259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 45989. [D 20:43:23.981269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 45990. [D 20:43:23.981279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 45991. [D 20:43:23.981290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 45992. [D 20:43:23.981311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 45993. [D 20:43:23.981321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 45994. [D 20:43:23.981347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 45995. [D 20:43:23.981358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 45996. [D 20:43:23.981368] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 45997. [D 20:43:23.986848] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 45997. [D 20:43:23.986865] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 51/70. [D 20:43:23.989160] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:23.989175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:23.989186] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:24.150054] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.150069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.150080] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:24.150111] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6907 [D 20:43:24.150122] element 0: offset: 0x62aeb0, size: 24 [D 20:43:24.150134] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 52/70. [D 20:43:24.152408] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6907 [D 20:43:24.152462] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 53/70. [D 20:43:24.152509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 45997. [D 20:43:24.152531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 45998. [D 20:43:24.152543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 45999. [D 20:43:24.152553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 46000. [D 20:43:24.152563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 46001. [D 20:43:24.152573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 46002. [D 20:43:24.152583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 46003. [D 20:43:24.152593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 46004. [D 20:43:24.152604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 46005. [D 20:43:24.152620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 46006. [D 20:43:24.152630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 46007. [D 20:43:24.152640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 46008. [D 20:43:24.152650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 46009. [D 20:43:24.152670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 46010. [D 20:43:24.152680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 46011. [D 20:43:24.152690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 46012. [D 20:43:24.152700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 46013. [D 20:43:24.152710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 46014. [D 20:43:24.152720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 46015. [D 20:43:24.152730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 46016. [D 20:43:24.152754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 46017. [D 20:43:24.152764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 46018. [D 20:43:24.152774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 46019. [D 20:43:24.152784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 46020. [D 20:43:24.152802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 46021. [D 20:43:24.152826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 46022. [D 20:43:24.152841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 46023. [D 20:43:24.152851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 46024. [D 20:43:24.152867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 46025. [D 20:43:24.152877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 46026. [D 20:43:24.152887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 46027. [D 20:43:24.152898] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 46028. [D 20:43:24.158891] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46028. [D 20:43:24.158905] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 54/70. [D 20:43:24.161258] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.161271] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.161282] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:24.190021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.190035] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.190045] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:24.190060] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6910 [D 20:43:24.190070] element 0: offset: 0x655ed0, size: 24 [D 20:43:24.190080] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 55/70. [D 20:43:24.190095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.190110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.190119] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:24.192411] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6913 [D 20:43:24.192423] element 0: offset: 0x5b0030, size: 24 [D 20:43:24.192432] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 56/70. [D 20:43:24.194376] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6910 [D 20:43:24.194397] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 57/70. [D 20:43:24.194536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 46028. [D 20:43:24.194593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 46029. [D 20:43:24.194605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 46030. [D 20:43:24.194616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 46031. [D 20:43:24.194630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 46032. [D 20:43:24.194640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 46033. [D 20:43:24.194650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 46034. [D 20:43:24.194663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 46035. [D 20:43:24.194673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 46036. [D 20:43:24.194683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 46037. [D 20:43:24.194699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 46038. [D 20:43:24.194708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 46039. [D 20:43:24.194718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 46040. [D 20:43:24.194734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 46041. [D 20:43:24.194744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 46042. [D 20:43:24.194753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 46043. [D 20:43:24.194798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 46044. [D 20:43:24.194809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 46045. [D 20:43:24.194818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 46046. [D 20:43:24.194829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 46047. [D 20:43:24.194839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 46048. [D 20:43:24.194849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 46049. [D 20:43:24.194859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 46050. [D 20:43:24.194870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 46051. [D 20:43:24.194896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 46052. [D 20:43:24.194906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 46053. [D 20:43:24.194916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 46054. [D 20:43:24.194985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 46055. [D 20:43:24.194997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 46056. [D 20:43:24.195025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 46057. [D 20:43:24.195035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 46058. [D 20:43:24.195045] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 46059. [D 20:43:24.197064] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6913 [D 20:43:24.197122] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.197145] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.197155] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.197187] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6916 [D 20:43:24.197199] element 0: offset: 0x61f310, size: 24 [D 20:43:24.197123] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 58/70. [D 20:43:24.197242] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 59/70. [D 20:43:24.206209] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46059. [D 20:43:24.206225] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 60/70. [D 20:43:24.206252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 46059. [D 20:43:24.206265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 46060. [D 20:43:24.206275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 46061. [D 20:43:24.206285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 46062. [D 20:43:24.206296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 46063. [D 20:43:24.206306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 46064. [D 20:43:24.206316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 46065. [D 20:43:24.206326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 46066. [D 20:43:24.206336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 46067. [D 20:43:24.206346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 46068. [D 20:43:24.206363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 46069. [D 20:43:24.206373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 46070. [D 20:43:24.206383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 46071. [D 20:43:24.206394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 46072. [D 20:43:24.206405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 46073. [D 20:43:24.206415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 46074. [D 20:43:24.208507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 46075. [D 20:43:24.208525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 46076. [D 20:43:24.208536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 46077. [D 20:43:24.208558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 46078. [D 20:43:24.208571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 46079. [D 20:43:24.208581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 46080. [D 20:43:24.208451] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6916 [D 20:43:24.208600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 46081. [D 20:43:24.208611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 46082. [D 20:43:24.208621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 46083. [D 20:43:24.208631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 46084. [D 20:43:24.208641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 46085. [D 20:43:24.208680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 46086. [D 20:43:24.208692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 46087. [D 20:43:24.208701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 46088. [D 20:43:24.208712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 46089. [D 20:43:24.208722] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 46090. [D 20:43:24.208770] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 0/70. [D 20:43:24.208834] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.208849] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.208875] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.216546] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.216561] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.216572] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.216603] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6918 [D 20:43:24.216614] element 0: offset: 0x643630, size: 24 [D 20:43:24.216627] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 1/70. [D 20:43:24.217916] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 46090. [D 20:43:24.217930] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 2/70. [D 20:43:24.217968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 46090. [D 20:43:24.217980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 46091. [D 20:43:24.217992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 46092. [D 20:43:24.218002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 46093. [D 20:43:24.218013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 46094. [D 20:43:24.218024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 46095. [D 20:43:24.218034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 46096. [D 20:43:24.218044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 46097. [D 20:43:24.218054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 46098. [D 20:43:24.218064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 46099. [D 20:43:24.218167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 46100. [D 20:43:24.218179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 46101. [D 20:43:24.218189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 46102. [D 20:43:24.218199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 46103. [D 20:43:24.218209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 46104. [D 20:43:24.218219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 46105. [D 20:43:24.218229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 46106. [D 20:43:24.218241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 46107. [D 20:43:24.218251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 46108. [D 20:43:24.218261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 46109. [D 20:43:24.218271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 46110. [D 20:43:24.218281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 46111. [D 20:43:24.218291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 46112. [D 20:43:24.218301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 46113. [D 20:43:24.218311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 46114. [D 20:43:24.218321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 46115. [D 20:43:24.218331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 46116. [D 20:43:24.218341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 46117. [D 20:43:24.218351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 46118. [D 20:43:24.218361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 46119. [D 20:43:24.218371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 46120. [D 20:43:24.218381] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 46121. [D 20:43:24.218410] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.218420] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.218429] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.220649] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6918 [D 20:43:24.220665] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 3/70. [D 20:43:24.228956] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.228972] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.228983] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.228998] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6922 [D 20:43:24.229008] element 0: offset: 0x62aeb0, size: 24 [D 20:43:24.229019] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 4/70. [D 20:43:24.229755] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46121. [D 20:43:24.229768] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 5/70. [D 20:43:24.229813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 46121. [D 20:43:24.229824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 46122. [D 20:43:24.229835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 46123. [D 20:43:24.229845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 46124. [D 20:43:24.229856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 46125. [D 20:43:24.229867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 46126. [D 20:43:24.229877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 46127. [D 20:43:24.229888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 46128. [D 20:43:24.229897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 46129. [D 20:43:24.229907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 46130. [D 20:43:24.229917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 46131. [D 20:43:24.229934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 46132. [D 20:43:24.229944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 46133. [D 20:43:24.229954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 46134. [D 20:43:24.229964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 46135. [D 20:43:24.229975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 46136. [D 20:43:24.229985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 46137. [D 20:43:24.229996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 46138. [D 20:43:24.230038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 46139. [D 20:43:24.230048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 46140. [D 20:43:24.230058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 46141. [D 20:43:24.230075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 46142. [D 20:43:24.230085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 46143. [D 20:43:24.230095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 46144. [D 20:43:24.230106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 46145. [D 20:43:24.230116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 46146. [D 20:43:24.230126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 46147. [D 20:43:24.230187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 46148. [D 20:43:24.230199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 46149. [D 20:43:24.230209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 46150. [D 20:43:24.230220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 46151. [D 20:43:24.230230] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 46152. [D 20:43:24.230272] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.230283] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.230294] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.234254] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6922 [D 20:43:24.234769] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 6/70. [D 20:43:24.240573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.240590] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.240601] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.240634] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6925 [D 20:43:24.240646] element 0: offset: 0x648e30, size: 24 [D 20:43:24.240657] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 7/70. [D 20:43:24.241470] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 46152. [D 20:43:24.241486] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 8/70. [D 20:43:24.241522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 46152. [D 20:43:24.241534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 46153. [D 20:43:24.241545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 46154. [D 20:43:24.241555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 46155. [D 20:43:24.241565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 46156. [D 20:43:24.241580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 46157. [D 20:43:24.241590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 46158. [D 20:43:24.241599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 46159. [D 20:43:24.241615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 46160. [D 20:43:24.241625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 46161. [D 20:43:24.241635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 46162. [D 20:43:24.241650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 46163. [D 20:43:24.241660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 46164. [D 20:43:24.241670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 46165. [D 20:43:24.241685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 46166. [D 20:43:24.241695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 46167. [D 20:43:24.241705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 46168. [D 20:43:24.241721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 46169. [D 20:43:24.241731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 46170. [D 20:43:24.241740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 46171. [D 20:43:24.241756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 46172. [D 20:43:24.241784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 46173. [D 20:43:24.241795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 46174. [D 20:43:24.241806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 46175. [D 20:43:24.241815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 46176. [D 20:43:24.241826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 46177. [D 20:43:24.241836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 46178. [D 20:43:24.241846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 46179. [D 20:43:24.241856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 46180. [D 20:43:24.241873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 46181. [D 20:43:24.241883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 46182. [D 20:43:24.241893] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 46183. [D 20:43:24.244313] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.244327] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.244337] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.246655] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6925 [D 20:43:24.246669] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 9/70. [D 20:43:24.252190] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.252204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.252216] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.252230] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6927 [D 20:43:24.252240] element 0: offset: 0x632910, size: 24 [D 20:43:24.252251] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 10/70. [D 20:43:24.253202] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46183. [D 20:43:24.253216] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 11/70. [D 20:43:24.253248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 46183. [D 20:43:24.253260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 46184. [D 20:43:24.253307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 46185. [D 20:43:24.253319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 46186. [D 20:43:24.253329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 46187. [D 20:43:24.253339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 46188. [D 20:43:24.253350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 46189. [D 20:43:24.253360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 46190. [D 20:43:24.253371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 46191. [D 20:43:24.253380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 46192. [D 20:43:24.253391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 46193. [D 20:43:24.253400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 46194. [D 20:43:24.253419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 46195. [D 20:43:24.253429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 46196. [D 20:43:24.253464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 46197. [D 20:43:24.253476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 46198. [D 20:43:24.253486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 46199. [D 20:43:24.253496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 46200. [D 20:43:24.253506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 46201. [D 20:43:24.253516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 46202. [D 20:43:24.253526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 46203. [D 20:43:24.253536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 46204. [D 20:43:24.253546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 46205. [D 20:43:24.253556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 46206. [D 20:43:24.253587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 46207. [D 20:43:24.253598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 46208. [D 20:43:24.253609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 46209. [D 20:43:24.253619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 46210. [D 20:43:24.253632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 46211. [D 20:43:24.253646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 46212. [D 20:43:24.253656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 46213. [D 20:43:24.253666] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 46214. [D 20:43:24.253699] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.253726] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.253735] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.258032] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6927 [D 20:43:24.258092] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 12/70. [D 20:43:24.264087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.264104] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.264115] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.264149] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6931 [D 20:43:24.264160] element 0: offset: 0x691fe0, size: 24 [D 20:43:24.264177] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 13/70. [D 20:43:24.264997] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 46214. [D 20:43:24.265013] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 14/70. [D 20:43:24.265050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 46214. [D 20:43:24.265062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 46215. [D 20:43:24.265075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 46216. [D 20:43:24.265085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 46217. [D 20:43:24.265095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 46218. [D 20:43:24.265105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 46219. [D 20:43:24.265115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 46220. [D 20:43:24.265187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 46221. [D 20:43:24.265199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 46222. [D 20:43:24.265209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 46223. [D 20:43:24.265219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 46224. [D 20:43:24.265229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 46225. [D 20:43:24.265269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 46226. [D 20:43:24.265279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 46227. [D 20:43:24.265289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 46228. [D 20:43:24.265299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 46229. [D 20:43:24.265309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 46230. [D 20:43:24.265319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 46231. [D 20:43:24.265329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 46232. [D 20:43:24.265339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 46233. [D 20:43:24.265349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 46234. [D 20:43:24.265359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 46235. [D 20:43:24.265368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 46236. [D 20:43:24.265378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 46237. [D 20:43:24.265388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 46238. [D 20:43:24.265398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 46239. [D 20:43:24.265408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 46240. [D 20:43:24.265418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 46241. [D 20:43:24.265428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 46242. [D 20:43:24.265438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 46243. [D 20:43:24.265448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 46244. [D 20:43:24.265458] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 46245. [D 20:43:24.265498] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.265509] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.265517] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.267356] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6931 [D 20:43:24.267765] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 15/70. [D 20:43:24.275803] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.275816] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.275828] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.275842] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6934 [D 20:43:24.275856] element 0: offset: 0x5b0030, size: 24 [D 20:43:24.275866] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 16/70. [D 20:43:24.276729] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46245. [D 20:43:24.276742] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 17/70. [D 20:43:24.276780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 46245. [D 20:43:24.276792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 46246. [D 20:43:24.276802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 46247. [D 20:43:24.276812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 46248. [D 20:43:24.276822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 46249. [D 20:43:24.276838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 46250. [D 20:43:24.276848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 46251. [D 20:43:24.276858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 46252. [D 20:43:24.276874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 46253. [D 20:43:24.276884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 46254. [D 20:43:24.276894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 46255. [D 20:43:24.276910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 46256. [D 20:43:24.276920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 46257. [D 20:43:24.276930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 46258. [D 20:43:24.276973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 46259. [D 20:43:24.276984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 46260. [D 20:43:24.276993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 46261. [D 20:43:24.277004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 46262. [D 20:43:24.277014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 46263. [D 20:43:24.277024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 46264. [D 20:43:24.277035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 46265. [D 20:43:24.277045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 46266. [D 20:43:24.277055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 46267. [D 20:43:24.277065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 46268. [D 20:43:24.277094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 46269. [D 20:43:24.277104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 46270. [D 20:43:24.277114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 46271. [D 20:43:24.277124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 46272. [D 20:43:24.277134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 46273. [D 20:43:24.277180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 46274. [D 20:43:24.277192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 46275. [D 20:43:24.277202] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 46276. [D 20:43:24.277249] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.277260] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.277268] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.281412] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 6934 [D 20:43:24.281474] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 18/70. [D 20:43:24.287311] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.287327] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.287338] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.287370] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6936 [D 20:43:24.287381] element 0: offset: 0x64da70, size: 24 [D 20:43:24.287392] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 19/70. [D 20:43:24.288462] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 46276. [D 20:43:24.288478] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 20/70. [D 20:43:24.288507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 46276. [D 20:43:24.288519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 46277. [D 20:43:24.288530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 46278. [D 20:43:24.288542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 46279. [D 20:43:24.288552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 46280. [D 20:43:24.288565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 46281. [D 20:43:24.288579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 46282. [D 20:43:24.288589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 46283. [D 20:43:24.288599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 46284. [D 20:43:24.288614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 46285. [D 20:43:24.288625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 46286. [D 20:43:24.288634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 46287. [D 20:43:24.288650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 46288. [D 20:43:24.288659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 46289. [D 20:43:24.288670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 46290. [D 20:43:24.288709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 46291. [D 20:43:24.288723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 46292. [D 20:43:24.288732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 46293. [D 20:43:24.288743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 46294. [D 20:43:24.288753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 46295. [D 20:43:24.288763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 46296. [D 20:43:24.288773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 46297. [D 20:43:24.288784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 46298. [D 20:43:24.288794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 46299. [D 20:43:24.288804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 46300. [D 20:43:24.288839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 46301. [D 20:43:24.288850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 46302. [D 20:43:24.288861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 46303. [D 20:43:24.288870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 46304. [D 20:43:24.288886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 46305. [D 20:43:24.288896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 46306. [D 20:43:24.288906] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 46307. [D 20:43:24.291281] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.291295] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.291304] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.293248] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6936 [D 20:43:24.293270] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 21/70. [D 20:43:24.299702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.299716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.299727] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.299741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6940 [D 20:43:24.299751] element 0: offset: 0x655ed0, size: 24 [D 20:43:24.299762] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 22/70. [D 20:43:24.300241] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46307. [D 20:43:24.300256] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 23/70. [D 20:43:24.300290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 46307. [D 20:43:24.300302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 46308. [D 20:43:24.300312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 46309. [D 20:43:24.300325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 46310. [D 20:43:24.300336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 46311. [D 20:43:24.300349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 46312. [D 20:43:24.300377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 46313. [D 20:43:24.300388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 46314. [D 20:43:24.300399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 46315. [D 20:43:24.300410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 46316. [D 20:43:24.300422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 46317. [D 20:43:24.300437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 46318. [D 20:43:24.300446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 46319. [D 20:43:24.300471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 46320. [D 20:43:24.300481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 46321. [D 20:43:24.300491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 46322. [D 20:43:24.300518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 46323. [D 20:43:24.300529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 46324. [D 20:43:24.300541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 46325. [D 20:43:24.300551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 46326. [D 20:43:24.300608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 46327. [D 20:43:24.300622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 46328. [D 20:43:24.300632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 46329. [D 20:43:24.300647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 46330. [D 20:43:24.300670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 46331. [D 20:43:24.300683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 46332. [D 20:43:24.300692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 46333. [D 20:43:24.302707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 46334. [D 20:43:24.302724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 46335. [D 20:43:24.302734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 46336. [D 20:43:24.302745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 46337. [D 20:43:24.302755] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 46338. [D 20:43:24.302847] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.302862] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.302871] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.302660] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6940 [D 20:43:24.305089] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 24/70. [D 20:43:24.309239] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 46338. [D 20:43:24.309254] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 25/70. [D 20:43:24.309266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 46338. [D 20:43:24.309277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 46339. [D 20:43:24.309288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 46340. [D 20:43:24.309298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 46341. [D 20:43:24.309308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 46342. [D 20:43:24.309319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 46343. [D 20:43:24.309329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 46344. [D 20:43:24.309339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 46345. [D 20:43:24.309349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 46346. [D 20:43:24.309366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 46347. [D 20:43:24.309376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 46348. [D 20:43:24.309386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 46349. [D 20:43:24.309396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 46350. [D 20:43:24.309414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 46351. [D 20:43:24.309424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 46352. [D 20:43:24.309434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 46353. [D 20:43:24.309452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 46354. [D 20:43:24.309462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 46355. [D 20:43:24.309472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 46356. [D 20:43:24.309482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 46357. [D 20:43:24.309493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 46358. [D 20:43:24.309516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 46359. [D 20:43:24.309530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 46360. [D 20:43:24.309540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 46361. [D 20:43:24.309550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 46362. [D 20:43:24.309560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 46363. [D 20:43:24.309584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 46364. [D 20:43:24.309595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 46365. [D 20:43:24.309606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 46366. [D 20:43:24.309616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 46367. [D 20:43:24.309626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 46368. [D 20:43:24.309636] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 46369. [D 20:43:24.311945] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.311958] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.311968] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:24.315144] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46369. [D 20:43:24.315158] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 26/70. [D 20:43:24.317428] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.317442] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.317452] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:24.327647] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.327662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.327673] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:24.327702] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6943 [D 20:43:24.327714] element 0: offset: 0x61f310, size: 24 [D 20:43:24.327726] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 27/70. [D 20:43:24.330084] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6943 [D 20:43:24.330101] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 28/70. [D 20:43:24.330150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 46369. [D 20:43:24.330161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 46370. [D 20:43:24.330171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 46371. [D 20:43:24.330181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 46372. [D 20:43:24.330197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 46373. [D 20:43:24.330208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 46374. [D 20:43:24.330218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 46375. [D 20:43:24.330228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 46376. [D 20:43:24.330239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 46377. [D 20:43:24.330249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 46378. [D 20:43:24.330259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 46379. [D 20:43:24.330283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 46380. [D 20:43:24.330293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 46381. [D 20:43:24.330303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 46382. [D 20:43:24.330313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 46383. [D 20:43:24.330323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 46384. [D 20:43:24.330336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 46385. [D 20:43:24.330345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 46386. [D 20:43:24.330355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 46387. [D 20:43:24.330366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 46388. [D 20:43:24.330390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 46389. [D 20:43:24.330400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 46390. [D 20:43:24.330416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 46391. [D 20:43:24.330426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 46392. [D 20:43:24.330436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 46393. [D 20:43:24.330451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 46394. [D 20:43:24.330461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 46395. [D 20:43:24.330471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 46396. [D 20:43:24.330498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 46397. [D 20:43:24.330508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 46398. [D 20:43:24.330532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 46399. [D 20:43:24.330542] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 46400. [D 20:43:24.336024] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46400. [D 20:43:24.336037] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 29/70. [D 20:43:24.338298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.338312] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.338321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:24.437632] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.437646] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.437657] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:24.437672] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6946 [D 20:43:24.437682] element 0: offset: 0x648e30, size: 24 [D 20:43:24.437691] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 30/70. [D 20:43:24.439685] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6946 [D 20:43:24.439735] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 31/70. [D 20:43:24.439795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 46400. [D 20:43:24.439860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 46401. [D 20:43:24.439872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 46402. [D 20:43:24.439883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 46403. [D 20:43:24.439892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 46404. [D 20:43:24.439908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 46405. [D 20:43:24.439918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 46406. [D 20:43:24.439928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 46407. [D 20:43:24.439943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 46408. [D 20:43:24.439953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 46409. [D 20:43:24.439963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 46410. [D 20:43:24.440001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 46411. [D 20:43:24.440011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 46412. [D 20:43:24.440021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 46413. [D 20:43:24.440035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 46414. [D 20:43:24.440057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 46415. [D 20:43:24.440071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 46416. [D 20:43:24.440106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 46417. [D 20:43:24.440128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 46418. [D 20:43:24.440138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 46419. [D 20:43:24.440159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 46420. [D 20:43:24.440169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 46421. [D 20:43:24.440190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 46422. [D 20:43:24.440208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 46423. [D 20:43:24.440217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 46424. [D 20:43:24.440229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 46425. [D 20:43:24.440239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 46426. [D 20:43:24.440249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 46427. [D 20:43:24.440275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 46428. [D 20:43:24.440296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 46429. [D 20:43:24.440306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 46430. [D 20:43:24.440328] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 46431. [D 20:43:24.445723] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46431. [D 20:43:24.445740] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 32/70. [D 20:43:24.448046] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.448061] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.448071] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:24.580102] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.580117] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.580126] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:24.580162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6948 [D 20:43:24.580173] element 0: offset: 0x5b0030, size: 24 [D 20:43:24.581795] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 33/70. [D 20:43:24.582027] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.582040] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.582049] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:24.582064] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6952 [D 20:43:24.582073] element 0: offset: 0x632910, size: 24 [D 20:43:24.582083] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 34/70. [D 20:43:24.584048] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6948 [D 20:43:24.584111] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 35/70. [D 20:43:24.586344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 46431. [D 20:43:24.586409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 46432. [D 20:43:24.586421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 46433. [D 20:43:24.586432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 46434. [D 20:43:24.586442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 46435. [D 20:43:24.586453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 46436. [D 20:43:24.586463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 46437. [D 20:43:24.586473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 46438. [D 20:43:24.586483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 46439. [D 20:43:24.586493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 46440. [D 20:43:24.586502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 46441. [D 20:43:24.586520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 46442. [D 20:43:24.586530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 46443. [D 20:43:24.586539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 46444. [D 20:43:24.586550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 46445. [D 20:43:24.586559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 46446. [D 20:43:24.586569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 46447. [D 20:43:24.586579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 46448. [D 20:43:24.586597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 46449. [D 20:43:24.586606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 46450. [D 20:43:24.586616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 46451. [D 20:43:24.586626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 46452. [D 20:43:24.586636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 46453. [D 20:43:24.586646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 46454. [D 20:43:24.586656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 46455. [D 20:43:24.586693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 46456. [D 20:43:24.586703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 46457. [D 20:43:24.586713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 46458. [D 20:43:24.586727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 46459. [D 20:43:24.586737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 46460. [D 20:43:24.586747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 46461. [D 20:43:24.586763] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 46462. [D 20:43:24.589111] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6952 [D 20:43:24.589133] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 36/70. [D 20:43:24.595122] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46462. [D 20:43:24.595142] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 37/70. [D 20:43:24.595169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 46462. [D 20:43:24.595180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 46463. [D 20:43:24.595190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 46464. [D 20:43:24.595200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 46465. [D 20:43:24.595211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 46466. [D 20:43:24.595221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 46467. [D 20:43:24.595231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 46468. [D 20:43:24.595241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 46469. [D 20:43:24.595251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 46470. [D 20:43:24.595260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 46471. [D 20:43:24.595286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 46472. [D 20:43:24.595296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 46473. [D 20:43:24.595307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 46474. [D 20:43:24.595332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 46475. [D 20:43:24.595343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 46476. [D 20:43:24.595352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 46477. [D 20:43:24.595362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 46478. [D 20:43:24.595379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 46479. [D 20:43:24.595402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 46480. [D 20:43:24.595414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 46481. [D 20:43:24.595423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 46482. [D 20:43:24.595433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 46483. [D 20:43:24.595448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 46484. [D 20:43:24.595458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 46485. [D 20:43:24.595468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 46486. [D 20:43:24.595494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 46487. [D 20:43:24.595504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 46488. [D 20:43:24.595514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 46489. [D 20:43:24.595530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 46490. [D 20:43:24.595540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 46491. [D 20:43:24.595566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 46492. [D 20:43:24.595576] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 46493. [D 20:43:24.595633] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.595648] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.595658] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:24.606929] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 46493. [D 20:43:24.606943] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 38/70. [D 20:43:24.608101] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.608114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.608124] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:24.629350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.629365] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.629375] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:24.629405] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6956 [D 20:43:24.629416] element 0: offset: 0x64da70, size: 24 [D 20:43:24.629428] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 39/70. [D 20:43:24.629446] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.629459] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.629468] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:24.629483] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6958 [D 20:43:24.629494] element 0: offset: 0x6434e0, size: 24 [D 20:43:24.629504] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 40/70. [D 20:43:24.633917] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6956 [D 20:43:24.633974] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 41/70. [D 20:43:24.633995] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6958 [D 20:43:24.634005] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 42/70. [D 20:43:24.634040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 46493. [D 20:43:24.634100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 46494. [D 20:43:24.634112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 46495. [D 20:43:24.634122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 46496. [D 20:43:24.634131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 46497. [D 20:43:24.634141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 46498. [D 20:43:24.634152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 46499. [D 20:43:24.634163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 46500. [D 20:43:24.634172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 46501. [D 20:43:24.634182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 46502. [D 20:43:24.634198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 46503. [D 20:43:24.634209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 46504. [D 20:43:24.634219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 46505. [D 20:43:24.634228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 46506. [D 20:43:24.634239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 46507. [D 20:43:24.634249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 46508. [D 20:43:24.634259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 46509. [D 20:43:24.634268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 46510. [D 20:43:24.634318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 46511. [D 20:43:24.634330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 46512. [D 20:43:24.634340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 46513. [D 20:43:24.634350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 46514. [D 20:43:24.634374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 46515. [D 20:43:24.634385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 46516. [D 20:43:24.634395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 46517. [D 20:43:24.634405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 46518. [D 20:43:24.634416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 46519. [D 20:43:24.634441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 46520. [D 20:43:24.634452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 46521. [D 20:43:24.634462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 46522. [D 20:43:24.634472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 46523. [D 20:43:24.634482] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 46524. [D 20:43:24.634513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 46525. [D 20:43:24.634523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 46526. [D 20:43:24.634534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 46527. [D 20:43:24.634544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 46528. [D 20:43:24.634554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 46529. [D 20:43:24.634564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 46530. [D 20:43:24.634594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 46531. [D 20:43:24.634603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 46532. [D 20:43:24.634616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 46533. [D 20:43:24.634626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 46534. [D 20:43:24.634652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 46535. [D 20:43:24.634666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 46536. [D 20:43:24.634676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 46537. [D 20:43:24.634686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 46538. [D 20:43:24.634701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 46539. [D 20:43:24.634723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 46540. [D 20:43:24.634737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 46541. [D 20:43:24.634747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 46542. [D 20:43:24.634757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 46543. [D 20:43:24.634771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 46544. [D 20:43:24.634781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 46545. [D 20:43:24.634790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 46546. [D 20:43:24.634820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 46547. [D 20:43:24.634831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 46548. [D 20:43:24.634845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 46549. [D 20:43:24.634854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 46550. [D 20:43:24.634864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 46551. [D 20:43:24.634906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 46552. [D 20:43:24.634916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 46553. [D 20:43:24.634926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 46554. [D 20:43:24.634956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 46555. [D 20:43:24.634970] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 46556. [D 20:43:24.638016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.638032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.638043] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.638076] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6961 [D 20:43:24.638088] element 0: offset: 0x5b0030, size: 24 [D 20:43:24.638103] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 43/70. [D 20:43:24.638126] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.638136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.638144] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:24.638162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6964 [D 20:43:24.638171] element 0: offset: 0x61f310, size: 24 [D 20:43:24.638185] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 44/70. [D 20:43:24.640706] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46556. [D 20:43:24.640722] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 45/70. [D 20:43:24.652387] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 46555. [D 20:43:24.652403] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 46/70. [D 20:43:24.654743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.654756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.654765] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:24.654836] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.654847] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.654856] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.657506] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6964 [D 20:43:24.657566] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 47/70. [D 20:43:24.659809] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6961 [D 20:43:24.659826] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 48/70. [D 20:43:24.664107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 46555. [D 20:43:24.664124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 46556. [D 20:43:24.664136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 46557. [D 20:43:24.664147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 46558. [D 20:43:24.664157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 46559. [D 20:43:24.664172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 46560. [D 20:43:24.664182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 46561. [D 20:43:24.664192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 46562. [D 20:43:24.664201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 46563. [D 20:43:24.664218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 46564. [D 20:43:24.664228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 46565. [D 20:43:24.664240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 46566. [D 20:43:24.664267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 46567. [D 20:43:24.664277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 46568. [D 20:43:24.664291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 46569. [D 20:43:24.664301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 46570. [D 20:43:24.664311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 46571. [D 20:43:24.664341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 46572. [D 20:43:24.664352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 46573. [D 20:43:24.664362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 46574. [D 20:43:24.664372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 46575. [D 20:43:24.664401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 46576. [D 20:43:24.664411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 46577. [D 20:43:24.664424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 46578. [D 20:43:24.664434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 46579. [D 20:43:24.664450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 46580. [D 20:43:24.664460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 46581. [D 20:43:24.664470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 46582. [D 20:43:24.664480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 46583. [D 20:43:24.664490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 46584. [D 20:43:24.664500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 46585. [D 20:43:24.664510] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 46586. [D 20:43:24.664540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 46587. [D 20:43:24.664551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 46588. [D 20:43:24.664567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 46589. [D 20:43:24.664577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 46590. [D 20:43:24.664587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 46591. [D 20:43:24.664597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 46592. [D 20:43:24.664607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 46593. [D 20:43:24.664617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 46594. [D 20:43:24.664627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 46595. [D 20:43:24.664658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 46596. [D 20:43:24.664668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 46597. [D 20:43:24.664682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 46598. [D 20:43:24.664692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 46599. [D 20:43:24.664702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 46600. [D 20:43:24.664716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 46601. [D 20:43:24.664738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 46602. [D 20:43:24.664751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 46603. [D 20:43:24.664761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 46604. [D 20:43:24.664775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 46605. [D 20:43:24.664799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 46606. [D 20:43:24.664810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 46607. [D 20:43:24.664820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 46608. [D 20:43:24.664830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 46609. [D 20:43:24.664840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 46610. [D 20:43:24.664850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 46611. [D 20:43:24.664860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 46612. [D 20:43:24.664886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 46613. [D 20:43:24.664896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 46614. [D 20:43:24.664906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 46615. [D 20:43:24.664922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 46616. [D 20:43:24.664932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 46617. [D 20:43:24.664941] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 46618. [D 20:43:24.672116] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.672132] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.672143] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.672176] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6968 [D 20:43:24.672187] element 0: offset: 0x632910, size: 24 [D 20:43:24.672198] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 49/70. [D 20:43:24.672217] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.672227] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.672238] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:24.672254] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6970 [D 20:43:24.672263] element 0: offset: 0x643630, size: 24 [D 20:43:24.672272] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 50/70. [D 20:43:24.675173] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46618. [D 20:43:24.675188] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 51/70. [D 20:43:24.681013] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 46617. [D 20:43:24.681027] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 52/70. [D 20:43:24.683348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.683361] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.683371] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:24.683447] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.683460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.683469] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.686078] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6970 [D 20:43:24.686142] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 53/70. [D 20:43:24.686948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 46617. [D 20:43:24.686967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 46618. [D 20:43:24.686978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 46619. [D 20:43:24.686988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 46620. [D 20:43:24.686999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 46621. [D 20:43:24.687009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 46622. [D 20:43:24.687019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 46623. [D 20:43:24.687029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 46624. [D 20:43:24.687044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 46625. [D 20:43:24.687054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 46626. [D 20:43:24.687064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 46627. [D 20:43:24.687074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 46628. [D 20:43:24.687084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 46629. [D 20:43:24.687094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 46630. [D 20:43:24.687131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 46631. [D 20:43:24.687143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 46632. [D 20:43:24.687153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 46633. [D 20:43:24.687163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 46634. [D 20:43:24.687174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 46635. [D 20:43:24.687197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 46636. [D 20:43:24.687208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 46637. [D 20:43:24.687218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 46638. [D 20:43:24.687228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 46639. [D 20:43:24.687243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 46640. [D 20:43:24.687253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 46641. [D 20:43:24.687263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 46642. [D 20:43:24.687286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 46643. [D 20:43:24.687296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 46644. [D 20:43:24.687306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 46645. [D 20:43:24.687317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 46646. [D 20:43:24.687326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 46647. [D 20:43:24.687337] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 46648. [D 20:43:24.689652] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6968 [D 20:43:24.689668] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 54/70. [D 20:43:24.697304] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.697320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.697331] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.697364] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6973 [D 20:43:24.697376] element 0: offset: 0x6434e0, size: 24 [D 20:43:24.697387] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 55/70. [D 20:43:24.698678] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46648. [D 20:43:24.698693] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 56/70. [D 20:43:24.698704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 46648. [D 20:43:24.698715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 46649. [D 20:43:24.698725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 46650. [D 20:43:24.698736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 46651. [D 20:43:24.698746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 46652. [D 20:43:24.698756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 46653. [D 20:43:24.698767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 46654. [D 20:43:24.698777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 46655. [D 20:43:24.698792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 46656. [D 20:43:24.698802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 46657. [D 20:43:24.698812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 46658. [D 20:43:24.698822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 46659. [D 20:43:24.698832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 46660. [D 20:43:24.698842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 46661. [D 20:43:24.698852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 46662. [D 20:43:24.698862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 46663. [D 20:43:24.698872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 46664. [D 20:43:24.698882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 46665. [D 20:43:24.698892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 46666. [D 20:43:24.698902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 46667. [D 20:43:24.698912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 46668. [D 20:43:24.698922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 46669. [D 20:43:24.698932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 46670. [D 20:43:24.698947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 46671. [D 20:43:24.698957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 46672. [D 20:43:24.698966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 46673. [D 20:43:24.698976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 46674. [D 20:43:24.699000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 46675. [D 20:43:24.699010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 46676. [D 20:43:24.699020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 46677. [D 20:43:24.699034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 46678. [D 20:43:24.699044] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 46679. [D 20:43:24.699083] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.699096] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.699121] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.703761] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6973 [D 20:43:24.703830] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 57/70. [D 20:43:24.705135] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 46679. [D 20:43:24.705152] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 58/70. [D 20:43:24.705180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 46679. [D 20:43:24.705191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 46680. [D 20:43:24.705202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 46681. [D 20:43:24.705216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 46682. [D 20:43:24.705226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 46683. [D 20:43:24.705236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 46684. [D 20:43:24.705251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 46685. [D 20:43:24.705260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 46686. [D 20:43:24.705270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 46687. [D 20:43:24.705285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 46688. [D 20:43:24.705295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 46689. [D 20:43:24.705325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 46690. [D 20:43:24.705335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 46691. [D 20:43:24.705345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 46692. [D 20:43:24.705356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 46693. [D 20:43:24.705366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 46694. [D 20:43:24.705391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 46695. [D 20:43:24.705401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 46696. [D 20:43:24.705411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 46697. [D 20:43:24.705421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 46698. [D 20:43:24.705431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 46699. [D 20:43:24.705442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 46700. [D 20:43:24.705467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 46701. [D 20:43:24.705480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 46702. [D 20:43:24.705494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 46703. [D 20:43:24.705504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 46704. [D 20:43:24.705514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 46705. [D 20:43:24.705530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 46706. [D 20:43:24.705552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 46707. [D 20:43:24.705567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 46708. [D 20:43:24.705577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 46709. [D 20:43:24.705587] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 46710. [D 20:43:24.707926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.707941] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.707951] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:24.712316] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.712330] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.712338] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:24.712368] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6976 [D 20:43:24.712378] element 0: offset: 0x5b0030, size: 24 [D 20:43:24.712389] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 59/70. [D 20:43:24.716414] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46710. [D 20:43:24.716429] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 60/70. [D 20:43:24.718699] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.718713] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.718722] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:24.718736] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6979 [D 20:43:24.718746] element 0: offset: 0x64dce0, size: 24 [D 20:43:24.718756] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 0/70. [D 20:43:24.718812] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.718825] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.718834] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:24.722955] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6976 [D 20:43:24.722971] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 1/70. [D 20:43:24.723045] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6979 [D 20:43:24.723063] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 2/70. [D 20:43:24.723105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 46710. [D 20:43:24.723132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 46711. [D 20:43:24.723143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 46712. [D 20:43:24.723153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 46713. [D 20:43:24.723168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 46714. [D 20:43:24.723179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 46715. [D 20:43:24.723189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 46716. [D 20:43:24.723199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 46717. [D 20:43:24.723223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 46718. [D 20:43:24.723233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 46719. [D 20:43:24.723248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 46720. [D 20:43:24.723258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 46721. [D 20:43:24.723268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 46722. [D 20:43:24.723295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 46723. [D 20:43:24.723306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 46724. [D 20:43:24.723316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 46725. [D 20:43:24.723330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 46726. [D 20:43:24.723340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 46727. [D 20:43:24.723361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 46728. [D 20:43:24.723371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 46729. [D 20:43:24.723381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 46730. [D 20:43:24.723397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 46731. [D 20:43:24.723407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 46732. [D 20:43:24.723417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 46733. [D 20:43:24.723446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 46734. [D 20:43:24.723456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 46735. [D 20:43:24.723469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 46736. [D 20:43:24.723479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 46737. [D 20:43:24.723491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 46738. [D 20:43:24.723506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 46739. [D 20:43:24.723516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 46740. [D 20:43:24.723542] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 46741. [D 20:43:24.723553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 46742. [D 20:43:24.723564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 46743. [D 20:43:24.723588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 46744. [D 20:43:24.723598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 46745. [D 20:43:24.723608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 46746. [D 20:43:24.723618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 46747. [D 20:43:24.723628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 46748. [D 20:43:24.723638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 46749. [D 20:43:24.723655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 46750. [D 20:43:24.723678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 46751. [D 20:43:24.723692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 46752. [D 20:43:24.723702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 46753. [D 20:43:24.723712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 46754. [D 20:43:24.723726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 46755. [D 20:43:24.723745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 46756. [D 20:43:24.723756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 46757. [D 20:43:24.723767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 46758. [D 20:43:24.723776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 46759. [D 20:43:24.723795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 46760. [D 20:43:24.723806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 46761. [D 20:43:24.723816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 46762. [D 20:43:24.723826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 46763. [D 20:43:24.723836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 46764. [D 20:43:24.723853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 46765. [D 20:43:24.723862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 46766. [D 20:43:24.723872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 46767. [D 20:43:24.723896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 46768. [D 20:43:24.723906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 46769. [D 20:43:24.723916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 46770. [D 20:43:24.723926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 46771. [D 20:43:24.723936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 46772. [D 20:43:24.723946] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 46773. [D 20:43:24.732760] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46773. [D 20:43:24.732774] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 3/70. [D 20:43:24.738609] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 46772. [D 20:43:24.738623] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 4/70. [D 20:43:24.740900] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.740914] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.740924] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:24.740938] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.740956] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.740966] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:24.827428] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.827443] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.827454] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:24.827470] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6981 [D 20:43:24.827480] element 0: offset: 0x6434e0, size: 24 [D 20:43:24.827490] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 5/70. [D 20:43:24.829857] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6981 [D 20:43:24.829875] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 6/70. [D 20:43:24.829924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 46772. [D 20:43:24.829936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 46773. [D 20:43:24.829946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 46774. [D 20:43:24.829956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 46775. [D 20:43:24.829966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 46776. [D 20:43:24.829985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 46777. [D 20:43:24.829995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 46778. [D 20:43:24.830005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 46779. [D 20:43:24.830019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 46780. [D 20:43:24.830029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 46781. [D 20:43:24.830039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 46782. [D 20:43:24.830067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 46783. [D 20:43:24.830077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 46784. [D 20:43:24.830087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 46785. [D 20:43:24.830103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 46786. [D 20:43:24.830124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 46787. [D 20:43:24.830139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 46788. [D 20:43:24.830149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 46789. [D 20:43:24.830173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 46790. [D 20:43:24.830183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 46791. [D 20:43:24.830193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 46792. [D 20:43:24.830214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 46793. [D 20:43:24.830224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 46794. [D 20:43:24.830234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 46795. [D 20:43:24.830258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 46796. [D 20:43:24.830269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 46797. [D 20:43:24.830279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 46798. [D 20:43:24.830289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 46799. [D 20:43:24.830309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 46800. [D 20:43:24.830320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 46801. [D 20:43:24.830330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 46802. [D 20:43:24.830340] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 46803. [D 20:43:24.835789] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46803. [D 20:43:24.835803] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 7/70. [D 20:43:24.838083] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.838097] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.838108] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:24.853634] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:24.853648] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.853659] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:24.853673] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6985 [D 20:43:24.853683] element 0: offset: 0x691fe0, size: 24 [D 20:43:24.853693] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 8/70. [D 20:43:24.855894] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6985 [D 20:43:24.855911] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 9/70. [D 20:43:24.855956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 46803. [D 20:43:24.855968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 46804. [D 20:43:24.855978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 46805. [D 20:43:24.855988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 46806. [D 20:43:24.855998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 46807. [D 20:43:24.856011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 46808. [D 20:43:24.856021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 46809. [D 20:43:24.856030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 46810. [D 20:43:24.856041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 46811. [D 20:43:24.856051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 46812. [D 20:43:24.856061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 46813. [D 20:43:24.856085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 46814. [D 20:43:24.856095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 46815. [D 20:43:24.856105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 46816. [D 20:43:24.856129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 46817. [D 20:43:24.856140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 46818. [D 20:43:24.856150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 46819. [D 20:43:24.856160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 46820. [D 20:43:24.856170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 46821. [D 20:43:24.856181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 46822. [D 20:43:24.856190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 46823. [D 20:43:24.856214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 46824. [D 20:43:24.856224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 46825. [D 20:43:24.856233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 46826. [D 20:43:24.856243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 46827. [D 20:43:24.856253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 46828. [D 20:43:24.856270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 46829. [D 20:43:24.856288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 46830. [D 20:43:24.856298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 46831. [D 20:43:24.856308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 46832. [D 20:43:24.856320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 46833. [D 20:43:24.856336] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 46834. [D 20:43:24.861826] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46834. [D 20:43:24.861841] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 10/70. [D 20:43:24.864094] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:24.864107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:24.864117] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:25.040152] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.040168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.040179] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:25.040193] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6988 [D 20:43:25.040203] element 0: offset: 0x643630, size: 24 [D 20:43:25.040391] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 11/70. [D 20:43:25.040708] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.040722] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.040731] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.040745] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6991 [D 20:43:25.040754] element 0: offset: 0x62d3b0, size: 24 [D 20:43:25.040764] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 12/70. [D 20:43:25.042623] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6988 [D 20:43:25.042638] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 13/70. [D 20:43:25.042765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 46834. [D 20:43:25.042778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 46835. [D 20:43:25.042790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 46836. [D 20:43:25.042800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 46837. [D 20:43:25.042811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 46838. [D 20:43:25.042820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 46839. [D 20:43:25.042830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 46840. [D 20:43:25.042841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 46841. [D 20:43:25.042851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 46842. [D 20:43:25.042876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 46843. [D 20:43:25.042886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 46844. [D 20:43:25.042897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 46845. [D 20:43:25.042908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 46846. [D 20:43:25.042917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 46847. [D 20:43:25.042938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 46848. [D 20:43:25.042948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 46849. [D 20:43:25.042958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 46850. [D 20:43:25.042969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 46851. [D 20:43:25.042980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 46852. [D 20:43:25.042990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 46853. [D 20:43:25.045328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 46854. [D 20:43:25.045321] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6991 [D 20:43:25.045382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 46855. [D 20:43:25.045433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 46856. [D 20:43:25.045449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 46857. [D 20:43:25.045477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 46858. [D 20:43:25.045487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 46859. [D 20:43:25.045498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 46860. [D 20:43:25.045509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 46861. [D 20:43:25.045519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 46862. [D 20:43:25.045529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 46863. [D 20:43:25.045539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 46864. [D 20:43:25.045549] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 46865. [D 20:43:25.045594] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 14/70. [D 20:43:25.054519] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46865. [D 20:43:25.054539] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 15/70. [D 20:43:25.054571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 46865. [D 20:43:25.054582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 46866. [D 20:43:25.054592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 46867. [D 20:43:25.054606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 46868. [D 20:43:25.054615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 46869. [D 20:43:25.054626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 46870. [D 20:43:25.054639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 46871. [D 20:43:25.054649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 46872. [D 20:43:25.054659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 46873. [D 20:43:25.054688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 46874. [D 20:43:25.054703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 46875. [D 20:43:25.054727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 46876. [D 20:43:25.054738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 46877. [D 20:43:25.054748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 46878. [D 20:43:25.054758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 46879. [D 20:43:25.054768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 46880. [D 20:43:25.054779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 46881. [D 20:43:25.054789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 46882. [D 20:43:25.054801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 46883. [D 20:43:25.054826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 46884. [D 20:43:25.054836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 46885. [D 20:43:25.054847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 46886. [D 20:43:25.054869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 46887. [D 20:43:25.054879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 46888. [D 20:43:25.054890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 46889. [D 20:43:25.054900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 46890. [D 20:43:25.054911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 46891. [D 20:43:25.054920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 46892. [D 20:43:25.054946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 46893. [D 20:43:25.054960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 46894. [D 20:43:25.054970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 46895. [D 20:43:25.054980] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 46896. [D 20:43:25.055054] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.055069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.055079] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.061317] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 46896. [D 20:43:25.061331] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 16/70. [D 20:43:25.063591] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.063604] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.063613] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:25.071297] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.071311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.071322] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:25.071352] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6994 [D 20:43:25.071363] element 0: offset: 0x5b0030, size: 24 [D 20:43:25.071375] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 17/70. [D 20:43:25.071393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.071405] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.071413] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.071427] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 6997 [D 20:43:25.071437] element 0: offset: 0x691fe0, size: 24 [D 20:43:25.071447] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 18/70. [D 20:43:25.076018] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 6994 [D 20:43:25.076079] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 19/70. [D 20:43:25.076099] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 6997 [D 20:43:25.076110] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 20/70. [D 20:43:25.076226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 46896. [D 20:43:25.076289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 46897. [D 20:43:25.076300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 46898. [D 20:43:25.076319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 46899. [D 20:43:25.076329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 46900. [D 20:43:25.076346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 46901. [D 20:43:25.076357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 46902. [D 20:43:25.076368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 46903. [D 20:43:25.076378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 46904. [D 20:43:25.076427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 46905. [D 20:43:25.076438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 46906. [D 20:43:25.076452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 46907. [D 20:43:25.076472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 46908. [D 20:43:25.076487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 46909. [D 20:43:25.076502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 46910. [D 20:43:25.076512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 46911. [D 20:43:25.076522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 46912. [D 20:43:25.076533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 46913. [D 20:43:25.076560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 46914. [D 20:43:25.076570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 46915. [D 20:43:25.076581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 46916. [D 20:43:25.076591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 46917. [D 20:43:25.076601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 46918. [D 20:43:25.076612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 46919. [D 20:43:25.076623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 46920. [D 20:43:25.076633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 46921. [D 20:43:25.076647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 46922. [D 20:43:25.076658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 46923. [D 20:43:25.076685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 46924. [D 20:43:25.076695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 46925. [D 20:43:25.076718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 46926. [D 20:43:25.076728] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 46927. [D 20:43:25.076742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 46928. [D 20:43:25.076752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 46929. [D 20:43:25.076764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 46930. [D 20:43:25.076774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 46931. [D 20:43:25.076784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 46932. [D 20:43:25.076794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 46933. [D 20:43:25.076804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 46934. [D 20:43:25.076825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 46935. [D 20:43:25.076835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 46936. [D 20:43:25.076845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 46937. [D 20:43:25.076855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 46938. [D 20:43:25.076866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 46939. [D 20:43:25.076878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 46940. [D 20:43:25.076887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 46941. [D 20:43:25.076897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 46942. [D 20:43:25.076908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 46943. [D 20:43:25.076921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 46944. [D 20:43:25.076931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 46945. [D 20:43:25.076941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 46946. [D 20:43:25.076951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 46947. [D 20:43:25.076961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 46948. [D 20:43:25.076971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 46949. [D 20:43:25.076997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 46950. [D 20:43:25.077008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 46951. [D 20:43:25.077018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 46952. [D 20:43:25.077043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 46953. [D 20:43:25.077053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 46954. [D 20:43:25.077064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 46955. [D 20:43:25.077075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 46956. [D 20:43:25.077085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 46957. [D 20:43:25.077095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 46958. [D 20:43:25.077118] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 46959. [D 20:43:25.083969] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46959. [D 20:43:25.083990] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 21/70. [D 20:43:25.089814] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 46958. [D 20:43:25.089834] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 22/70. [D 20:43:25.092134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.092149] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.092165] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.092182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.092191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.092203] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:25.096164] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.096178] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.096189] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:25.096219] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7001 [D 20:43:25.096231] element 0: offset: 0x643630, size: 24 [D 20:43:25.096245] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 23/70. [D 20:43:25.096264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.096274] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.096283] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.096297] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7003 [D 20:43:25.096312] element 0: offset: 0x655ed0, size: 24 [D 20:43:25.096322] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 24/70. [D 20:43:25.101340] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7003 [D 20:43:25.101396] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 25/70. [D 20:43:25.101541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 46958. [D 20:43:25.101567] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7001 [D 20:43:25.101613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 46959. [D 20:43:25.101662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 46960. [D 20:43:25.101673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 46961. [D 20:43:25.101683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 46962. [D 20:43:25.101699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 46963. [D 20:43:25.101709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 46964. [D 20:43:25.101719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 46965. [D 20:43:25.101735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 46966. [D 20:43:25.101745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 46967. [D 20:43:25.101755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 46968. [D 20:43:25.101785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 46969. [D 20:43:25.101801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 46970. [D 20:43:25.101812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 46971. [D 20:43:25.101822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 46972. [D 20:43:25.101851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 46973. [D 20:43:25.101862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 46974. [D 20:43:25.101875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 46975. [D 20:43:25.101885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 46976. [D 20:43:25.101899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 46977. [D 20:43:25.101909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 46978. [D 20:43:25.101919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 46979. [D 20:43:25.101930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 46980. [D 20:43:25.101944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 46981. [D 20:43:25.101954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 46982. [D 20:43:25.101964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 46983. [D 20:43:25.101973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 46984. [D 20:43:25.101983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 46985. [D 20:43:25.101994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 46986. [D 20:43:25.102007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 46987. [D 20:43:25.102016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 46988. [D 20:43:25.102026] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 46989. [D 20:43:25.102058] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 26/70. [D 20:43:25.109188] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 46989. [D 20:43:25.109207] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 27/70. [D 20:43:25.110068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 46989. [D 20:43:25.110083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 46990. [D 20:43:25.110094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 46991. [D 20:43:25.110104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 46992. [D 20:43:25.110140] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.110159] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.110169] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.110189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 46993. [D 20:43:25.110201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 46994. [D 20:43:25.110211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 46995. [D 20:43:25.110222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 46996. [D 20:43:25.110232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 46997. [D 20:43:25.110242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 46998. [D 20:43:25.110253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 46999. [D 20:43:25.110263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 47000. [D 20:43:25.110273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 47001. [D 20:43:25.110284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 47002. [D 20:43:25.110295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 47003. [D 20:43:25.110305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 47004. [D 20:43:25.110315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 47005. [D 20:43:25.110325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 47006. [D 20:43:25.110335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 47007. [D 20:43:25.110346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 47008. [D 20:43:25.110356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 47009. [D 20:43:25.110366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 47010. [D 20:43:25.110379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 47011. [D 20:43:25.110397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 47012. [D 20:43:25.110423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 47013. [D 20:43:25.110434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 47014. [D 20:43:25.110445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 47015. [D 20:43:25.110455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 47016. [D 20:43:25.110465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 47017. [D 20:43:25.110476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 47018. [D 20:43:25.110486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 47019. [D 20:43:25.110497] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 47020. [D 20:43:25.120468] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.120482] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.120493] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.120524] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7006 [D 20:43:25.120535] element 0: offset: 0x691fe0, size: 24 [D 20:43:25.120552] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 28/70. [D 20:43:25.120571] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.120582] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.120590] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:25.120604] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7009 [D 20:43:25.120615] element 0: offset: 0x61f310, size: 24 [D 20:43:25.120624] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 29/70. [D 20:43:25.121773] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 47020. [D 20:43:25.121788] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 30/70. [D 20:43:25.124191] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.124205] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.124214] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:25.126962] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7009 [D 20:43:25.127012] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 31/70. [D 20:43:25.127095] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7006 [D 20:43:25.127111] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 32/70. [D 20:43:25.127460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 47020. [D 20:43:25.127504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 47021. [D 20:43:25.127516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 47022. [D 20:43:25.127527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 47023. [D 20:43:25.127538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 47024. [D 20:43:25.127548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 47025. [D 20:43:25.127558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 47026. [D 20:43:25.127568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 47027. [D 20:43:25.127578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 47028. [D 20:43:25.127588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 47029. [D 20:43:25.127598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 47030. [D 20:43:25.127631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 47031. [D 20:43:25.127647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 47032. [D 20:43:25.127657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 47033. [D 20:43:25.127667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 47034. [D 20:43:25.127697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 47035. [D 20:43:25.127707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 47036. [D 20:43:25.127719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 47037. [D 20:43:25.127729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 47038. [D 20:43:25.127744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 47039. [D 20:43:25.127768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 47040. [D 20:43:25.127779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 47041. [D 20:43:25.127790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 47042. [D 20:43:25.127800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 47043. [D 20:43:25.127824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 47044. [D 20:43:25.127836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 47045. [D 20:43:25.127846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 47046. [D 20:43:25.127856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 47047. [D 20:43:25.127866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 47048. [D 20:43:25.127877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 47049. [D 20:43:25.127888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 47050. [D 20:43:25.127898] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 47051. [D 20:43:25.127929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 47052. [D 20:43:25.127939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 47053. [D 20:43:25.127961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 47054. [D 20:43:25.127971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 47055. [D 20:43:25.127982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 47056. [D 20:43:25.127997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 47057. [D 20:43:25.128007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 47058. [D 20:43:25.128017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 47059. [D 20:43:25.128046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 47060. [D 20:43:25.128056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 47061. [D 20:43:25.128069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 47062. [D 20:43:25.128079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 47063. [D 20:43:25.128093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 47064. [D 20:43:25.128117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 47065. [D 20:43:25.128128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 47066. [D 20:43:25.128138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 47067. [D 20:43:25.128148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 47068. [D 20:43:25.128182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 47069. [D 20:43:25.128193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 47070. [D 20:43:25.128203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 47071. [D 20:43:25.128213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 47072. [D 20:43:25.128224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 47073. [D 20:43:25.128234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 47074. [D 20:43:25.128244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 47075. [D 20:43:25.128255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 47076. [D 20:43:25.128277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 47077. [D 20:43:25.128287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 47078. [D 20:43:25.128297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 47079. [D 20:43:25.128308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 47080. [D 20:43:25.128323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 47081. [D 20:43:25.128333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 47082. [D 20:43:25.128343] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 47083. [D 20:43:25.137778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.137794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.137805] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:25.137839] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7012 [D 20:43:25.137850] element 0: offset: 0x6537b0, size: 24 [D 20:43:25.137865] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 33/70. [D 20:43:25.138006] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.138020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.138029] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:25.138045] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7015 [D 20:43:25.138058] element 0: offset: 0x64dce0, size: 24 [D 20:43:25.138068] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 34/70. [D 20:43:25.138695] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47083. [D 20:43:25.138711] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 35/70. [D 20:43:25.150279] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 47082. [D 20:43:25.150293] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 36/70. [D 20:43:25.152618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.152632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.152642] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:25.152720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.152732] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.152740] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:25.155442] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7012 [D 20:43:25.155498] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 37/70. [D 20:43:25.155521] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7015 [D 20:43:25.155531] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 38/70. [D 20:43:25.160857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 47082. [D 20:43:25.160912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 47083. [D 20:43:25.160923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 47084. [D 20:43:25.160934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 47085. [D 20:43:25.160951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 47086. [D 20:43:25.160962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 47087. [D 20:43:25.160972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 47088. [D 20:43:25.160983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 47089. [D 20:43:25.160993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 47090. [D 20:43:25.161003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 47091. [D 20:43:25.161013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 47092. [D 20:43:25.161030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 47093. [D 20:43:25.161040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 47094. [D 20:43:25.161050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 47095. [D 20:43:25.161060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 47096. [D 20:43:25.161089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 47097. [D 20:43:25.161100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 47098. [D 20:43:25.161110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 47099. [D 20:43:25.161121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 47100. [D 20:43:25.161131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 47101. [D 20:43:25.161158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 47102. [D 20:43:25.161168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 47103. [D 20:43:25.161179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 47104. [D 20:43:25.161189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 47105. [D 20:43:25.161199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 47106. [D 20:43:25.161210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 47107. [D 20:43:25.161234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 47108. [D 20:43:25.161246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 47109. [D 20:43:25.161257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 47110. [D 20:43:25.161267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 47111. [D 20:43:25.161277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 47112. [D 20:43:25.161300] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 47113. [D 20:43:25.161316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 47114. [D 20:43:25.161328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 47115. [D 20:43:25.161338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 47116. [D 20:43:25.161348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 47117. [D 20:43:25.161359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 47118. [D 20:43:25.161369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 47119. [D 20:43:25.161383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 47120. [D 20:43:25.161396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 47121. [D 20:43:25.161406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 47122. [D 20:43:25.161416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 47123. [D 20:43:25.161438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 47124. [D 20:43:25.161449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 47125. [D 20:43:25.161459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 47126. [D 20:43:25.161469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 47127. [D 20:43:25.161486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 47128. [D 20:43:25.161496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 47129. [D 20:43:25.161506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 47130. [D 20:43:25.161517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 47131. [D 20:43:25.161528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 47132. [D 20:43:25.161538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 47133. [D 20:43:25.161564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 47134. [D 20:43:25.161575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 47135. [D 20:43:25.161585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 47136. [D 20:43:25.161598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 47137. [D 20:43:25.161608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 47138. [D 20:43:25.161618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 47139. [D 20:43:25.161645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 47140. [D 20:43:25.161655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 47141. [D 20:43:25.161669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 47142. [D 20:43:25.161679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 47143. [D 20:43:25.161694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 47144. [D 20:43:25.161704] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 47145. [D 20:43:25.165916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.165932] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.165942] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:25.165978] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7018 [D 20:43:25.165989] element 0: offset: 0x6434e0, size: 24 [D 20:43:25.166003] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 39/70. [D 20:43:25.166027] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.166037] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.166048] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:25.166065] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7021 [D 20:43:25.166092] element 0: offset: 0x643630, size: 24 [D 20:43:25.166102] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 40/70. [D 20:43:25.166780] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47145. [D 20:43:25.166795] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 41/70. [D 20:43:25.172615] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 47144. [D 20:43:25.172629] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 42/70. [D 20:43:25.174895] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.174909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.174918] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:25.174995] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.175008] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.175017] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:25.177271] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7021 [D 20:43:25.177333] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 43/70. [D 20:43:25.177414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 47144. [D 20:43:25.177432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 47145. [D 20:43:25.177444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 47146. [D 20:43:25.177454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 47147. [D 20:43:25.177482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 47148. [D 20:43:25.177492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 47149. [D 20:43:25.177507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 47150. [D 20:43:25.177518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 47151. [D 20:43:25.177527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 47152. [D 20:43:25.177543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 47153. [D 20:43:25.177554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 47154. [D 20:43:25.177564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 47155. [D 20:43:25.177592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 47156. [D 20:43:25.177602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 47157. [D 20:43:25.177614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 47158. [D 20:43:25.177625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 47159. [D 20:43:25.177635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 47160. [D 20:43:25.177663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 47161. [D 20:43:25.177678] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7018 [D 20:43:25.177697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 47162. [D 20:43:25.177721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 47163. [D 20:43:25.177732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 47164. [D 20:43:25.177747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 47165. [D 20:43:25.177757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 47166. [D 20:43:25.177767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 47167. [D 20:43:25.177777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 47168. [D 20:43:25.177787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 47169. [D 20:43:25.177806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 47170. [D 20:43:25.177819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 47171. [D 20:43:25.177829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 47172. [D 20:43:25.177839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 47173. [D 20:43:25.177849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 47174. [D 20:43:25.177877] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 47175. [D 20:43:25.177895] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 44/70. [D 20:43:25.183371] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47175. [D 20:43:25.183386] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 45/70. [D 20:43:25.183399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 47175. [D 20:43:25.183409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 47176. [D 20:43:25.183420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 47177. [D 20:43:25.183431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 47178. [D 20:43:25.183440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 47179. [D 20:43:25.183451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 47180. [D 20:43:25.183463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 47181. [D 20:43:25.183472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 47182. [D 20:43:25.183487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 47183. [D 20:43:25.183497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 47184. [D 20:43:25.183507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 47185. [D 20:43:25.183518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 47186. [D 20:43:25.183550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 47187. [D 20:43:25.183563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 47188. [D 20:43:25.183577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 47189. [D 20:43:25.183587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 47190. [D 20:43:25.183609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 47191. [D 20:43:25.183620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 47192. [D 20:43:25.183630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 47193. [D 20:43:25.183646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 47194. [D 20:43:25.183656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 47195. [D 20:43:25.183666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 47196. [D 20:43:25.183689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 47197. [D 20:43:25.183699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 47198. [D 20:43:25.183710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 47199. [D 20:43:25.183720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 47200. [D 20:43:25.183730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 47201. [D 20:43:25.183741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 47202. [D 20:43:25.183764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 47203. [D 20:43:25.183779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 47204. [D 20:43:25.183790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 47205. [D 20:43:25.183800] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 47206. [D 20:43:25.183861] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.183875] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.183900] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.189305] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 47206. [D 20:43:25.189320] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 46/70. [D 20:43:25.191604] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.191618] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.191627] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:25.492217] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.492232] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.492242] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:25.492273] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7025 [D 20:43:25.492284] element 0: offset: 0x5b0030, size: 24 [D 20:43:25.492294] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 47/70. [D 20:43:25.492313] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.492323] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.492332] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.492346] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7027 [D 20:43:25.492358] element 0: offset: 0x62d3b0, size: 24 [D 20:43:25.492367] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 48/70. [D 20:43:25.497087] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7027 [D 20:43:25.497152] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 49/70. [D 20:43:25.497175] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7025 [D 20:43:25.497186] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 50/70. [D 20:43:25.497296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 47206. [D 20:43:25.497312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 47207. [D 20:43:25.497323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 47208. [D 20:43:25.497333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 47209. [D 20:43:25.497343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 47210. [D 20:43:25.497353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 47211. [D 20:43:25.497363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 47212. [D 20:43:25.497374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 47213. [D 20:43:25.497387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 47214. [D 20:43:25.497397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 47215. [D 20:43:25.497408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 47216. [D 20:43:25.497458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 47217. [D 20:43:25.497472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 47218. [D 20:43:25.497482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 47219. [D 20:43:25.497492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 47220. [D 20:43:25.497502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 47221. [D 20:43:25.497512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 47222. [D 20:43:25.497523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 47223. [D 20:43:25.497534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 47224. [D 20:43:25.497544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 47225. [D 20:43:25.497554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 47226. [D 20:43:25.497585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 47227. [D 20:43:25.497595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 47228. [D 20:43:25.497609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 47229. [D 20:43:25.497620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 47230. [D 20:43:25.497629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 47231. [D 20:43:25.497655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 47232. [D 20:43:25.497665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 47233. [D 20:43:25.497674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 47234. [D 20:43:25.497691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 47235. [D 20:43:25.497701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 47236. [D 20:43:25.497726] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 47237. [D 20:43:25.497739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 47238. [D 20:43:25.497749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 47239. [D 20:43:25.497765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 47240. [D 20:43:25.497775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 47241. [D 20:43:25.497785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 47242. [D 20:43:25.497812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 47243. [D 20:43:25.497822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 47244. [D 20:43:25.497836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 47245. [D 20:43:25.497846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 47246. [D 20:43:25.497860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 47247. [D 20:43:25.497884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 47248. [D 20:43:25.497894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 47249. [D 20:43:25.497905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 47250. [D 20:43:25.497915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 47251. [D 20:43:25.497925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 47252. [D 20:43:25.497947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 47253. [D 20:43:25.497958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 47254. [D 20:43:25.497971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 47255. [D 20:43:25.497981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 47256. [D 20:43:25.497991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 47257. [D 20:43:25.498007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 47258. [D 20:43:25.498017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 47259. [D 20:43:25.498043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 47260. [D 20:43:25.498053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 47261. [D 20:43:25.498063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 47262. [D 20:43:25.498089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 47263. [D 20:43:25.498099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 47264. [D 20:43:25.498112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 47265. [D 20:43:25.498121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 47266. [D 20:43:25.498131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 47267. [D 20:43:25.498157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 47268. [D 20:43:25.498167] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 47269. [D 20:43:25.505097] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47269. [D 20:43:25.505112] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 51/70. [D 20:43:25.515371] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 47268. [D 20:43:25.515386] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 52/70. [D 20:43:25.517714] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.517729] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.517740] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:25.517771] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7030 [D 20:43:25.517782] element 0: offset: 0x655ed0, size: 24 [D 20:43:25.517793] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 53/70. [D 20:43:25.517812] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.517824] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.517832] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:25.517846] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7033 [D 20:43:25.517857] element 0: offset: 0x643630, size: 24 [D 20:43:25.517866] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 54/70. [D 20:43:25.517918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.517928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.517950] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:25.517965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.517975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.517983] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:25.522639] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7030 [D 20:43:25.522705] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 55/70. [D 20:43:25.522727] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7033 [D 20:43:25.522739] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 56/70. [D 20:43:25.522846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 47268. [D 20:43:25.522862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 47269. [D 20:43:25.522873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 47270. [D 20:43:25.522883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 47271. [D 20:43:25.522894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 47272. [D 20:43:25.522904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 47273. [D 20:43:25.522914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 47274. [D 20:43:25.522930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 47275. [D 20:43:25.522940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 47276. [D 20:43:25.522950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 47277. [D 20:43:25.522961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 47278. [D 20:43:25.523007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 47279. [D 20:43:25.523057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 47280. [D 20:43:25.523067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 47281. [D 20:43:25.523082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 47282. [D 20:43:25.523093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 47283. [D 20:43:25.523103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 47284. [D 20:43:25.523114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 47285. [D 20:43:25.523124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 47286. [D 20:43:25.523133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 47287. [D 20:43:25.523144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 47288. [D 20:43:25.523154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 47289. [D 20:43:25.523173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 47290. [D 20:43:25.523183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 47291. [D 20:43:25.523193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 47292. [D 20:43:25.523204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 47293. [D 20:43:25.523214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 47294. [D 20:43:25.523235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 47295. [D 20:43:25.523246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 47296. [D 20:43:25.523257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 47297. [D 20:43:25.523267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 47298. [D 20:43:25.523281] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 47299. [D 20:43:25.523309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 47300. [D 20:43:25.523320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 47301. [D 20:43:25.523331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 47302. [D 20:43:25.523340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 47303. [D 20:43:25.523351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 47304. [D 20:43:25.523375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 47305. [D 20:43:25.523390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 47306. [D 20:43:25.523401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 47307. [D 20:43:25.523411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 47308. [D 20:43:25.523435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 47309. [D 20:43:25.523446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 47310. [D 20:43:25.523456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 47311. [D 20:43:25.523472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 47312. [D 20:43:25.523482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 47313. [D 20:43:25.523492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 47314. [D 20:43:25.523502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 47315. [D 20:43:25.523519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 47316. [D 20:43:25.523530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 47317. [D 20:43:25.523540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 47318. [D 20:43:25.523550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 47319. [D 20:43:25.523561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 47320. [D 20:43:25.523585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 47321. [D 20:43:25.523597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 47322. [D 20:43:25.523607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 47323. [D 20:43:25.523622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 47324. [D 20:43:25.523633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 47325. [D 20:43:25.523643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 47326. [D 20:43:25.523654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 47327. [D 20:43:25.523678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 47328. [D 20:43:25.523692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 47329. [D 20:43:25.523703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 47330. [D 20:43:25.523713] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 47331. [D 20:43:25.534422] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47331. [D 20:43:25.534440] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 57/70. [D 20:43:25.545887] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 47330. [D 20:43:25.545901] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 58/70. [D 20:43:25.548225] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.548240] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.548251] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.548266] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.548280] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.548289] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:25.562689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.562703] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.562714] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:25.562744] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7036 [D 20:43:25.562755] element 0: offset: 0x64dce0, size: 24 [D 20:43:25.562766] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 59/70. [D 20:43:25.562785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.562800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.562808] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.565086] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7039 [D 20:43:25.565097] element 0: offset: 0x61f310, size: 24 [D 20:43:25.565107] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 60/70. [D 20:43:25.567782] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7036 [D 20:43:25.567848] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 0/70. [D 20:43:25.568002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 47330. [D 20:43:25.568076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 47331. [D 20:43:25.568088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 47332. [D 20:43:25.568099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 47333. [D 20:43:25.568114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 47334. [D 20:43:25.568124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 47335. [D 20:43:25.568134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 47336. [D 20:43:25.568149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 47337. [D 20:43:25.568159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 47338. [D 20:43:25.568169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 47339. [D 20:43:25.568185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 47340. [D 20:43:25.568195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 47341. [D 20:43:25.568247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 47342. [D 20:43:25.568257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 47343. [D 20:43:25.568267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 47344. [D 20:43:25.568295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 47345. [D 20:43:25.568306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 47346. [D 20:43:25.568318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 47347. [D 20:43:25.568328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 47348. [D 20:43:25.568379] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7039 [D 20:43:25.568406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 47349. [D 20:43:25.568435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 47350. [D 20:43:25.568445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 47351. [D 20:43:25.568456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 47352. [D 20:43:25.568466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 47353. [D 20:43:25.568476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 47354. [D 20:43:25.568486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 47355. [D 20:43:25.568503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 47356. [D 20:43:25.568513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 47357. [D 20:43:25.568539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 47358. [D 20:43:25.568549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 47359. [D 20:43:25.568559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 47360. [D 20:43:25.568575] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 47361. [D 20:43:25.568599] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 1/70. [D 20:43:25.579725] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47361. [D 20:43:25.579744] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 2/70. [D 20:43:25.579775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 47361. [D 20:43:25.579787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 47362. [D 20:43:25.579797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 47363. [D 20:43:25.579810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 47364. [D 20:43:25.579820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 47365. [D 20:43:25.579835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 47366. [D 20:43:25.579846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 47367. [D 20:43:25.579856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 47368. [D 20:43:25.579866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 47369. [D 20:43:25.579877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 47370. [D 20:43:25.579899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 47371. [D 20:43:25.579914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 47372. [D 20:43:25.579924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 47373. [D 20:43:25.579934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 47374. [D 20:43:25.579944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 47375. [D 20:43:25.579975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 47376. [D 20:43:25.579985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 47377. [D 20:43:25.579996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 47378. [D 20:43:25.580006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 47379. [D 20:43:25.580016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 47380. [D 20:43:25.580039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 47381. [D 20:43:25.580050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 47382. [D 20:43:25.580060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 47383. [D 20:43:25.580075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 47384. [D 20:43:25.580085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 47385. [D 20:43:25.580105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 47386. [D 20:43:25.580116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 47387. [D 20:43:25.580127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 47388. [D 20:43:25.580137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 47389. [D 20:43:25.580151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 47390. [D 20:43:25.580162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 47391. [D 20:43:25.580172] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 47392. [D 20:43:25.580244] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.580258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.580267] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.587813] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 47392. [D 20:43:25.587828] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 3/70. [D 20:43:25.589963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.589977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.589987] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:25.596228] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.596242] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.596252] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:25.596282] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7041 [D 20:43:25.596293] element 0: offset: 0x6434e0, size: 24 [D 20:43:25.596307] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 4/70. [D 20:43:25.598983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.598998] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.599006] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.599021] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7045 [D 20:43:25.599030] element 0: offset: 0x632910, size: 24 [D 20:43:25.599040] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 5/70. [D 20:43:25.601314] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7041 [D 20:43:25.601395] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 6/70. [D 20:43:25.601423] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7045 [D 20:43:25.601434] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 7/70. [D 20:43:25.601538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 47392. [D 20:43:25.601631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 47393. [D 20:43:25.601644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 47394. [D 20:43:25.601654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 47395. [D 20:43:25.601669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 47396. [D 20:43:25.601679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 47397. [D 20:43:25.601689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 47398. [D 20:43:25.601703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 47399. [D 20:43:25.601713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 47400. [D 20:43:25.601723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 47401. [D 20:43:25.601739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 47402. [D 20:43:25.601749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 47403. [D 20:43:25.601759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 47404. [D 20:43:25.601775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 47405. [D 20:43:25.601785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 47406. [D 20:43:25.601795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 47407. [D 20:43:25.601805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 47408. [D 20:43:25.601815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 47409. [D 20:43:25.601825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 47410. [D 20:43:25.601860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 47411. [D 20:43:25.601870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 47412. [D 20:43:25.601880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 47413. [D 20:43:25.601891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 47414. [D 20:43:25.601901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 47415. [D 20:43:25.601911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 47416. [D 20:43:25.601921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 47417. [D 20:43:25.601931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 47418. [D 20:43:25.601941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 47419. [D 20:43:25.601958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 47420. [D 20:43:25.601967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 47421. [D 20:43:25.601977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 47422. [D 20:43:25.602006] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 47423. [D 20:43:25.602019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 47424. [D 20:43:25.602034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 47425. [D 20:43:25.602043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 47426. [D 20:43:25.602054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 47427. [D 20:43:25.602078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 47428. [D 20:43:25.602088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 47429. [D 20:43:25.602098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 47430. [D 20:43:25.602114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 47431. [D 20:43:25.602124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 47432. [D 20:43:25.602134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 47433. [D 20:43:25.602149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 47434. [D 20:43:25.602159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 47435. [D 20:43:25.602169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 47436. [D 20:43:25.602199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 47437. [D 20:43:25.602210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 47438. [D 20:43:25.602220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 47439. [D 20:43:25.602230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 47440. [D 20:43:25.602260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 47441. [D 20:43:25.602271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 47442. [D 20:43:25.602283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 47443. [D 20:43:25.602293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 47444. [D 20:43:25.602308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 47445. [D 20:43:25.602319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 47446. [D 20:43:25.602329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 47447. [D 20:43:25.602340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 47448. [D 20:43:25.602362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 47449. [D 20:43:25.602378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 47450. [D 20:43:25.602389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 47451. [D 20:43:25.602398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 47452. [D 20:43:25.602423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 47453. [D 20:43:25.602440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 47454. [D 20:43:25.602450] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 47455. [D 20:43:25.613259] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47455. [D 20:43:25.613275] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 8/70. [D 20:43:25.621551] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 47454. [D 20:43:25.621566] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 9/70. [D 20:43:25.623868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.623883] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.623892] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.623908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.623921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.623929] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:25.638620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.638634] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.638645] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:25.638675] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7048 [D 20:43:25.638686] element 0: offset: 0x6537b0, size: 24 [D 20:43:25.638697] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 10/70. [D 20:43:25.638717] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.638730] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.638739] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.638753] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7051 [D 20:43:25.638764] element 0: offset: 0x643630, size: 24 [D 20:43:25.638773] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 11/70. [D 20:43:25.643663] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7048 [D 20:43:25.643723] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 12/70. [D 20:43:25.643743] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7051 [D 20:43:25.643753] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 13/70. [D 20:43:25.643870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 47454. [D 20:43:25.643934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 47455. [D 20:43:25.643946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 47456. [D 20:43:25.643956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 47457. [D 20:43:25.643971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 47458. [D 20:43:25.643981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 47459. [D 20:43:25.643990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 47460. [D 20:43:25.644006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 47461. [D 20:43:25.644015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 47462. [D 20:43:25.644025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 47463. [D 20:43:25.644041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 47464. [D 20:43:25.644051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 47465. [D 20:43:25.644061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 47466. [D 20:43:25.644116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 47467. [D 20:43:25.644126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 47468. [D 20:43:25.644136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 47469. [D 20:43:25.644163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 47470. [D 20:43:25.644173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 47471. [D 20:43:25.644188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 47472. [D 20:43:25.644198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 47473. [D 20:43:25.644208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 47474. [D 20:43:25.644232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 47475. [D 20:43:25.644242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 47476. [D 20:43:25.644269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 47477. [D 20:43:25.644280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 47478. [D 20:43:25.644290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 47479. [D 20:43:25.644300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 47480. [D 20:43:25.644314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 47481. [D 20:43:25.644324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 47482. [D 20:43:25.644337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 47483. [D 20:43:25.644348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 47484. [D 20:43:25.644359] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 47485. [D 20:43:25.644372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 47486. [D 20:43:25.644382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 47487. [D 20:43:25.644399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 47488. [D 20:43:25.644415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 47489. [D 20:43:25.644426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 47490. [D 20:43:25.644452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 47491. [D 20:43:25.644467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 47492. [D 20:43:25.644477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 47493. [D 20:43:25.644487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 47494. [D 20:43:25.644503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 47495. [D 20:43:25.644526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 47496. [D 20:43:25.644539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 47497. [D 20:43:25.644549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 47498. [D 20:43:25.644572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 47499. [D 20:43:25.644584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 47500. [D 20:43:25.644594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 47501. [D 20:43:25.644605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 47502. [D 20:43:25.644615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 47503. [D 20:43:25.644625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 47504. [D 20:43:25.644648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 47505. [D 20:43:25.644658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 47506. [D 20:43:25.644674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 47507. [D 20:43:25.644685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 47508. [D 20:43:25.644695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 47509. [D 20:43:25.644705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 47510. [D 20:43:25.644729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 47511. [D 20:43:25.644744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 47512. [D 20:43:25.644755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 47513. [D 20:43:25.644765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 47514. [D 20:43:25.644788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 47515. [D 20:43:25.644799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 47516. [D 20:43:25.644809] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 47517. [D 20:43:25.655539] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47517. [D 20:43:25.655556] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 14/70. [D 20:43:25.659627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.659642] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.659653] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:25.659686] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7054 [D 20:43:25.659697] element 0: offset: 0x64dce0, size: 24 [D 20:43:25.659709] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 15/70. [D 20:43:25.664773] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 47516. [D 20:43:25.664787] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 16/70. [D 20:43:25.667067] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.667081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.667091] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:25.667106] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7057 [D 20:43:25.667119] element 0: offset: 0x5b0030, size: 24 [D 20:43:25.667129] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 17/70. [D 20:43:25.667159] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.667172] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.667182] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:25.667243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.667254] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.667263] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:25.669266] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7054 [D 20:43:25.669321] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 18/70. [D 20:43:25.673423] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7057 [D 20:43:25.673439] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 19/70. [D 20:43:25.675782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 47516. [D 20:43:25.675844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 47517. [D 20:43:25.675856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 47518. [D 20:43:25.675866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 47519. [D 20:43:25.675881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 47520. [D 20:43:25.675891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 47521. [D 20:43:25.675901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 47522. [D 20:43:25.675915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 47523. [D 20:43:25.675925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 47524. [D 20:43:25.675935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 47525. [D 20:43:25.675951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 47526. [D 20:43:25.675961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 47527. [D 20:43:25.675971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 47528. [D 20:43:25.676016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 47529. [D 20:43:25.676026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 47530. [D 20:43:25.676037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 47531. [D 20:43:25.676047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 47532. [D 20:43:25.676071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 47533. [D 20:43:25.676082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 47534. [D 20:43:25.676093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 47535. [D 20:43:25.676103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 47536. [D 20:43:25.676113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 47537. [D 20:43:25.676137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 47538. [D 20:43:25.676147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 47539. [D 20:43:25.676157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 47540. [D 20:43:25.676173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 47541. [D 20:43:25.676183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 47542. [D 20:43:25.676209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 47543. [D 20:43:25.676219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 47544. [D 20:43:25.676235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 47545. [D 20:43:25.676246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 47546. [D 20:43:25.676256] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 47547. [D 20:43:25.676269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 47548. [D 20:43:25.676295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 47549. [D 20:43:25.676305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 47550. [D 20:43:25.676315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 47551. [D 20:43:25.676326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 47552. [D 20:43:25.676352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 47553. [D 20:43:25.676363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 47554. [D 20:43:25.676372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 47555. [D 20:43:25.676383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 47556. [D 20:43:25.676393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 47557. [D 20:43:25.676403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 47558. [D 20:43:25.676417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 47559. [D 20:43:25.676427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 47560. [D 20:43:25.676438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 47561. [D 20:43:25.676462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 47562. [D 20:43:25.676478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 47563. [D 20:43:25.676488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 47564. [D 20:43:25.676498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 47565. [D 20:43:25.676509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 47566. [D 20:43:25.676519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 47567. [D 20:43:25.676529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 47568. [D 20:43:25.676539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 47569. [D 20:43:25.676571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 47570. [D 20:43:25.676587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 47571. [D 20:43:25.676598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 47572. [D 20:43:25.676607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 47573. [D 20:43:25.676635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 47574. [D 20:43:25.676645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 47575. [D 20:43:25.676659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 47576. [D 20:43:25.676669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 47577. [D 20:43:25.676684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 47578. [D 20:43:25.676706] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 47579. [D 20:43:25.683856] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47579. [D 20:43:25.683872] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 20/70. [D 20:43:25.689697] openib_check_cq: completed rdma wr_id 2aaaab208850, nic_wr_credit 47578. [D 20:43:25.689712] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 21/70. [D 20:43:25.691988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.692003] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.692013] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.692028] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.692041] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.692050] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:25.804605] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.804620] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.804632] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:25.804664] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7059 [D 20:43:25.804675] element 0: offset: 0x632910, size: 24 [D 20:43:25.804691] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 22/70. [D 20:43:25.806885] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7059 [D 20:43:25.806939] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 23/70. [D 20:43:25.806991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 47578. [D 20:43:25.807010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 47579. [D 20:43:25.807022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 47580. [D 20:43:25.807032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 47581. [D 20:43:25.807042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 47582. [D 20:43:25.807052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 47583. [D 20:43:25.807062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 47584. [D 20:43:25.807072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 47585. [D 20:43:25.807083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 47586. [D 20:43:25.807098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 47587. [D 20:43:25.807108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 47588. [D 20:43:25.807118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 47589. [D 20:43:25.807128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 47590. [D 20:43:25.807138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 47591. [D 20:43:25.807158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 47592. [D 20:43:25.807168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 47593. [D 20:43:25.807178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 47594. [D 20:43:25.807193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 47595. [D 20:43:25.807203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 47596. [D 20:43:25.807214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 47597. [D 20:43:25.807224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 47598. [D 20:43:25.807234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 47599. [D 20:43:25.807244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 47600. [D 20:43:25.807254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 47601. [D 20:43:25.807276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 47602. [D 20:43:25.807286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 47603. [D 20:43:25.807296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 47604. [D 20:43:25.807319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 47605. [D 20:43:25.807329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 47606. [D 20:43:25.807339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 47607. [D 20:43:25.807350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 47608. [D 20:43:25.807361] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 47609. [D 20:43:25.807392] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.807403] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.807411] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.807441] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7063 [D 20:43:25.807452] element 0: offset: 0x691fe0, size: 24 [D 20:43:25.807462] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 24/70. [D 20:43:25.812867] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47609. [D 20:43:25.812882] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 25/70. [D 20:43:25.815194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.815207] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.815217] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.817139] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7063 [D 20:43:25.817158] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 26/70. [D 20:43:25.817220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 47609. [D 20:43:25.817274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 47610. [D 20:43:25.817286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 47611. [D 20:43:25.817303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 47612. [D 20:43:25.817315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 47613. [D 20:43:25.817325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 47614. [D 20:43:25.817341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 47615. [D 20:43:25.817351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 47616. [D 20:43:25.817360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 47617. [D 20:43:25.817399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 47618. [D 20:43:25.817411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 47619. [D 20:43:25.817421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 47620. [D 20:43:25.817431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 47621. [D 20:43:25.817447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 47622. [D 20:43:25.817477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 47623. [D 20:43:25.817487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 47624. [D 20:43:25.817497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 47625. [D 20:43:25.817514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 47626. [D 20:43:25.817524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 47627. [D 20:43:25.817548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 47628. [D 20:43:25.817559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 47629. [D 20:43:25.817569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 47630. [D 20:43:25.817583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 47631. [D 20:43:25.817593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 47632. [D 20:43:25.817619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 47633. [D 20:43:25.817629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 47634. [D 20:43:25.817639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 47635. [D 20:43:25.817655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 47636. [D 20:43:25.817665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 47637. [D 20:43:25.817692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 47638. [D 20:43:25.817703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 47639. [D 20:43:25.817713] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 47640. [D 20:43:25.823132] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47640. [D 20:43:25.823148] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 27/70. [D 20:43:25.825342] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.825357] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.825368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:25.943014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.943029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.943040] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:25.943073] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7067 [D 20:43:25.943084] element 0: offset: 0x62d470, size: 24 [D 20:43:25.943096] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 28/70. [D 20:43:25.943115] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.943126] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.943134] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.943148] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7069 [D 20:43:25.943159] element 0: offset: 0x643630, size: 24 [D 20:43:25.943168] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 29/70. [D 20:43:25.946985] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7069 [D 20:43:25.947038] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 30/70. [D 20:43:25.947095] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7067 [D 20:43:25.947107] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 31/70. [D 20:43:25.947181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 47640. [D 20:43:25.947248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 47641. [D 20:43:25.947260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 47642. [D 20:43:25.947270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 47643. [D 20:43:25.947285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 47644. [D 20:43:25.947295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 47645. [D 20:43:25.947305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 47646. [D 20:43:25.947320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 47647. [D 20:43:25.947330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 47648. [D 20:43:25.947340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 47649. [D 20:43:25.947351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 47650. [D 20:43:25.947404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 47651. [D 20:43:25.947415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 47652. [D 20:43:25.947425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 47653. [D 20:43:25.947435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 47654. [D 20:43:25.947445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 47655. [D 20:43:25.947460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 47656. [D 20:43:25.947489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 47657. [D 20:43:25.947500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 47658. [D 20:43:25.947510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 47659. [D 20:43:25.947520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 47660. [D 20:43:25.947531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 47661. [D 20:43:25.947542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 47662. [D 20:43:25.947562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 47663. [D 20:43:25.947573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 47664. [D 20:43:25.947584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 47665. [D 20:43:25.947594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 47666. [D 20:43:25.947604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 47667. [D 20:43:25.947631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 47668. [D 20:43:25.947641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 47669. [D 20:43:25.947651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 47670. [D 20:43:25.947673] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 47671. [D 20:43:25.947700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 47672. [D 20:43:25.947712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 47673. [D 20:43:25.947723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 47674. [D 20:43:25.947732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 47675. [D 20:43:25.947749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 47676. [D 20:43:25.947759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 47677. [D 20:43:25.947768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 47678. [D 20:43:25.947779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 47679. [D 20:43:25.947803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 47680. [D 20:43:25.947819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 47681. [D 20:43:25.947830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 47682. [D 20:43:25.947841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 47683. [D 20:43:25.947851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 47684. [D 20:43:25.947861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 47685. [D 20:43:25.947881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 47686. [D 20:43:25.947892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 47687. [D 20:43:25.947902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 47688. [D 20:43:25.947921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 47689. [D 20:43:25.947931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 47690. [D 20:43:25.947958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 47691. [D 20:43:25.947969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 47692. [D 20:43:25.947989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 47693. [D 20:43:25.948000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 47694. [D 20:43:25.948021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 47695. [D 20:43:25.948032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 47696. [D 20:43:25.948043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 47697. [D 20:43:25.948053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 47698. [D 20:43:25.948063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 47699. [D 20:43:25.948074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 47700. [D 20:43:25.948084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 47701. [D 20:43:25.948095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 47702. [D 20:43:25.948109] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 47703. [D 20:43:25.955560] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47703. [D 20:43:25.955577] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 32/70. [D 20:43:25.965108] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 47702. [D 20:43:25.965122] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 33/70. [D 20:43:25.968155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.968170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.968180] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.968197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.968208] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.968217] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:25.968235] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.968245] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.968257] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:25.968306] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7072 [D 20:43:25.968329] element 0: offset: 0x61f310, size: 24 [D 20:43:25.968342] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 34/70. [D 20:43:25.968369] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.968379] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.968400] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.968423] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7075 [D 20:43:25.968448] element 0: offset: 0x64dce0, size: 24 [D 20:43:25.968459] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 35/70. [D 20:43:25.973493] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7075 [D 20:43:25.973548] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 36/70. [D 20:43:25.973615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 47702. [D 20:43:25.973679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 47703. [D 20:43:25.973690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 47704. [D 20:43:25.973700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 47705. [D 20:43:25.973711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 47706. [D 20:43:25.973721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 47707. [D 20:43:25.973731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 47708. [D 20:43:25.973741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 47709. [D 20:43:25.973759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 47710. [D 20:43:25.973769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 47711. [D 20:43:25.973779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 47712. [D 20:43:25.973789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 47713. [D 20:43:25.973799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 47714. [D 20:43:25.973847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 47715. [D 20:43:25.973870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 47716. [D 20:43:25.973880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 47717. [D 20:43:25.973895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 47718. [D 20:43:25.973916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 47719. [D 20:43:25.973927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 47720. [D 20:43:25.973937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 47721. [D 20:43:25.973947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 47722. [D 20:43:25.973957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 47723. [D 20:43:25.973967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 47724. [D 20:43:25.973992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 47725. [D 20:43:25.974002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 47726. [D 20:43:25.974032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 47727. [D 20:43:25.974042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 47728. [D 20:43:25.974054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 47729. [D 20:43:25.974076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 47730. [D 20:43:25.974091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 47731. [D 20:43:25.974101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 47732. [D 20:43:25.974129] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 47733. [D 20:43:25.974217] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7072 [D 20:43:25.974236] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 37/70. [D 20:43:25.979559] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47733. [D 20:43:25.979580] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 38/70. [D 20:43:25.980278] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.980293] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.980303] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:25.980342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 47733. [D 20:43:25.980356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 47734. [D 20:43:25.980367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 47735. [D 20:43:25.980377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 47736. [D 20:43:25.980388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 47737. [D 20:43:25.980399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 47738. [D 20:43:25.980409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 47739. [D 20:43:25.980419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 47740. [D 20:43:25.980429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 47741. [D 20:43:25.980439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 47742. [D 20:43:25.980449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 47743. [D 20:43:25.980469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 47744. [D 20:43:25.980479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 47745. [D 20:43:25.980489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 47746. [D 20:43:25.980499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 47747. [D 20:43:25.980509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 47748. [D 20:43:25.980519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 47749. [D 20:43:25.980550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 47750. [D 20:43:25.980561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 47751. [D 20:43:25.980571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 47752. [D 20:43:25.980584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 47753. [D 20:43:25.980594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 47754. [D 20:43:25.980609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 47755. [D 20:43:25.980633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 47756. [D 20:43:25.980644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 47757. [D 20:43:25.980654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 47758. [D 20:43:25.980664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 47759. [D 20:43:25.980674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 47760. [D 20:43:25.980685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 47761. [D 20:43:25.980695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 47762. [D 20:43:25.980710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 47763. [D 20:43:25.980735] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 47764. [D 20:43:25.983040] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.983054] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.983064] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:25.983098] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7078 [D 20:43:25.983109] element 0: offset: 0x6537b0, size: 24 [D 20:43:25.983122] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 39/70. [D 20:43:25.985495] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:25.985509] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.985519] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:25.985534] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7081 [D 20:43:25.985544] element 0: offset: 0x62d470, size: 24 [D 20:43:25.985554] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 40/70. [D 20:43:25.991926] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 47764. [D 20:43:25.991940] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 41/70. [D 20:43:25.994345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:25.994359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:25.994368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:25.997035] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7081 [D 20:43:25.997085] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 42/70. [D 20:43:25.997101] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7078 [D 20:43:25.997111] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 43/70. [D 20:43:25.997218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 47764. [D 20:43:25.997298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 47765. [D 20:43:25.997310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 47766. [D 20:43:25.997320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 47767. [D 20:43:25.997335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 47768. [D 20:43:25.997345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 47769. [D 20:43:25.997355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 47770. [D 20:43:25.997370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 47771. [D 20:43:25.997380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 47772. [D 20:43:25.997390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 47773. [D 20:43:25.997406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 47774. [D 20:43:25.997416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 47775. [D 20:43:25.997426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 47776. [D 20:43:25.997458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 47777. [D 20:43:25.997469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 47778. [D 20:43:25.997480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 47779. [D 20:43:25.997490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 47780. [D 20:43:25.997505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 47781. [D 20:43:25.997516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 47782. [D 20:43:25.997535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 47783. [D 20:43:25.997552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 47784. [D 20:43:25.997562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 47785. [D 20:43:25.997571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 47786. [D 20:43:25.997601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 47787. [D 20:43:25.997611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 47788. [D 20:43:25.997624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 47789. [D 20:43:25.997634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 47790. [D 20:43:25.997646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 47791. [D 20:43:25.997661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 47792. [D 20:43:25.997671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 47793. [D 20:43:25.997681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 47794. [D 20:43:25.997710] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 47795. [D 20:43:25.997730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 47796. [D 20:43:25.997740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 47797. [D 20:43:25.997750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 47798. [D 20:43:25.997766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 47799. [D 20:43:25.997776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 47800. [D 20:43:25.997786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 47801. [D 20:43:25.997809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 47802. [D 20:43:25.997819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 47803. [D 20:43:25.997830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 47804. [D 20:43:25.997840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 47805. [D 20:43:25.997850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 47806. [D 20:43:25.997861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 47807. [D 20:43:25.997885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 47808. [D 20:43:25.997895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 47809. [D 20:43:25.997910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 47810. [D 20:43:25.997920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 47811. [D 20:43:25.997930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 47812. [D 20:43:25.997940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 47813. [D 20:43:25.997970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 47814. [D 20:43:25.997980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 47815. [D 20:43:25.997994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 47816. [D 20:43:25.998004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 47817. [D 20:43:25.998015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 47818. [D 20:43:25.998040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 47819. [D 20:43:25.998050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 47820. [D 20:43:25.998065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 47821. [D 20:43:25.998075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 47822. [D 20:43:25.998085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 47823. [D 20:43:25.998099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 47824. [D 20:43:25.998109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 47825. [D 20:43:25.998119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 47826. [D 20:43:25.998148] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 47827. [D 20:43:26.003771] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47827. [D 20:43:26.003789] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 44/70. [D 20:43:26.009635] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 47826. [D 20:43:26.009649] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 45/70. [D 20:43:26.011924] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.011939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.011949] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:26.011965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.011977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.011985] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:26.014970] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.014984] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.014995] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:26.015025] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7084 [D 20:43:26.015036] element 0: offset: 0x691fe0, size: 24 [D 20:43:26.015048] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 46/70. [D 20:43:26.015067] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.015078] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.015086] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:26.015116] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7087 [D 20:43:26.015134] element 0: offset: 0x657310, size: 24 [D 20:43:26.015144] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 47/70. [D 20:43:26.018920] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7087 [D 20:43:26.018975] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 48/70. [D 20:43:26.019117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 47826. [D 20:43:26.019174] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7084 [D 20:43:26.019186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 47827. [D 20:43:26.019201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 47828. [D 20:43:26.019217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 47829. [D 20:43:26.019237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 47830. [D 20:43:26.019248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 47831. [D 20:43:26.019259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 47832. [D 20:43:26.019268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 47833. [D 20:43:26.019279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 47834. [D 20:43:26.019289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 47835. [D 20:43:26.019299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 47836. [D 20:43:26.019309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 47837. [D 20:43:26.019319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 47838. [D 20:43:26.019369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 47839. [D 20:43:26.019379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 47840. [D 20:43:26.019390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 47841. [D 20:43:26.019413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 47842. [D 20:43:26.019423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 47843. [D 20:43:26.019434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 47844. [D 20:43:26.019444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 47845. [D 20:43:26.019454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 47846. [D 20:43:26.019464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 47847. [D 20:43:26.019474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 47848. [D 20:43:26.019485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 47849. [D 20:43:26.019495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 47850. [D 20:43:26.019530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 47851. [D 20:43:26.019540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 47852. [D 20:43:26.019550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 47853. [D 20:43:26.019561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 47854. [D 20:43:26.019577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 47855. [D 20:43:26.019587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 47856. [D 20:43:26.019597] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 47857. [D 20:43:26.019638] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 49/70. [D 20:43:26.027591] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47857. [D 20:43:26.027612] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 50/70. [D 20:43:26.029713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 47857. [D 20:43:26.029728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 47858. [D 20:43:26.029739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 47859. [D 20:43:26.029749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 47860. [D 20:43:26.029760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 47861. [D 20:43:26.029776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 47862. [D 20:43:26.029785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 47863. [D 20:43:26.029795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 47864. [D 20:43:26.029811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 47865. [D 20:43:26.029821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 47866. [D 20:43:26.029831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 47867. [D 20:43:26.029847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 47868. [D 20:43:26.029857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 47869. [D 20:43:26.029867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 47870. [D 20:43:26.029882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 47871. [D 20:43:26.029892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 47872. [D 20:43:26.029902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 47873. [D 20:43:26.029935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 47874. [D 20:43:26.029945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 47875. [D 20:43:26.029956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 47876. [D 20:43:26.029975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 47877. [D 20:43:26.029990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 47878. [D 20:43:26.030000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 47879. [D 20:43:26.030010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 47880. [D 20:43:26.030026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 47881. [D 20:43:26.030037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 47882. [D 20:43:26.030061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 47883. [D 20:43:26.030072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 47884. [D 20:43:26.030082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 47885. [D 20:43:26.030092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 47886. [D 20:43:26.030102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 47887. [D 20:43:26.030137] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.030175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.030185] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:26.030208] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 47888. [D 20:43:26.039970] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.039985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.039996] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:26.040027] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7091 [D 20:43:26.040038] element 0: offset: 0x632910, size: 24 [D 20:43:26.040050] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 51/70. [D 20:43:26.040068] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.040081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.040089] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:26.040104] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7093 [D 20:43:26.040115] element 0: offset: 0x5b0030, size: 24 [D 20:43:26.040142] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 52/70. [D 20:43:26.041404] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 47888. [D 20:43:26.041419] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 53/70. [D 20:43:26.043776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.043790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.043799] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:26.046427] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7093 [D 20:43:26.046481] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 54/70. [D 20:43:26.046562] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7091 [D 20:43:26.046586] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 55/70. [D 20:43:26.047418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 47888. [D 20:43:26.047435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 47889. [D 20:43:26.047447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 47890. [D 20:43:26.047457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 47891. [D 20:43:26.047468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 47892. [D 20:43:26.047478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 47893. [D 20:43:26.047488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 47894. [D 20:43:26.047499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 47895. [D 20:43:26.047510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 47896. [D 20:43:26.047520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 47897. [D 20:43:26.047530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 47898. [D 20:43:26.047549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 47899. [D 20:43:26.047559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 47900. [D 20:43:26.047569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 47901. [D 20:43:26.047585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 47902. [D 20:43:26.047595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 47903. [D 20:43:26.047606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 47904. [D 20:43:26.047640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 47905. [D 20:43:26.047650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 47906. [D 20:43:26.047661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 47907. [D 20:43:26.047671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 47908. [D 20:43:26.047681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 47909. [D 20:43:26.047692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 47910. [D 20:43:26.047703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 47911. [D 20:43:26.047732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 47912. [D 20:43:26.047742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 47913. [D 20:43:26.047752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 47914. [D 20:43:26.047762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 47915. [D 20:43:26.047774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 47916. [D 20:43:26.047784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 47917. [D 20:43:26.047794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 47918. [D 20:43:26.047811] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 47919. [D 20:43:26.047840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 47920. [D 20:43:26.047851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 47921. [D 20:43:26.047861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 47922. [D 20:43:26.047872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 47923. [D 20:43:26.047882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 47924. [D 20:43:26.047892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 47925. [D 20:43:26.047902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 47926. [D 20:43:26.047913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 47927. [D 20:43:26.047939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 47928. [D 20:43:26.047952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 47929. [D 20:43:26.047962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 47930. [D 20:43:26.047972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 47931. [D 20:43:26.047988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 47932. [D 20:43:26.047998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 47933. [D 20:43:26.048008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 47934. [D 20:43:26.048019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 47935. [D 20:43:26.048044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 47936. [D 20:43:26.048057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 47937. [D 20:43:26.048072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 47938. [D 20:43:26.048082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 47939. [D 20:43:26.048092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 47940. [D 20:43:26.048107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 47941. [D 20:43:26.048118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 47942. [D 20:43:26.048127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 47943. [D 20:43:26.048152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 47944. [D 20:43:26.048162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 47945. [D 20:43:26.048177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 47946. [D 20:43:26.048187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 47947. [D 20:43:26.048197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 47948. [D 20:43:26.048211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 47949. [D 20:43:26.048221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 47950. [D 20:43:26.048231] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23ce90 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 47951. [D 20:43:26.053336] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47951. [D 20:43:26.053353] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 56/70. [D 20:43:26.055829] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.055844] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.055853] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:26.055886] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7095 [D 20:43:26.055897] element 0: offset: 0x64dce0, size: 24 [D 20:43:26.055910] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 57/70. [D 20:43:26.058499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.058512] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.058523] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:26.058538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7099 [D 20:43:26.058548] element 0: offset: 0x657310, size: 24 [D 20:43:26.058557] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 58/70. [D 20:43:26.064873] openib_check_cq: completed rdma wr_id 2aaaab23ce90, nic_wr_credit 47950. [D 20:43:26.064889] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 59/70. [D 20:43:26.067203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.067216] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.067225] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:26.067302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.067314] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.067340] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:26.069981] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7099 [D 20:43:26.070036] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 60/70. [D 20:43:26.070118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 47950. [D 20:43:26.070136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 47951. [D 20:43:26.070147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 47952. [D 20:43:26.070158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 47953. [D 20:43:26.070211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 47954. [D 20:43:26.070222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 47955. [D 20:43:26.070232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 47956. [D 20:43:26.070242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 47957. [D 20:43:26.070258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 47958. [D 20:43:26.070268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 47959. [D 20:43:26.070296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 47960. [D 20:43:26.070306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 47961. [D 20:43:26.070316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 47962. [D 20:43:26.070327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 47963. [D 20:43:26.070351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 47964. [D 20:43:26.070365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 47965. [D 20:43:26.070375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 47966. [D 20:43:26.070385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 47967. [D 20:43:26.070401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 47968. [D 20:43:26.070425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 47969. [D 20:43:26.070438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 47970. [D 20:43:26.070448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 47971. [D 20:43:26.070463] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7095 [D 20:43:26.070483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 47972. [D 20:43:26.070494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 47973. [D 20:43:26.070504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 47974. [D 20:43:26.070514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 47975. [D 20:43:26.070525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 47976. [D 20:43:26.070552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 47977. [D 20:43:26.070563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 47978. [D 20:43:26.070574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 47979. [D 20:43:26.070592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 47980. [D 20:43:26.070601] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 47981. [D 20:43:26.070618] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 0/70. [D 20:43:26.076051] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 47981. [D 20:43:26.076067] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 1/70. [D 20:43:26.076080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 47981. [D 20:43:26.076091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 47982. [D 20:43:26.076101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 47983. [D 20:43:26.076113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 47984. [D 20:43:26.076123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 47985. [D 20:43:26.076134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 47986. [D 20:43:26.076144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 47987. [D 20:43:26.076155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 47988. [D 20:43:26.076168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 47989. [D 20:43:26.076199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 47990. [D 20:43:26.076210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 47991. [D 20:43:26.076222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 47992. [D 20:43:26.076232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 47993. [D 20:43:26.076244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 47994. [D 20:43:26.076262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 47995. [D 20:43:26.076272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 47996. [D 20:43:26.076298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 47997. [D 20:43:26.076308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 47998. [D 20:43:26.076318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 47999. [D 20:43:26.076341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 48000. [D 20:43:26.076351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 48001. [D 20:43:26.076361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 48002. [D 20:43:26.076377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 48003. [D 20:43:26.076387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 48004. [D 20:43:26.076397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 48005. [D 20:43:26.076422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 48006. [D 20:43:26.076432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 48007. [D 20:43:26.076448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 48008. [D 20:43:26.076458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 48009. [D 20:43:26.076469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 48010. [D 20:43:26.076483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 48011. [D 20:43:26.076494] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 48012. [D 20:43:26.076556] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.076572] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.076581] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:26.082012] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 48012. [D 20:43:26.082026] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 2/70. [D 20:43:26.084151] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.084165] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.084174] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:26.392078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.392094] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.392105] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:26.392137] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7103 [D 20:43:26.392148] element 0: offset: 0x661df0, size: 24 [D 20:43:26.392158] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 3/70. [D 20:43:26.392176] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.392185] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.392195] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:26.392221] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7105 [D 20:43:26.392246] element 0: offset: 0x643630, size: 24 [D 20:43:26.392269] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 4/70. [D 20:43:26.397444] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7105 [D 20:43:26.397516] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 5/70. [D 20:43:26.397542] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7103 [D 20:43:26.397553] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 6/70. [D 20:43:26.397657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 48012. [D 20:43:26.397721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 48013. [D 20:43:26.397733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 48014. [D 20:43:26.397744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 48015. [D 20:43:26.397754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 48016. [D 20:43:26.397764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 48017. [D 20:43:26.397780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 48018. [D 20:43:26.397790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 48019. [D 20:43:26.397820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 48020. [D 20:43:26.397831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 48021. [D 20:43:26.397850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 48022. [D 20:43:26.397861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 48023. [D 20:43:26.397871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 48024. [D 20:43:26.397881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 48025. [D 20:43:26.397891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 48026. [D 20:43:26.397901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 48027. [D 20:43:26.397911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 48028. [D 20:43:26.397941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 48029. [D 20:43:26.397952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 48030. [D 20:43:26.397962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 48031. [D 20:43:26.397978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 48032. [D 20:43:26.397988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 48033. [D 20:43:26.398015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 48034. [D 20:43:26.398025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 48035. [D 20:43:26.398035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 48036. [D 20:43:26.398049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 48037. [D 20:43:26.398071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 48038. [D 20:43:26.398086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 48039. [D 20:43:26.398096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 48040. [D 20:43:26.398117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 48041. [D 20:43:26.398127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 48042. [D 20:43:26.398137] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 48043. [D 20:43:26.398151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 48044. [D 20:43:26.398161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 48045. [D 20:43:26.398185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 48046. [D 20:43:26.398197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 48047. [D 20:43:26.398207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 48048. [D 20:43:26.398217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 48049. [D 20:43:26.398245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 48050. [D 20:43:26.398256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 48051. [D 20:43:26.398268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 48052. [D 20:43:26.398296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 48053. [D 20:43:26.398317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 48054. [D 20:43:26.398332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 48055. [D 20:43:26.398342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 48056. [D 20:43:26.398352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 48057. [D 20:43:26.398366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 48058. [D 20:43:26.398376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 48059. [D 20:43:26.398386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 48060. [D 20:43:26.398415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 48061. [D 20:43:26.398426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 48062. [D 20:43:26.398438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 48063. [D 20:43:26.398448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 48064. [D 20:43:26.398474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 48065. [D 20:43:26.398484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 48066. [D 20:43:26.398506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 48067. [D 20:43:26.398516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 48068. [D 20:43:26.398526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 48069. [D 20:43:26.398549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 48070. [D 20:43:26.398560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 48071. [D 20:43:26.398570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 48072. [D 20:43:26.398580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 48073. [D 20:43:26.398591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 48074. [D 20:43:26.398601] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 48075. [D 20:43:26.404655] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 48075. [D 20:43:26.404670] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 7/70. [D 20:43:26.410520] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 48074. [D 20:43:26.410534] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 8/70. [D 20:43:26.412832] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.412847] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.412858] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:26.412876] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.412887] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.412896] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:26.416174] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.416187] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.416197] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:26.416227] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7108 [D 20:43:26.416238] element 0: offset: 0x61f310, size: 24 [D 20:43:26.416249] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 9/70. [D 20:43:26.416266] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.416276] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.416285] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:26.416305] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7111 [D 20:43:26.416318] element 0: offset: 0x657310, size: 24 [D 20:43:26.416331] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 10/70. [D 20:43:26.421270] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7108 [D 20:43:26.421341] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 11/70. [D 20:43:26.421413] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7111 [D 20:43:26.421426] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 12/70. [D 20:43:26.421488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 48074. [D 20:43:26.421504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 48075. [D 20:43:26.421515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 48076. [D 20:43:26.421525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 48077. [D 20:43:26.421536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 48078. [D 20:43:26.421586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 48079. [D 20:43:26.421597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 48080. [D 20:43:26.421608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 48081. [D 20:43:26.421618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 48082. [D 20:43:26.421628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 48083. [D 20:43:26.421654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 48084. [D 20:43:26.421664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 48085. [D 20:43:26.421687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 48086. [D 20:43:26.421698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 48087. [D 20:43:26.421709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 48088. [D 20:43:26.421719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 48089. [D 20:43:26.421729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 48090. [D 20:43:26.421740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 48091. [D 20:43:26.421750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 48092. [D 20:43:26.421759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 48093. [D 20:43:26.421770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 48094. [D 20:43:26.421788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 48095. [D 20:43:26.421814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 48096. [D 20:43:26.421828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 48097. [D 20:43:26.421839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 48098. [D 20:43:26.421848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 48099. [D 20:43:26.421876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 48100. [D 20:43:26.421887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 48101. [D 20:43:26.421898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 48102. [D 20:43:26.421908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 48103. [D 20:43:26.421918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 48104. [D 20:43:26.421932] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 48105. [D 20:43:26.421945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 48106. [D 20:43:26.421955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 48107. [D 20:43:26.421981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 48108. [D 20:43:26.421992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 48109. [D 20:43:26.422002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 48110. [D 20:43:26.422012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 48111. [D 20:43:26.422036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 48112. [D 20:43:26.422047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 48113. [D 20:43:26.422057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 48114. [D 20:43:26.422067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 48115. [D 20:43:26.422086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 48116. [D 20:43:26.422106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 48117. [D 20:43:26.422117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 48118. [D 20:43:26.422127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 48119. [D 20:43:26.422136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 48120. [D 20:43:26.422160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 48121. [D 20:43:26.422171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 48122. [D 20:43:26.422181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 48123. [D 20:43:26.422196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 48124. [D 20:43:26.422206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 48125. [D 20:43:26.422217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 48126. [D 20:43:26.422231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 48127. [D 20:43:26.422241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 48128. [D 20:43:26.422251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 48129. [D 20:43:26.422281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 48130. [D 20:43:26.422293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 48131. [D 20:43:26.422303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 48132. [D 20:43:26.422313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 48133. [D 20:43:26.422324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 48134. [D 20:43:26.422335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 48135. [D 20:43:26.422345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 48136. [D 20:43:26.422355] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d380 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 48137. [D 20:43:26.428866] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 48137. [D 20:43:26.428881] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 13/70. [D 20:43:26.438573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.438589] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.438598] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:26.438634] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7115 [D 20:43:26.438646] element 0: offset: 0x661df0, size: 24 [D 20:43:26.438657] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 14/70. [D 20:43:26.438684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.438694] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.438702] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:26.438717] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7117 [D 20:43:26.438726] element 0: offset: 0x6435e0, size: 24 [D 20:43:26.438736] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 15/70. [D 20:43:26.438863] openib_check_cq: completed rdma wr_id 2aaaab23d380, nic_wr_credit 48136. [D 20:43:26.438909] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 16/70. [D 20:43:26.438962] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.438976] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.438984] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:26.439073] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.439084] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.439092] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:26.443230] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7115 [D 20:43:26.443291] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 17/70. [D 20:43:26.443351] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7117 [D 20:43:26.443366] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 18/70. [D 20:43:26.446656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 48136. [D 20:43:26.446673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 48137. [D 20:43:26.446684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 48138. [D 20:43:26.446695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 48139. [D 20:43:26.446705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 48140. [D 20:43:26.446715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 48141. [D 20:43:26.446725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 48142. [D 20:43:26.446740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 48143. [D 20:43:26.446751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 48144. [D 20:43:26.446761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 48145. [D 20:43:26.446771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 48146. [D 20:43:26.446786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 48147. [D 20:43:26.446796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 48148. [D 20:43:26.446806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 48149. [D 20:43:26.446817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 48150. [D 20:43:26.446827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 48151. [D 20:43:26.446837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 48152. [D 20:43:26.446851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 48153. [D 20:43:26.446861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 48154. [D 20:43:26.446871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 48155. [D 20:43:26.446881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 48156. [D 20:43:26.446925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 48157. [D 20:43:26.446935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 48158. [D 20:43:26.446944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 48159. [D 20:43:26.446960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 48160. [D 20:43:26.446970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 48161. [D 20:43:26.446980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 48162. [D 20:43:26.446990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 48163. [D 20:43:26.447000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 48164. [D 20:43:26.447010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 48165. [D 20:43:26.447020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 48166. [D 20:43:26.447037] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208840 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 48167. [D 20:43:26.447051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 48168. [D 20:43:26.447061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 48169. [D 20:43:26.447070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 48170. [D 20:43:26.447080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 48171. [D 20:43:26.447091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 48172. [D 20:43:26.447101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 48173. [D 20:43:26.447111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 48174. [D 20:43:26.447121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 48175. [D 20:43:26.447131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 48176. [D 20:43:26.447142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 48177. [D 20:43:26.447152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 48178. [D 20:43:26.447162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 48179. [D 20:43:26.447189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 48180. [D 20:43:26.447199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 48181. [D 20:43:26.447209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 48182. [D 20:43:26.447219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 48183. [D 20:43:26.447229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 48184. [D 20:43:26.447239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 48185. [D 20:43:26.447268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 48186. [D 20:43:26.447278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 48187. [D 20:43:26.447291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 48188. [D 20:43:26.447301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 48189. [D 20:43:26.447314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 48190. [D 20:43:26.447337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 48191. [D 20:43:26.447347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 48192. [D 20:43:26.447359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 48193. [D 20:43:26.447374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 48194. [D 20:43:26.447384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 48195. [D 20:43:26.447404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 48196. [D 20:43:26.447414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 48197. [D 20:43:26.447424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 48198. [D 20:43:26.447438] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230260 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 48199. [D 20:43:26.452567] openib_check_cq: completed rdma wr_id 2aaaab208840, nic_wr_credit 48199. [D 20:43:26.452583] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 19/70. [D 20:43:26.454907] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.454922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.454932] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:26.454963] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7119 [D 20:43:26.454975] element 0: offset: 0x2aaaab23d1d0, size: 24 [D 20:43:26.454988] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 20/70. [D 20:43:26.457671] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.457685] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.457694] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:26.457709] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7123 [D 20:43:26.457719] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:26.457729] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 21/70. [D 20:43:26.464105] openib_check_cq: completed rdma wr_id 2aaaab230260, nic_wr_credit 48198. [D 20:43:26.464119] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 22/70. [D 20:43:26.466453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.466467] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.466476] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:26.466553] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.466566] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.466575] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:26.468558] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7119 [D 20:43:26.468581] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 23/70. [D 20:43:26.470727] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7123 [D 20:43:26.470743] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 24/70. [D 20:43:26.470776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 48198. [D 20:43:26.470838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 48199. [D 20:43:26.470849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 48200. [D 20:43:26.470860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 48201. [D 20:43:26.470874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 48202. [D 20:43:26.470884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 48203. [D 20:43:26.470894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 48204. [D 20:43:26.470904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 48205. [D 20:43:26.470916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 48206. [D 20:43:26.470925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 48207. [D 20:43:26.470942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 48208. [D 20:43:26.470954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 48209. [D 20:43:26.470963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 48210. [D 20:43:26.471003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 48211. [D 20:43:26.471014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 48212. [D 20:43:26.471037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 48213. [D 20:43:26.471051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 48214. [D 20:43:26.471061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 48215. [D 20:43:26.471076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 48216. [D 20:43:26.471087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 48217. [D 20:43:26.471112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 48218. [D 20:43:26.471122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 48219. [D 20:43:26.471132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 48220. [D 20:43:26.471143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 48221. [D 20:43:26.471153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 48222. [D 20:43:26.471178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 48223. [D 20:43:26.471192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 48224. [D 20:43:26.471202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 48225. [D 20:43:26.471212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 48226. [D 20:43:26.471235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 48227. [D 20:43:26.471245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 48228. [D 20:43:26.471255] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab208840 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 48229. [D 20:43:26.476240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 48230. [D 20:43:26.476255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 48231. [D 20:43:26.476267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 48232. [D 20:43:26.476277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 48233. [D 20:43:26.476287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 48234. [D 20:43:26.476303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 48235. [D 20:43:26.476313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 48236. [D 20:43:26.476323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 48237. [D 20:43:26.476334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 48238. [D 20:43:26.476344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 48239. [D 20:43:26.476354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 48240. [D 20:43:26.476364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 48241. [D 20:43:26.476395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 48242. [D 20:43:26.476406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 48243. [D 20:43:26.476416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 48244. [D 20:43:26.476432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 48245. [D 20:43:26.476441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 48246. [D 20:43:26.476461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 48247. [D 20:43:26.476471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 48248. [D 20:43:26.476481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 48249. [D 20:43:26.476496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 48250. [D 20:43:26.476506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 48251. [D 20:43:26.476516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 48252. [D 20:43:26.476526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 48253. [D 20:43:26.476555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 48254. [D 20:43:26.476565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 48255. [D 20:43:26.476580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 48256. [D 20:43:26.476590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 48257. [D 20:43:26.476600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 48258. [D 20:43:26.476626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 48259. [D 20:43:26.476636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 48260. [D 20:43:26.476649] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d350 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 48261. [D 20:43:26.476757] openib_check_cq: completed rdma wr_id 2aaaab208840, nic_wr_credit 48261. [D 20:43:26.476773] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 25/70. [D 20:43:26.483542] openib_check_cq: completed rdma wr_id 2aaaab23d350, nic_wr_credit 48260. [D 20:43:26.483557] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 26/70. [D 20:43:26.486639] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.486654] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.486665] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:26.486681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.486690] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.486699] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:26.486718] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.486729] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.486737] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:26.486795] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7127 [D 20:43:26.486825] element 0: offset: 0x2aaaab2085a0, size: 24 [D 20:43:26.486837] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 27/70. [D 20:43:26.486868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.486879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.486888] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:26.486902] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7129 [D 20:43:26.486912] element 0: offset: 0x2aaaab203290, size: 24 [D 20:43:26.486926] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 28/70. [D 20:43:26.491336] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7127 [D 20:43:26.491357] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 29/70. [D 20:43:26.491507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 48260. [D 20:43:26.491570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 48261. [D 20:43:26.491583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 48262. [D 20:43:26.491593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 48263. [D 20:43:26.491607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 48264. [D 20:43:26.491617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 48265. [D 20:43:26.491627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 48266. [D 20:43:26.491641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 48267. [D 20:43:26.491651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 48268. [D 20:43:26.491661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 48269. [D 20:43:26.491676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 48270. [D 20:43:26.491686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 48271. [D 20:43:26.491696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 48272. [D 20:43:26.491746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 48273. [D 20:43:26.491757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 48274. [D 20:43:26.491766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 48275. [D 20:43:26.491792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 48276. [D 20:43:26.491802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 48277. [D 20:43:26.491812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 48278. [D 20:43:26.491826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 48279. [D 20:43:26.491835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 48280. [D 20:43:26.491860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 48281. [D 20:43:26.491875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 48282. [D 20:43:26.491885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 48283. [D 20:43:26.491895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 48284. [D 20:43:26.491910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 48285. [D 20:43:26.491920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 48286. [D 20:43:26.491947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 48287. [D 20:43:26.491957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 48288. [D 20:43:26.491970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 48289. [D 20:43:26.491984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 48290. [D 20:43:26.491994] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 48291. [D 20:43:26.496142] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7129 [D 20:43:26.496160] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 30/70. [D 20:43:26.500207] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 48291. [D 20:43:26.500255] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 31/70. [D 20:43:26.502597] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.502612] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.502622] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:26.502959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 48291. [D 20:43:26.502974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 48292. [D 20:43:26.502985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 48293. [D 20:43:26.502995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 48294. [D 20:43:26.503010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 48295. [D 20:43:26.503021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 48296. [D 20:43:26.503031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 48297. [D 20:43:26.503042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 48298. [D 20:43:26.503052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 48299. [D 20:43:26.503061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 48300. [D 20:43:26.503071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 48301. [D 20:43:26.503082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 48302. [D 20:43:26.503092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 48303. [D 20:43:26.503102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 48304. [D 20:43:26.503111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 48305. [D 20:43:26.503122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 48306. [D 20:43:26.503132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 48307. [D 20:43:26.503155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 48308. [D 20:43:26.503166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 48309. [D 20:43:26.503177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 48310. [D 20:43:26.503187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 48311. [D 20:43:26.503215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 48312. [D 20:43:26.503226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 48313. [D 20:43:26.503241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 48314. [D 20:43:26.503252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 48315. [D 20:43:26.503261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 48316. [D 20:43:26.503272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 48317. [D 20:43:26.503296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 48318. [D 20:43:26.503310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 48319. [D 20:43:26.503321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 48320. [D 20:43:26.503331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 48321. [D 20:43:26.503342] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202e60 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 48322. [D 20:43:26.507832] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.507846] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.507856] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:26.507888] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7131 [D 20:43:26.507899] element 0: offset: 0x2aaaab2085a0, size: 24 [D 20:43:26.507911] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 32/70. [D 20:43:26.508923] openib_check_cq: completed rdma wr_id 2aaaab202e60, nic_wr_credit 48322. [D 20:43:26.508937] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 33/70. [D 20:43:26.511275] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.511289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.511298] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:26.513269] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7131 [D 20:43:26.513288] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 34/70. [D 20:43:26.513351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 48322. [D 20:43:26.513403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 48323. [D 20:43:26.513421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 48324. [D 20:43:26.513438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 48325. [D 20:43:26.513449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 48326. [D 20:43:26.513459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 48327. [D 20:43:26.513475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 48328. [D 20:43:26.513485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 48329. [D 20:43:26.513495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 48330. [D 20:43:26.513535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 48331. [D 20:43:26.513546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 48332. [D 20:43:26.513556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 48333. [D 20:43:26.513566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 48334. [D 20:43:26.513599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 48335. [D 20:43:26.513609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 48336. [D 20:43:26.513620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 48337. [D 20:43:26.513630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 48338. [D 20:43:26.513660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 48339. [D 20:43:26.513670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 48340. [D 20:43:26.513682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 48341. [D 20:43:26.513692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 48342. [D 20:43:26.513703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 48343. [D 20:43:26.513726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 48344. [D 20:43:26.513736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 48345. [D 20:43:26.513750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 48346. [D 20:43:26.513760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 48347. [D 20:43:26.513770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 48348. [D 20:43:26.513796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 48349. [D 20:43:26.513806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 48350. [D 20:43:26.513817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 48351. [D 20:43:26.513827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 48352. [D 20:43:26.513837] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 48353. [D 20:43:26.519292] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 48353. [D 20:43:26.519308] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 35/70. [D 20:43:26.521513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.521528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.521538] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:26.829009] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.829024] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.829035] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:26.829067] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7135 [D 20:43:26.829077] element 0: offset: 0x2aaaab2085a0, size: 24 [D 20:43:26.829089] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 36/70. [D 20:43:26.831197] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7135 [D 20:43:26.831216] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 37/70. [D 20:43:26.831372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 48353. [D 20:43:26.831437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 48354. [D 20:43:26.831449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 48355. [D 20:43:26.831459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 48356. [D 20:43:26.831474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 48357. [D 20:43:26.831484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 48358. [D 20:43:26.831496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 48359. [D 20:43:26.831511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 48360. [D 20:43:26.831521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 48361. [D 20:43:26.831530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 48362. [D 20:43:26.831546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 48363. [D 20:43:26.831556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 48364. [D 20:43:26.831565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 48365. [D 20:43:26.831581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 48366. [D 20:43:26.831591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 48367. [D 20:43:26.831623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 48368. [D 20:43:26.831634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 48369. [D 20:43:26.831644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 48370. [D 20:43:26.831668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 48371. [D 20:43:26.831678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 48372. [D 20:43:26.831688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 48373. [D 20:43:26.831704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 48374. [D 20:43:26.831714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 48375. [D 20:43:26.831742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 48376. [D 20:43:26.831754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 48377. [D 20:43:26.831764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 48378. [D 20:43:26.831774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 48379. [D 20:43:26.831790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 48380. [D 20:43:26.831800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 48381. [D 20:43:26.831809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 48382. [D 20:43:26.831819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 48383. [D 20:43:26.831837] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2093c0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 48384. [D 20:43:26.843223] openib_check_cq: completed rdma wr_id 2aaaab2093c0, nic_wr_credit 48384. [D 20:43:26.843240] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 38/70. [D 20:43:26.845580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.845595] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.845606] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:26.872313] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.872338] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.872349] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:26.872380] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7140 [D 20:43:26.872391] element 0: offset: 0x2aaaab2085a0, size: 24 [D 20:43:26.872403] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 39/70. [D 20:43:26.874433] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7140 [D 20:43:26.874453] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 40/70. [D 20:43:26.874507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 48384. [D 20:43:26.874569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 48385. [D 20:43:26.874581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 48386. [D 20:43:26.874600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 48387. [D 20:43:26.874610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 48388. [D 20:43:26.874620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 48389. [D 20:43:26.874636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 48390. [D 20:43:26.874646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 48391. [D 20:43:26.874656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 48392. [D 20:43:26.874666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 48393. [D 20:43:26.874676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 48394. [D 20:43:26.874686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 48395. [D 20:43:26.874695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 48396. [D 20:43:26.874713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 48397. [D 20:43:26.874722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 48398. [D 20:43:26.874732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 48399. [D 20:43:26.874790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 48400. [D 20:43:26.874800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 48401. [D 20:43:26.874810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 48402. [D 20:43:26.874821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 48403. [D 20:43:26.874831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 48404. [D 20:43:26.874841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 48405. [D 20:43:26.874854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.874887] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.874907] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:26.874942] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7143 [D 20:43:26.874955] element 0: offset: 0x2aaaab2088e0, size: 24 [D 20:43:26.874982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 48406. [D 20:43:26.874993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 48407. [D 20:43:26.875003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 48408. [D 20:43:26.875013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 48409. [D 20:43:26.875027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 48410. [D 20:43:26.875037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 48411. [D 20:43:26.875047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 48412. [D 20:43:26.875062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 48413. [D 20:43:26.875072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 48414. [D 20:43:26.875082] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23f850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 48415. [D 20:43:26.875117] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 41/70. [D 20:43:26.875146] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.875156] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.875181] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:26.875198] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7144 [D 20:43:26.875207] element 0: offset: 0x2aaaab208fb0, size: 24 [D 20:43:26.875237] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 42/70. [D 20:43:26.875256] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:26.875266] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.875278] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:26.875292] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7147 [D 20:43:26.875301] element 0: offset: 0x2aaaab2030c0, size: 24 [D 20:43:26.875311] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 43/70. [D 20:43:26.883274] openib_check_cq: completed rdma wr_id 2aaaab23f850, nic_wr_credit 48415. [D 20:43:26.883290] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 44/70. [D 20:43:26.885703] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.885717] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.885728] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:26.887690] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7143 [D 20:43:26.887710] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 45/70. [D 20:43:26.888375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 48415. [D 20:43:26.888437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 48416. [D 20:43:26.888467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 48417. [D 20:43:26.888478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 48418. [D 20:43:26.888490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 48419. [D 20:43:26.888500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 48420. [D 20:43:26.888510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 48421. [D 20:43:26.888524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 48422. [D 20:43:26.888534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 48423. [D 20:43:26.888544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 48424. [D 20:43:26.888560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 48425. [D 20:43:26.888603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 48426. [D 20:43:26.888614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 48427. [D 20:43:26.888641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 48428. [D 20:43:26.888652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 48429. [D 20:43:26.888662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 48430. [D 20:43:26.888672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 48431. [D 20:43:26.888695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 48432. [D 20:43:26.888706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 48433. [D 20:43:26.888716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 48434. [D 20:43:26.888726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 48435. [D 20:43:26.888736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 48436. [D 20:43:26.888746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 48437. [D 20:43:26.888756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 48438. [D 20:43:26.888780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 48439. [D 20:43:26.888791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 48440. [D 20:43:26.888802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 48441. [D 20:43:26.888811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 48442. [D 20:43:26.888827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 48443. [D 20:43:26.888837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 48444. [D 20:43:26.888847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 48445. [D 20:43:26.888857] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23f850 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 48446. [D 20:43:26.890694] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7147 [D 20:43:26.890749] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 46/70. [D 20:43:26.892764] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7144 [D 20:43:26.892781] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 47/70. [D 20:43:26.900210] openib_check_cq: completed rdma wr_id 2aaaab23f850, nic_wr_credit 48446. [D 20:43:26.900266] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 48/70. [D 20:43:26.900282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 48446. [D 20:43:26.900295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 48447. [D 20:43:26.900308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 48448. [D 20:43:26.900318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 48449. [D 20:43:26.900331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 48450. [D 20:43:26.900341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 48451. [D 20:43:26.900350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 48452. [D 20:43:26.900361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 48453. [D 20:43:26.900371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 48454. [D 20:43:26.900381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 48455. [D 20:43:26.900391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 48456. [D 20:43:26.900416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 48457. [D 20:43:26.900439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 48458. [D 20:43:26.900449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 48459. [D 20:43:26.900458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 48460. [D 20:43:26.900468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 48461. [D 20:43:26.900478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 48462. [D 20:43:26.900499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 48463. [D 20:43:26.900509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 48464. [D 20:43:26.900519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 48465. [D 20:43:26.900528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 48466. [D 20:43:26.900539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 48467. [D 20:43:26.900551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 48468. [D 20:43:26.900561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 48469. [D 20:43:26.900571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 48470. [D 20:43:26.900582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 48471. [D 20:43:26.900592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 48472. [D 20:43:26.900601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 48473. [D 20:43:26.900611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 48474. [D 20:43:26.900640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 48475. [D 20:43:26.900650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 48476. [D 20:43:26.900661] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23f670 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 48477. [D 20:43:26.900673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 48478. [D 20:43:26.900683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 48479. [D 20:43:26.900693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 48480. [D 20:43:26.900718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 48481. [D 20:43:26.900729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 48482. [D 20:43:26.900739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 48483. [D 20:43:26.900749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 48484. [D 20:43:26.900781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 48485. [D 20:43:26.900792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 48486. [D 20:43:26.900802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 48487. [D 20:43:26.900813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 48488. [D 20:43:26.900822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 48489. [D 20:43:26.900845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 48490. [D 20:43:26.900856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 48491. [D 20:43:26.900865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 48492. [D 20:43:26.900875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 48493. [D 20:43:26.900891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 48494. [D 20:43:26.900901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 48495. [D 20:43:26.900919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 48496. [D 20:43:26.900936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 48497. [D 20:43:26.900945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 48498. [D 20:43:26.900955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 48499. [D 20:43:26.900971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 48500. [D 20:43:26.900981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 48501. [D 20:43:26.900991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 48502. [D 20:43:26.901017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 48503. [D 20:43:26.901027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 48504. [D 20:43:26.901042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 48505. [D 20:43:26.901052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 48506. [D 20:43:26.901062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 48507. [D 20:43:26.901089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 48508. [D 20:43:26.901104] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 48509. [D 20:43:26.901179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.901194] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.901215] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:26.912128] openib_check_cq: completed rdma wr_id 2aaaab23f670, nic_wr_credit 48509. [D 20:43:26.912143] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 49/70. [D 20:43:26.921640] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 48508. [D 20:43:26.921656] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 50/70. [D 20:43:26.923838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.923851] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.923860] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:26.923874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:26.923883] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:26.923892] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:27.045666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.045681] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.045692] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:27.045724] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7150 [D 20:43:27.045735] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:27.045747] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 51/70. [D 20:43:27.047981] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7150 [D 20:43:27.048001] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 52/70. [D 20:43:27.048057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 48508. [D 20:43:27.048121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 48509. [D 20:43:27.048133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 48510. [D 20:43:27.048143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 48511. [D 20:43:27.048154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 48512. [D 20:43:27.048163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 48513. [D 20:43:27.048173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 48514. [D 20:43:27.048184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 48515. [D 20:43:27.048193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 48516. [D 20:43:27.048203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 48517. [D 20:43:27.048213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 48518. [D 20:43:27.048230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 48519. [D 20:43:27.048239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 48520. [D 20:43:27.048249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 48521. [D 20:43:27.048297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 48522. [D 20:43:27.048308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 48523. [D 20:43:27.048318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 48524. [D 20:43:27.048328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 48525. [D 20:43:27.048365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 48526. [D 20:43:27.048376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 48527. [D 20:43:27.048386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 48528. [D 20:43:27.048414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 48529. [D 20:43:27.048425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 48530. [D 20:43:27.048438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 48531. [D 20:43:27.048448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 48532. [D 20:43:27.048458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 48533. [D 20:43:27.048471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 48534. [D 20:43:27.048480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 48535. [D 20:43:27.048490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 48536. [D 20:43:27.048501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 48537. [D 20:43:27.048527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 48538. [D 20:43:27.048537] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 48539. [D 20:43:27.052358] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.052374] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.052385] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:27.052419] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7153 [D 20:43:27.052430] element 0: offset: 0x2aaaab2085a0, size: 24 [D 20:43:27.052444] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 53/70. [D 20:43:27.053986] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 48539. [D 20:43:27.054001] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 54/70. [D 20:43:27.056362] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.056376] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.056385] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:27.058331] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7153 [D 20:43:27.058384] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 55/70. [D 20:43:27.058526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 48539. [D 20:43:27.058543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 48540. [D 20:43:27.058555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 48541. [D 20:43:27.058565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 48542. [D 20:43:27.058575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 48543. [D 20:43:27.058589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 48544. [D 20:43:27.058599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 48545. [D 20:43:27.058609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 48546. [D 20:43:27.058625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 48547. [D 20:43:27.058635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 48548. [D 20:43:27.058645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 48549. [D 20:43:27.058672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 48550. [D 20:43:27.058682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 48551. [D 20:43:27.058697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 48552. [D 20:43:27.058706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 48553. [D 20:43:27.058716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 48554. [D 20:43:27.058745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 48555. [D 20:43:27.058755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 48556. [D 20:43:27.058781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 48557. [D 20:43:27.058792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 48558. [D 20:43:27.058807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 48559. [D 20:43:27.058817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 48560. [D 20:43:27.058836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 48561. [D 20:43:27.058851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 48562. [D 20:43:27.058872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 48563. [D 20:43:27.058882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 48564. [D 20:43:27.058906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 48565. [D 20:43:27.058916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 48566. [D 20:43:27.058935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 48567. [D 20:43:27.058945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 48568. [D 20:43:27.058955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 48569. [D 20:43:27.058968] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cf80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 48570. [D 20:43:27.070130] openib_check_cq: completed rdma wr_id 2aaaab23cf80, nic_wr_credit 48570. [D 20:43:27.070144] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 56/70. [D 20:43:27.073860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.073873] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.073884] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:27.073898] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7157 [D 20:43:27.073908] element 0: offset: 0x2aaaab233c80, size: 24 [D 20:43:27.073918] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 57/70. [D 20:43:27.073932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.073946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.073955] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:27.073969] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7159 [D 20:43:27.073979] element 0: offset: 0x2aaaab2088e0, size: 24 [D 20:43:27.073988] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 58/70. [D 20:43:27.074007] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.074017] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.074025] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:27.074039] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.074048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.074060] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:27.074095] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7161 [D 20:43:27.074105] element 0: offset: 0x2aaaab23f8c0, size: 24 [D 20:43:27.074114] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 59/70. [D 20:43:27.078757] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7159 [D 20:43:27.078814] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 60/70. [D 20:43:27.078881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 48570. [D 20:43:27.078952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 48571. [D 20:43:27.078963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 48572. [D 20:43:27.078973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 48573. [D 20:43:27.078983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 48574. [D 20:43:27.078993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 48575. [D 20:43:27.079003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 48576. [D 20:43:27.079013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 48577. [D 20:43:27.079022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 48578. [D 20:43:27.079032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 48579. [D 20:43:27.079042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 48580. [D 20:43:27.079052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 48581. [D 20:43:27.079062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 48582. [D 20:43:27.079071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 48583. [D 20:43:27.079081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 48584. [D 20:43:27.079091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 48585. [D 20:43:27.079101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 48586. [D 20:43:27.079111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 48587. [D 20:43:27.079120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 48588. [D 20:43:27.079130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 48589. [D 20:43:27.079140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 48590. [D 20:43:27.079150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 48591. [D 20:43:27.079159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 48592. [D 20:43:27.079169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 48593. [D 20:43:27.079179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 48594. [D 20:43:27.079188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 48595. [D 20:43:27.079198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 48596. [D 20:43:27.079208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 48597. [D 20:43:27.079218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 48598. [D 20:43:27.079229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 48599. [D 20:43:27.079239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 48600. [D 20:43:27.079249] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab216880 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 48601. [D 20:43:27.081433] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7157 [D 20:43:27.081474] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 0/70. [D 20:43:27.081488] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.081505] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.081514] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.081547] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7165 [D 20:43:27.081558] element 0: offset: 0x2aaaab2084c0, size: 24 [D 20:43:27.081571] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 1/70. [D 20:43:27.083048] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7161 [D 20:43:27.083068] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 2/70. [D 20:43:27.089153] openib_check_cq: completed rdma wr_id 2aaaab216880, nic_wr_credit 48601. [D 20:43:27.089172] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 3/70. [D 20:43:27.089198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 48601. [D 20:43:27.089211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 48602. [D 20:43:27.089221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 48603. [D 20:43:27.089231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 48604. [D 20:43:27.089242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 48605. [D 20:43:27.089252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 48606. [D 20:43:27.089262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 48607. [D 20:43:27.089272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 48608. [D 20:43:27.089297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 48609. [D 20:43:27.089309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 48610. [D 20:43:27.089330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 48611. [D 20:43:27.089354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 48612. [D 20:43:27.089365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 48613. [D 20:43:27.089377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 48614. [D 20:43:27.089397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 48615. [D 20:43:27.089411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 48616. [D 20:43:27.089430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 48617. [D 20:43:27.089440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 48618. [D 20:43:27.089451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 48619. [D 20:43:27.089471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 48620. [D 20:43:27.089481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 48621. [D 20:43:27.089505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 48622. [D 20:43:27.089522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 48623. [D 20:43:27.091736] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7165 [D 20:43:27.091755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 48624. [D 20:43:27.091807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 48625. [D 20:43:27.091818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 48626. [D 20:43:27.091829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 48627. [D 20:43:27.091839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 48628. [D 20:43:27.091849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 48629. [D 20:43:27.091859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 48630. [D 20:43:27.091869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 48631. [D 20:43:27.091880] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab216580 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 48632. [D 20:43:27.091940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 48633. [D 20:43:27.091951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 48634. [D 20:43:27.091970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 48635. [D 20:43:27.091983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 48636. [D 20:43:27.091993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 48637. [D 20:43:27.092005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 48638. [D 20:43:27.092020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 48639. [D 20:43:27.092030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 48640. [D 20:43:27.092055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 48641. [D 20:43:27.092066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 48642. [D 20:43:27.092076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 48643. [D 20:43:27.092089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 48644. [D 20:43:27.092099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 48645. [D 20:43:27.092109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 48646. [D 20:43:27.092132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 48647. [D 20:43:27.092142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 48648. [D 20:43:27.092152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 48649. [D 20:43:27.092166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 48650. [D 20:43:27.092205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 48651. [D 20:43:27.092215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 48652. [D 20:43:27.092225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 48653. [D 20:43:27.092235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 48654. [D 20:43:27.092245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 48655. [D 20:43:27.092271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 48656. [D 20:43:27.092281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 48657. [D 20:43:27.092291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 48658. [D 20:43:27.092304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 48659. [D 20:43:27.092314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 48660. [D 20:43:27.092324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 48661. [D 20:43:27.092351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 48662. [D 20:43:27.092361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 48663. [D 20:43:27.092372] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c050 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 48664. [D 20:43:27.092396] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 4/70. [D 20:43:27.092488] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.092503] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.092513] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.100850] openib_check_cq: completed rdma wr_id 2aaaab216580, nic_wr_credit 48664. [D 20:43:27.100866] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 5/70. [D 20:43:27.103162] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.103174] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.103184] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.103214] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7168 [D 20:43:27.103225] element 0: offset: 0x2aaaab2085a0, size: 24 [D 20:43:27.103235] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 6/70. [D 20:43:27.112480] openib_check_cq: completed rdma wr_id 2aaaab23c050, nic_wr_credit 48663. [D 20:43:27.112495] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 7/70. [D 20:43:27.112523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 48663. [D 20:43:27.112536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 48664. [D 20:43:27.112546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 48665. [D 20:43:27.112556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 48666. [D 20:43:27.112568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 48667. [D 20:43:27.112577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 48668. [D 20:43:27.112588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 48669. [D 20:43:27.112598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 48670. [D 20:43:27.112608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 48671. [D 20:43:27.112617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 48672. [D 20:43:27.112628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 48673. [D 20:43:27.112654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 48674. [D 20:43:27.112668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 48675. [D 20:43:27.112679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 48676. [D 20:43:27.112689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 48677. [D 20:43:27.112699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 48678. [D 20:43:27.112709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 48679. [D 20:43:27.112719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 48680. [D 20:43:27.112729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 48681. [D 20:43:27.112758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 48682. [D 20:43:27.112768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 48683. [D 20:43:27.112782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 48684. [D 20:43:27.112803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 48685. [D 20:43:27.112816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 48686. [D 20:43:27.112826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 48687. [D 20:43:27.112838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 48688. [D 20:43:27.112853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 48689. [D 20:43:27.112863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 48690. [D 20:43:27.112890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 48691. [D 20:43:27.112899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 48692. [D 20:43:27.112943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 48693. [D 20:43:27.112956] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cba0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 48694. [D 20:43:27.112917] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.115161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.115171] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.115225] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.115239] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.115250] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:27.117543] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7168 [D 20:43:27.117560] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 8/70. [D 20:43:27.120191] openib_check_cq: completed rdma wr_id 2aaaab23cba0, nic_wr_credit 48694. [D 20:43:27.120206] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 9/70. [D 20:43:27.121131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 48694. [D 20:43:27.121146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 48695. [D 20:43:27.121158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 48696. [D 20:43:27.121168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 48697. [D 20:43:27.121178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 48698. [D 20:43:27.121193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 48699. [D 20:43:27.121203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 48700. [D 20:43:27.121213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 48701. [D 20:43:27.121229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 48702. [D 20:43:27.121239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 48703. [D 20:43:27.121248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 48704. [D 20:43:27.121277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 48705. [D 20:43:27.121288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 48706. [D 20:43:27.121302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 48707. [D 20:43:27.121312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 48708. [D 20:43:27.121322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 48709. [D 20:43:27.121335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 48710. [D 20:43:27.121357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 48711. [D 20:43:27.121371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 48712. [D 20:43:27.121381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 48713. [D 20:43:27.121391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 48714. [D 20:43:27.121404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 48715. [D 20:43:27.121426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 48716. [D 20:43:27.121440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 48717. [D 20:43:27.121450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 48718. [D 20:43:27.121459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 48719. [D 20:43:27.121473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 48720. [D 20:43:27.121483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 48721. [D 20:43:27.121503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 48722. [D 20:43:27.121516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 48723. [D 20:43:27.121533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 48724. [D 20:43:27.121543] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab216880 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 48725. [D 20:43:27.123852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.123865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.123874] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:27.127043] openib_check_cq: completed rdma wr_id 2aaaab216880, nic_wr_credit 48725. [D 20:43:27.127057] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 10/70. [D 20:43:27.128353] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.128366] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.128375] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:27.130956] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.130970] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.130979] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:27.130994] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7172 [D 20:43:27.131004] element 0: offset: 0x2aaaab2088e0, size: 24 [D 20:43:27.131013] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 11/70. [D 20:43:27.131028] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.131042] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.131051] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:27.131065] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7173 [D 20:43:27.131075] element 0: offset: 0x2aaaab233c80, size: 24 [D 20:43:27.131099] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 12/70. [D 20:43:27.136075] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7173 [D 20:43:27.136148] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 13/70. [D 20:43:27.136233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 48725. [D 20:43:27.136247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 48726. [D 20:43:27.136258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 48727. [D 20:43:27.136276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 48728. [D 20:43:27.136286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 48729. [D 20:43:27.136297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 48730. [D 20:43:27.136307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 48731. [D 20:43:27.136424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 48732. [D 20:43:27.136436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 48733. [D 20:43:27.136446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 48734. [D 20:43:27.136456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 48735. [D 20:43:27.136470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 48736. [D 20:43:27.136480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 48737. [D 20:43:27.136490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 48738. [D 20:43:27.136500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 48739. [D 20:43:27.136518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 48740. [D 20:43:27.136527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 48741. [D 20:43:27.136537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 48742. [D 20:43:27.136548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 48743. [D 20:43:27.136572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 48744. [D 20:43:27.136583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 48745. [D 20:43:27.136593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 48746. [D 20:43:27.136603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 48747. [D 20:43:27.136399] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7172 [D 20:43:27.136634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 48748. [D 20:43:27.136645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 48749. [D 20:43:27.136678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 48750. [D 20:43:27.136690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 48751. [D 20:43:27.136700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 48752. [D 20:43:27.136709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 48753. [D 20:43:27.136726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 48754. [D 20:43:27.136735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 48755. [D 20:43:27.136762] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab232750 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 48756. [D 20:43:27.136780] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 14/70. [D 20:43:27.142190] openib_check_cq: completed rdma wr_id 2aaaab232750, nic_wr_credit 48756. [D 20:43:27.142205] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 15/70. [D 20:43:27.142218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 48756. [D 20:43:27.142228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 48757. [D 20:43:27.142241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 48758. [D 20:43:27.142255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 48759. [D 20:43:27.142265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 48760. [D 20:43:27.142275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 48761. [D 20:43:27.142290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 48762. [D 20:43:27.142299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 48763. [D 20:43:27.142309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 48764. [D 20:43:27.142320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 48765. [D 20:43:27.142330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 48766. [D 20:43:27.142339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 48767. [D 20:43:27.142349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 48768. [D 20:43:27.142367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 48769. [D 20:43:27.142393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 48770. [D 20:43:27.142408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 48771. [D 20:43:27.142418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 48772. [D 20:43:27.142427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 48773. [D 20:43:27.142455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 48774. [D 20:43:27.142469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 48775. [D 20:43:27.142482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 48776. [D 20:43:27.142491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 48777. [D 20:43:27.142501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 48778. [D 20:43:27.142515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 48779. [D 20:43:27.142537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 48780. [D 20:43:27.142552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 48781. [D 20:43:27.142562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 48782. [D 20:43:27.142572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 48783. [D 20:43:27.142598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 48784. [D 20:43:27.142608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 48785. [D 20:43:27.142620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 48786. [D 20:43:27.142630] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c560 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 48787. [D 20:43:27.144958] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.144973] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.144983] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:27.148131] openib_check_cq: completed rdma wr_id 2aaaab23c560, nic_wr_credit 48787. [D 20:43:27.148145] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 16/70. [D 20:43:27.148354] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.148367] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.148377] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:27.305200] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.305215] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.305225] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:27.305256] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7177 [D 20:43:27.305267] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:27.305277] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 17/70. [D 20:43:27.307411] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7177 [D 20:43:27.307460] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 18/70. [D 20:43:27.309256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 48787. [D 20:43:27.309314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 48788. [D 20:43:27.309325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 48789. [D 20:43:27.309335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 48790. [D 20:43:27.309346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 48791. [D 20:43:27.309357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 48792. [D 20:43:27.309366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 48793. [D 20:43:27.309377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 48794. [D 20:43:27.309386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 48795. [D 20:43:27.309396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 48796. [D 20:43:27.309406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 48797. [D 20:43:27.309424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 48798. [D 20:43:27.309433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 48799. [D 20:43:27.309443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 48800. [D 20:43:27.309454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 48801. [D 20:43:27.309464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 48802. [D 20:43:27.309474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 48803. [D 20:43:27.309489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 48804. [D 20:43:27.309499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 48805. [D 20:43:27.309509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 48806. [D 20:43:27.309519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 48807. [D 20:43:27.309547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 48808. [D 20:43:27.309557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 48809. [D 20:43:27.309567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 48810. [D 20:43:27.309577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 48811. [D 20:43:27.309588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 48812. [D 20:43:27.309598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 48813. [D 20:43:27.309608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 48814. [D 20:43:27.309626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 48815. [D 20:43:27.309635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 48816. [D 20:43:27.309645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 48817. [D 20:43:27.309681] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202990 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 48818. [D 20:43:27.311991] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.312006] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.312017] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:27.312050] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7180 [D 20:43:27.312061] element 0: offset: 0x2aaaab2084c0, size: 24 [D 20:43:27.312077] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 19/70. [D 20:43:27.316979] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.316994] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.317005] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:27.317019] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7183 [D 20:43:27.317029] element 0: offset: 0x2aaaab233c80, size: 24 [D 20:43:27.317039] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 20/70. [D 20:43:27.319610] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.319624] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.319633] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.319648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7185 [D 20:43:27.319657] element 0: offset: 0x2aaaab2085a0, size: 24 [D 20:43:27.319667] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 21/70. [D 20:43:27.320897] openib_check_cq: completed rdma wr_id 2aaaab202990, nic_wr_credit 48818. [D 20:43:27.320912] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 22/70. [D 20:43:27.323357] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.323371] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.323380] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.326224] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7183 [D 20:43:27.326279] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 23/70. [D 20:43:27.327190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 48818. [D 20:43:27.327249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 48819. [D 20:43:27.327260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 48820. [D 20:43:27.327270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 48821. [D 20:43:27.327280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 48822. [D 20:43:27.327290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 48823. [D 20:43:27.327300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 48824. [D 20:43:27.327309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 48825. [D 20:43:27.327319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 48826. [D 20:43:27.327329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 48827. [D 20:43:27.327339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 48828. [D 20:43:27.327348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 48829. [D 20:43:27.327358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 48830. [D 20:43:27.327368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 48831. [D 20:43:27.327378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 48832. [D 20:43:27.327388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 48833. [D 20:43:27.327398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 48834. [D 20:43:27.327407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 48835. [D 20:43:27.327417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 48836. [D 20:43:27.327427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 48837. [D 20:43:27.327437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 48838. [D 20:43:27.327447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 48839. [D 20:43:27.327457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 48840. [D 20:43:27.327466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 48841. [D 20:43:27.327476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 48842. [D 20:43:27.327486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 48843. [D 20:43:27.327496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 48844. [D 20:43:27.327507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 48845. [D 20:43:27.327517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 48846. [D 20:43:27.327526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 48847. [D 20:43:27.327536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 48848. [D 20:43:27.327546] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22c040 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 48849. [D 20:43:27.328325] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7180 [D 20:43:27.328370] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 24/70. [D 20:43:27.328469] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7185 [D 20:43:27.328486] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 25/70. [D 20:43:27.332117] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.332135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.332146] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.332183] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7189 [D 20:43:27.332195] element 0: offset: 0x2aaaab2093a0, size: 24 [D 20:43:27.332208] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 26/70. [D 20:43:27.338028] openib_check_cq: completed rdma wr_id 2aaaab22c040, nic_wr_credit 48849. [D 20:43:27.338044] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 27/70. [D 20:43:27.338064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 48849. [D 20:43:27.338075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 48850. [D 20:43:27.338087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 48851. [D 20:43:27.338097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 48852. [D 20:43:27.338107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 48853. [D 20:43:27.338117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 48854. [D 20:43:27.338127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 48855. [D 20:43:27.338140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 48856. [D 20:43:27.338171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 48857. [D 20:43:27.338184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 48858. [D 20:43:27.338197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 48859. [D 20:43:27.338207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 48860. [D 20:43:27.338217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 48861. [D 20:43:27.338241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 48862. [D 20:43:27.338251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 48863. [D 20:43:27.338266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 48864. [D 20:43:27.338275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 48865. [D 20:43:27.338285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 48866. [D 20:43:27.338299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 48867. [D 20:43:27.338326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 48868. [D 20:43:27.338338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 48869. [D 20:43:27.338348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 48870. [D 20:43:27.338432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 48871. [D 20:43:27.338445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 48872. [D 20:43:27.338468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 48873. [D 20:43:27.338479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 48874. [D 20:43:27.338489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 48875. [D 20:43:27.338505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 48876. [D 20:43:27.338515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 48877. [D 20:43:27.338525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 48878. [D 20:43:27.338535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 48879. [D 20:43:27.338545] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c520 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 48880. [D 20:43:27.338556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 48881. [D 20:43:27.338566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 48882. [D 20:43:27.338583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 48883. [D 20:43:27.338592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 48884. [D 20:43:27.338602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 48885. [D 20:43:27.338613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 48886. [D 20:43:27.338624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 48887. [D 20:43:27.338633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 48888. [D 20:43:27.338664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 48889. [D 20:43:27.338674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 48890. [D 20:43:27.338684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 48891. [D 20:43:27.338695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 48892. [D 20:43:27.338714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 48893. [D 20:43:27.338730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 48894. [D 20:43:27.338740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 48895. [D 20:43:27.338750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 48896. [D 20:43:27.338765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 48897. [D 20:43:27.338775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 48898. [D 20:43:27.338802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 48899. [D 20:43:27.338812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 48900. [D 20:43:27.338822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 48901. [D 20:43:27.338835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 48902. [D 20:43:27.338858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 48903. [D 20:43:27.338870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 48904. [D 20:43:27.338880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 48905. [D 20:43:27.338890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 48906. [D 20:43:27.338900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 48907. [D 20:43:27.338910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 48908. [D 20:43:27.338920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 48909. [D 20:43:27.338943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 48910. [D 20:43:27.338953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 48911. [D 20:43:27.338963] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 48912. [D 20:43:27.339016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.339027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.339036] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.342334] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7189 [D 20:43:27.342353] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 28/70. [D 20:43:27.349676] openib_check_cq: completed rdma wr_id 2aaaab23c520, nic_wr_credit 48912. [D 20:43:27.349731] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 29/70. [D 20:43:27.352060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.352075] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.352084] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.352118] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7192 [D 20:43:27.352130] element 0: offset: 0x2aaaab2088e0, size: 24 [D 20:43:27.352144] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 30/70. [D 20:43:27.361342] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 48911. [D 20:43:27.361359] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 31/70. [D 20:43:27.361388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 48911. [D 20:43:27.361401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 48912. [D 20:43:27.361411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 48913. [D 20:43:27.361422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 48914. [D 20:43:27.361432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 48915. [D 20:43:27.361442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 48916. [D 20:43:27.361452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 48917. [D 20:43:27.361463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 48918. [D 20:43:27.361473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 48919. [D 20:43:27.361516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.361535] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.361545] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.361625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 48920. [D 20:43:27.361640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 48921. [D 20:43:27.361651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 48922. [D 20:43:27.361661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 48923. [D 20:43:27.363697] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7192 [D 20:43:27.363712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 48924. [D 20:43:27.363753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 48925. [D 20:43:27.363772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 48926. [D 20:43:27.363782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 48927. [D 20:43:27.363792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 48928. [D 20:43:27.363808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 48929. [D 20:43:27.363818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 48930. [D 20:43:27.363828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 48931. [D 20:43:27.363843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 48932. [D 20:43:27.363853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 48933. [D 20:43:27.363863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 48934. [D 20:43:27.363878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 48935. [D 20:43:27.363888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 48936. [D 20:43:27.363898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 48937. [D 20:43:27.363913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 48938. [D 20:43:27.363923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 48939. [D 20:43:27.363933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 48940. [D 20:43:27.363948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 48941. [D 20:43:27.363958] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2301d0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 48942. [D 20:43:27.364022] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 32/70. [D 20:43:27.364062] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.364077] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.364088] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:27.373080] openib_check_cq: completed rdma wr_id 2aaaab2301d0, nic_wr_credit 48942. [D 20:43:27.373098] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 33/70. [D 20:43:27.373910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 48942. [D 20:43:27.373924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 48943. [D 20:43:27.373935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 48944. [D 20:43:27.373946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 48945. [D 20:43:27.373963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.373978] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.373987] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:27.374005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 48946. [D 20:43:27.374015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 48947. [D 20:43:27.374030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 48948. [D 20:43:27.374041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 48949. [D 20:43:27.374051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 48950. [D 20:43:27.374062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 48951. [D 20:43:27.374073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 48952. [D 20:43:27.374101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 48953. [D 20:43:27.374111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 48954. [D 20:43:27.374121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 48955. [D 20:43:27.374132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 48956. [D 20:43:27.374142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 48957. [D 20:43:27.374166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 48958. [D 20:43:27.374177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 48959. [D 20:43:27.374187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 48960. [D 20:43:27.374198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 48961. [D 20:43:27.374208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 48962. [D 20:43:27.374218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 48963. [D 20:43:27.374241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 48964. [D 20:43:27.374251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 48965. [D 20:43:27.374261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 48966. [D 20:43:27.374271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 48967. [D 20:43:27.374282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 48968. [D 20:43:27.374292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 48969. [D 20:43:27.374307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 48970. [D 20:43:27.374317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 48971. [D 20:43:27.374337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 48972. [D 20:43:27.374347] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 48973. [D 20:43:27.383387] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.383401] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.383412] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:27.383446] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7196 [D 20:43:27.383457] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:27.383469] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 34/70. [D 20:43:27.383488] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.383498] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.383507] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:27.383535] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7197 [D 20:43:27.383546] element 0: offset: 0x2aaaab236d70, size: 24 [D 20:43:27.383558] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 35/70. [D 20:43:27.385174] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 48973. [D 20:43:27.385189] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 36/70. [D 20:43:27.387510] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.387523] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.387532] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.387547] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7201 [D 20:43:27.387556] element 0: offset: 0x2aaaab23cd10, size: 24 [D 20:43:27.387566] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 37/70. [D 20:43:27.387651] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.387666] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.387677] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.390379] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7196 [D 20:43:27.390945] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 38/70. [D 20:43:27.390975] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7197 [D 20:43:27.390987] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 39/70. [D 20:43:27.392403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 48973. [D 20:43:27.392475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 48974. [D 20:43:27.392487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 48975. [D 20:43:27.392497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 48976. [D 20:43:27.392507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 48977. [D 20:43:27.392517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 48978. [D 20:43:27.392527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 48979. [D 20:43:27.392537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 48980. [D 20:43:27.392548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 48981. [D 20:43:27.392558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 48982. [D 20:43:27.392567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 48983. [D 20:43:27.392585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 48984. [D 20:43:27.392595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 48985. [D 20:43:27.392605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 48986. [D 20:43:27.392615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 48987. [D 20:43:27.392625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 48988. [D 20:43:27.392655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 48989. [D 20:43:27.392665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 48990. [D 20:43:27.392682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 48991. [D 20:43:27.392692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 48992. [D 20:43:27.392702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 48993. [D 20:43:27.392719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 48994. [D 20:43:27.393455] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7201 [D 20:43:27.393472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 48995. [D 20:43:27.393509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 48996. [D 20:43:27.393520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 48997. [D 20:43:27.393532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 48998. [D 20:43:27.393542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 48999. [D 20:43:27.393552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 49000. [D 20:43:27.393566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 49001. [D 20:43:27.393575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 49002. [D 20:43:27.393585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 49003. [D 20:43:27.393601] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cc50 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 49004. [D 20:43:27.393618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 49005. [D 20:43:27.393628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 49006. [D 20:43:27.393639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 49007. [D 20:43:27.393648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 49008. [D 20:43:27.393681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 49009. [D 20:43:27.393691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 49010. [D 20:43:27.393704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 49011. [D 20:43:27.393714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 49012. [D 20:43:27.393724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 49013. [D 20:43:27.393737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 49014. [D 20:43:27.393747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 49015. [D 20:43:27.393780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 49016. [D 20:43:27.393790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 49017. [D 20:43:27.393800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 49018. [D 20:43:27.393810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 49019. [D 20:43:27.393831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 49020. [D 20:43:27.393847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 49021. [D 20:43:27.393857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 49022. [D 20:43:27.393867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 49023. [D 20:43:27.393883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 49024. [D 20:43:27.393907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 49025. [D 20:43:27.393919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 49026. [D 20:43:27.393928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 49027. [D 20:43:27.393938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 49028. [D 20:43:27.393952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 49029. [D 20:43:27.393961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 49030. [D 20:43:27.393971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 49031. [D 20:43:27.393986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 49032. [D 20:43:27.393996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 49033. [D 20:43:27.394006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 49034. [D 20:43:27.394038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 49035. [D 20:43:27.394049] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c7d0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 49036. [D 20:43:27.394076] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 40/70. [D 20:43:27.396599] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.396616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.396628] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.396663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7204 [D 20:43:27.396675] element 0: offset: 0x2aaaab233c80, size: 24 [D 20:43:27.396689] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 41/70. [D 20:43:27.403944] openib_check_cq: completed rdma wr_id 2aaaab23cc50, nic_wr_credit 49036. [D 20:43:27.403960] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 42/70. [D 20:43:27.415474] openib_check_cq: completed rdma wr_id 2aaaab23c7d0, nic_wr_credit 49035. [D 20:43:27.415489] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 43/70. [D 20:43:27.415517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 49035. [D 20:43:27.415529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 49036. [D 20:43:27.415539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 49037. [D 20:43:27.415549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 49038. [D 20:43:27.415564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 49039. [D 20:43:27.415574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 49040. [D 20:43:27.415584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 49041. [D 20:43:27.415600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 49042. [D 20:43:27.415610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 49043. [D 20:43:27.415620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 49044. [D 20:43:27.415650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 49045. [D 20:43:27.415661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 49046. [D 20:43:27.415672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 49047. [D 20:43:27.415682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 49048. [D 20:43:27.415698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 49049. [D 20:43:27.415708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 49050. [D 20:43:27.415730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 49051. [D 20:43:27.415741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 49052. [D 20:43:27.415751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 49053. [D 20:43:27.415761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 49054. [D 20:43:27.415784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 49055. [D 20:43:27.415795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 49056. [D 20:43:27.415805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 49057. [D 20:43:27.415815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 49058. [D 20:43:27.415825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 49059. [D 20:43:27.415836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 49060. [D 20:43:27.415846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 49061. [D 20:43:27.415888] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.415921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.415931] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.416015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 49062. [D 20:43:27.416030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 49063. [D 20:43:27.416043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 49064. [D 20:43:27.416053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 49065. [D 20:43:27.416063] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20f5f0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 49066. [D 20:43:27.416092] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.416104] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.416113] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:27.418394] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7204 [D 20:43:27.418449] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 44/70. [D 20:43:27.424378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.424394] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.424405] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:27.424421] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7206 [D 20:43:27.424431] element 0: offset: 0x2aaaab2327b0, size: 24 [D 20:43:27.424442] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 45/70. [D 20:43:27.427291] openib_check_cq: completed rdma wr_id 2aaaab20f5f0, nic_wr_credit 49066. [D 20:43:27.427305] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 46/70. [D 20:43:27.427339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 49066. [D 20:43:27.427350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 49067. [D 20:43:27.427361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 49068. [D 20:43:27.427374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 49069. [D 20:43:27.427384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 49070. [D 20:43:27.427394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 49071. [D 20:43:27.427408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 49072. [D 20:43:27.427418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 49073. [D 20:43:27.427428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 49074. [D 20:43:27.427459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 49075. [D 20:43:27.427469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 49076. [D 20:43:27.427480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 49077. [D 20:43:27.427490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 49078. [D 20:43:27.427500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 49079. [D 20:43:27.427511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 49080. [D 20:43:27.427521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 49081. [D 20:43:27.427545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 49082. [D 20:43:27.427555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 49083. [D 20:43:27.427565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 49084. [D 20:43:27.427582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 49085. [D 20:43:27.427601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 49086. [D 20:43:27.427611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 49087. [D 20:43:27.427621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 49088. [D 20:43:27.427638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 49089. [D 20:43:27.427648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 49090. [D 20:43:27.427668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 49091. [D 20:43:27.427678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 49092. [D 20:43:27.427688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 49093. [D 20:43:27.427698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 49094. [D 20:43:27.427708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 49095. [D 20:43:27.427725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 49096. [D 20:43:27.427735] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cc50 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 49097. [D 20:43:27.430058] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.430072] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.430083] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:27.432180] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7206 [D 20:43:27.432199] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 47/70. [D 20:43:27.439078] openib_check_cq: completed rdma wr_id 2aaaab23cc50, nic_wr_credit 49097. [D 20:43:27.439130] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 48/70. [D 20:43:27.439453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 49097. [D 20:43:27.439468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 49098. [D 20:43:27.439479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 49099. [D 20:43:27.439489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 49100. [D 20:43:27.439500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 49101. [D 20:43:27.439510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 49102. [D 20:43:27.439519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 49103. [D 20:43:27.439532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 49104. [D 20:43:27.439548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 49105. [D 20:43:27.439558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 49106. [D 20:43:27.439567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 49107. [D 20:43:27.439578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 49108. [D 20:43:27.439604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 49109. [D 20:43:27.439614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 49110. [D 20:43:27.439625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 49111. [D 20:43:27.439634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 49112. [D 20:43:27.439644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 49113. [D 20:43:27.439660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 49114. [D 20:43:27.439670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 49115. [D 20:43:27.439679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 49116. [D 20:43:27.439689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 49117. [D 20:43:27.439700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 49118. [D 20:43:27.439711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 49119. [D 20:43:27.439721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 49120. [D 20:43:27.439741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 49121. [D 20:43:27.439756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 49122. [D 20:43:27.439765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 49123. [D 20:43:27.439775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 49124. [D 20:43:27.439785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 49125. [D 20:43:27.439796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 49126. [D 20:43:27.439806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 49127. [D 20:43:27.439854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.439875] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.439885] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:27.439924] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22c030 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 49128. [D 20:43:27.447711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.447726] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.447736] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:27.447768] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7211 [D 20:43:27.447779] element 0: offset: 0x2aaaab2088e0, size: 24 [D 20:43:27.447791] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 49/70. [D 20:43:27.450575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.450589] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.450598] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:27.450613] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7214 [D 20:43:27.450623] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:27.450633] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 50/70. [D 20:43:27.450649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.450658] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.450667] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.450680] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7216 [D 20:43:27.450693] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:43:27.450703] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 51/70. [D 20:43:27.451152] openib_check_cq: completed rdma wr_id 2aaaab22c030, nic_wr_credit 49128. [D 20:43:27.451166] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 52/70. [D 20:43:27.452467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.452481] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.452489] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.455090] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7214 [D 20:43:27.455147] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 53/70. [D 20:43:27.456507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 49128. [D 20:43:27.456562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 49129. [D 20:43:27.456573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 49130. [D 20:43:27.456584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 49131. [D 20:43:27.456594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 49132. [D 20:43:27.456604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 49133. [D 20:43:27.456614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 49134. [D 20:43:27.456624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 49135. [D 20:43:27.456634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 49136. [D 20:43:27.456643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 49137. [D 20:43:27.456668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 49138. [D 20:43:27.456678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 49139. [D 20:43:27.456688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 49140. [D 20:43:27.456698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 49141. [D 20:43:27.457375] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7211 [D 20:43:27.457601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 49142. [D 20:43:27.457638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 49143. [D 20:43:27.457648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 49144. [D 20:43:27.457658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 49145. [D 20:43:27.457668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 49146. [D 20:43:27.457679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 49147. [D 20:43:27.457692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 49148. [D 20:43:27.457702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 49149. [D 20:43:27.457712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 49150. [D 20:43:27.457732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 49151. [D 20:43:27.457743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 49152. [D 20:43:27.457753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 49153. [D 20:43:27.457763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 49154. [D 20:43:27.457773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 49155. [D 20:43:27.457783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 49156. [D 20:43:27.457795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 49157. [D 20:43:27.457805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 49158. [D 20:43:27.457815] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cc50 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 49159. [D 20:43:27.457869] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 54/70. [D 20:43:27.457898] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7216 [D 20:43:27.457910] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 55/70. [D 20:43:27.461636] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.461654] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.461666] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.461702] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7218 [D 20:43:27.461713] element 0: offset: 0x2aaaab23cd10, size: 24 [D 20:43:27.461728] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 56/70. [D 20:43:27.464426] openib_check_cq: completed rdma wr_id 2aaaab23cc50, nic_wr_credit 49159. [D 20:43:27.464442] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 57/70. [D 20:43:27.464454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 49159. [D 20:43:27.464465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 49160. [D 20:43:27.464475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 49161. [D 20:43:27.464485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 49162. [D 20:43:27.464496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 49163. [D 20:43:27.464506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 49164. [D 20:43:27.464517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 49165. [D 20:43:27.464527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 49166. [D 20:43:27.464542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 49167. [D 20:43:27.464567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 49168. [D 20:43:27.464577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 49169. [D 20:43:27.464587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 49170. [D 20:43:27.464597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 49171. [D 20:43:27.464609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 49172. [D 20:43:27.464625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 49173. [D 20:43:27.464650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 49174. [D 20:43:27.464660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 49175. [D 20:43:27.464671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 49176. [D 20:43:27.464681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 49177. [D 20:43:27.464691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 49178. [D 20:43:27.464701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 49179. [D 20:43:27.464732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 49180. [D 20:43:27.464742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 49181. [D 20:43:27.464752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 49182. [D 20:43:27.464762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 49183. [D 20:43:27.464772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 49184. [D 20:43:27.464782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 49185. [D 20:43:27.464809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 49186. [D 20:43:27.464819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 49187. [D 20:43:27.464829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 49188. [D 20:43:27.464844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 49189. [D 20:43:27.464854] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab236b30 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 49190. [D 20:43:27.464879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 49191. [D 20:43:27.464890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 49192. [D 20:43:27.464900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 49193. [D 20:43:27.464914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 49194. [D 20:43:27.464934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 49195. [D 20:43:27.464945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 49196. [D 20:43:27.464961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 49197. [D 20:43:27.464971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 49198. [D 20:43:27.464981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 49199. [D 20:43:27.464997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 49200. [D 20:43:27.465024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 49201. [D 20:43:27.465034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 49202. [D 20:43:27.465044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 49203. [D 20:43:27.465054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 49204. [D 20:43:27.465064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 49205. [D 20:43:27.465086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 49206. [D 20:43:27.465097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 49207. [D 20:43:27.465107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 49208. [D 20:43:27.465117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 49209. [D 20:43:27.465127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 49210. [D 20:43:27.465144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 49211. [D 20:43:27.465154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 49212. [D 20:43:27.465164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 49213. [D 20:43:27.465174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 49214. [D 20:43:27.465184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 49215. [D 20:43:27.465213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 49216. [D 20:43:27.465224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 49217. [D 20:43:27.465234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 49218. [D 20:43:27.465245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 49219. [D 20:43:27.465254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 49220. [D 20:43:27.465264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 49221. [D 20:43:27.465288] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22f9d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 49222. [D 20:43:27.465342] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.465355] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.465365] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.469925] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7218 [D 20:43:27.469982] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 58/70. [D 20:43:27.470322] openib_check_cq: completed rdma wr_id 2aaaab236b30, nic_wr_credit 49222. [D 20:43:27.470340] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 59/70. [D 20:43:27.476194] openib_check_cq: completed rdma wr_id 2aaaab22f9d0, nic_wr_credit 49221. [D 20:43:27.476208] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 60/70. [D 20:43:27.476221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 49221. [D 20:43:27.476231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 49222. [D 20:43:27.476242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 49223. [D 20:43:27.476253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 49224. [D 20:43:27.476263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 49225. [D 20:43:27.476273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 49226. [D 20:43:27.476283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 49227. [D 20:43:27.476293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 49228. [D 20:43:27.476303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 49229. [D 20:43:27.476312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 49230. [D 20:43:27.476340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 49231. [D 20:43:27.476350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 49232. [D 20:43:27.476360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 49233. [D 20:43:27.476374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 49234. [D 20:43:27.476384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 49235. [D 20:43:27.476405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 49236. [D 20:43:27.476416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 49237. [D 20:43:27.476426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 49238. [D 20:43:27.476436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 49239. [D 20:43:27.476446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 49240. [D 20:43:27.476456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 49241. [D 20:43:27.476470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 49242. [D 20:43:27.476480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 49243. [D 20:43:27.476490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 49244. [D 20:43:27.476499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 49245. [D 20:43:27.476519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 49246. [D 20:43:27.476542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 49247. [D 20:43:27.476553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 49248. [D 20:43:27.476563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 49249. [D 20:43:27.476573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 49250. [D 20:43:27.476584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 49251. [D 20:43:27.476594] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cc50 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 49252. [D 20:43:27.478930] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.478943] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.478953] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:27.478967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.478976] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.478985] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:27.482175] openib_check_cq: completed rdma wr_id 2aaaab23cc50, nic_wr_credit 49252. [D 20:43:27.482189] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 0/70. [D 20:43:27.484391] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.484404] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.484415] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:27.731810] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.731825] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.731836] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:27.731852] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7222 [D 20:43:27.731862] element 0: offset: 0x2aaaab2085a0, size: 24 [D 20:43:27.731872] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 1/70. [D 20:43:27.734195] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7222 [D 20:43:27.734248] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 2/70. [D 20:43:27.739208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 49252. [D 20:43:27.739226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 49253. [D 20:43:27.739238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 49254. [D 20:43:27.739248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 49255. [D 20:43:27.739258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 49256. [D 20:43:27.739273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 49257. [D 20:43:27.739283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 49258. [D 20:43:27.739292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 49259. [D 20:43:27.739309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 49260. [D 20:43:27.739319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 49261. [D 20:43:27.739328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 49262. [D 20:43:27.739345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 49263. [D 20:43:27.739355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 49264. [D 20:43:27.739365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 49265. [D 20:43:27.739381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 49266. [D 20:43:27.739391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 49267. [D 20:43:27.739401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 49268. [D 20:43:27.739416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 49269. [D 20:43:27.739426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 49270. [D 20:43:27.739474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 49271. [D 20:43:27.739485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 49272. [D 20:43:27.739496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 49273. [D 20:43:27.739507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 49274. [D 20:43:27.739516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 49275. [D 20:43:27.739527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 49276. [D 20:43:27.739537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 49277. [D 20:43:27.739546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 49278. [D 20:43:27.739556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 49279. [D 20:43:27.739589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 49280. [D 20:43:27.739600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 49281. [D 20:43:27.739612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 49282. [D 20:43:27.739622] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cc50 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 49283. [D 20:43:27.745268] openib_check_cq: completed rdma wr_id 2aaaab23cc50, nic_wr_credit 49283. [D 20:43:27.745283] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 3/70. [D 20:43:27.747623] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.747636] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.747645] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:27.752624] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.752638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.752648] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:27.752663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7226 [D 20:43:27.752673] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:27.752684] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 4/70. [D 20:43:27.754753] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7226 [D 20:43:27.754772] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 5/70. [D 20:43:27.756828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 49283. [D 20:43:27.756889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 49284. [D 20:43:27.756901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 49285. [D 20:43:27.756912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 49286. [D 20:43:27.756927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 49287. [D 20:43:27.756937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 49288. [D 20:43:27.756946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 49289. [D 20:43:27.756961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 49290. [D 20:43:27.756971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 49291. [D 20:43:27.756981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 49292. [D 20:43:27.756996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 49293. [D 20:43:27.757006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 49294. [D 20:43:27.757016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 49295. [D 20:43:27.757026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 49296. [D 20:43:27.757036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 49297. [D 20:43:27.757046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 49298. [D 20:43:27.757055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 49299. [D 20:43:27.757098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 49300. [D 20:43:27.757110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 49301. [D 20:43:27.757120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 49302. [D 20:43:27.757130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 49303. [D 20:43:27.757140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 49304. [D 20:43:27.757150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 49305. [D 20:43:27.757163] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.757180] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.757190] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:27.757242] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7229 [D 20:43:27.757253] element 0: offset: 0x2aaaab233c80, size: 24 [D 20:43:27.757265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 49306. [D 20:43:27.757276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 49307. [D 20:43:27.757286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 49308. [D 20:43:27.757296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 49309. [D 20:43:27.757324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 49310. [D 20:43:27.757335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 49311. [D 20:43:27.757344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 49312. [D 20:43:27.757355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 49313. [D 20:43:27.757365] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22ffc0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 49314. [D 20:43:27.757382] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 6/70. [D 20:43:27.761821] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.761834] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.761845] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:27.761860] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7230 [D 20:43:27.761870] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:43:27.761880] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 7/70. [D 20:43:27.761896] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.761909] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.761917] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.761931] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7234 [D 20:43:27.761941] element 0: offset: 0x2aaaab2088e0, size: 24 [D 20:43:27.761950] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 8/70. [D 20:43:27.764159] openib_check_cq: completed rdma wr_id 2aaaab22ffc0, nic_wr_credit 49314. [D 20:43:27.764173] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 9/70. [D 20:43:27.766618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.766632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.766640] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.771605] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7230 [D 20:43:27.771659] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 10/70. [D 20:43:27.771680] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7229 [D 20:43:27.771691] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 11/70. [D 20:43:27.771701] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7234 [D 20:43:27.771711] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 12/70. [D 20:43:27.775265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 49314. [D 20:43:27.775324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 49315. [D 20:43:27.775334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 49316. [D 20:43:27.775345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 49317. [D 20:43:27.775356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 49318. [D 20:43:27.775365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 49319. [D 20:43:27.775375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 49320. [D 20:43:27.775385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 49321. [D 20:43:27.775401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 49322. [D 20:43:27.775410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 49323. [D 20:43:27.775420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 49324. [D 20:43:27.775431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 49325. [D 20:43:27.775441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 49326. [D 20:43:27.775451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 49327. [D 20:43:27.775483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 49328. [D 20:43:27.775493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 49329. [D 20:43:27.775503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 49330. [D 20:43:27.775514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 49331. [D 20:43:27.775524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 49332. [D 20:43:27.775535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 49333. [D 20:43:27.775544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 49334. [D 20:43:27.775565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 49335. [D 20:43:27.775575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 49336. [D 20:43:27.775585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 49337. [D 20:43:27.775604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 49338. [D 20:43:27.775614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 49339. [D 20:43:27.775624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 49340. [D 20:43:27.775634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 49341. [D 20:43:27.775657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 49342. [D 20:43:27.775667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 49343. [D 20:43:27.775681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 49344. [D 20:43:27.775690] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20e130 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 49345. [D 20:43:27.775704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 49346. [D 20:43:27.775716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 49347. [D 20:43:27.775744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 49348. [D 20:43:27.775757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 49349. [D 20:43:27.775767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 49350. [D 20:43:27.775777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 49351. [D 20:43:27.775792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 49352. [D 20:43:27.775801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 49353. [D 20:43:27.775811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 49354. [D 20:43:27.775840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 49355. [D 20:43:27.775850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 49356. [D 20:43:27.775862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 49357. [D 20:43:27.775872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 49358. [D 20:43:27.775882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 49359. [D 20:43:27.775895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 49360. [D 20:43:27.775905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 49361. [D 20:43:27.775915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 49362. [D 20:43:27.775945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 49363. [D 20:43:27.775955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 49364. [D 20:43:27.775970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 49365. [D 20:43:27.775980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 49366. [D 20:43:27.775990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 49367. [D 20:43:27.776018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 49368. [D 20:43:27.776028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 49369. [D 20:43:27.776040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 49370. [D 20:43:27.776049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 49371. [D 20:43:27.776062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 49372. [D 20:43:27.776077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 49373. [D 20:43:27.776086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 49374. [D 20:43:27.776096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 49375. [D 20:43:27.776112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 49376. [D 20:43:27.776122] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22fbc0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 49377. [D 20:43:27.776133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 49378. [D 20:43:27.776143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 49379. [D 20:43:27.776153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 49380. [D 20:43:27.776172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 49381. [D 20:43:27.776182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 49382. [D 20:43:27.776192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 49383. [D 20:43:27.776202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 49384. [E 20:43:27.776215] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 49385, block for 10 ms. [D 20:43:27.778018] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 49384. [E 20:43:27.778035] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 49385, block for 10 ms. [D 20:43:27.786904] openib_check_cq: completed rdma wr_id 2aaaab20e130, nic_wr_credit 49384. [D 20:43:27.786922] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 13/70. [D 20:43:27.786936] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 49383. [D 20:43:27.786948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 49384. [D 20:43:27.786961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 49385. [D 20:43:27.786971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 49386. [D 20:43:27.786984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 49387. [D 20:43:27.786996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 49388. [D 20:43:27.787008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 49389. [D 20:43:27.787021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 49390. [D 20:43:27.787033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 49391. [D 20:43:27.787045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 49392. [D 20:43:27.787057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 49393. [D 20:43:27.787069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 49394. [D 20:43:27.787082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 49395. [D 20:43:27.787094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 49396. [D 20:43:27.787107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 49397. [D 20:43:27.787119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 49398. [D 20:43:27.787131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 49399. [D 20:43:27.787143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 49400. [D 20:43:27.787155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 49401. [D 20:43:27.787168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 49402. [D 20:43:27.787180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 49403. [D 20:43:27.787192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 49404. [D 20:43:27.787205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 49405. [D 20:43:27.787217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 49406. [D 20:43:27.787229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 49407. [D 20:43:27.787242] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20fbc0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 49408. [D 20:43:27.789732] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.789748] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.789762] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.789803] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7237 [D 20:43:27.789817] element 0: offset: 0x2aaaab20e440, size: 24 [D 20:43:27.789831] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 14/70. [D 20:43:27.798481] openib_check_cq: completed rdma wr_id 2aaaab22fbc0, nic_wr_credit 49408. [D 20:43:27.798497] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 15/70. [D 20:43:27.803116] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.803130] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.803144] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.809743] openib_check_cq: completed rdma wr_id 2aaaab20fbc0, nic_wr_credit 49407. [D 20:43:27.809758] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 16/70. [D 20:43:27.811984] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.811996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.812008] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:27.812026] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7239 [D 20:43:27.812038] element 0: offset: 0x2aaaab23cd10, size: 24 [D 20:43:27.812049] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 17/70. [D 20:43:27.812069] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.812083] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.812095] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:27.812156] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.812169] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.812178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:27.814435] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7237 [D 20:43:27.814492] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 18/70. [D 20:43:27.815241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 49407. [D 20:43:27.815310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 49408. [D 20:43:27.815322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 49409. [D 20:43:27.815335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 49410. [D 20:43:27.815348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 49411. [D 20:43:27.815360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 49412. [D 20:43:27.815372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 49413. [D 20:43:27.815384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 49414. [D 20:43:27.815396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 49415. [D 20:43:27.815408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 49416. [D 20:43:27.815420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 49417. [D 20:43:27.815432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 49418. [D 20:43:27.815444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 49419. [D 20:43:27.815457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 49420. [D 20:43:27.815469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 49421. [D 20:43:27.815481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 49422. [D 20:43:27.815493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 49423. [D 20:43:27.815505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 49424. [D 20:43:27.815517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 49425. [D 20:43:27.815529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 49426. [D 20:43:27.815540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 49427. [D 20:43:27.815554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 49428. [D 20:43:27.815566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 49429. [D 20:43:27.815578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 49430. [D 20:43:27.815591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 49431. [D 20:43:27.815603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 49432. [D 20:43:27.815615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 49433. [D 20:43:27.815627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 49434. [D 20:43:27.815639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 49435. [D 20:43:27.815652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 49436. [D 20:43:27.815664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 49437. [D 20:43:27.815674] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab213790 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 49438. [D 20:43:27.817942] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7239 [D 20:43:27.817960] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 19/70. [D 20:43:27.821232] openib_check_cq: completed rdma wr_id 2aaaab213790, nic_wr_credit 49438. [D 20:43:27.821253] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 20/70. [D 20:43:27.821275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 49438. [D 20:43:27.821288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 49439. [D 20:43:27.821300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 49440. [D 20:43:27.821313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 49441. [D 20:43:27.821326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 49442. [D 20:43:27.821338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 49443. [D 20:43:27.821350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 49444. [D 20:43:27.821363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 49445. [D 20:43:27.821375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 49446. [D 20:43:27.821388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 49447. [D 20:43:27.821400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 49448. [D 20:43:27.821412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 49449. [D 20:43:27.821425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 49450. [D 20:43:27.821437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 49451. [D 20:43:27.821449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 49452. [D 20:43:27.821460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 49453. [D 20:43:27.821472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 49454. [D 20:43:27.821484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 49455. [D 20:43:27.821497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 49456. [D 20:43:27.821509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 49457. [D 20:43:27.821521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 49458. [D 20:43:27.821534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 49459. [D 20:43:27.821546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 49460. [D 20:43:27.821559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 49461. [D 20:43:27.821571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 49462. [D 20:43:27.821583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 49463. [D 20:43:27.821595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 49464. [D 20:43:27.821608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 49465. [D 20:43:27.821620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 49466. [D 20:43:27.821633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 49467. [D 20:43:27.821643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 49468. [D 20:43:27.821653] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22c030 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 49469. [D 20:43:27.824076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.824092] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.824105] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:27.833141] openib_check_cq: completed rdma wr_id 2aaaab22c030, nic_wr_credit 49469. [D 20:43:27.833156] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 21/70. [D 20:43:27.836074] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.836087] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.836100] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:27.836123] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.836134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.836148] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:27.836182] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7243 [D 20:43:27.836195] element 0: offset: 0x2aaaab22f7c0, size: 24 [D 20:43:27.836208] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 22/70. [D 20:43:27.838400] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7243 [D 20:43:27.838450] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 23/70. [D 20:43:27.841977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 49469. [D 20:43:27.841996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 49470. [D 20:43:27.842012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 49471. [D 20:43:27.842023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 49472. [D 20:43:27.842034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 49473. [D 20:43:27.842046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 49474. [D 20:43:27.842059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 49475. [D 20:43:27.842071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 49476. [D 20:43:27.842083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 49477. [D 20:43:27.842095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 49478. [D 20:43:27.842107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 49479. [D 20:43:27.842119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 49480. [D 20:43:27.842131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 49481. [D 20:43:27.842144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 49482. [D 20:43:27.842156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 49483. [D 20:43:27.842168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 49484. [D 20:43:27.842181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 49485. [D 20:43:27.842193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 49486. [D 20:43:27.842205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 49487. [D 20:43:27.842217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 49488. [D 20:43:27.842230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 49489. [D 20:43:27.842242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 49490. [D 20:43:27.842254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 49491. [D 20:43:27.842267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 49492. [D 20:43:27.842279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 49493. [D 20:43:27.842291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 49494. [D 20:43:27.842303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 49495. [D 20:43:27.842316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 49496. [D 20:43:27.842328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 49497. [D 20:43:27.842341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 49498. [D 20:43:27.842353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 49499. [D 20:43:27.842364] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab213790 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 49500. [D 20:43:27.853574] openib_check_cq: completed rdma wr_id 2aaaab213790, nic_wr_credit 49500. [D 20:43:27.853590] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 24/70. [D 20:43:27.855903] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.855916] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.855930] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:27.954586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.954603] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.954617] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:27.954636] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7246 [D 20:43:27.954648] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:27.954660] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 25/70. [D 20:43:27.956616] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7246 [D 20:43:27.956635] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 26/70. [D 20:43:27.956772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 49500. [D 20:43:27.956846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 49501. [D 20:43:27.956860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 49502. [D 20:43:27.956872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 49503. [D 20:43:27.956884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 49504. [D 20:43:27.956896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 49505. [D 20:43:27.956909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 49506. [D 20:43:27.956921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 49507. [D 20:43:27.956933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 49508. [D 20:43:27.956946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 49509. [D 20:43:27.956958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 49510. [D 20:43:27.956970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 49511. [D 20:43:27.956983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 49512. [D 20:43:27.956995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 49513. [D 20:43:27.957008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 49514. [D 20:43:27.957020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 49515. [D 20:43:27.957033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 49516. [D 20:43:27.957045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 49517. [D 20:43:27.957058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 49518. [D 20:43:27.957070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 49519. [D 20:43:27.957082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 49520. [D 20:43:27.957095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 49521. [D 20:43:27.957107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 49522. [D 20:43:27.957118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 49523. [D 20:43:27.957130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 49524. [D 20:43:27.957142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 49525. [D 20:43:27.957154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 49526. [D 20:43:27.957167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 49527. [D 20:43:27.957179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 49528. [D 20:43:27.957192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 49529. [D 20:43:27.957204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 49530. [D 20:43:27.957215] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c850 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 49531. [D 20:43:27.965898] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.965915] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.965931] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:27.965968] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7249 [D 20:43:27.965981] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:43:27.965996] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 27/70. [D 20:43:27.968134] openib_check_cq: completed rdma wr_id 2aaaab23c850, nic_wr_credit 49531. [D 20:43:27.968152] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 28/70. [D 20:43:27.968492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.968506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.968517] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:27.970686] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7249 [D 20:43:27.970743] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 29/70. [D 20:43:27.974134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 49531. [D 20:43:27.974153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 49532. [D 20:43:27.974170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 49533. [D 20:43:27.974182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 49534. [D 20:43:27.974195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 49535. [D 20:43:27.974208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 49536. [D 20:43:27.974220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 49537. [D 20:43:27.974233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 49538. [D 20:43:27.974245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 49539. [D 20:43:27.974257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 49540. [D 20:43:27.974269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 49541. [D 20:43:27.974282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 49542. [D 20:43:27.974294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 49543. [D 20:43:27.974304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 49544. [D 20:43:27.974315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 49545. [D 20:43:27.974327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 49546. [D 20:43:27.974339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 49547. [D 20:43:27.974351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 49548. [D 20:43:27.974364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 49549. [D 20:43:27.974376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 49550. [D 20:43:27.974389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 49551. [D 20:43:27.974401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 49552. [D 20:43:27.974413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 49553. [D 20:43:27.974425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 49554. [D 20:43:27.974438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 49555. [D 20:43:27.974450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 49556. [D 20:43:27.974463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 49557. [D 20:43:27.974475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 49558. [D 20:43:27.974487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 49559. [D 20:43:27.974500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 49560. [D 20:43:27.974512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 49561. [D 20:43:27.974523] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22c030 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 49562. [D 20:43:27.979375] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.979389] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.979402] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:27.979421] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7252 [D 20:43:27.979433] element 0: offset: 0x2aaaab236d70, size: 24 [D 20:43:27.979445] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 30/70. [D 20:43:27.979467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:27.979478] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.979489] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:27.979506] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7255 [D 20:43:27.979517] element 0: offset: 0x2aaaab233c80, size: 24 [D 20:43:27.979529] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 31/70. [D 20:43:27.984768] openib_check_cq: completed rdma wr_id 2aaaab22c030, nic_wr_credit 49562. [D 20:43:27.984783] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 32/70. [D 20:43:27.987163] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:27.987177] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:27.987196] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:27.989936] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7252 [D 20:43:27.989989] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 33/70. [D 20:43:27.990008] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7255 [D 20:43:27.990019] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 34/70. [D 20:43:27.990059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 49562. [D 20:43:27.990106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 49563. [D 20:43:27.990119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 49564. [D 20:43:27.990132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 49565. [D 20:43:27.990144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 49566. [D 20:43:27.990157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 49567. [D 20:43:27.990170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 49568. [D 20:43:27.990183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 49569. [D 20:43:27.990195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 49570. [D 20:43:27.990208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 49571. [D 20:43:27.990220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 49572. [D 20:43:27.990232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 49573. [D 20:43:27.990245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 49574. [D 20:43:27.990258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 49575. [D 20:43:27.990270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 49576. [D 20:43:27.990282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 49577. [D 20:43:27.990294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 49578. [D 20:43:27.990306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 49579. [D 20:43:27.990319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 49580. [D 20:43:27.990332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 49581. [D 20:43:27.990344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 49582. [D 20:43:27.990357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 49583. [D 20:43:27.990369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 49584. [D 20:43:27.990382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 49585. [D 20:43:27.990394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 49586. [D 20:43:27.990406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 49587. [D 20:43:27.990418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 49588. [D 20:43:27.990429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 49589. [D 20:43:27.990440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 49590. [D 20:43:27.990450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 49591. [D 20:43:27.990460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 49592. [D 20:43:27.990469] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab213790 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 49593. [D 20:43:27.990483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 49594. [D 20:43:27.990493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 49595. [D 20:43:27.990503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 49596. [D 20:43:27.990512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 49597. [D 20:43:27.990522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 49598. [D 20:43:27.990532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 49599. [D 20:43:27.990541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 49600. [D 20:43:27.990551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 49601. [D 20:43:27.990561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 49602. [D 20:43:27.990570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 49603. [D 20:43:27.990580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 49604. [D 20:43:27.990590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 49605. [D 20:43:27.990600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 49606. [D 20:43:27.990609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 49607. [D 20:43:27.990619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 49608. [D 20:43:27.990629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 49609. [D 20:43:27.990638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 49610. [D 20:43:27.990648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 49611. [D 20:43:27.990658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 49612. [D 20:43:27.990667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 49613. [D 20:43:27.990677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 49614. [D 20:43:27.990687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 49615. [D 20:43:27.990696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 49616. [D 20:43:27.990706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 49617. [D 20:43:27.990716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 49618. [D 20:43:27.990727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 49619. [D 20:43:27.990736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 49620. [D 20:43:27.990746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 49621. [D 20:43:27.990756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 49622. [D 20:43:27.990766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 49623. [D 20:43:27.990776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 49624. [D 20:43:27.990785] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20b9b0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 49625. [D 20:43:27.995971] openib_check_cq: completed rdma wr_id 2aaaab213790, nic_wr_credit 49625. [D 20:43:27.995990] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 35/70. [D 20:43:28.001810] openib_check_cq: completed rdma wr_id 2aaaab20b9b0, nic_wr_credit 49624. [D 20:43:28.001827] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 36/70. [D 20:43:28.004180] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.004195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.004209] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.004237] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.004249] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.004260] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:28.006575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.006589] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.006603] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:28.006638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7258 [D 20:43:28.006651] element 0: offset: 0x2aaaab23cd10, size: 24 [D 20:43:28.006665] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 37/70. [D 20:43:28.008765] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7258 [D 20:43:28.008815] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 38/70. [D 20:43:28.008864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 49624. [D 20:43:28.008915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 49625. [D 20:43:28.008957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 49626. [D 20:43:28.008998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 49627. [D 20:43:28.009052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 49628. [D 20:43:28.009093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 49629. [D 20:43:28.009145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 49630. [D 20:43:28.009186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 49631. [D 20:43:28.009239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 49632. [D 20:43:28.009281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 49633. [D 20:43:28.009332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 49634. [D 20:43:28.009373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 49635. [D 20:43:28.009424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 49636. [D 20:43:28.009466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 49637. [D 20:43:28.009518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 49638. [D 20:43:28.009559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 49639. [D 20:43:28.009610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 49640. [D 20:43:28.009651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 49641. [D 20:43:28.009703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 49642. [D 20:43:28.009744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 49643. [D 20:43:28.009795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 49644. [D 20:43:28.009836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 49645. [D 20:43:28.009887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 49646. [D 20:43:28.009929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 49647. [D 20:43:28.009979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 49648. [D 20:43:28.010021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 49649. [D 20:43:28.010072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 49650. [D 20:43:28.010113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 49651. [D 20:43:28.010164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 49652. [D 20:43:28.010205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 49653. [D 20:43:28.010257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 49654. [D 20:43:28.010298] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23b700 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 49655. [D 20:43:28.014769] openib_check_cq: completed rdma wr_id 2aaaab23b700, nic_wr_credit 49655. [D 20:43:28.014785] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 39/70. [D 20:43:28.017117] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.017131] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.017145] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:28.167202] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.167217] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.167232] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:28.167250] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7261 [D 20:43:28.167262] element 0: offset: 0x2aaaab20e440, size: 24 [D 20:43:28.167274] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 40/70. [D 20:43:28.169534] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7261 [D 20:43:28.169552] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 41/70. [D 20:43:28.169692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 49655. [D 20:43:28.169764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 49656. [D 20:43:28.169777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 49657. [D 20:43:28.169789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 49658. [D 20:43:28.169812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 49659. [D 20:43:28.169824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 49660. [D 20:43:28.169837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 49661. [D 20:43:28.169849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 49662. [D 20:43:28.169861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 49663. [D 20:43:28.169874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 49664. [D 20:43:28.169886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 49665. [D 20:43:28.169899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 49666. [D 20:43:28.169911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 49667. [D 20:43:28.169924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 49668. [D 20:43:28.169936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 49669. [D 20:43:28.169949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 49670. [D 20:43:28.169961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 49671. [D 20:43:28.169973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 49672. [D 20:43:28.169986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 49673. [D 20:43:28.169998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 49674. [D 20:43:28.170011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 49675. [D 20:43:28.170023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 49676. [D 20:43:28.170035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 49677. [D 20:43:28.170048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 49678. [D 20:43:28.170061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 49679. [D 20:43:28.170073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 49680. [D 20:43:28.170085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 49681. [D 20:43:28.170098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 49682. [D 20:43:28.170110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 49683. [D 20:43:28.170122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 49684. [D 20:43:28.170135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 49685. [D 20:43:28.170146] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 49686. [D 20:43:28.181394] openib_check_cq: completed rdma wr_id 2aaaab23c850, nic_wr_credit 49686. [D 20:43:28.181413] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 42/70. [D 20:43:28.183754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.183770] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.183783] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:28.183822] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7263 [D 20:43:28.183835] element 0: offset: 0x2aaaab230000, size: 24 [D 20:43:28.183850] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 43/70. [D 20:43:28.183884] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.183895] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.183906] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.186276] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7263 [D 20:43:28.186328] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 44/70. [D 20:43:28.186468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 49686. [D 20:43:28.186490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 49687. [D 20:43:28.186505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 49688. [D 20:43:28.186517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 49689. [D 20:43:28.186529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 49690. [D 20:43:28.186550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 49691. [D 20:43:28.186562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 49692. [D 20:43:28.186575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 49693. [D 20:43:28.186587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 49694. [D 20:43:28.186599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 49695. [D 20:43:28.186612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 49696. [D 20:43:28.186624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 49697. [D 20:43:28.186636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 49698. [D 20:43:28.186649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 49699. [D 20:43:28.186661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 49700. [D 20:43:28.186674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 49701. [D 20:43:28.186686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 49702. [D 20:43:28.186698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 49703. [D 20:43:28.186710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 49704. [D 20:43:28.186723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 49705. [D 20:43:28.186735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 49706. [D 20:43:28.186746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 49707. [D 20:43:28.186760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 49708. [D 20:43:28.186772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 49709. [D 20:43:28.186785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 49710. [D 20:43:28.186797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 49711. [D 20:43:28.186809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 49712. [D 20:43:28.186821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 49713. [D 20:43:28.186833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 49714. [D 20:43:28.186846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 49715. [D 20:43:28.186858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 49716. [D 20:43:28.186869] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab213790 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 49717. [D 20:43:28.198310] openib_check_cq: completed rdma wr_id 2aaaab213790, nic_wr_credit 49717. [D 20:43:28.198327] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 45/70. [D 20:43:28.200675] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.200689] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.200703] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:28.208454] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.208468] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.208483] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:28.208500] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7267 [D 20:43:28.208512] element 0: offset: 0x2aaaab2327b0, size: 24 [D 20:43:28.208524] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 46/70. [D 20:43:28.210812] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7267 [D 20:43:28.210831] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 47/70. [D 20:43:28.212524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 49717. [D 20:43:28.212592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 49718. [D 20:43:28.212637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 49719. [D 20:43:28.212679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 49720. [D 20:43:28.212720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 49721. [D 20:43:28.212761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 49722. [D 20:43:28.212803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 49723. [D 20:43:28.212844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 49724. [D 20:43:28.212886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 49725. [D 20:43:28.212928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 49726. [D 20:43:28.212969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 49727. [D 20:43:28.213007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 49728. [D 20:43:28.213064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 49729. [D 20:43:28.213105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 49730. [D 20:43:28.213146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 49731. [D 20:43:28.213187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 49732. [D 20:43:28.213228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 49733. [D 20:43:28.213269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 49734. [D 20:43:28.213310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 49735. [D 20:43:28.213350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 49736. [D 20:43:28.213392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 49737. [D 20:43:28.213433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 49738. [D 20:43:28.213445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 49739. [D 20:43:28.213455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 49740. [D 20:43:28.213471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 49741. [D 20:43:28.213535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 49742. [D 20:43:28.213577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 49743. [D 20:43:28.213622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 49744. [D 20:43:28.213664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 49745. [D 20:43:28.213707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 49746. [D 20:43:28.213763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 49747. [D 20:43:28.213804] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20b9b0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 49748. [D 20:43:28.219237] openib_check_cq: completed rdma wr_id 2aaaab20b9b0, nic_wr_credit 49748. [D 20:43:28.219255] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 48/70. [D 20:43:28.222678] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.222692] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.222705] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:28.222741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7271 [D 20:43:28.222755] element 0: offset: 0x2aaaab20b8d0, size: 24 [D 20:43:28.222769] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 49/70. [D 20:43:28.222802] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.222814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.222825] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.222843] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.222858] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.222869] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:28.222884] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7274 [D 20:43:28.222896] element 0: offset: 0x2aaaab21af70, size: 24 [D 20:43:28.222908] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 50/70. [D 20:43:28.222926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.222937] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.222948] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:28.222965] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7275 [D 20:43:28.222977] element 0: offset: 0x2aaaab23d450, size: 24 [D 20:43:28.222989] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 51/70. [D 20:43:28.225004] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7271 [D 20:43:28.225058] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 52/70. [D 20:43:28.227796] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7274 [D 20:43:28.227839] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 53/70. [D 20:43:28.230160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 49748. [D 20:43:28.230227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 49749. [D 20:43:28.230238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 49750. [D 20:43:28.230249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 49751. [D 20:43:28.230259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 49752. [D 20:43:28.230269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 49753. [D 20:43:28.230279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 49754. [D 20:43:28.230289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 49755. [D 20:43:28.230298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 49756. [D 20:43:28.230309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 49757. [D 20:43:28.230318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 49758. [D 20:43:28.230373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 49759. [D 20:43:28.230384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 49760. [D 20:43:28.230394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 49761. [D 20:43:28.230413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 49762. [D 20:43:28.230425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 49763. [D 20:43:28.230435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 49764. [D 20:43:28.230398] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7275 [D 20:43:28.230445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 49765. [D 20:43:28.230482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 49766. [D 20:43:28.230501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 49767. [D 20:43:28.230530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 49768. [D 20:43:28.230544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 49769. [D 20:43:28.230554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 49770. [D 20:43:28.230564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 49771. [D 20:43:28.230579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 49772. [D 20:43:28.230589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 49773. [D 20:43:28.230599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 49774. [D 20:43:28.230609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 49775. [D 20:43:28.230627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 49776. [D 20:43:28.230637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 49777. [D 20:43:28.230665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 49778. [D 20:43:28.230675] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c850 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 49779. [D 20:43:28.230688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 49780. [D 20:43:28.230699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 49781. [D 20:43:28.230709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 49782. [D 20:43:28.230719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 49783. [D 20:43:28.230734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 49784. [D 20:43:28.230756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 49785. [D 20:43:28.230766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 49786. [D 20:43:28.230782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 49787. [D 20:43:28.230792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 49788. [D 20:43:28.230801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 49789. [D 20:43:28.230830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 49790. [D 20:43:28.230839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 49791. [D 20:43:28.230852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 49792. [D 20:43:28.230862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 49793. [D 20:43:28.230872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 49794. [D 20:43:28.230885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 49795. [D 20:43:28.230895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 49796. [D 20:43:28.230905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 49797. [D 20:43:28.230921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 49798. [D 20:43:28.230930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 49799. [D 20:43:28.230941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 49800. [D 20:43:28.230972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 49801. [D 20:43:28.230982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 49802. [D 20:43:28.230991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 49803. [D 20:43:28.231005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 49804. [D 20:43:28.231015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 49805. [D 20:43:28.231025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 49806. [D 20:43:28.231040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 49807. [D 20:43:28.231060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 49808. [D 20:43:28.231071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 49809. [D 20:43:28.231081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 49810. [D 20:43:28.231091] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20bb80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 49811. [D 20:43:28.231139] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 54/70. [D 20:43:28.235272] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.235290] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.235300] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:28.235334] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7279 [D 20:43:28.235345] element 0: offset: 0x2aaaab236d70, size: 24 [D 20:43:28.235360] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 55/70. [D 20:43:28.240720] openib_check_cq: completed rdma wr_id 2aaaab23c850, nic_wr_credit 49811. [D 20:43:28.240736] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 56/70. [D 20:43:28.252369] openib_check_cq: completed rdma wr_id 2aaaab20bb80, nic_wr_credit 49810. [D 20:43:28.252383] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 57/70. [D 20:43:28.252415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 49810. [D 20:43:28.252461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 49811. [D 20:43:28.252472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 49812. [D 20:43:28.252482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 49813. [D 20:43:28.252492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 49814. [D 20:43:28.252508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 49815. [D 20:43:28.252518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 49816. [D 20:43:28.252542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 49817. [D 20:43:28.252553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 49818. [D 20:43:28.252563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 49819. [D 20:43:28.252577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 49820. [D 20:43:28.252587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 49821. [D 20:43:28.252596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 49822. [D 20:43:28.252607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 49823. [D 20:43:28.252617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 49824. [D 20:43:28.252640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 49825. [D 20:43:28.252656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 49826. [D 20:43:28.252666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 49827. [D 20:43:28.252676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 49828. [D 20:43:28.252703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 49829. [D 20:43:28.252714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 49830. [D 20:43:28.252727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 49831. [D 20:43:28.252736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 49832. [D 20:43:28.252746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 49833. [D 20:43:28.252760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 49834. [D 20:43:28.252769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 49835. [D 20:43:28.252792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 49836. [D 20:43:28.252802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 49837. [D 20:43:28.252812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 49838. [D 20:43:28.252827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 49839. [D 20:43:28.252837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 49840. [D 20:43:28.252865] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c190 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 49841. [D 20:43:28.252448] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.255069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.255080] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:28.255131] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.255144] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.255153] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:28.257112] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7279 [D 20:43:28.257132] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 58/70. [D 20:43:28.264031] openib_check_cq: completed rdma wr_id 2aaaab23c190, nic_wr_credit 49841. [D 20:43:28.264077] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 59/70. [D 20:43:28.265946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 49841. [D 20:43:28.265962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 49842. [D 20:43:28.265973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 49843. [D 20:43:28.265983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 49844. [D 20:43:28.265993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 49845. [D 20:43:28.266025] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.266044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.266054] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.266075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 49846. [D 20:43:28.266086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 49847. [D 20:43:28.266096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 49848. [D 20:43:28.266111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 49849. [D 20:43:28.266121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 49850. [D 20:43:28.266131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 49851. [D 20:43:28.266145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 49852. [D 20:43:28.266155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 49853. [D 20:43:28.266164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 49854. [D 20:43:28.266180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 49855. [D 20:43:28.266190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 49856. [D 20:43:28.266200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 49857. [D 20:43:28.266215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 49858. [D 20:43:28.266225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 49859. [D 20:43:28.266235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 49860. [D 20:43:28.266278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 49861. [D 20:43:28.266289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 49862. [D 20:43:28.266299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 49863. [D 20:43:28.266309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 49864. [D 20:43:28.266320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 49865. [D 20:43:28.266330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 49866. [D 20:43:28.266341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 49867. [D 20:43:28.266351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 49868. [D 20:43:28.266361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 49869. [D 20:43:28.266370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 49870. [D 20:43:28.266406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 49871. [D 20:43:28.266416] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c850 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 49872. [D 20:43:28.273537] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.273551] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.273562] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:28.273594] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7283 [D 20:43:28.273606] element 0: offset: 0x2aaaab23cd10, size: 24 [D 20:43:28.273618] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 60/70. [D 20:43:28.276247] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.276261] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.276270] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:28.276285] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7286 [D 20:43:28.276295] element 0: offset: 0x2aaaab230240, size: 24 [D 20:43:28.276305] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 0/70. [D 20:43:28.276320] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.276330] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.276338] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:28.276353] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7287 [D 20:43:28.276364] element 0: offset: 0x2aaaab20e440, size: 24 [D 20:43:28.276373] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 1/70. [D 20:43:28.277683] openib_check_cq: completed rdma wr_id 2aaaab23c850, nic_wr_credit 49872. [D 20:43:28.277698] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 2/70. [D 20:43:28.280092] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.280106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.280115] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:28.283163] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7283 [D 20:43:28.283220] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 3/70. [D 20:43:28.284887] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7287 [D 20:43:28.284904] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 4/70. [D 20:43:28.284939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 49872. [D 20:43:28.285001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 49873. [D 20:43:28.285012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 49874. [D 20:43:28.285023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 49875. [D 20:43:28.285038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 49876. [D 20:43:28.285047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 49877. [D 20:43:28.285057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 49878. [D 20:43:28.285072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 49879. [D 20:43:28.285082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 49880. [D 20:43:28.285091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 49881. [D 20:43:28.285135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 49882. [D 20:43:28.285146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 49883. [D 20:43:28.285157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 49884. [D 20:43:28.285166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 49885. [D 20:43:28.285181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 49886. [D 20:43:28.285206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 49887. [D 20:43:28.285216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 49888. [D 20:43:28.285232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 49889. [D 20:43:28.285242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 49890. [D 20:43:28.285252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 49891. [D 20:43:28.285281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 49892. [D 20:43:28.285292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 49893. [D 20:43:28.285304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 49894. [D 20:43:28.285314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 49895. [D 20:43:28.285324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 49896. [D 20:43:28.285338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 49897. [D 20:43:28.285347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 49898. [D 20:43:28.285375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 49899. [D 20:43:28.285385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 49900. [D 20:43:28.285395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 49901. [D 20:43:28.285405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 49902. [D 20:43:28.285415] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22fbc0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 49903. [D 20:43:28.285435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 49904. [D 20:43:28.285446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 49905. [D 20:43:28.285456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 49906. [D 20:43:28.285466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 49907. [D 20:43:28.285494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 49908. [D 20:43:28.285505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 49909. [D 20:43:28.285515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 49910. [D 20:43:28.285525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 49911. [D 20:43:28.285549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 49912. [D 20:43:28.285558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 49913. [D 20:43:28.285573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 49914. [D 20:43:28.285584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 49915. [D 20:43:28.285605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 49916. [D 20:43:28.285615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 49917. [D 20:43:28.285630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 49918. [D 20:43:28.285640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 49919. [D 20:43:28.285650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 49920. [D 20:43:28.285674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 49921. [D 20:43:28.285684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 49922. [D 20:43:28.285694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 49923. [D 20:43:28.285704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 49924. [D 20:43:28.285714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 49925. [D 20:43:28.285729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 49926. [D 20:43:28.285739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 49927. [D 20:43:28.285749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 49928. [D 20:43:28.285759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 49929. [D 20:43:28.285775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 49930. [D 20:43:28.285785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 49931. [D 20:43:28.285795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 49932. [D 20:43:28.285822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 49933. [D 20:43:28.285832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 49934. [D 20:43:28.285847] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab236b30 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 49935. [D 20:43:28.288436] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.288451] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.288463] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:28.288498] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7291 [D 20:43:28.288510] element 0: offset: 0x2aaaab22f7c0, size: 24 [D 20:43:28.288523] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 5/70. [D 20:43:28.288899] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7286 [D 20:43:28.288920] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 6/70. [D 20:43:28.296613] openib_check_cq: completed rdma wr_id 2aaaab22fbc0, nic_wr_credit 49935. [D 20:43:28.296632] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 7/70. [D 20:43:28.308344] openib_check_cq: completed rdma wr_id 2aaaab236b30, nic_wr_credit 49934. [D 20:43:28.308358] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 8/70. [D 20:43:28.308393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 49934. [D 20:43:28.308405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 49935. [D 20:43:28.308415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 49936. [D 20:43:28.308428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 49937. [D 20:43:28.308440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 49938. [D 20:43:28.308450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 49939. [D 20:43:28.308460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 49940. [D 20:43:28.308486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 49941. [D 20:43:28.308496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 49942. [D 20:43:28.308506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 49943. [D 20:43:28.308519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 49944. [D 20:43:28.308529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 49945. [D 20:43:28.308551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 49946. [D 20:43:28.308561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 49947. [D 20:43:28.308571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 49948. [D 20:43:28.308581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 49949. [D 20:43:28.308591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 49950. [D 20:43:28.308601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 49951. [D 20:43:28.308611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 49952. [D 20:43:28.308627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 49953. [D 20:43:28.308647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 49954. [D 20:43:28.308676] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.308693] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.308702] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:28.308799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 49955. [D 20:43:28.308829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 49956. [D 20:43:28.308839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 49957. [D 20:43:28.308849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 49958. [D 20:43:28.308859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 49959. [D 20:43:28.308873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 49960. [D 20:43:28.308883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 49961. [D 20:43:28.308893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 49962. [D 20:43:28.308903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 49963. [D 20:43:28.308913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 49964. [D 20:43:28.308922] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2293e0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 49965. [D 20:43:28.308951] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.308961] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.308970] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:28.311396] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7291 [D 20:43:28.311449] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 9/70. [D 20:43:28.318155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.318170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.318182] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:28.318197] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7294 [D 20:43:28.318207] element 0: offset: 0x2aaaab233c80, size: 24 [D 20:43:28.318219] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 10/70. [D 20:43:28.318576] openib_check_cq: completed rdma wr_id 2aaaab2293e0, nic_wr_credit 49965. [D 20:43:28.318590] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 11/70. [D 20:43:28.318602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 49965. [D 20:43:28.318612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 49966. [D 20:43:28.318623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 49967. [D 20:43:28.318634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 49968. [D 20:43:28.318644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 49969. [D 20:43:28.318654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 49970. [D 20:43:28.318666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 49971. [D 20:43:28.318676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 49972. [D 20:43:28.318688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 49973. [D 20:43:28.318717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 49974. [D 20:43:28.318727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 49975. [D 20:43:28.318737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 49976. [D 20:43:28.318747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 49977. [D 20:43:28.318757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 49978. [D 20:43:28.318768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 49979. [D 20:43:28.318790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 49980. [D 20:43:28.318802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 49981. [D 20:43:28.318817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 49982. [D 20:43:28.318827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 49983. [D 20:43:28.318837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 49984. [D 20:43:28.318848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 49985. [D 20:43:28.318857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 49986. [D 20:43:28.318879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 49987. [D 20:43:28.318895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 49988. [D 20:43:28.318905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 49989. [D 20:43:28.318915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 49990. [D 20:43:28.318931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 49991. [D 20:43:28.318953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 49992. [D 20:43:28.318967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 49993. [D 20:43:28.318977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 49994. [D 20:43:28.318987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 49995. [D 20:43:28.319001] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c850 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 49996. [D 20:43:28.321321] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.321334] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.321345] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:28.323462] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7294 [D 20:43:28.323482] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 12/70. [D 20:43:28.324502] openib_check_cq: completed rdma wr_id 2aaaab23c850, nic_wr_credit 49996. [D 20:43:28.324562] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 13/70. [D 20:43:28.324579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 49996. [D 20:43:28.324591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 49997. [D 20:43:28.324602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 49998. [D 20:43:28.324612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 49999. [D 20:43:28.324626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 50000. [D 20:43:28.324636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 50001. [D 20:43:28.324646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 50002. [D 20:43:28.324662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 50003. [D 20:43:28.324695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 50004. [D 20:43:28.324705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 50005. [D 20:43:28.324715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 50006. [D 20:43:28.324725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 50007. [D 20:43:28.324753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 50008. [D 20:43:28.324770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 50009. [D 20:43:28.324781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 50010. [D 20:43:28.324791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 50011. [D 20:43:28.324801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 50012. [D 20:43:28.324811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 50013. [D 20:43:28.324835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 50014. [D 20:43:28.324849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 50015. [D 20:43:28.324858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 50016. [D 20:43:28.324868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 50017. [D 20:43:28.324886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 50018. [D 20:43:28.324916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 50019. [D 20:43:28.324927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 50020. [D 20:43:28.324936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 50021. [D 20:43:28.324952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 50022. [D 20:43:28.324962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 50023. [D 20:43:28.324988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 50024. [D 20:43:28.324998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 50025. [D 20:43:28.325011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 50026. [D 20:43:28.325026] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2085f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 50027. [D 20:43:28.325100] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.325128] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.325138] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.330509] openib_check_cq: completed rdma wr_id 2aaaab2085f0, nic_wr_credit 50027. [D 20:43:28.330524] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 14/70. [D 20:43:28.332446] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.332460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.332471] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:28.624079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.624094] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.624105] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:28.624138] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7298 [D 20:43:28.624149] element 0: offset: 0x2aaaab221680, size: 24 [D 20:43:28.624160] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 15/70. [D 20:43:28.624181] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.624190] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.624201] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:28.624245] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7299 [D 20:43:28.624256] element 0: offset: 0x2aaaab21af70, size: 24 [D 20:43:28.624279] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 16/70. [D 20:43:28.629216] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7299 [D 20:43:28.629287] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 17/70. [D 20:43:28.629426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 50027. [D 20:43:28.629441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 50028. [D 20:43:28.629452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 50029. [D 20:43:28.629462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 50030. [D 20:43:28.629472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 50031. [D 20:43:28.629482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 50032. [D 20:43:28.629492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 50033. [D 20:43:28.629501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 50034. [D 20:43:28.629511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 50035. [D 20:43:28.629521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 50036. [D 20:43:28.629531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 50037. [D 20:43:28.629541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 50038. [D 20:43:28.629551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 50039. [D 20:43:28.629561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 50040. [D 20:43:28.629572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 50041. [D 20:43:28.629582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 50042. [D 20:43:28.629591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 50043. [D 20:43:28.629614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 50044. [D 20:43:28.629656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 50045. [D 20:43:28.629666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 50046. [D 20:43:28.629676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 50047. [D 20:43:28.629685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 50048. [D 20:43:28.629695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 50049. [D 20:43:28.629705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 50050. [D 20:43:28.629715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 50051. [D 20:43:28.629725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 50052. [D 20:43:28.629734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 50053. [D 20:43:28.629744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 50054. [D 20:43:28.629754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 50055. [D 20:43:28.629764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 50056. [D 20:43:28.629774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 50057. [D 20:43:28.629784] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20bb80 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 50058. [D 20:43:28.632131] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7298 [D 20:43:28.632147] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 18/70. [D 20:43:28.639040] openib_check_cq: completed rdma wr_id 2aaaab20bb80, nic_wr_credit 50058. [D 20:43:28.639055] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 19/70. [D 20:43:28.641397] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.641412] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.641424] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.647673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 50058. [D 20:43:28.647688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 50059. [D 20:43:28.647699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 50060. [D 20:43:28.647709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 50061. [D 20:43:28.647722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 50062. [D 20:43:28.647737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 50063. [D 20:43:28.647747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 50064. [D 20:43:28.647756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 50065. [D 20:43:28.647773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 50066. [D 20:43:28.647782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 50067. [D 20:43:28.647792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 50068. [D 20:43:28.647808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 50069. [D 20:43:28.647818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 50070. [D 20:43:28.647827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 50071. [D 20:43:28.647843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 50072. [D 20:43:28.647853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 50073. [D 20:43:28.647862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 50074. [D 20:43:28.647878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 50075. [D 20:43:28.647901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 50076. [D 20:43:28.647927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 50077. [D 20:43:28.647937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 50078. [D 20:43:28.647948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 50079. [D 20:43:28.647958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 50080. [D 20:43:28.647968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 50081. [D 20:43:28.647991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 50082. [D 20:43:28.648002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 50083. [D 20:43:28.648014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 50084. [D 20:43:28.648029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 50085. [D 20:43:28.648039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 50086. [D 20:43:28.648049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 50087. [D 20:43:28.648064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 50088. [D 20:43:28.648090] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab229530 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 50089. [D 20:43:28.650631] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.650645] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.650656] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:28.650686] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7304 [D 20:43:28.650697] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:43:28.650708] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 20/70. [D 20:43:28.650727] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.650740] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.650748] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:28.650777] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7306 [D 20:43:28.650797] element 0: offset: 0x2aaaab21ad00, size: 24 [D 20:43:28.650809] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 21/70. [D 20:43:28.659306] openib_check_cq: completed rdma wr_id 2aaaab229530, nic_wr_credit 50089. [D 20:43:28.659322] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 22/70. [D 20:43:28.660527] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.660540] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.660549] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:28.663539] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7304 [D 20:43:28.663621] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 23/70. [D 20:43:28.663764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 50089. [D 20:43:28.663780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 50090. [D 20:43:28.663791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 50091. [D 20:43:28.663802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 50092. [D 20:43:28.663812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 50093. [D 20:43:28.663822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 50094. [D 20:43:28.663832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 50095. [D 20:43:28.663842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 50096. [D 20:43:28.663857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 50097. [D 20:43:28.663867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 50098. [D 20:43:28.663877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 50099. [D 20:43:28.663887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 50100. [D 20:43:28.663913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 50101. [D 20:43:28.663922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 50102. [D 20:43:28.663941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 50103. [D 20:43:28.663957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 50104. [D 20:43:28.663967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 50105. [D 20:43:28.663977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 50106. [D 20:43:28.663993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 50107. [D 20:43:28.664016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 50108. [D 20:43:28.664029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 50109. [D 20:43:28.664038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 50110. [D 20:43:28.664048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 50111. [D 20:43:28.664075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 50112. [D 20:43:28.664085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 50113. [D 20:43:28.664097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 50114. [D 20:43:28.664121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 50115. [D 20:43:28.664136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 50116. [D 20:43:28.664146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 50117. [D 20:43:28.664155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 50118. [D 20:43:28.664165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 50119. [D 20:43:28.664175] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c850 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 50120. [D 20:43:28.667103] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7306 [D 20:43:28.667159] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 24/70. [D 20:43:28.671072] openib_check_cq: completed rdma wr_id 2aaaab23c850, nic_wr_credit 50120. [D 20:43:28.671090] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 25/70. [D 20:43:28.672921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 50120. [D 20:43:28.672938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 50121. [D 20:43:28.672951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 50122. [D 20:43:28.672961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 50123. [D 20:43:28.672971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 50124. [D 20:43:28.672986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 50125. [D 20:43:28.672996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 50126. [D 20:43:28.673006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 50127. [D 20:43:28.673021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 50128. [D 20:43:28.673032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 50129. [D 20:43:28.673041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 50130. [D 20:43:28.673057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 50131. [D 20:43:28.673067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 50132. [D 20:43:28.673077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 50133. [D 20:43:28.673092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 50134. [D 20:43:28.673102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 50135. [D 20:43:28.673112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 50136. [D 20:43:28.673147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 50137. [D 20:43:28.673157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 50138. [D 20:43:28.673167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 50139. [D 20:43:28.673177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 50140. [D 20:43:28.673205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 50141. [D 20:43:28.673217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 50142. [D 20:43:28.673229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 50143. [D 20:43:28.673239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 50144. [D 20:43:28.673251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 50145. [D 20:43:28.673265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 50146. [D 20:43:28.673275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 50147. [D 20:43:28.673285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 50148. [D 20:43:28.673317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 50149. [D 20:43:28.673327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 50150. [D 20:43:28.673337] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20b9b0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 50151. [D 20:43:28.675655] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.675670] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.675680] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.681294] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.681308] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.681319] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:28.681350] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7310 [D 20:43:28.681362] element 0: offset: 0x2aaaab2327b0, size: 24 [D 20:43:28.681373] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 26/70. [D 20:43:28.681393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.681403] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.681411] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:28.681426] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7311 [D 20:43:28.681436] element 0: offset: 0x2aaaab208910, size: 24 [D 20:43:28.681446] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 27/70. [D 20:43:28.684665] openib_check_cq: completed rdma wr_id 2aaaab20b9b0, nic_wr_credit 50151. [D 20:43:28.684679] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 28/70. [D 20:43:28.687077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.687091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.687100] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:28.689855] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7311 [D 20:43:28.689909] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 29/70. [D 20:43:28.689977] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7310 [D 20:43:28.689992] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 30/70. [D 20:43:28.690061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 50151. [D 20:43:28.690074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 50152. [D 20:43:28.690085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 50153. [D 20:43:28.690102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 50154. [D 20:43:28.690112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 50155. [D 20:43:28.690121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 50156. [D 20:43:28.690138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 50157. [D 20:43:28.690148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 50158. [D 20:43:28.690158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 50159. [D 20:43:28.690174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 50160. [D 20:43:28.690184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 50161. [D 20:43:28.690194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 50162. [D 20:43:28.690253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 50163. [D 20:43:28.690263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 50164. [D 20:43:28.690273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 50165. [D 20:43:28.690298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 50166. [D 20:43:28.690308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 50167. [D 20:43:28.690318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 50168. [D 20:43:28.690328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 50169. [D 20:43:28.690338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 50170. [D 20:43:28.690348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 50171. [D 20:43:28.690358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 50172. [D 20:43:28.690368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 50173. [D 20:43:28.690378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 50174. [D 20:43:28.690388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 50175. [D 20:43:28.690409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 50176. [D 20:43:28.690427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 50177. [D 20:43:28.690437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 50178. [D 20:43:28.690446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 50179. [D 20:43:28.690457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 50180. [D 20:43:28.690468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 50181. [D 20:43:28.690477] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 50182. [D 20:43:28.690505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 50183. [D 20:43:28.690516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 50184. [D 20:43:28.690526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 50185. [D 20:43:28.690536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 50186. [D 20:43:28.690546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 50187. [D 20:43:28.690582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 50188. [D 20:43:28.690594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 50189. [D 20:43:28.690607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 50190. [D 20:43:28.690617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 50191. [D 20:43:28.690627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 50192. [D 20:43:28.690662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 50193. [D 20:43:28.690671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 50194. [D 20:43:28.690681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 50195. [D 20:43:28.690695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 50196. [D 20:43:28.690724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 50197. [D 20:43:28.690734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 50198. [D 20:43:28.690744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 50199. [D 20:43:28.690755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 50200. [D 20:43:28.690764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 50201. [D 20:43:28.690775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 50202. [D 20:43:28.690784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 50203. [D 20:43:28.690795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 50204. [D 20:43:28.690804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 50205. [D 20:43:28.690833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 50206. [D 20:43:28.690844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 50207. [D 20:43:28.690857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 50208. [D 20:43:28.690867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 50209. [D 20:43:28.690877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 50210. [D 20:43:28.690901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 50211. [D 20:43:28.690911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 50212. [D 20:43:28.690925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 50213. [D 20:43:28.690935] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22fbc0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 50214. [D 20:43:28.696538] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50214. [D 20:43:28.696553] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 31/70. [D 20:43:28.702518] openib_check_cq: completed rdma wr_id 2aaaab22fbc0, nic_wr_credit 50213. [D 20:43:28.702531] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 32/70. [D 20:43:28.705056] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.705071] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.705082] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.705097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.705107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.705116] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:28.705135] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.705146] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.705154] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:28.705185] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7316 [D 20:43:28.705197] element 0: offset: 0x2aaaab20b8d0, size: 24 [D 20:43:28.705208] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 33/70. [D 20:43:28.705228] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.705238] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.705246] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:28.705283] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7318 [D 20:43:28.705299] element 0: offset: 0x2aaaab21af70, size: 24 [D 20:43:28.705308] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 34/70. [D 20:43:28.710406] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7318 [D 20:43:28.710480] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 35/70. [D 20:43:28.710622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 50213. [D 20:43:28.710638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 50214. [D 20:43:28.710649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 50215. [D 20:43:28.710665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 50216. [D 20:43:28.710676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 50217. [D 20:43:28.710686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 50218. [D 20:43:28.710696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 50219. [D 20:43:28.710707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 50220. [D 20:43:28.710717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 50221. [D 20:43:28.710727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 50222. [D 20:43:28.710745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 50223. [D 20:43:28.710755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 50224. [D 20:43:28.710765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 50225. [D 20:43:28.710775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 50226. [D 20:43:28.710785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 50227. [D 20:43:28.710795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 50228. [D 20:43:28.710804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 50229. [D 20:43:28.710862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 50230. [D 20:43:28.710910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 50231. [D 20:43:28.710921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 50232. [D 20:43:28.710931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 50233. [D 20:43:28.710943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 50234. [D 20:43:28.710953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 50235. [D 20:43:28.710962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 50236. [D 20:43:28.710976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 50237. [D 20:43:28.710986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 50238. [D 20:43:28.710996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 50239. [D 20:43:28.711021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 50240. [D 20:43:28.711031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 50241. [D 20:43:28.711041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 50242. [D 20:43:28.711057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 50243. [D 20:43:28.711067] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22fbc0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 50244. [D 20:43:28.710879] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7316 [D 20:43:28.713391] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 36/70. [D 20:43:28.720130] openib_check_cq: completed rdma wr_id 2aaaab22fbc0, nic_wr_credit 50244. [D 20:43:28.720145] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 37/70. [D 20:43:28.722472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.722487] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.722498] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.723883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 50244. [D 20:43:28.723897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 50245. [D 20:43:28.723908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 50246. [D 20:43:28.723918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 50247. [D 20:43:28.723933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 50248. [D 20:43:28.723944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 50249. [D 20:43:28.723954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 50250. [D 20:43:28.723964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 50251. [D 20:43:28.723974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 50252. [D 20:43:28.723984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 50253. [D 20:43:28.723994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 50254. [D 20:43:28.724011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 50255. [D 20:43:28.724021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 50256. [D 20:43:28.724031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 50257. [D 20:43:28.724041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 50258. [D 20:43:28.724052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 50259. [D 20:43:28.724062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 50260. [D 20:43:28.724094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 50261. [D 20:43:28.724105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 50262. [D 20:43:28.724115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 50263. [D 20:43:28.724129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 50264. [D 20:43:28.724139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 50265. [D 20:43:28.724162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 50266. [D 20:43:28.724172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 50267. [D 20:43:28.724182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 50268. [D 20:43:28.724198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 50269. [D 20:43:28.724207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 50270. [D 20:43:28.724217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 50271. [D 20:43:28.724246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 50272. [D 20:43:28.724256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 50273. [D 20:43:28.724268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 50274. [D 20:43:28.724278] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab209160 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 50275. [D 20:43:28.732323] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.732336] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.732347] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:28.732378] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7322 [D 20:43:28.732389] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:43:28.732400] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 38/70. [D 20:43:28.732419] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.732431] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.732439] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:28.732454] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7323 [D 20:43:28.732464] element 0: offset: 0x2aaaab221680, size: 24 [D 20:43:28.732478] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 39/70. [D 20:43:28.735575] openib_check_cq: completed rdma wr_id 2aaaab209160, nic_wr_credit 50275. [D 20:43:28.735589] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 40/70. [D 20:43:28.737964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.737978] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.737986] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:28.740618] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7323 [D 20:43:28.740665] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 41/70. [D 20:43:28.740812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 50275. [D 20:43:28.740827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 50276. [D 20:43:28.740837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 50277. [D 20:43:28.740848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 50278. [D 20:43:28.740865] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7322 [D 20:43:28.740884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 50279. [D 20:43:28.740894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 50280. [D 20:43:28.740904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 50281. [D 20:43:28.740921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 50282. [D 20:43:28.740931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 50283. [D 20:43:28.740941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 50284. [D 20:43:28.740963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 50285. [D 20:43:28.741018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 50286. [D 20:43:28.741032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 50287. [D 20:43:28.741043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 50288. [D 20:43:28.741054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 50289. [D 20:43:28.741076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 50290. [D 20:43:28.741087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 50291. [D 20:43:28.741098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 50292. [D 20:43:28.741107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 50293. [D 20:43:28.741117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 50294. [D 20:43:28.741153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 50295. [D 20:43:28.741165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 50296. [D 20:43:28.741179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 50297. [D 20:43:28.741189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 50298. [D 20:43:28.741216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 50299. [D 20:43:28.741230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 50300. [D 20:43:28.741240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 50301. [D 20:43:28.741249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 50302. [D 20:43:28.741265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 50303. [D 20:43:28.741288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 50304. [D 20:43:28.741302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 50305. [D 20:43:28.741312] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 50306. [D 20:43:28.741335] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 42/70. [D 20:43:28.747468] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50306. [D 20:43:28.747483] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 43/70. [D 20:43:28.748107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 50306. [D 20:43:28.748121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 50307. [D 20:43:28.748131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 50308. [D 20:43:28.748141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 50309. [D 20:43:28.748173] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.748191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.748201] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.748219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 50310. [D 20:43:28.748230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 50311. [D 20:43:28.748240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 50312. [D 20:43:28.748251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 50313. [D 20:43:28.748261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 50314. [D 20:43:28.748271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 50315. [D 20:43:28.748281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 50316. [D 20:43:28.748292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 50317. [D 20:43:28.748302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 50318. [D 20:43:28.748323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 50319. [D 20:43:28.748340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 50320. [D 20:43:28.748350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 50321. [D 20:43:28.748359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 50322. [D 20:43:28.748370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 50323. [D 20:43:28.748380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 50324. [D 20:43:28.748391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 50325. [D 20:43:28.748401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 50326. [D 20:43:28.748426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 50327. [D 20:43:28.748437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 50328. [D 20:43:28.748450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 50329. [D 20:43:28.748460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 50330. [D 20:43:28.748473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 50331. [D 20:43:28.748495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 50332. [D 20:43:28.748505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 50333. [D 20:43:28.748516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 50334. [D 20:43:28.748530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 50335. [D 20:43:28.748540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 50336. [D 20:43:28.748561] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20b9b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 50337. [D 20:43:28.756283] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.756297] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.756308] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:28.756339] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7328 [D 20:43:28.756350] element 0: offset: 0x2aaaab208910, size: 24 [D 20:43:28.756366] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 44/70. [D 20:43:28.756386] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.756397] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.756406] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:28.756420] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7330 [D 20:43:28.756431] element 0: offset: 0x2aaaab22f7c0, size: 24 [D 20:43:28.756440] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 45/70. [D 20:43:28.759781] openib_check_cq: completed rdma wr_id 2aaaab20b9b0, nic_wr_credit 50337. [D 20:43:28.759795] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 46/70. [D 20:43:28.762149] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.762163] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.762172] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:28.765028] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7330 [D 20:43:28.765081] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 47/70. [D 20:43:28.766382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 50337. [D 20:43:28.766400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 50338. [D 20:43:28.766411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 50339. [D 20:43:28.766421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 50340. [D 20:43:28.766439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 50341. [D 20:43:28.766450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 50342. [D 20:43:28.766460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 50343. [D 20:43:28.766470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 50344. [D 20:43:28.766480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 50345. [D 20:43:28.766490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 50346. [D 20:43:28.766500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 50347. [D 20:43:28.766553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 50348. [D 20:43:28.766564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 50349. [D 20:43:28.766574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 50350. [D 20:43:28.766599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 50351. [D 20:43:28.766609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 50352. [D 20:43:28.766618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 50353. [D 20:43:28.766629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 50354. [D 20:43:28.766639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 50355. [D 20:43:28.766649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 50356. [D 20:43:28.766659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 50357. [D 20:43:28.766669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 50358. [D 20:43:28.766679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 50359. [D 20:43:28.766688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 50360. [D 20:43:28.766711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 50361. [D 20:43:28.766721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 50362. [D 20:43:28.766730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 50363. [D 20:43:28.766757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 50364. [D 20:43:28.766768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 50365. [D 20:43:28.766778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 50366. [D 20:43:28.766788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 50367. [D 20:43:28.766804] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20b9b0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 50368. [D 20:43:28.769250] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:28.769265] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.769277] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:28.769311] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7333 [D 20:43:28.769323] element 0: offset: 0x2aaaab21ad00, size: 24 [D 20:43:28.769336] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 48/70. [D 20:43:28.769371] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7328 [D 20:43:28.769385] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 49/70. [D 20:43:28.772353] openib_check_cq: completed rdma wr_id 2aaaab20b9b0, nic_wr_credit 50368. [D 20:43:28.772368] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 50/70. [D 20:43:28.772383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 50368. [D 20:43:28.772394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 50369. [D 20:43:28.772407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 50370. [D 20:43:28.772417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 50371. [D 20:43:28.772490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 50372. [D 20:43:28.772502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 50373. [D 20:43:28.772529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 50374. [D 20:43:28.772539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 50375. [D 20:43:28.772549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 50376. [D 20:43:28.772564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 50377. [D 20:43:28.772574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 50378. [D 20:43:28.772584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 50379. [D 20:43:28.772613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 50380. [D 20:43:28.772624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 50381. [D 20:43:28.772636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 50382. [D 20:43:28.772646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 50383. [D 20:43:28.772658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 50384. [D 20:43:28.772673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 50385. [D 20:43:28.772696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 50386. [D 20:43:28.772709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 50387. [D 20:43:28.772719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 50388. [D 20:43:28.772729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 50389. [D 20:43:28.772742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 50390. [D 20:43:28.772752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 50391. [D 20:43:28.772778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 50392. [D 20:43:28.772787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 50393. [D 20:43:28.772798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 50394. [D 20:43:28.772811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 50395. [D 20:43:28.772821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 50396. [D 20:43:28.772844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 50397. [D 20:43:28.772854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 50398. [D 20:43:28.772864] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22fbc0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 50399. [D 20:43:28.772918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.772930] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.772939] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:28.777588] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7333 [D 20:43:28.777650] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 51/70. [D 20:43:28.778266] openib_check_cq: completed rdma wr_id 2aaaab22fbc0, nic_wr_credit 50399. [D 20:43:28.778283] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 52/70. [D 20:43:28.778297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 50399. [D 20:43:28.778308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 50400. [D 20:43:28.778322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 50401. [D 20:43:28.778332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 50402. [D 20:43:28.778342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 50403. [D 20:43:28.778352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 50404. [D 20:43:28.778362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 50405. [D 20:43:28.778374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 50406. [D 20:43:28.778391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 50407. [D 20:43:28.778401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 50408. [D 20:43:28.778411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 50409. [D 20:43:28.778439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 50410. [D 20:43:28.778449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 50411. [D 20:43:28.778464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 50412. [D 20:43:28.778474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 50413. [D 20:43:28.778489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 50414. [D 20:43:28.778499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 50415. [D 20:43:28.778520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 50416. [D 20:43:28.778535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 50417. [D 20:43:28.778545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 50418. [D 20:43:28.778555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 50419. [D 20:43:28.778570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 50420. [D 20:43:28.778580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 50421. [D 20:43:28.778590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 50422. [D 20:43:28.778614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 50423. [D 20:43:28.778624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 50424. [D 20:43:28.778635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 50425. [D 20:43:28.778645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 50426. [D 20:43:28.778655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 50427. [D 20:43:28.778664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 50428. [D 20:43:28.778675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 50429. [D 20:43:28.778685] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab227f60 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 50430. [D 20:43:28.778739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.778751] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.778759] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:28.784223] openib_check_cq: completed rdma wr_id 2aaaab227f60, nic_wr_credit 50430. [D 20:43:28.784237] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 53/70. [D 20:43:28.786348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:28.786361] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:28.786372] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:29.074501] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.074517] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.074528] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:29.074559] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7335 [D 20:43:29.074571] element 0: offset: 0x2aaaab23cd10, size: 24 [D 20:43:29.074586] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 54/70. [D 20:43:29.076537] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7335 [D 20:43:29.076553] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 55/70. [D 20:43:29.076599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 50430. [D 20:43:29.076611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 50431. [D 20:43:29.076620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 50432. [D 20:43:29.076631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 50433. [D 20:43:29.076646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 50434. [D 20:43:29.076657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 50435. [D 20:43:29.076667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 50436. [D 20:43:29.076676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 50437. [D 20:43:29.076687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 50438. [D 20:43:29.076697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 50439. [D 20:43:29.076707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 50440. [D 20:43:29.076716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 50441. [D 20:43:29.076727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 50442. [D 20:43:29.076737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 50443. [D 20:43:29.076746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 50444. [D 20:43:29.076756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 50445. [D 20:43:29.076767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 50446. [D 20:43:29.076777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 50447. [D 20:43:29.076786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 50448. [D 20:43:29.076796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 50449. [D 20:43:29.076827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 50450. [D 20:43:29.076837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 50451. [D 20:43:29.076847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 50452. [D 20:43:29.076857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 50453. [D 20:43:29.076868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 50454. [D 20:43:29.076878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 50455. [D 20:43:29.076902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 50456. [D 20:43:29.076912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 50457. [D 20:43:29.076922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 50458. [D 20:43:29.076938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 50459. [D 20:43:29.076948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 50460. [D 20:43:29.076959] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 50461. [D 20:43:29.087701] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50461. [D 20:43:29.087714] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 56/70. [D 20:43:29.088508] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.088521] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.088530] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:29.128239] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.128254] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.128265] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:29.128281] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7339 [D 20:43:29.128291] element 0: offset: 0x2aaaab230000, size: 24 [D 20:43:29.128301] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 57/70. [D 20:43:29.130497] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7339 [D 20:43:29.130546] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 58/70. [D 20:43:29.130697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 50461. [D 20:43:29.130764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 50462. [D 20:43:29.130776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 50463. [D 20:43:29.130787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 50464. [D 20:43:29.130802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 50465. [D 20:43:29.130811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 50466. [D 20:43:29.130821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 50467. [D 20:43:29.130835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 50468. [D 20:43:29.130844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 50469. [D 20:43:29.130854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 50470. [D 20:43:29.130864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 50471. [D 20:43:29.130874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 50472. [D 20:43:29.130909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 50473. [D 20:43:29.130919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 50474. [D 20:43:29.130929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 50475. [D 20:43:29.130970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 50476. [D 20:43:29.130980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 50477. [D 20:43:29.130990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 50478. [D 20:43:29.131020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 50479. [D 20:43:29.131031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 50480. [D 20:43:29.131042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 50481. [D 20:43:29.131052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 50482. [D 20:43:29.131068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 50483. [D 20:43:29.131078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 50484. [D 20:43:29.131088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 50485. [D 20:43:29.131099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 50486. [D 20:43:29.131125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 50487. [D 20:43:29.131136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 50488. [D 20:43:29.131147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 50489. [D 20:43:29.131156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 50490. [D 20:43:29.131166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 50491. [D 20:43:29.131190] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 50492. [D 20:43:29.141496] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50492. [D 20:43:29.141513] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 59/70. [D 20:43:29.143799] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.143813] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.143823] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:29.235056] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.235071] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.235082] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:29.235114] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7342 [D 20:43:29.235124] element 0: offset: 0x2aaaab20b8d0, size: 24 [D 20:43:29.235136] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 60/70. [D 20:43:29.237141] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7342 [D 20:43:29.237198] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 0/70. [D 20:43:29.237300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 50492. [D 20:43:29.237317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 50493. [D 20:43:29.237328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 50494. [D 20:43:29.237338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 50495. [D 20:43:29.237352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 50496. [D 20:43:29.237362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 50497. [D 20:43:29.237371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 50498. [D 20:43:29.237388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 50499. [D 20:43:29.237398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 50500. [D 20:43:29.237408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 50501. [D 20:43:29.237418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 50502. [D 20:43:29.237429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 50503. [D 20:43:29.237439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 50504. [D 20:43:29.237449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 50505. [D 20:43:29.237492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 50506. [D 20:43:29.237502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 50507. [D 20:43:29.237512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 50508. [D 20:43:29.237523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 50509. [D 20:43:29.237547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 50510. [D 20:43:29.237557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 50511. [D 20:43:29.237567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 50512. [D 20:43:29.237577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 50513. [D 20:43:29.237590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 50514. [D 20:43:29.237607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 50515. [D 20:43:29.237617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 50516. [D 20:43:29.237627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 50517. [D 20:43:29.237637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 50518. [D 20:43:29.237661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 50519. [D 20:43:29.237671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 50520. [D 20:43:29.237682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 50521. [D 20:43:29.237692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 50522. [D 20:43:29.237702] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 50523. [D 20:43:29.248668] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50523. [D 20:43:29.248682] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 1/70. [D 20:43:29.250979] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.250992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.251002] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:29.257807] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.257821] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.257832] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:29.257846] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7346 [D 20:43:29.257856] element 0: offset: 0x2aaaab208910, size: 24 [D 20:43:29.257867] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 2/70. [D 20:43:29.257882] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.257895] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.257904] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:29.257919] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7348 [D 20:43:29.257929] element 0: offset: 0x2aaaab21af70, size: 24 [D 20:43:29.257953] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 3/70. [D 20:43:29.262483] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7348 [D 20:43:29.262540] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 4/70. [D 20:43:29.262589] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7346 [D 20:43:29.262605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 50523. [D 20:43:29.262673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 50524. [D 20:43:29.262685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 50525. [D 20:43:29.262695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 50526. [D 20:43:29.262705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 50527. [D 20:43:29.262714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 50528. [D 20:43:29.262724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 50529. [D 20:43:29.262746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 50530. [D 20:43:29.262756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 50531. [D 20:43:29.262765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 50532. [D 20:43:29.262775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 50533. [D 20:43:29.262792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 50534. [D 20:43:29.262802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 50535. [D 20:43:29.262811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 50536. [D 20:43:29.262821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 50537. [D 20:43:29.262832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 50538. [D 20:43:29.262842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 50539. [D 20:43:29.262851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 50540. [D 20:43:29.262861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 50541. [D 20:43:29.262911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 50542. [D 20:43:29.262922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 50543. [D 20:43:29.262932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 50544. [D 20:43:29.262942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 50545. [D 20:43:29.262970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 50546. [D 20:43:29.262980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 50547. [D 20:43:29.262996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 50548. [D 20:43:29.263006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 50549. [D 20:43:29.263028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 50550. [D 20:43:29.263045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 50551. [D 20:43:29.263054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 50552. [D 20:43:29.263064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 50553. [D 20:43:29.263081] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 50554. [D 20:43:29.263104] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 5/70. [D 20:43:29.272608] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50554. [D 20:43:29.272627] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 6/70. [D 20:43:29.272662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 50554. [D 20:43:29.272672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 50555. [D 20:43:29.272683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 50556. [D 20:43:29.272695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 50557. [D 20:43:29.272705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 50558. [D 20:43:29.272717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 50559. [D 20:43:29.272732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 50560. [D 20:43:29.272753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 50561. [D 20:43:29.272764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 50562. [D 20:43:29.272774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 50563. [D 20:43:29.272786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 50564. [D 20:43:29.272796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 50565. [D 20:43:29.272819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 50566. [D 20:43:29.272829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 50567. [D 20:43:29.272839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 50568. [D 20:43:29.272855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 50569. [D 20:43:29.272865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 50570. [D 20:43:29.272875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 50571. [D 20:43:29.272902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 50572. [D 20:43:29.272912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 50573. [D 20:43:29.272926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 50574. [D 20:43:29.272936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 50575. [D 20:43:29.272951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 50576. [D 20:43:29.272976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 50577. [D 20:43:29.272986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 50578. [D 20:43:29.272996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 50579. [D 20:43:29.273006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 50580. [D 20:43:29.273016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 50581. [D 20:43:29.273042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 50582. [D 20:43:29.273052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 50583. [D 20:43:29.273068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 50584. [D 20:43:29.273078] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cbc0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 50585. [D 20:43:29.275416] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.275432] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.275441] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:29.284357] openib_check_cq: completed rdma wr_id 2aaaab23cbc0, nic_wr_credit 50585. [D 20:43:29.284371] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 7/70. [D 20:43:29.287458] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.287472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.287481] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:29.287511] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7352 [D 20:43:29.287522] element 0: offset: 0x2aaaab23ced0, size: 24 [D 20:43:29.287538] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 8/70. [D 20:43:29.287557] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.287572] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.287581] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:29.287595] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7354 [D 20:43:29.287605] element 0: offset: 0x2aaaab230000, size: 24 [D 20:43:29.287631] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 9/70. [D 20:43:29.287648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.287658] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.287679] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:29.287696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.287705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.287714] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:29.287728] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7356 [D 20:43:29.287740] element 0: offset: 0x2aaaab221680, size: 24 [D 20:43:29.287750] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 10/70. [D 20:43:29.292303] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7354 [D 20:43:29.292358] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 11/70. [D 20:43:29.292502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 50585. [D 20:43:29.292579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 50586. [D 20:43:29.292589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 50587. [D 20:43:29.292600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 50588. [D 20:43:29.292610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 50589. [D 20:43:29.292620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 50590. [D 20:43:29.292630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 50591. [D 20:43:29.292639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 50592. [D 20:43:29.292649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 50593. [D 20:43:29.292659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 50594. [D 20:43:29.292669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 50595. [D 20:43:29.292679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 50596. [D 20:43:29.292689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 50597. [D 20:43:29.292698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 50598. [D 20:43:29.292708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 50599. [D 20:43:29.292718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 50600. [D 20:43:29.292728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 50601. [D 20:43:29.292737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 50602. [D 20:43:29.292747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 50603. [D 20:43:29.292757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 50604. [D 20:43:29.292767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 50605. [D 20:43:29.292777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 50606. [D 20:43:29.292787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 50607. [D 20:43:29.292796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 50608. [D 20:43:29.292806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 50609. [D 20:43:29.292816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 50610. [D 20:43:29.292826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 50611. [D 20:43:29.292836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 50612. [D 20:43:29.292845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 50613. [D 20:43:29.292857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 50614. [D 20:43:29.292866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 50615. [D 20:43:29.292877] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 50616. [D 20:43:29.294899] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7352 [D 20:43:29.294940] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 12/70. [D 20:43:29.294961] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.294976] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.294985] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:29.295409] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7360 [D 20:43:29.295424] element 0: offset: 0x691fe0, size: 24 [D 20:43:29.295440] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 13/70. [D 20:43:29.295486] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7356 [D 20:43:29.295502] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 14/70. [D 20:43:29.303869] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50616. [D 20:43:29.303885] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 15/70. [D 20:43:29.303917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 50616. [D 20:43:29.303929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 50617. [D 20:43:29.303939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 50618. [D 20:43:29.303953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 50619. [D 20:43:29.303964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 50620. [D 20:43:29.303973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 50621. [D 20:43:29.303987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 50622. [D 20:43:29.303997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 50623. [D 20:43:29.304023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 50624. [D 20:43:29.304033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 50625. [D 20:43:29.304043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 50626. [D 20:43:29.304053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 50627. [D 20:43:29.304080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 50628. [D 20:43:29.304090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 50629. [D 20:43:29.304101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 50630. [D 20:43:29.304110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 50631. [D 20:43:29.304121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 50632. [D 20:43:29.304145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 50633. [D 20:43:29.304156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 50634. [D 20:43:29.304167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 50635. [D 20:43:29.304177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 50636. [D 20:43:29.304187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 50637. [D 20:43:29.304197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 50638. [D 20:43:29.304207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 50639. [D 20:43:29.304232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 50640. [D 20:43:29.304242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 50641. [D 20:43:29.304252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 50642. [D 20:43:29.304267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 50643. [D 20:43:29.304294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 50644. [D 20:43:29.304307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 50645. [D 20:43:29.304317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 50646. [D 20:43:29.304327] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cbc0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 50647. [D 20:43:29.304342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 50648. [D 20:43:29.304366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 50649. [D 20:43:29.304376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 50650. [D 20:43:29.304386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 50651. [D 20:43:29.304397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 50652. [D 20:43:29.304408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 50653. [D 20:43:29.304417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 50654. [D 20:43:29.306701] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7360 [D 20:43:29.306713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 50655. [D 20:43:29.306767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 50656. [D 20:43:29.306780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 50657. [D 20:43:29.306790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 50658. [D 20:43:29.306800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 50659. [D 20:43:29.306810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 50660. [D 20:43:29.306820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 50661. [D 20:43:29.306839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 50662. [D 20:43:29.306850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 50663. [D 20:43:29.306860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 50664. [D 20:43:29.306870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 50665. [D 20:43:29.306885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 50666. [D 20:43:29.306895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 50667. [D 20:43:29.306905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 50668. [D 20:43:29.306921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 50669. [D 20:43:29.306931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 50670. [D 20:43:29.306941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 50671. [D 20:43:29.306957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 50672. [D 20:43:29.306967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 50673. [D 20:43:29.306976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 50674. [D 20:43:29.306992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 50675. [D 20:43:29.307059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 50676. [D 20:43:29.307070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 50677. [D 20:43:29.307080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 50678. [D 20:43:29.307090] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab227c30 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 50679. [D 20:43:29.307122] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 16/70. [D 20:43:29.307180] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.307198] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.307208] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:29.315541] openib_check_cq: completed rdma wr_id 2aaaab23cbc0, nic_wr_credit 50679. [D 20:43:29.315559] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 17/70. [D 20:43:29.327222] openib_check_cq: completed rdma wr_id 2aaaab227c30, nic_wr_credit 50678. [D 20:43:29.327236] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 18/70. [D 20:43:29.327270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 50678. [D 20:43:29.327281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 50679. [D 20:43:29.327291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 50680. [D 20:43:29.327304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 50681. [D 20:43:29.327314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 50682. [D 20:43:29.327326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 50683. [D 20:43:29.327341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 50684. [D 20:43:29.327351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 50685. [D 20:43:29.327360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 50686. [D 20:43:29.327376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 50687. [D 20:43:29.327403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 50688. [D 20:43:29.327414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 50689. [D 20:43:29.327424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 50690. [D 20:43:29.327439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 50691. [D 20:43:29.327449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 50692. [D 20:43:29.327469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 50693. [D 20:43:29.327484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 50694. [D 20:43:29.327494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 50695. [D 20:43:29.327504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 50696. [D 20:43:29.327535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 50697. [D 20:43:29.327546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 50698. [D 20:43:29.327557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 50699. [D 20:43:29.327566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 50700. [D 20:43:29.327582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 50701. [D 20:43:29.327592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 50702. [D 20:43:29.327615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 50703. [D 20:43:29.327626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 50704. [D 20:43:29.327636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 50705. [D 20:43:29.327646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 50706. [D 20:43:29.327672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 50707. [D 20:43:29.327681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 50708. [D 20:43:29.327696] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 50709. [D 20:43:29.330000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.330014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.330024] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:29.330040] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.330049] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.330058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:29.334614] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50709. [D 20:43:29.334628] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 19/70. [D 20:43:29.336944] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.336957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.336967] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:29.351888] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.351902] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.351913] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:29.351946] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7365 [D 20:43:29.351957] element 0: offset: 0x5b0030, size: 24 [D 20:43:29.351969] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 20/70. [D 20:43:29.351986] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.352002] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.352011] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:29.352026] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7368 [D 20:43:29.352035] element 0: offset: 0x61f670, size: 24 [D 20:43:29.352045] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 21/70. [D 20:43:29.352063] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.352072] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.352081] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:29.352095] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7369 [D 20:43:29.352105] element 0: offset: 0x61e4e0, size: 24 [D 20:43:29.352117] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 22/70. [D 20:43:29.352132] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.352141] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.352150] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:29.352163] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7372 [D 20:43:29.352173] element 0: offset: 0x61fa70, size: 24 [D 20:43:29.352183] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 23/70. [D 20:43:29.357140] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7368 [D 20:43:29.357206] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 24/70. [D 20:43:29.357356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 50709. [D 20:43:29.357430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 50710. [D 20:43:29.357441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 50711. [D 20:43:29.357452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 50712. [D 20:43:29.357462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 50713. [D 20:43:29.357471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 50714. [D 20:43:29.357481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 50715. [D 20:43:29.357491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 50716. [D 20:43:29.357501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 50717. [D 20:43:29.357510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 50718. [D 20:43:29.357521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 50719. [D 20:43:29.357530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 50720. [D 20:43:29.357540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 50721. [D 20:43:29.357550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 50722. [D 20:43:29.357560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 50723. [D 20:43:29.357569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 50724. [D 20:43:29.357579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 50725. [D 20:43:29.357589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 50726. [D 20:43:29.357599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 50727. [D 20:43:29.357609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 50728. [D 20:43:29.357618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 50729. [D 20:43:29.357628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 50730. [D 20:43:29.357638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 50731. [D 20:43:29.357648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 50732. [D 20:43:29.357658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 50733. [D 20:43:29.357667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 50734. [D 20:43:29.357677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 50735. [D 20:43:29.357687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 50736. [D 20:43:29.357697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 50737. [D 20:43:29.357708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 50738. [D 20:43:29.357719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 50739. [D 20:43:29.357728] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 50740. [D 20:43:29.359567] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7365 [D 20:43:29.359614] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 25/70. [D 20:43:29.361363] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7372 [D 20:43:29.361379] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 26/70. [D 20:43:29.361910] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7369 [D 20:43:29.361927] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 27/70. [D 20:43:29.366856] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50740. [D 20:43:29.366907] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 28/70. [D 20:43:29.366923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 50740. [D 20:43:29.366935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 50741. [D 20:43:29.366946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 50742. [D 20:43:29.366956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 50743. [D 20:43:29.366971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 50744. [D 20:43:29.366981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 50745. [D 20:43:29.366991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 50746. [D 20:43:29.367007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 50747. [D 20:43:29.367017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 50748. [D 20:43:29.367026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 50749. [D 20:43:29.367042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 50750. [D 20:43:29.367052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 50751. [D 20:43:29.367062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 50752. [D 20:43:29.367072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 50753. [D 20:43:29.367082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 50754. [D 20:43:29.367092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 50755. [D 20:43:29.367113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 50756. [D 20:43:29.367138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 50757. [D 20:43:29.367149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 50758. [D 20:43:29.367159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 50759. [D 20:43:29.367169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 50760. [D 20:43:29.367179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 50761. [D 20:43:29.367189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 50762. [D 20:43:29.367199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 50763. [D 20:43:29.367209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 50764. [D 20:43:29.367225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 50765. [D 20:43:29.367235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 50766. [D 20:43:29.367244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 50767. [D 20:43:29.367271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 50768. [D 20:43:29.367281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 50769. [D 20:43:29.367291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 50770. [D 20:43:29.367304] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c850 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 50771. [D 20:43:29.367316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 50772. [D 20:43:29.367327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 50773. [D 20:43:29.367359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 50774. [D 20:43:29.367370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 50775. [D 20:43:29.367380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 50776. [D 20:43:29.367389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 50777. [D 20:43:29.367405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 50778. [D 20:43:29.367415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 50779. [D 20:43:29.367424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 50780. [D 20:43:29.367455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 50781. [D 20:43:29.367465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 50782. [D 20:43:29.367476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 50783. [D 20:43:29.367498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 50784. [D 20:43:29.367508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 50785. [D 20:43:29.367518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 50786. [D 20:43:29.367529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 50787. [D 20:43:29.367539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 50788. [D 20:43:29.367549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 50789. [D 20:43:29.367559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 50790. [D 20:43:29.367575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 50791. [D 20:43:29.367600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 50792. [D 20:43:29.367612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 50793. [D 20:43:29.367622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 50794. [D 20:43:29.367634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 50795. [D 20:43:29.367649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 50796. [D 20:43:29.367659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 50797. [D 20:43:29.367681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 50798. [D 20:43:29.367692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 50799. [D 20:43:29.367701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 50800. [D 20:43:29.367712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 50801. [D 20:43:29.367735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 50802. [D 20:43:29.367746] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab21ac80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 50803. [D 20:43:29.367757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 50804. [D 20:43:29.367767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 50805. [D 20:43:29.367777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 50806. [D 20:43:29.367788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 50807. [D 20:43:29.367798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 50808. [D 20:43:29.367819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 50809. [E 20:43:29.367834] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 50810, block for 10 ms. [D 20:43:29.367859] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 50809. [D 20:43:29.367873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 50810. [E 20:43:29.367883] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 50811, block for 10 ms. [D 20:43:29.372789] openib_check_cq: completed rdma wr_id 2aaaab23c850, nic_wr_credit 50810. [D 20:43:29.372803] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 29/70. [D 20:43:29.372815] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 50809. [D 20:43:29.372825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 50810. [D 20:43:29.372840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 50811. [D 20:43:29.372852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 50812. [D 20:43:29.372861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 50813. [D 20:43:29.372872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 50814. [D 20:43:29.372883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 50815. [D 20:43:29.372893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 50816. [D 20:43:29.372907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 50817. [D 20:43:29.372917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 50818. [D 20:43:29.372927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 50819. [D 20:43:29.372937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 50820. [D 20:43:29.372960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 50821. [D 20:43:29.372974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 50822. [D 20:43:29.372984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 50823. [D 20:43:29.372994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 50824. [D 20:43:29.373004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 50825. [D 20:43:29.373015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 50826. [D 20:43:29.373025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 50827. [D 20:43:29.373044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 50828. [D 20:43:29.373064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 50829. [D 20:43:29.373074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 50830. [D 20:43:29.373084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 50831. [D 20:43:29.373098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 50832. [D 20:43:29.373107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 50833. [D 20:43:29.373117] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c6d0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 50834. [D 20:43:29.373193] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.373222] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.373232] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:29.378659] openib_check_cq: completed rdma wr_id 2aaaab21ac80, nic_wr_credit 50834. [D 20:43:29.378681] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 30/70. [D 20:43:29.379755] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.379769] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.379778] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:29.384516] openib_check_cq: completed rdma wr_id 2aaaab23c6d0, nic_wr_credit 50833. [D 20:43:29.384534] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 31/70. [D 20:43:29.387455] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.387469] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.387478] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:29.387492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.387502] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.387511] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:29.387532] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.387542] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.387550] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:29.387597] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7375 [D 20:43:29.387609] element 0: offset: 0x61e4e0, size: 24 [D 20:43:29.387625] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 32/70. [D 20:43:29.389649] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7375 [D 20:43:29.389707] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 33/70. [D 20:43:29.389758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 50833. [D 20:43:29.389779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 50834. [D 20:43:29.389791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 50835. [D 20:43:29.389802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 50836. [D 20:43:29.389811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 50837. [D 20:43:29.389821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 50838. [D 20:43:29.389831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 50839. [D 20:43:29.389842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 50840. [D 20:43:29.389852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 50841. [D 20:43:29.389871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 50842. [D 20:43:29.389881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 50843. [D 20:43:29.389891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 50844. [D 20:43:29.389901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 50845. [D 20:43:29.389921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 50846. [D 20:43:29.389930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 50847. [D 20:43:29.389940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 50848. [D 20:43:29.389951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 50849. [D 20:43:29.389961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 50850. [D 20:43:29.389971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 50851. [D 20:43:29.389982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 50852. [D 20:43:29.390015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 50853. [D 20:43:29.390025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 50854. [D 20:43:29.390035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 50855. [D 20:43:29.390051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 50856. [D 20:43:29.390070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 50857. [D 20:43:29.390080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 50858. [D 20:43:29.390097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 50859. [D 20:43:29.390107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 50860. [D 20:43:29.390117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 50861. [D 20:43:29.390132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 50862. [D 20:43:29.390142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 50863. [D 20:43:29.390170] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 50864. [D 20:43:29.395729] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50864. [D 20:43:29.395743] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 34/70. [D 20:43:29.396538] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.396551] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.396560] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:29.545362] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.545376] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.545387] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:29.545403] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7379 [D 20:43:29.545413] element 0: offset: 0x61f670, size: 24 [D 20:43:29.545423] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 35/70. [D 20:43:29.545439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.545450] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.545459] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:29.545472] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7382 [D 20:43:29.545483] element 0: offset: 0x691fe0, size: 24 [D 20:43:29.545492] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 36/70. [D 20:43:29.545512] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.545521] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.547705] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:29.547722] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7384 [D 20:43:29.547732] element 0: offset: 0x5b0030, size: 24 [D 20:43:29.547744] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 37/70. [D 20:43:29.552321] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7379 [D 20:43:29.552395] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 38/70. [D 20:43:29.552457] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7382 [D 20:43:29.552471] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 39/70. [D 20:43:29.553832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 50864. [D 20:43:29.553897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 50865. [D 20:43:29.553908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 50866. [D 20:43:29.553919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 50867. [D 20:43:29.553930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 50868. [D 20:43:29.553940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 50869. [D 20:43:29.553950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 50870. [D 20:43:29.554262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 50871. [D 20:43:29.554279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 50872. [D 20:43:29.554267] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7384 [D 20:43:29.554297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 50873. [D 20:43:29.554346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 50874. [D 20:43:29.554357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 50875. [D 20:43:29.554367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 50876. [D 20:43:29.554377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 50877. [D 20:43:29.554387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 50878. [D 20:43:29.554398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 50879. [D 20:43:29.554410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 50880. [D 20:43:29.554420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 50881. [D 20:43:29.554430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 50882. [D 20:43:29.554440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 50883. [D 20:43:29.554451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 50884. [D 20:43:29.554460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 50885. [D 20:43:29.554470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 50886. [D 20:43:29.554480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 50887. [D 20:43:29.554490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 50888. [D 20:43:29.554500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 50889. [D 20:43:29.554510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 50890. [D 20:43:29.554525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 50891. [D 20:43:29.554535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 50892. [D 20:43:29.554545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 50893. [D 20:43:29.554555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 50894. [D 20:43:29.554574] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 50895. [D 20:43:29.554600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 50896. [D 20:43:29.554611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 50897. [D 20:43:29.554621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 50898. [D 20:43:29.554631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 50899. [D 20:43:29.554641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 50900. [D 20:43:29.554651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 50901. [D 20:43:29.554661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 50902. [D 20:43:29.554671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 50903. [D 20:43:29.554702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 50904. [D 20:43:29.554713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 50905. [D 20:43:29.554728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 50906. [D 20:43:29.554738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 50907. [D 20:43:29.554747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 50908. [D 20:43:29.554762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 50909. [D 20:43:29.554772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 50910. [D 20:43:29.554782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 50911. [D 20:43:29.554797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 50912. [D 20:43:29.554807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 50913. [D 20:43:29.554817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 50914. [D 20:43:29.554827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 50915. [D 20:43:29.554845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 50916. [D 20:43:29.554854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 50917. [D 20:43:29.554864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 50918. [D 20:43:29.554875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 50919. [D 20:43:29.554885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 50920. [D 20:43:29.554895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 50921. [D 20:43:29.554904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 50922. [D 20:43:29.554931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 50923. [D 20:43:29.554942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 50924. [D 20:43:29.554952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 50925. [D 20:43:29.554962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 50926. [D 20:43:29.554972] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c850 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 50927. [D 20:43:29.555017] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 40/70. [D 20:43:29.555037] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.555053] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.555063] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:29.555109] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7387 [D 20:43:29.555124] element 0: offset: 0x63e8c0, size: 24 [D 20:43:29.555137] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 41/70. [D 20:43:29.560756] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50927. [D 20:43:29.560771] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 42/70. [D 20:43:29.572259] openib_check_cq: completed rdma wr_id 2aaaab23c850, nic_wr_credit 50926. [D 20:43:29.572273] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 43/70. [D 20:43:29.572298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 50926. [D 20:43:29.572310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 50927. [D 20:43:29.572320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 50928. [D 20:43:29.572330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 50929. [D 20:43:29.572344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 50930. [D 20:43:29.572354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 50931. [D 20:43:29.572364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 50932. [D 20:43:29.572379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 50933. [D 20:43:29.572389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 50934. [D 20:43:29.572398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 50935. [D 20:43:29.572414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 50936. [D 20:43:29.572424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 50937. [D 20:43:29.572434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 50938. [D 20:43:29.572449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 50939. [D 20:43:29.572494] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.572513] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.572538] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:29.572602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 50940. [D 20:43:29.572615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 50941. [D 20:43:29.572625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 50942. [D 20:43:29.572634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 50943. [D 20:43:29.572650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 50944. [D 20:43:29.572660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 50945. [D 20:43:29.572670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 50946. [D 20:43:29.572694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 50947. [D 20:43:29.572703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 50948. [D 20:43:29.572713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 50949. [D 20:43:29.572723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 50950. [D 20:43:29.572733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 50951. [D 20:43:29.572743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 50952. [D 20:43:29.572753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 50953. [D 20:43:29.572763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 50954. [D 20:43:29.572772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 50955. [D 20:43:29.572782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 50956. [D 20:43:29.572792] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab21ac80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 50957. [D 20:43:29.572820] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.572830] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.572838] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:29.574528] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7387 [D 20:43:29.574586] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 44/70. [D 20:43:29.584055] openib_check_cq: completed rdma wr_id 2aaaab21ac80, nic_wr_credit 50957. [D 20:43:29.584072] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 45/70. [D 20:43:29.584110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 50957. [D 20:43:29.584121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 50958. [D 20:43:29.584132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 50959. [D 20:43:29.584143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 50960. [D 20:43:29.584153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 50961. [D 20:43:29.584163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 50962. [D 20:43:29.584174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 50963. [D 20:43:29.584183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 50964. [D 20:43:29.584193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 50965. [D 20:43:29.584208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 50966. [D 20:43:29.584218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 50967. [D 20:43:29.584228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 50968. [D 20:43:29.584239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 50969. [D 20:43:29.584249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 50970. [D 20:43:29.584259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 50971. [D 20:43:29.584274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 50972. [D 20:43:29.584284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 50973. [D 20:43:29.584294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 50974. [D 20:43:29.584304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 50975. [D 20:43:29.584341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 50976. [D 20:43:29.584356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 50977. [D 20:43:29.584367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 50978. [D 20:43:29.584377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 50979. [D 20:43:29.584393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 50980. [D 20:43:29.584403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 50981. [D 20:43:29.584412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 50982. [D 20:43:29.584443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 50983. [D 20:43:29.584458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 50984. [D 20:43:29.584469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 50985. [D 20:43:29.584479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 50986. [D 20:43:29.584495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 50987. [D 20:43:29.584505] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 50988. [D 20:43:29.584532] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.584542] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.584554] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:29.595924] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 50988. [D 20:43:29.595939] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 46/70. [D 20:43:29.596555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.596568] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.596577] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:29.621360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.621374] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.621385] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:29.621400] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7392 [D 20:43:29.621410] element 0: offset: 0x64dc80, size: 24 [D 20:43:29.621421] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 47/70. [D 20:43:29.621435] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.621450] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.621459] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:29.621473] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7395 [D 20:43:29.621483] element 0: offset: 0x61e4e0, size: 24 [D 20:43:29.621492] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 48/70. [D 20:43:29.621510] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.621519] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.621528] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:29.621542] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7397 [D 20:43:29.621552] element 0: offset: 0x5b0030, size: 24 [D 20:43:29.621565] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 49/70. [D 20:43:29.621578] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.621588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.621597] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:29.621610] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7399 [D 20:43:29.621623] element 0: offset: 0x691fe0, size: 24 [D 20:43:29.621633] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 50/70. [D 20:43:29.623604] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7392 [D 20:43:29.623660] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 51/70. [D 20:43:29.623735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 50988. [D 20:43:29.623752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 50989. [D 20:43:29.623763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 50990. [D 20:43:29.623772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 50991. [D 20:43:29.623782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 50992. [D 20:43:29.623792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 50993. [D 20:43:29.623802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 50994. [D 20:43:29.623812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 50995. [D 20:43:29.623822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 50996. [D 20:43:29.623832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 50997. [D 20:43:29.623842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 50998. [D 20:43:29.623852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 50999. [D 20:43:29.623862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 51000. [D 20:43:29.623872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 51001. [D 20:43:29.623882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 51002. [D 20:43:29.623892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 51003. [D 20:43:29.623901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 51004. [D 20:43:29.623912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 51005. [D 20:43:29.623922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 51006. [D 20:43:29.623931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 51007. [D 20:43:29.623941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 51008. [D 20:43:29.623951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 51009. [D 20:43:29.623961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 51010. [D 20:43:29.623971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 51011. [D 20:43:29.623981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 51012. [D 20:43:29.623991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 51013. [D 20:43:29.624001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 51014. [D 20:43:29.624011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 51015. [D 20:43:29.624021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 51016. [D 20:43:29.624032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 51017. [D 20:43:29.624042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 51018. [D 20:43:29.624052] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 51019. [D 20:43:29.628905] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7395 [D 20:43:29.628953] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 52/70. [D 20:43:29.628973] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7397 [D 20:43:29.628983] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 53/70. [D 20:43:29.628993] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7399 [D 20:43:29.629003] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 54/70. [D 20:43:29.633368] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 51019. [D 20:43:29.633413] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 55/70. [D 20:43:29.633430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 51019. [D 20:43:29.633447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 51020. [D 20:43:29.633458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 51021. [D 20:43:29.633468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 51022. [D 20:43:29.633483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 51023. [D 20:43:29.633492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 51024. [D 20:43:29.633502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 51025. [D 20:43:29.633518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 51026. [D 20:43:29.633527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 51027. [D 20:43:29.633537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 51028. [D 20:43:29.633553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 51029. [D 20:43:29.633581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 51030. [D 20:43:29.633591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 51031. [D 20:43:29.633601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 51032. [D 20:43:29.633611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 51033. [D 20:43:29.633634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 51034. [D 20:43:29.633644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 51035. [D 20:43:29.633658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 51036. [D 20:43:29.633668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 51037. [D 20:43:29.633678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 51038. [D 20:43:29.633721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 51039. [D 20:43:29.633731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 51040. [D 20:43:29.633740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 51041. [D 20:43:29.633755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 51042. [D 20:43:29.633778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 51043. [D 20:43:29.633788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 51044. [D 20:43:29.633802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 51045. [D 20:43:29.633812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 51046. [D 20:43:29.633821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 51047. [D 20:43:29.633837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 51048. [D 20:43:29.633847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 51049. [D 20:43:29.633857] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c850 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 51050. [D 20:43:29.633883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 51051. [D 20:43:29.633893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 51052. [D 20:43:29.633903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 51053. [D 20:43:29.633936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 51054. [D 20:43:29.633946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 51055. [D 20:43:29.633956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 51056. [D 20:43:29.633966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 51057. [D 20:43:29.633976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 51058. [D 20:43:29.633999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 51059. [D 20:43:29.634015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 51060. [D 20:43:29.634025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 51061. [D 20:43:29.634035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 51062. [D 20:43:29.634050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 51063. [D 20:43:29.634060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 51064. [D 20:43:29.634070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 51065. [D 20:43:29.634097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 51066. [D 20:43:29.634107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 51067. [D 20:43:29.634121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 51068. [D 20:43:29.634131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 51069. [D 20:43:29.634141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 51070. [D 20:43:29.634164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 51071. [D 20:43:29.634174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 51072. [D 20:43:29.634185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 51073. [D 20:43:29.634195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 51074. [D 20:43:29.634205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 51075. [D 20:43:29.634229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 51076. [D 20:43:29.634239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 51077. [D 20:43:29.634249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 51078. [D 20:43:29.634265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 51079. [D 20:43:29.634275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 51080. [D 20:43:29.634285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 51081. [D 20:43:29.634309] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab21ac80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 51082. [D 20:43:29.634321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 51083. [D 20:43:29.634335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 51084. [D 20:43:29.634345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 51085. [D 20:43:29.634355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 51086. [D 20:43:29.634383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 51087. [D 20:43:29.634398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 51088. [E 20:43:29.634412] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 51089, block for 10 ms. [D 20:43:29.634448] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 51088. [D 20:43:29.634460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 51089. [E 20:43:29.634471] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 51090, block for 10 ms. [D 20:43:29.643057] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 51089. [E 20:43:29.643072] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 51090, block for 10 ms. [D 20:43:29.645121] openib_check_cq: completed rdma wr_id 2aaaab23c850, nic_wr_credit 51089. [D 20:43:29.645134] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 56/70. [D 20:43:29.645145] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 51088. [D 20:43:29.645155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 51089. [D 20:43:29.645165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 51090. [D 20:43:29.645180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 51091. [D 20:43:29.645190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 51092. [D 20:43:29.645200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 51093. [D 20:43:29.645216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 51094. [D 20:43:29.645226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 51095. [D 20:43:29.645236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 51096. [D 20:43:29.645250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 51097. [D 20:43:29.645261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 51098. [D 20:43:29.645271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 51099. [D 20:43:29.645286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 51100. [D 20:43:29.645313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 51101. [D 20:43:29.645324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 51102. [D 20:43:29.645333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 51103. [D 20:43:29.645361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 51104. [D 20:43:29.645372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 51105. [D 20:43:29.645386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 51106. [D 20:43:29.645396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 51107. [D 20:43:29.645411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 51108. [D 20:43:29.645433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 51109. [D 20:43:29.645443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 51110. [D 20:43:29.645453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 51111. [D 20:43:29.645463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 51112. [D 20:43:29.645473] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c6d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 51113. [D 20:43:29.645531] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.645543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.645567] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:29.647859] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.647873] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.647882] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:29.647914] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7401 [D 20:43:29.647925] element 0: offset: 0x61f670, size: 24 [D 20:43:29.647936] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 57/70. [D 20:43:29.656777] openib_check_cq: completed rdma wr_id 2aaaab21ac80, nic_wr_credit 51113. [D 20:43:29.656791] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 58/70. [D 20:43:29.661345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.661359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.661370] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:29.668475] openib_check_cq: completed rdma wr_id 2aaaab23c6d0, nic_wr_credit 51112. [D 20:43:29.668488] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 59/70. [D 20:43:29.668565] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.668578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.668588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:29.671106] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7401 [D 20:43:29.671164] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 60/70. [D 20:43:29.671166] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.671191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.671200] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:29.671215] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.671225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.671239] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:29.671254] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7405 [D 20:43:29.671264] element 0: offset: 0x620cc0, size: 24 [D 20:43:29.671274] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 0/70. [D 20:43:29.675437] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7405 [D 20:43:29.675455] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 1/70. [D 20:43:29.675870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 51112. [D 20:43:29.675930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 51113. [D 20:43:29.675942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 51114. [D 20:43:29.675953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 51115. [D 20:43:29.675967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 51116. [D 20:43:29.675978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 51117. [D 20:43:29.675987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 51118. [D 20:43:29.676002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 51119. [D 20:43:29.676012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 51120. [D 20:43:29.676022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 51121. [D 20:43:29.676069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 51122. [D 20:43:29.676083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 51123. [D 20:43:29.676092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 51124. [D 20:43:29.676116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 51125. [D 20:43:29.676126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 51126. [D 20:43:29.676136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 51127. [D 20:43:29.676147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 51128. [D 20:43:29.676156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 51129. [D 20:43:29.676167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 51130. [D 20:43:29.676192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 51131. [D 20:43:29.676203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 51132. [D 20:43:29.676212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 51133. [D 20:43:29.676223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 51134. [D 20:43:29.676238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 51135. [D 20:43:29.676263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 51136. [D 20:43:29.676276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 51137. [D 20:43:29.676287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 51138. [D 20:43:29.676297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 51139. [D 20:43:29.676310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 51140. [D 20:43:29.676320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 51141. [D 20:43:29.676330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 51142. [D 20:43:29.676345] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2092d0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 51143. [D 20:43:29.676373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 51144. [D 20:43:29.676384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 51145. [D 20:43:29.676394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 51146. [D 20:43:29.676404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 51147. [D 20:43:29.676428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 51148. [D 20:43:29.676438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 51149. [D 20:43:29.676454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 51150. [D 20:43:29.676464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 51151. [D 20:43:29.676474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 51152. [D 20:43:29.676500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 51153. [D 20:43:29.676509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 51154. [D 20:43:29.676520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 51155. [D 20:43:29.676536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 51156. [D 20:43:29.676546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 51157. [D 20:43:29.676556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 51158. [D 20:43:29.676592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 51159. [D 20:43:29.676603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 51160. [D 20:43:29.676612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 51161. [D 20:43:29.676623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 51162. [D 20:43:29.676633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 51163. [D 20:43:29.676655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 51164. [D 20:43:29.676669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 51165. [D 20:43:29.676679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 51166. [D 20:43:29.676689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 51167. [D 20:43:29.676704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 51168. [D 20:43:29.676713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 51169. [D 20:43:29.676723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 51170. [D 20:43:29.676753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 51171. [D 20:43:29.676764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 51172. [D 20:43:29.676775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 51173. [D 20:43:29.676785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 51174. [D 20:43:29.676801] openib_post_sr_rdmaw: ibv_post_send wr_id 6625e0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 51175. [D 20:43:29.679191] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.679206] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.679217] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:29.679250] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7408 [D 20:43:29.679261] element 0: offset: 0x625390, size: 24 [D 20:43:29.679277] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 2/70. [D 20:43:29.681880] openib_check_cq: completed rdma wr_id 2aaaab2092d0, nic_wr_credit 51175. [D 20:43:29.681896] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 3/70. [D 20:43:29.687717] openib_check_cq: completed rdma wr_id 6625e0, nic_wr_credit 51174. [D 20:43:29.687731] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 4/70. [D 20:43:29.690005] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.690018] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.690028] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:29.690079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.690090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.690098] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:29.692489] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7408 [D 20:43:29.692540] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 5/70. [D 20:43:29.692591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 51174. [D 20:43:29.692606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 51175. [D 20:43:29.692616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 51176. [D 20:43:29.692627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 51177. [D 20:43:29.692641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 51178. [D 20:43:29.692650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 51179. [D 20:43:29.692660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 51180. [D 20:43:29.692675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 51181. [D 20:43:29.692694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 51182. [D 20:43:29.692704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 51183. [D 20:43:29.692714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 51184. [D 20:43:29.692724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 51185. [D 20:43:29.692734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 51186. [D 20:43:29.692744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 51187. [D 20:43:29.692772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 51188. [D 20:43:29.692782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 51189. [D 20:43:29.692792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 51190. [D 20:43:29.692808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 51191. [D 20:43:29.692818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 51192. [D 20:43:29.692828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 51193. [D 20:43:29.692852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 51194. [D 20:43:29.692862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 51195. [D 20:43:29.692873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 51196. [D 20:43:29.692883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 51197. [D 20:43:29.692893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 51198. [D 20:43:29.692903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 51199. [D 20:43:29.692928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 51200. [D 20:43:29.692941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 51201. [D 20:43:29.692956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 51202. [D 20:43:29.692966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 51203. [D 20:43:29.692988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 51204. [D 20:43:29.692998] openib_post_sr_rdmaw: ibv_post_send wr_id 6625e0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 51205. [D 20:43:29.698510] openib_check_cq: completed rdma wr_id 6625e0, nic_wr_credit 51205. [D 20:43:29.698524] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 6/70. [D 20:43:29.700568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.700581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.700590] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:29.964446] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.964461] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.964472] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:29.964488] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7411 [D 20:43:29.964498] element 0: offset: 0x691fe0, size: 24 [D 20:43:29.964509] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 7/70. [D 20:43:29.966487] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7411 [D 20:43:29.966506] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 8/70. [D 20:43:29.966666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 51205. [D 20:43:29.966731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 51206. [D 20:43:29.966743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 51207. [D 20:43:29.966754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 51208. [D 20:43:29.966768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 51209. [D 20:43:29.966778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 51210. [D 20:43:29.966788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 51211. [D 20:43:29.966801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 51212. [D 20:43:29.966811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 51213. [D 20:43:29.966821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 51214. [D 20:43:29.966848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 51215. [D 20:43:29.966858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 51216. [D 20:43:29.966882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 51217. [D 20:43:29.966898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 51218. [D 20:43:29.966920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 51219. [D 20:43:29.966934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 51220. [D 20:43:29.966957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 51221. [D 20:43:29.966979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 51222. [D 20:43:29.966993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 51223. [D 20:43:29.967014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 51224. [D 20:43:29.967024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 51225. [D 20:43:29.967049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 51226. [D 20:43:29.967060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 51227. [D 20:43:29.967087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 51228. [D 20:43:29.967098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 51229. [D 20:43:29.967120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 51230. [D 20:43:29.967130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 51231. [D 20:43:29.967152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 51232. [D 20:43:29.967162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 51233. [D 20:43:29.967187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 51234. [D 20:43:29.967197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 51235. [D 20:43:29.967220] openib_post_sr_rdmaw: ibv_post_send wr_id 620c50 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 51236. [D 20:43:29.978490] openib_check_cq: completed rdma wr_id 620c50, nic_wr_credit 51236. [D 20:43:29.978507] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 9/70. [D 20:43:29.980844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:29.980859] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.980870] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:29.996023] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.996037] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.996048] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:29.996079] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7414 [D 20:43:29.996090] element 0: offset: 0x5b0030, size: 24 [D 20:43:29.996101] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 10/70. [D 20:43:29.996120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:29.996137] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:29.996146] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:29.996160] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7417 [D 20:43:29.996170] element 0: offset: 0x64dc80, size: 24 [D 20:43:29.996180] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 11/70. [D 20:43:30.001596] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7417 [D 20:43:30.001649] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 12/70. [D 20:43:30.001688] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7414 [D 20:43:30.001724] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 13/70. [D 20:43:30.005795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 51236. [D 20:43:30.005857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 51237. [D 20:43:30.005869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 51238. [D 20:43:30.005879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 51239. [D 20:43:30.005890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 51240. [D 20:43:30.005900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 51241. [D 20:43:30.005910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 51242. [D 20:43:30.005920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 51243. [D 20:43:30.005936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 51244. [D 20:43:30.005945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 51245. [D 20:43:30.005955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 51246. [D 20:43:30.005965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 51247. [D 20:43:30.005984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 51248. [D 20:43:30.005994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 51249. [D 20:43:30.006004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 51250. [D 20:43:30.006014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 51251. [D 20:43:30.006024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 51252. [D 20:43:30.006034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 51253. [D 20:43:30.006044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 51254. [D 20:43:30.006074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 51255. [D 20:43:30.006085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 51256. [D 20:43:30.006098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 51257. [D 20:43:30.006108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 51258. [D 20:43:30.006144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 51259. [D 20:43:30.006155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 51260. [D 20:43:30.006166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 51261. [D 20:43:30.006176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 51262. [D 20:43:30.006187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 51263. [D 20:43:30.006212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 51264. [D 20:43:30.006222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 51265. [D 20:43:30.006233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 51266. [D 20:43:30.006243] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 51267. [D 20:43:30.006257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 51268. [D 20:43:30.006267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 51269. [D 20:43:30.006277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 51270. [D 20:43:30.006288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 51271. [D 20:43:30.006312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 51272. [D 20:43:30.006323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 51273. [D 20:43:30.006339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 51274. [D 20:43:30.006349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 51275. [D 20:43:30.006359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 51276. [D 20:43:30.006375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 51277. [D 20:43:30.006385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 51278. [D 20:43:30.006395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 51279. [D 20:43:30.006438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 51280. [D 20:43:30.006448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 51281. [D 20:43:30.006471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 51282. [D 20:43:30.006486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 51283. [D 20:43:30.006496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 51284. [D 20:43:30.006506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 51285. [D 20:43:30.006523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 51286. [D 20:43:30.006533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 51287. [D 20:43:30.006556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 51288. [D 20:43:30.006566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 51289. [D 20:43:30.006577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 51290. [D 20:43:30.006591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 51291. [D 20:43:30.006601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 51292. [D 20:43:30.006611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 51293. [D 20:43:30.006639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 51294. [D 20:43:30.006650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 51295. [D 20:43:30.006662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 51296. [D 20:43:30.006672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 51297. [D 20:43:30.006687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 51298. [D 20:43:30.006711] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 51299. [D 20:43:30.008594] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.008610] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.008620] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.008654] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7421 [D 20:43:30.008666] element 0: offset: 0x61e400, size: 24 [D 20:43:30.008680] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 14/70. [D 20:43:30.008703] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.008713] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.009291] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:30.009307] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7423 [D 20:43:30.009317] element 0: offset: 0x691fe0, size: 24 [D 20:43:30.009330] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 15/70. [D 20:43:30.017498] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 51299. [D 20:43:30.017514] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 16/70. [D 20:43:30.029157] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 51298. [D 20:43:30.029173] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 17/70. [D 20:43:30.031480] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.031493] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.031503] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:30.031573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.031587] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.031595] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.034316] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7423 [D 20:43:30.034376] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 18/70. [D 20:43:30.036615] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7421 [D 20:43:30.036632] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 19/70. [D 20:43:30.040269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 51298. [D 20:43:30.040287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 51299. [D 20:43:30.040298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 51300. [D 20:43:30.040309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 51301. [D 20:43:30.040326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 51302. [D 20:43:30.040337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 51303. [D 20:43:30.040347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 51304. [D 20:43:30.040358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 51305. [D 20:43:30.040368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 51306. [D 20:43:30.040378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 51307. [D 20:43:30.040388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 51308. [D 20:43:30.040405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 51309. [D 20:43:30.040416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 51310. [D 20:43:30.040445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 51311. [D 20:43:30.040455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 51312. [D 20:43:30.040470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 51313. [D 20:43:30.040495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 51314. [D 20:43:30.040506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 51315. [D 20:43:30.040523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 51316. [D 20:43:30.040533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 51317. [D 20:43:30.040555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 51318. [D 20:43:30.040566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 51319. [D 20:43:30.040576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 51320. [D 20:43:30.040595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 51321. [D 20:43:30.040605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 51322. [D 20:43:30.040615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 51323. [D 20:43:30.040640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 51324. [D 20:43:30.040651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 51325. [D 20:43:30.040662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 51326. [D 20:43:30.040672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 51327. [D 20:43:30.040682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 51328. [D 20:43:30.040693] openib_post_sr_rdmaw: ibv_post_send wr_id 662180 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 51329. [D 20:43:30.040718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 51330. [D 20:43:30.040728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 51331. [D 20:43:30.040742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 51332. [D 20:43:30.040753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 51333. [D 20:43:30.040763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 51334. [D 20:43:30.040778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 51335. [D 20:43:30.040788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 51336. [D 20:43:30.040798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 51337. [D 20:43:30.040813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 51338. [D 20:43:30.040823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 51339. [D 20:43:30.040834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 51340. [D 20:43:30.040844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 51341. [D 20:43:30.040854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 51342. [D 20:43:30.040869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 51343. [D 20:43:30.040882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 51344. [D 20:43:30.040906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 51345. [D 20:43:30.040920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 51346. [D 20:43:30.040937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 51347. [D 20:43:30.040947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 51348. [D 20:43:30.040957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 51349. [D 20:43:30.040967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 51350. [D 20:43:30.040978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 51351. [D 20:43:30.040988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 51352. [D 20:43:30.041012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 51353. [D 20:43:30.041023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 51354. [D 20:43:30.041033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 51355. [D 20:43:30.041047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 51356. [D 20:43:30.041057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 51357. [D 20:43:30.041067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 51358. [D 20:43:30.041099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 51359. [D 20:43:30.041110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 51360. [D 20:43:30.041120] openib_post_sr_rdmaw: ibv_post_send wr_id 61e370 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 51361. [D 20:43:30.043506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.043521] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.043531] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.043565] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7425 [D 20:43:30.043576] element 0: offset: 0x61e4e0, size: 24 [D 20:43:30.043588] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 20/70. [D 20:43:30.051899] openib_check_cq: completed rdma wr_id 662180, nic_wr_credit 51361. [D 20:43:30.051914] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 21/70. [D 20:43:30.063561] openib_check_cq: completed rdma wr_id 61e370, nic_wr_credit 51360. [D 20:43:30.063575] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 22/70. [D 20:43:30.064614] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.064628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.064637] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.064696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.064709] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.064719] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:30.067991] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7425 [D 20:43:30.068054] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 23/70. [D 20:43:30.070227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 51360. [D 20:43:30.070245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 51361. [D 20:43:30.070257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 51362. [D 20:43:30.070267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 51363. [D 20:43:30.070278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 51364. [D 20:43:30.070292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 51365. [D 20:43:30.070302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 51366. [D 20:43:30.070312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 51367. [D 20:43:30.070327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 51368. [D 20:43:30.070337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 51369. [D 20:43:30.070347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 51370. [D 20:43:30.070362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 51371. [D 20:43:30.070372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 51372. [D 20:43:30.070382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 51373. [D 20:43:30.070397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 51374. [D 20:43:30.070407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 51375. [D 20:43:30.070418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 51376. [D 20:43:30.070445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 51377. [D 20:43:30.070456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 51378. [D 20:43:30.070481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 51379. [D 20:43:30.070492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 51380. [D 20:43:30.070502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 51381. [D 20:43:30.070513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 51382. [D 20:43:30.070528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 51383. [D 20:43:30.070539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 51384. [D 20:43:30.070548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 51385. [D 20:43:30.070558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 51386. [D 20:43:30.070576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 51387. [D 20:43:30.070586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 51388. [D 20:43:30.070596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 51389. [D 20:43:30.070607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 51390. [D 20:43:30.070633] openib_post_sr_rdmaw: ibv_post_send wr_id 620c50 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 51391. [D 20:43:30.078856] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.078871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.078882] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:30.078916] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7430 [D 20:43:30.078927] element 0: offset: 0x64dc80, size: 24 [D 20:43:30.078940] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 24/70. [D 20:43:30.078960] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.078971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.078980] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.078995] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7432 [D 20:43:30.079004] element 0: offset: 0x5b0030, size: 24 [D 20:43:30.079033] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 25/70. [D 20:43:30.081975] openib_check_cq: completed rdma wr_id 620c50, nic_wr_credit 51391. [D 20:43:30.081990] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 26/70. [D 20:43:30.084346] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.084360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.084368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.086974] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7432 [D 20:43:30.087027] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 27/70. [D 20:43:30.087397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 51391. [D 20:43:30.087424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 51392. [D 20:43:30.087436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 51393. [D 20:43:30.087446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 51394. [D 20:43:30.087464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 51395. [D 20:43:30.087476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 51396. [D 20:43:30.087486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 51397. [D 20:43:30.087497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 51398. [D 20:43:30.087507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 51399. [D 20:43:30.087517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 51400. [D 20:43:30.087527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 51401. [D 20:43:30.087543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 51402. [D 20:43:30.087591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 51403. [D 20:43:30.087602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 51404. [D 20:43:30.087626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 51405. [D 20:43:30.087640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 51406. [D 20:43:30.087650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 51407. [D 20:43:30.087667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 51408. [D 20:43:30.087692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 51409. [D 20:43:30.087702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 51410. [D 20:43:30.087717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 51411. [D 20:43:30.087727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 51412. [D 20:43:30.087737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 51413. [D 20:43:30.087766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 51414. [D 20:43:30.087776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 51415. [D 20:43:30.087789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 51416. [D 20:43:30.087799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 51417. [D 20:43:30.087815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 51418. [D 20:43:30.087842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 51419. [D 20:43:30.087854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 51420. [D 20:43:30.087865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 51421. [D 20:43:30.087880] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7430 [D 20:43:30.087917] openib_post_sr_rdmaw: ibv_post_send wr_id 662180 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 51422. [D 20:43:30.087936] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 28/70. [D 20:43:30.088603] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.088619] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.088629] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.088663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7434 [D 20:43:30.088674] element 0: offset: 0x66e7a0, size: 24 [D 20:43:30.088686] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 29/70. [D 20:43:30.099115] openib_check_cq: completed rdma wr_id 662180, nic_wr_credit 51422. [D 20:43:30.099131] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 30/70. [D 20:43:30.099144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 51422. [D 20:43:30.099154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 51423. [D 20:43:30.099165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 51424. [D 20:43:30.099176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 51425. [D 20:43:30.099186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 51426. [D 20:43:30.099197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 51427. [D 20:43:30.099208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 51428. [D 20:43:30.099218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 51429. [D 20:43:30.099234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 51430. [D 20:43:30.099244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 51431. [D 20:43:30.099254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 51432. [D 20:43:30.099265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 51433. [D 20:43:30.099275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 51434. [D 20:43:30.099285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 51435. [D 20:43:30.099312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 51436. [D 20:43:30.099327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 51437. [D 20:43:30.099337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 51438. [D 20:43:30.099358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 51439. [D 20:43:30.099369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 51440. [D 20:43:30.099379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 51441. [D 20:43:30.099394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 51442. [D 20:43:30.099404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 51443. [D 20:43:30.099414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 51444. [D 20:43:30.099442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 51445. [D 20:43:30.099455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 51446. [D 20:43:30.099468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 51447. [D 20:43:30.099479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 51448. [D 20:43:30.099505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 51449. [D 20:43:30.099516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 51450. [D 20:43:30.099526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 51451. [D 20:43:30.099537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 51452. [D 20:43:30.099548] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 51453. [D 20:43:30.099598] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.099609] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.099618] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.103923] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7434 [D 20:43:30.103989] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 31/70. [D 20:43:30.110745] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 51453. [D 20:43:30.110763] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 32/70. [D 20:43:30.110784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 51453. [D 20:43:30.110796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 51454. [D 20:43:30.110811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 51455. [D 20:43:30.110821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 51456. [D 20:43:30.110831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 51457. [D 20:43:30.110846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 51458. [D 20:43:30.110856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 51459. [D 20:43:30.110866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 51460. [D 20:43:30.110881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 51461. [D 20:43:30.110891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 51462. [D 20:43:30.110901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 51463. [D 20:43:30.110916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 51464. [D 20:43:30.110926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 51465. [D 20:43:30.110961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 51466. [D 20:43:30.110972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 51467. [D 20:43:30.110996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 51468. [D 20:43:30.111007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 51469. [D 20:43:30.111018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 51470. [D 20:43:30.111028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 51471. [D 20:43:30.111058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 51472. [D 20:43:30.111070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 51473. [D 20:43:30.111081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 51474. [D 20:43:30.111091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 51475. [D 20:43:30.111102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 51476. [D 20:43:30.111113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 51477. [D 20:43:30.111123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 51478. [D 20:43:30.111146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 51479. [D 20:43:30.111157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 51480. [D 20:43:30.111167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 51481. [D 20:43:30.111181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 51482. [D 20:43:30.111191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 51483. [D 20:43:30.111216] openib_post_sr_rdmaw: ibv_post_send wr_id 662180 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 51484. [D 20:43:30.113548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.113564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.113575] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:30.121273] openib_check_cq: completed rdma wr_id 662180, nic_wr_credit 51484. [D 20:43:30.121287] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 33/70. [D 20:43:30.123548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.123561] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.123571] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:30.173469] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.173483] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.173494] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:30.173524] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7438 [D 20:43:30.173535] element 0: offset: 0x61f670, size: 24 [D 20:43:30.173546] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 34/70. [D 20:43:30.175974] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7438 [D 20:43:30.175992] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 35/70. [D 20:43:30.176042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 51484. [D 20:43:30.176053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 51485. [D 20:43:30.176064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 51486. [D 20:43:30.176074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 51487. [D 20:43:30.176085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 51488. [D 20:43:30.176095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 51489. [D 20:43:30.176105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 51490. [D 20:43:30.176115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 51491. [D 20:43:30.176125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 51492. [D 20:43:30.176135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 51493. [D 20:43:30.176145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 51494. [D 20:43:30.176168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 51495. [D 20:43:30.176179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 51496. [D 20:43:30.176189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 51497. [D 20:43:30.176199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 51498. [D 20:43:30.176221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 51499. [D 20:43:30.176232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 51500. [D 20:43:30.176248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 51501. [D 20:43:30.176266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 51502. [D 20:43:30.176276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 51503. [D 20:43:30.176293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 51504. [D 20:43:30.176314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 51505. [D 20:43:30.176325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 51506. [D 20:43:30.176335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 51507. [D 20:43:30.176363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 51508. [D 20:43:30.176373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 51509. [D 20:43:30.176393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 51510. [D 20:43:30.176404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 51511. [D 20:43:30.176415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 51512. [D 20:43:30.176436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 51513. [D 20:43:30.176451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 51514. [D 20:43:30.176462] openib_post_sr_rdmaw: ibv_post_send wr_id 662180 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 51515. [D 20:43:30.181918] openib_check_cq: completed rdma wr_id 662180, nic_wr_credit 51515. [D 20:43:30.181932] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 36/70. [D 20:43:30.184231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.184244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.184254] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:30.260289] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.260303] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.260314] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:30.260329] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7441 [D 20:43:30.260339] element 0: offset: 0x625390, size: 24 [D 20:43:30.260349] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 37/70. [D 20:43:30.262339] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7441 [D 20:43:30.262391] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 38/70. [D 20:43:30.262396] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.262454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.262464] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:30.262500] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7444 [D 20:43:30.262511] element 0: offset: 0x5b0030, size: 24 [D 20:43:30.262528] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 39/70. [D 20:43:30.262586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 51515. [D 20:43:30.262616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 51516. [D 20:43:30.262628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 51517. [D 20:43:30.262638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 51518. [D 20:43:30.262659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 51519. [D 20:43:30.262670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 51520. [D 20:43:30.262680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 51521. [D 20:43:30.262698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 51522. [D 20:43:30.262709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 51523. [D 20:43:30.262719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 51524. [D 20:43:30.262729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 51525. [D 20:43:30.262739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 51526. [D 20:43:30.262758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 51527. [D 20:43:30.262782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 51528. [D 20:43:30.262792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 51529. [D 20:43:30.262803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 51530. [D 20:43:30.262813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 51531. [D 20:43:30.262834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 51532. [D 20:43:30.262845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 51533. [D 20:43:30.262855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 51534. [D 20:43:30.262869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 51535. [D 20:43:30.262879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 51536. [D 20:43:30.262889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 51537. [D 20:43:30.262913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 51538. [D 20:43:30.262923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 51539. [D 20:43:30.262938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 51540. [D 20:43:30.262948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 51541. [D 20:43:30.262958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 51542. [D 20:43:30.262971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 51543. [D 20:43:30.262988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 51544. [D 20:43:30.263013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 51545. [D 20:43:30.263024] openib_post_sr_rdmaw: ibv_post_send wr_id 662180 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 51546. [D 20:43:30.265517] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7444 [D 20:43:30.265572] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 40/70. [D 20:43:30.268482] openib_check_cq: completed rdma wr_id 662180, nic_wr_credit 51546. [D 20:43:30.268501] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 41/70. [D 20:43:30.268513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 51546. [D 20:43:30.268524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 51547. [D 20:43:30.268535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 51548. [D 20:43:30.268546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 51549. [D 20:43:30.268556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 51550. [D 20:43:30.268567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 51551. [D 20:43:30.268577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 51552. [D 20:43:30.268588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 51553. [D 20:43:30.268598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 51554. [D 20:43:30.268632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 51555. [D 20:43:30.268642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 51556. [D 20:43:30.268669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 51557. [D 20:43:30.268680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 51558. [D 20:43:30.268690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 51559. [D 20:43:30.268701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 51560. [D 20:43:30.268711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 51561. [D 20:43:30.268721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 51562. [D 20:43:30.268754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 51563. [D 20:43:30.268764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 51564. [D 20:43:30.268775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 51565. [D 20:43:30.268785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 51566. [D 20:43:30.268796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 51567. [D 20:43:30.268816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 51568. [D 20:43:30.268827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 51569. [D 20:43:30.268837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 51570. [D 20:43:30.268854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 51571. [D 20:43:30.268864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 51572. [D 20:43:30.268874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 51573. [D 20:43:30.268901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 51574. [D 20:43:30.268911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 51575. [D 20:43:30.268926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 51576. [D 20:43:30.268936] openib_post_sr_rdmaw: ibv_post_send wr_id 6432c0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 51577. [D 20:43:30.271271] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.271285] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.271295] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:30.274380] openib_check_cq: completed rdma wr_id 6432c0, nic_wr_credit 51577. [D 20:43:30.274394] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 42/70. [D 20:43:30.276601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.276616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.276625] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:30.440231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.440247] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.440258] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:30.440275] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7447 [D 20:43:30.440285] element 0: offset: 0x66e7a0, size: 24 [D 20:43:30.440295] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 43/70. [D 20:43:30.442377] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7447 [D 20:43:30.442396] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 44/70. [D 20:43:30.442555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 51577. [D 20:43:30.442620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 51578. [D 20:43:30.442632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 51579. [D 20:43:30.442643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 51580. [D 20:43:30.442658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 51581. [D 20:43:30.442668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 51582. [D 20:43:30.442680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 51583. [D 20:43:30.442695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 51584. [D 20:43:30.442706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 51585. [D 20:43:30.442715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 51586. [D 20:43:30.442731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 51587. [D 20:43:30.442741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 51588. [D 20:43:30.442767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 51589. [D 20:43:30.442777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 51590. [D 20:43:30.442805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 51591. [D 20:43:30.442823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 51592. [D 20:43:30.442834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 51593. [D 20:43:30.442845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 51594. [D 20:43:30.442872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 51595. [D 20:43:30.442899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 51596. [D 20:43:30.442909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 51597. [D 20:43:30.442931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 51598. [D 20:43:30.442946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 51599. [D 20:43:30.442958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 51600. [D 20:43:30.442968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 51601. [D 20:43:30.442979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 51602. [D 20:43:30.442990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 51603. [D 20:43:30.443000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 51604. [D 20:43:30.443011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 51605. [D 20:43:30.443037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 51606. [D 20:43:30.443052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 51607. [D 20:43:30.443063] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 51608. [D 20:43:30.449298] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 51608. [D 20:43:30.449317] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 45/70. [D 20:43:30.451578] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.451593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.451603] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:30.463958] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.463973] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.463984] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:30.464016] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7451 [D 20:43:30.464027] element 0: offset: 0x61f670, size: 24 [D 20:43:30.464039] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 46/70. [D 20:43:30.464058] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.464072] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.464081] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:30.464095] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7453 [D 20:43:30.464104] element 0: offset: 0x691fe0, size: 24 [D 20:43:30.464114] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 47/70. [D 20:43:30.469226] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7453 [D 20:43:30.469280] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 48/70. [D 20:43:30.469301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.469339] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7451 [D 20:43:30.469363] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.469370] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 49/70. [D 20:43:30.469377] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.469417] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7456 [D 20:43:30.469431] element 0: offset: 0x64dc80, size: 24 [D 20:43:30.469444] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 50/70. [D 20:43:30.469475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 51608. [D 20:43:30.469488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 51609. [D 20:43:30.469503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 51610. [D 20:43:30.469513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 51611. [D 20:43:30.469523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 51612. [D 20:43:30.469533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 51613. [D 20:43:30.469544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 51614. [D 20:43:30.469555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 51615. [D 20:43:30.469565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 51616. [D 20:43:30.469575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 51617. [D 20:43:30.469586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 51618. [D 20:43:30.469597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 51619. [D 20:43:30.469646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 51620. [D 20:43:30.469666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 51621. [D 20:43:30.469676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 51622. [D 20:43:30.469703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 51623. [D 20:43:30.469714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 51624. [D 20:43:30.469724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 51625. [D 20:43:30.469752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 51626. [D 20:43:30.469764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 51627. [D 20:43:30.469775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 51628. [D 20:43:30.469785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 51629. [D 20:43:30.469802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 51630. [D 20:43:30.469812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 51631. [D 20:43:30.469822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 51632. [D 20:43:30.469837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 51633. [D 20:43:30.469863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 51634. [D 20:43:30.469874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 51635. [D 20:43:30.469884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 51636. [D 20:43:30.469899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 51637. [D 20:43:30.469911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 51638. [D 20:43:30.469931] openib_post_sr_rdmaw: ibv_post_send wr_id 662180 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 51639. [D 20:43:30.469944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 51640. [D 20:43:30.469954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 51641. [D 20:43:30.469964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 51642. [D 20:43:30.469974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 51643. [D 20:43:30.469991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 51644. [D 20:43:30.470001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 51645. [D 20:43:30.470026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 51646. [D 20:43:30.470038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 51647. [D 20:43:30.470047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 51648. [D 20:43:30.470058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 51649. [D 20:43:30.470068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 51650. [D 20:43:30.470078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 51651. [D 20:43:30.470088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 51652. [D 20:43:30.470123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 51653. [D 20:43:30.470134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 51654. [D 20:43:30.470144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 51655. [D 20:43:30.470154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 51656. [D 20:43:30.470170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 51657. [D 20:43:30.470180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 51658. [D 20:43:30.470190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 51659. [D 20:43:30.470205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 51660. [D 20:43:30.470215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 51661. [D 20:43:30.470226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 51662. [D 20:43:30.470235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 51663. [D 20:43:30.470259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 51664. [D 20:43:30.470269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 51665. [D 20:43:30.470279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 51666. [D 20:43:30.470289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 51667. [D 20:43:30.470307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 51668. [D 20:43:30.470317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 51669. [D 20:43:30.470327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 51670. [D 20:43:30.470351] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 51671. [D 20:43:30.472600] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7456 [D 20:43:30.472621] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 51/70. [D 20:43:30.481028] openib_check_cq: completed rdma wr_id 662180, nic_wr_credit 51671. [D 20:43:30.481090] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 52/70. [D 20:43:30.492531] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 51670. [D 20:43:30.492546] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 53/70. [D 20:43:30.492584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 51670. [D 20:43:30.492597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 51671. [D 20:43:30.492608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 51672. [D 20:43:30.492618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 51673. [D 20:43:30.492676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 51674. [D 20:43:30.492687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 51675. [D 20:43:30.492697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 51676. [D 20:43:30.492708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 51677. [D 20:43:30.492718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 51678. [D 20:43:30.492736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 51679. [D 20:43:30.492746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 51680. [D 20:43:30.492756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 51681. [D 20:43:30.492766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 51682. [D 20:43:30.492798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 51683. [D 20:43:30.492811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 51684. [D 20:43:30.492821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 51685. [D 20:43:30.492659] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.492838] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.492862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.492885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 51686. [D 20:43:30.492895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 51687. [D 20:43:30.492923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 51688. [D 20:43:30.492934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 51689. [D 20:43:30.492945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 51690. [D 20:43:30.492955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 51691. [D 20:43:30.492966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 51692. [D 20:43:30.492989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 51693. [D 20:43:30.493000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 51694. [D 20:43:30.493014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 51695. [D 20:43:30.493024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 51696. [D 20:43:30.493034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 51697. [D 20:43:30.493058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 51698. [D 20:43:30.493068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 51699. [D 20:43:30.493083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 51700. [D 20:43:30.493093] openib_post_sr_rdmaw: ibv_post_send wr_id 6278f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 51701. [D 20:43:30.493138] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.493151] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.493161] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:30.502876] openib_check_cq: completed rdma wr_id 6278f0, nic_wr_credit 51701. [D 20:43:30.502891] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 54/70. [D 20:43:30.505003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.505016] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.505025] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:30.513048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.513062] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.513073] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:30.513104] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7460 [D 20:43:30.513115] element 0: offset: 0x625390, size: 24 [D 20:43:30.513128] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 55/70. [D 20:43:30.513145] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.513160] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.513169] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:30.513184] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7463 [D 20:43:30.513193] element 0: offset: 0x64bb10, size: 24 [D 20:43:30.513203] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 56/70. [D 20:43:30.513235] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.513246] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.513257] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.513271] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7465 [D 20:43:30.513281] element 0: offset: 0x66e7a0, size: 24 [D 20:43:30.513291] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 57/70. [D 20:43:30.519970] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7463 [D 20:43:30.520025] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 58/70. [D 20:43:30.520066] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7460 [D 20:43:30.520078] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 59/70. [D 20:43:30.520126] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7465 [D 20:43:30.520139] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 60/70. [D 20:43:30.520169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 51701. [D 20:43:30.520231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 51702. [D 20:43:30.520243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 51703. [D 20:43:30.520253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 51704. [D 20:43:30.520263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 51705. [D 20:43:30.520272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 51706. [D 20:43:30.520282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 51707. [D 20:43:30.520298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 51708. [D 20:43:30.520313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 51709. [D 20:43:30.520323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 51710. [D 20:43:30.520333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 51711. [D 20:43:30.520343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 51712. [D 20:43:30.520362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 51713. [D 20:43:30.520372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 51714. [D 20:43:30.520383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 51715. [D 20:43:30.520393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 51716. [D 20:43:30.520404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 51717. [D 20:43:30.520414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 51718. [D 20:43:30.520428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 51719. [D 20:43:30.520438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 51720. [D 20:43:30.520483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 51721. [D 20:43:30.520493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 51722. [D 20:43:30.520520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 51723. [D 20:43:30.520531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 51724. [D 20:43:30.520541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 51725. [D 20:43:30.520551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 51726. [D 20:43:30.520567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 51727. [D 20:43:30.520577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 51728. [D 20:43:30.520587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 51729. [D 20:43:30.520619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 51730. [D 20:43:30.520666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 51731. [D 20:43:30.520679] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 51732. [D 20:43:30.520693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 51733. [D 20:43:30.520720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 51734. [D 20:43:30.520730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 51735. [D 20:43:30.520741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 51736. [D 20:43:30.520756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 51737. [D 20:43:30.520766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 51738. [D 20:43:30.520777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 51739. [D 20:43:30.520792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 51740. [D 20:43:30.520802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 51741. [D 20:43:30.520812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 51742. [D 20:43:30.520827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 51743. [D 20:43:30.520837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 51744. [D 20:43:30.520846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 51745. [D 20:43:30.520877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 51746. [D 20:43:30.520887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 51747. [D 20:43:30.520898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 51748. [D 20:43:30.520908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 51749. [D 20:43:30.520924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 51750. [D 20:43:30.520934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 51751. [D 20:43:30.520944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 51752. [D 20:43:30.520954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 51753. [D 20:43:30.520965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 51754. [D 20:43:30.520975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 51755. [D 20:43:30.520993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 51756. [D 20:43:30.521003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 51757. [D 20:43:30.521013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 51758. [D 20:43:30.521023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 51759. [D 20:43:30.521034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 51760. [D 20:43:30.521044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 51761. [D 20:43:30.521069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 51762. [D 20:43:30.521080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 51763. [D 20:43:30.521090] openib_post_sr_rdmaw: ibv_post_send wr_id 61f280 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 51764. [D 20:43:30.521102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 51765. [D 20:43:30.521112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 51766. [D 20:43:30.521122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 51767. [D 20:43:30.521132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 51768. [D 20:43:30.521156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 51769. [D 20:43:30.521166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 51770. [D 20:43:30.521176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 51771. [E 20:43:30.521190] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 51772, block for 10 ms. [D 20:43:30.531942] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 51771. [D 20:43:30.531959] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 0/70. [D 20:43:30.531971] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 51770. [D 20:43:30.531981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 51771. [D 20:43:30.531992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 51772. [D 20:43:30.532003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 51773. [D 20:43:30.532013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 51774. [D 20:43:30.532029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 51775. [D 20:43:30.532039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 51776. [D 20:43:30.532049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 51777. [D 20:43:30.532065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 51778. [D 20:43:30.532075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 51779. [D 20:43:30.532085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 51780. [D 20:43:30.532116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 51781. [D 20:43:30.532128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 51782. [D 20:43:30.532138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 51783. [D 20:43:30.532148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 51784. [D 20:43:30.532164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 51785. [D 20:43:30.532186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 51786. [D 20:43:30.532197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 51787. [D 20:43:30.532208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 51788. [D 20:43:30.532218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 51789. [D 20:43:30.532231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 51790. [D 20:43:30.532254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 51791. [D 20:43:30.532264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 51792. [D 20:43:30.532278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 51793. [D 20:43:30.532290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 51794. [D 20:43:30.532300] openib_post_sr_rdmaw: ibv_post_send wr_id 64d830 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 51795. [D 20:43:30.543473] openib_check_cq: completed rdma wr_id 61f280, nic_wr_credit 51795. [D 20:43:30.543490] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 1/70. [D 20:43:30.548013] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.548028] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.548038] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.552712] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.552726] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.552735] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.552767] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7468 [D 20:43:30.552777] element 0: offset: 0x61e4e0, size: 24 [D 20:43:30.552791] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 2/70. [D 20:43:30.552825] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.552834] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.552843] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:30.552857] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7471 [D 20:43:30.552866] element 0: offset: 0x620cc0, size: 24 [D 20:43:30.552877] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 3/70. [D 20:43:30.553048] openib_check_cq: completed rdma wr_id 64d830, nic_wr_credit 51794. [D 20:43:30.553068] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 4/70. [D 20:43:30.553109] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.553123] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.553131] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:30.553212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.553223] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.553231] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.555703] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7468 [D 20:43:30.556661] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 5/70. [D 20:43:30.556720] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7471 [D 20:43:30.556735] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 6/70. [D 20:43:30.564098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 51794. [D 20:43:30.564118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 51795. [D 20:43:30.564130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 51796. [D 20:43:30.564140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 51797. [D 20:43:30.564151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 51798. [D 20:43:30.564165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 51799. [D 20:43:30.564175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 51800. [D 20:43:30.564185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 51801. [D 20:43:30.564201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 51802. [D 20:43:30.564211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 51803. [D 20:43:30.564221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 51804. [D 20:43:30.564236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 51805. [D 20:43:30.564246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 51806. [D 20:43:30.564256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 51807. [D 20:43:30.564272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 51808. [D 20:43:30.564282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 51809. [D 20:43:30.564292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 51810. [D 20:43:30.564333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 51811. [D 20:43:30.564344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 51812. [D 20:43:30.564354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 51813. [D 20:43:30.564365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 51814. [D 20:43:30.564390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 51815. [D 20:43:30.564401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 51816. [D 20:43:30.564411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 51817. [D 20:43:30.564421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 51818. [D 20:43:30.564432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 51819. [D 20:43:30.564443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 51820. [D 20:43:30.564453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 51821. [D 20:43:30.564483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 51822. [D 20:43:30.564494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 51823. [D 20:43:30.564505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 51824. [D 20:43:30.564516] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 51825. [D 20:43:30.564529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 51826. [D 20:43:30.564539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 51827. [D 20:43:30.564550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 51828. [D 20:43:30.564560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 51829. [D 20:43:30.564570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 51830. [D 20:43:30.564601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 51831. [D 20:43:30.564611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 51832. [D 20:43:30.564625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 51833. [D 20:43:30.564643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 51834. [D 20:43:30.564658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 51835. [D 20:43:30.564668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 51836. [D 20:43:30.564679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 51837. [D 20:43:30.564693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 51838. [D 20:43:30.564720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 51839. [D 20:43:30.564733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 51840. [D 20:43:30.564743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 51841. [D 20:43:30.564758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 51842. [D 20:43:30.564770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 51843. [D 20:43:30.564780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 51844. [D 20:43:30.564790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 51845. [D 20:43:30.564800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 51846. [D 20:43:30.564826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 51847. [D 20:43:30.564839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 51848. [D 20:43:30.564849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 51849. [D 20:43:30.564860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 51850. [D 20:43:30.564875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 51851. [D 20:43:30.564885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 51852. [D 20:43:30.564895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 51853. [D 20:43:30.564924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 51854. [D 20:43:30.564934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 51855. [D 20:43:30.564949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 51856. [D 20:43:30.564959] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 51857. [D 20:43:30.567343] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.567358] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.567369] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.567403] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7475 [D 20:43:30.567414] element 0: offset: 0x691fe0, size: 24 [D 20:43:30.567426] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 7/70. [D 20:43:30.567449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.567458] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.567467] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:30.567484] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7477 [D 20:43:30.567494] element 0: offset: 0x64dc80, size: 24 [D 20:43:30.567520] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 8/70. [D 20:43:30.575799] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 51857. [D 20:43:30.575815] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 9/70. [D 20:43:30.587539] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 51856. [D 20:43:30.587554] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 10/70. [D 20:43:30.589856] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.589870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.589879] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:30.589960] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.589973] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.589981] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.592055] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7475 [D 20:43:30.592111] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 11/70. [D 20:43:30.594484] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7477 [D 20:43:30.594503] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 12/70. [D 20:43:30.598645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 51856. [D 20:43:30.598664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 51857. [D 20:43:30.598675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 51858. [D 20:43:30.598686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 51859. [D 20:43:30.598696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 51860. [D 20:43:30.598710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 51861. [D 20:43:30.598720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 51862. [D 20:43:30.598730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 51863. [D 20:43:30.598747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 51864. [D 20:43:30.598757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 51865. [D 20:43:30.598766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 51866. [D 20:43:30.598783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 51867. [D 20:43:30.598793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 51868. [D 20:43:30.598803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 51869. [D 20:43:30.598813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 51870. [D 20:43:30.598830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 51871. [D 20:43:30.598840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 51872. [D 20:43:30.598868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 51873. [D 20:43:30.598879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 51874. [D 20:43:30.598901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 51875. [D 20:43:30.598912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 51876. [D 20:43:30.598927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 51877. [D 20:43:30.598938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 51878. [D 20:43:30.598948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 51879. [D 20:43:30.598959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 51880. [D 20:43:30.598983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 51881. [D 20:43:30.598998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 51882. [D 20:43:30.599009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 51883. [D 20:43:30.599019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 51884. [D 20:43:30.599030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 51885. [D 20:43:30.599039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 51886. [D 20:43:30.599050] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 51887. [D 20:43:30.599063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 51888. [D 20:43:30.599093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 51889. [D 20:43:30.599103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 51890. [D 20:43:30.599113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 51891. [D 20:43:30.599130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 51892. [D 20:43:30.599140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 51893. [D 20:43:30.599150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 51894. [D 20:43:30.599165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 51895. [D 20:43:30.599175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 51896. [D 20:43:30.599185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 51897. [D 20:43:30.599216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 51898. [D 20:43:30.599226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 51899. [D 20:43:30.599240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 51900. [D 20:43:30.599250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 51901. [D 20:43:30.599263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 51902. [D 20:43:30.599286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 51903. [D 20:43:30.599296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 51904. [D 20:43:30.599307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 51905. [D 20:43:30.599317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 51906. [D 20:43:30.599327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 51907. [D 20:43:30.599338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 51908. [D 20:43:30.599348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 51909. [D 20:43:30.599358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 51910. [D 20:43:30.599369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 51911. [D 20:43:30.599394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 51912. [D 20:43:30.599406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 51913. [D 20:43:30.599416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 51914. [D 20:43:30.599426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 51915. [D 20:43:30.599436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 51916. [D 20:43:30.599447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 51917. [D 20:43:30.599458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 51918. [D 20:43:30.599467] openib_post_sr_rdmaw: ibv_post_send wr_id 6433e0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 51919. [D 20:43:30.600640] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.600655] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.600665] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.600700] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7480 [D 20:43:30.600711] element 0: offset: 0x625390, size: 24 [D 20:43:30.600724] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 13/70. [D 20:43:30.600748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.600760] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.600768] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:30.600782] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7483 [D 20:43:30.600793] element 0: offset: 0x61e7e0, size: 24 [D 20:43:30.600802] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 14/70. [D 20:43:30.610327] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 51919. [D 20:43:30.610344] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 15/70. [D 20:43:30.622142] openib_check_cq: completed rdma wr_id 6433e0, nic_wr_credit 51918. [D 20:43:30.622157] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 16/70. [D 20:43:30.624465] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.624478] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.624488] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:30.624569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.624582] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.624591] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.627210] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7483 [D 20:43:30.627270] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 17/70. [D 20:43:30.629511] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7480 [D 20:43:30.629531] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 18/70. [D 20:43:30.633337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 51918. [D 20:43:30.633355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 51919. [D 20:43:30.633368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 51920. [D 20:43:30.633378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 51921. [D 20:43:30.633394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 51922. [D 20:43:30.633406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 51923. [D 20:43:30.633416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 51924. [D 20:43:30.633427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 51925. [D 20:43:30.633437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 51926. [D 20:43:30.633447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 51927. [D 20:43:30.633457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 51928. [D 20:43:30.633474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 51929. [D 20:43:30.633500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 51930. [D 20:43:30.633515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 51931. [D 20:43:30.633525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 51932. [D 20:43:30.633535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 51933. [D 20:43:30.633549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 51934. [D 20:43:30.633559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 51935. [D 20:43:30.633569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 51936. [D 20:43:30.633596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 51937. [D 20:43:30.633606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 51938. [D 20:43:30.633621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 51939. [D 20:43:30.633643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 51940. [D 20:43:30.633658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 51941. [D 20:43:30.633668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 51942. [D 20:43:30.633679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 51943. [D 20:43:30.633703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 51944. [D 20:43:30.633713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 51945. [D 20:43:30.633724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 51946. [D 20:43:30.633739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 51947. [D 20:43:30.633749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 51948. [D 20:43:30.633759] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 51949. [D 20:43:30.633777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 51950. [D 20:43:30.633787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 51951. [D 20:43:30.633798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 51952. [D 20:43:30.633824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 51953. [D 20:43:30.633840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 51954. [D 20:43:30.633850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 51955. [D 20:43:30.633860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 51956. [D 20:43:30.633873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 51957. [D 20:43:30.633901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 51958. [D 20:43:30.633912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 51959. [D 20:43:30.633922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 51960. [D 20:43:30.633937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 51961. [D 20:43:30.633947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 51962. [D 20:43:30.633957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 51963. [D 20:43:30.633973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 51964. [D 20:43:30.633983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 51965. [D 20:43:30.634009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 51966. [D 20:43:30.634019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 51967. [D 20:43:30.634029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 51968. [D 20:43:30.634043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 51969. [D 20:43:30.634066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 51970. [D 20:43:30.634081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 51971. [D 20:43:30.634091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 51972. [D 20:43:30.634101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 51973. [D 20:43:30.634116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 51974. [D 20:43:30.634126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 51975. [D 20:43:30.634136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 51976. [D 20:43:30.634164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 51977. [D 20:43:30.634174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 51978. [D 20:43:30.634198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 51979. [D 20:43:30.634214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 51980. [D 20:43:30.634225] openib_post_sr_rdmaw: ibv_post_send wr_id 61f280 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 51981. [D 20:43:30.636631] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.636653] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.636663] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.636698] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7487 [D 20:43:30.636709] element 0: offset: 0x5b0030, size: 24 [D 20:43:30.636721] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 19/70. [D 20:43:30.636744] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.636754] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.636763] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:30.636779] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7489 [D 20:43:30.636789] element 0: offset: 0x66e7a0, size: 24 [D 20:43:30.636815] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 20/70. [D 20:43:30.645050] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 51981. [D 20:43:30.645066] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 21/70. [D 20:43:30.651623] openib_check_cq: completed rdma wr_id 61f280, nic_wr_credit 51980. [D 20:43:30.651637] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 22/70. [D 20:43:30.653949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.653963] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.653974] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:30.654050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.654063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.654086] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.656702] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7487 [D 20:43:30.656749] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 23/70. [D 20:43:30.656831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 51980. [D 20:43:30.656888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 51981. [D 20:43:30.656900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 51982. [D 20:43:30.656913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 51983. [D 20:43:30.656924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 51984. [D 20:43:30.656934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 51985. [D 20:43:30.656945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 51986. [D 20:43:30.656955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 51987. [D 20:43:30.656992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 51988. [D 20:43:30.657003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 51989. [D 20:43:30.657016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 51990. [D 20:43:30.657026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 51991. [D 20:43:30.657042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 51992. [D 20:43:30.657068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 51993. [D 20:43:30.657079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 51994. [D 20:43:30.657089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 51995. [D 20:43:30.657099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 51996. [D 20:43:30.657110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 51997. [D 20:43:30.657121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 51998. [D 20:43:30.657145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 51999. [D 20:43:30.657156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 52000. [D 20:43:30.657166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 52001. [D 20:43:30.657177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 52002. [D 20:43:30.657191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 52003. [D 20:43:30.657210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 52004. [D 20:43:30.657221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 52005. [D 20:43:30.657237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 52006. [D 20:43:30.657247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 52007. [D 20:43:30.657271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 52008. [D 20:43:30.657288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 52009. [D 20:43:30.657303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 52010. [D 20:43:30.657314] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 52011. [D 20:43:30.659504] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7489 [D 20:43:30.659520] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 24/70. [D 20:43:30.662749] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52011. [D 20:43:30.662764] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 25/70. [D 20:43:30.662776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 52011. [D 20:43:30.662787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 52012. [D 20:43:30.662798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 52013. [D 20:43:30.662809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 52014. [D 20:43:30.662819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 52015. [D 20:43:30.662830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 52016. [D 20:43:30.662841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 52017. [D 20:43:30.662851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 52018. [D 20:43:30.662866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 52019. [D 20:43:30.662893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 52020. [D 20:43:30.662904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 52021. [D 20:43:30.662915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 52022. [D 20:43:30.662925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 52023. [D 20:43:30.662936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 52024. [D 20:43:30.662946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 52025. [D 20:43:30.662956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 52026. [D 20:43:30.662966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 52027. [D 20:43:30.662977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 52028. [D 20:43:30.662990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 52029. [D 20:43:30.663010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 52030. [D 20:43:30.663020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 52031. [D 20:43:30.663040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 52032. [D 20:43:30.663056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 52033. [D 20:43:30.663066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 52034. [D 20:43:30.663076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 52035. [D 20:43:30.663092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 52036. [D 20:43:30.663103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 52037. [D 20:43:30.663112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 52038. [D 20:43:30.663128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 52039. [D 20:43:30.663153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 52040. [D 20:43:30.663168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 52041. [D 20:43:30.663178] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 52042. [D 20:43:30.663238] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.663253] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.663263] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:30.668727] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 52042. [D 20:43:30.668742] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 26/70. [D 20:43:30.670935] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.670948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.670958] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:30.868236] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.868251] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.868261] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:30.868293] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7492 [D 20:43:30.868304] element 0: offset: 0x61e4e0, size: 24 [D 20:43:30.868315] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 27/70. [D 20:43:30.868333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.868349] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.868358] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:30.870535] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7495 [D 20:43:30.870546] element 0: offset: 0x61f670, size: 24 [D 20:43:30.870556] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 28/70. [D 20:43:30.872665] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7492 [D 20:43:30.872720] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 29/70. [D 20:43:30.874681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 52042. [D 20:43:30.874750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 52043. [D 20:43:30.874762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 52044. [D 20:43:30.874773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 52045. [D 20:43:30.874784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 52046. [D 20:43:30.874794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 52047. [D 20:43:30.874804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 52048. [D 20:43:30.874815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 52049. [D 20:43:30.874824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 52050. [D 20:43:30.874834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 52051. [D 20:43:30.874844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 52052. [D 20:43:30.874863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 52053. [D 20:43:30.874872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 52054. [D 20:43:30.874882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 52055. [D 20:43:30.874928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 52056. [D 20:43:30.874940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 52057. [D 20:43:30.874964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 52058. [D 20:43:30.874978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 52059. [D 20:43:30.874988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 52060. [D 20:43:30.874998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 52061. [D 20:43:30.875012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 52062. [D 20:43:30.875022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 52063. [D 20:43:30.875032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 52064. [D 20:43:30.875042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 52065. [D 20:43:30.875052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 52066. [D 20:43:30.875079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 52067. [D 20:43:30.875089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 52068. [D 20:43:30.875107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 52069. [D 20:43:30.875117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 52070. [D 20:43:30.875128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 52071. [D 20:43:30.875138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 52072. [D 20:43:30.875148] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 52073. [D 20:43:30.877494] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7495 [D 20:43:30.877513] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 30/70. [D 20:43:30.886328] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52073. [D 20:43:30.886348] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 31/70. [D 20:43:30.886381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 52073. [D 20:43:30.886392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 52074. [D 20:43:30.886403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 52075. [D 20:43:30.886415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 52076. [D 20:43:30.886425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 52077. [D 20:43:30.886435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52078. [D 20:43:30.886449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52079. [D 20:43:30.886473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 52080. [D 20:43:30.886489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 52081. [D 20:43:30.886507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 52082. [D 20:43:30.886518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 52083. [D 20:43:30.886529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 52084. [D 20:43:30.886539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 52085. [D 20:43:30.886549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 52086. [D 20:43:30.886559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 52087. [D 20:43:30.886581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 52088. [D 20:43:30.886592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 52089. [D 20:43:30.886608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 52090. [D 20:43:30.886630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 52091. [D 20:43:30.886644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 52092. [D 20:43:30.886665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 52093. [D 20:43:30.886679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 52094. [D 20:43:30.886688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 52095. [D 20:43:30.886698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 52096. [D 20:43:30.886725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 52097. [D 20:43:30.886753] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.886773] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.886795] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.886833] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7498 [D 20:43:30.886860] element 0: offset: 0x2aaaab23d1d0, size: 24 [D 20:43:30.886872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 52098. [D 20:43:30.886883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 52099. [D 20:43:30.886897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 52100. [D 20:43:30.886925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 52101. [D 20:43:30.886935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 52102. [D 20:43:30.886959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 52103. [D 20:43:30.886971] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 52104. [D 20:43:30.886999] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 32/70. [D 20:43:30.887077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.887098] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.887108] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.898158] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 52104. [D 20:43:30.898174] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 33/70. [D 20:43:30.900550] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.900564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.900573] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:30.902645] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7498 [D 20:43:30.902660] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 34/70. [D 20:43:30.906457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 52104. [D 20:43:30.906472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 52105. [D 20:43:30.906483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 52106. [D 20:43:30.906493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 52107. [D 20:43:30.906504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 52108. [D 20:43:30.906518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 52109. [D 20:43:30.906528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 52110. [D 20:43:30.906538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 52111. [D 20:43:30.906554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 52112. [D 20:43:30.906564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 52113. [D 20:43:30.906574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 52114. [D 20:43:30.906590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 52115. [D 20:43:30.906600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 52116. [D 20:43:30.906610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 52117. [D 20:43:30.906637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 52118. [D 20:43:30.906647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 52119. [D 20:43:30.906661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 52120. [D 20:43:30.906672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 52121. [D 20:43:30.906698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 52122. [D 20:43:30.906709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 52123. [D 20:43:30.906720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 52124. [D 20:43:30.906730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 52125. [D 20:43:30.906740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 52126. [D 20:43:30.906767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 52127. [D 20:43:30.906778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 52128. [D 20:43:30.906789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 52129. [D 20:43:30.906803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 52130. [D 20:43:30.906813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 52131. [D 20:43:30.906836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 52132. [D 20:43:30.906849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 52133. [D 20:43:30.906859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 52134. [D 20:43:30.906870] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 52135. [D 20:43:30.912380] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52135. [D 20:43:30.912395] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 35/70. [D 20:43:30.914657] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.914670] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.914681] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:30.920466] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.920480] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.920489] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:30.920504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7503 [D 20:43:30.920518] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:30.920527] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 36/70. [D 20:43:30.920543] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.920553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.920562] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:30.920576] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7504 [D 20:43:30.920585] element 0: offset: 0x2aaaab23d0b0, size: 24 [D 20:43:30.920611] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 37/70. [D 20:43:30.920637] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.920648] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.920670] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.920694] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7507 [D 20:43:30.920705] element 0: offset: 0x2aaaab211240, size: 24 [D 20:43:30.920718] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 38/70. [D 20:43:30.927596] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7504 [D 20:43:30.927669] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 39/70. [D 20:43:30.927691] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7503 [D 20:43:30.927703] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 40/70. [D 20:43:30.927724] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7507 [D 20:43:30.927735] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 41/70. [D 20:43:30.929421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 52135. [D 20:43:30.929438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 52136. [D 20:43:30.929449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 52137. [D 20:43:30.929459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 52138. [D 20:43:30.929481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 52139. [D 20:43:30.929492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 52140. [D 20:43:30.929502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 52141. [D 20:43:30.929518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 52142. [D 20:43:30.929528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 52143. [D 20:43:30.929538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 52144. [D 20:43:30.929548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 52145. [D 20:43:30.929576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 52146. [D 20:43:30.929586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 52147. [D 20:43:30.929606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 52148. [D 20:43:30.929617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 52149. [D 20:43:30.929627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 52150. [D 20:43:30.929637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 52151. [D 20:43:30.929647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 52152. [D 20:43:30.929662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 52153. [D 20:43:30.929675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 52154. [D 20:43:30.929685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 52155. [D 20:43:30.929695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 52156. [D 20:43:30.929706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 52157. [D 20:43:30.929728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 52158. [D 20:43:30.929739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 52159. [D 20:43:30.929749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 52160. [D 20:43:30.929761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 52161. [D 20:43:30.929771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 52162. [D 20:43:30.929790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 52163. [D 20:43:30.929801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 52164. [D 20:43:30.929811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 52165. [D 20:43:30.929821] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 52166. [D 20:43:30.929857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 52167. [D 20:43:30.929877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 52168. [D 20:43:30.929889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 52169. [D 20:43:30.929903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 52170. [D 20:43:30.929913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 52171. [D 20:43:30.929923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 52172. [D 20:43:30.929934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 52173. [D 20:43:30.929957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 52174. [D 20:43:30.929968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 52175. [D 20:43:30.929989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 52176. [D 20:43:30.930000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 52177. [D 20:43:30.930029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 52178. [D 20:43:30.930041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 52179. [D 20:43:30.930051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 52180. [D 20:43:30.930061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 52181. [D 20:43:30.930073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 52182. [D 20:43:30.930083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 52183. [D 20:43:30.930093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 52184. [D 20:43:30.930103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 52185. [D 20:43:30.930114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 52186. [D 20:43:30.930125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 52187. [D 20:43:30.930135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 52188. [D 20:43:30.930145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 52189. [D 20:43:30.930156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 52190. [D 20:43:30.930167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 52191. [D 20:43:30.930177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 52192. [D 20:43:30.930187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 52193. [D 20:43:30.930212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 52194. [D 20:43:30.930222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 52195. [D 20:43:30.930235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 52196. [D 20:43:30.930250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 52197. [D 20:43:30.930260] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 52198. [D 20:43:30.930283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 52199. [D 20:43:30.930295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 52200. [D 20:43:30.930305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 52201. [D 20:43:30.930316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 52202. [D 20:43:30.930326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 52203. [D 20:43:30.930336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52204. [D 20:43:30.930364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52205. [E 20:43:30.930378] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52206, block for 10 ms. [D 20:43:30.930410] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52205. [E 20:43:30.930422] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52206, block for 10 ms. [D 20:43:30.940263] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 52205. [D 20:43:30.940279] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 42/70. [D 20:43:30.940290] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52204. [D 20:43:30.940300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 52205. [D 20:43:30.940311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 52206. [D 20:43:30.940321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 52207. [D 20:43:30.940331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 52208. [D 20:43:30.940342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 52209. [D 20:43:30.940352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 52210. [D 20:43:30.940362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 52211. [D 20:43:30.940372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 52212. [D 20:43:30.940389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 52213. [D 20:43:30.940400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 52214. [D 20:43:30.940410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 52215. [D 20:43:30.940443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 52216. [D 20:43:30.940454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 52217. [D 20:43:30.940464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 52218. [D 20:43:30.940474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 52219. [D 20:43:30.940490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 52220. [D 20:43:30.940513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 52221. [D 20:43:30.940527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 52222. [D 20:43:30.940537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 52223. [D 20:43:30.940547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 52224. [D 20:43:30.940569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 52225. [D 20:43:30.940579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 52226. [D 20:43:30.940590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 52227. [D 20:43:30.940600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 52228. [D 20:43:30.940610] openib_post_sr_rdmaw: ibv_post_send wr_id 64d7f0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 52229. [D 20:43:30.940678] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.940691] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.940714] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:30.940749] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7510 [D 20:43:30.940760] element 0: offset: 0x2aaaab2300f0, size: 24 [D 20:43:30.940770] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 43/70. [D 20:43:30.951904] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52229. [D 20:43:30.951953] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 44/70. [D 20:43:30.953969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.953983] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.953992] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:30.961787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.961801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.961812] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:30.961828] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7512 [D 20:43:30.961841] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:43:30.961851] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 45/70. [D 20:43:30.963481] openib_check_cq: completed rdma wr_id 64d7f0, nic_wr_credit 52228. [D 20:43:30.963495] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 46/70. [D 20:43:30.965808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.965821] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.965831] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:30.965910] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.965923] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.965932] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.968641] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7512 [D 20:43:30.968710] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 47/70. [D 20:43:30.968882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 52228. [D 20:43:30.968898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 52229. [D 20:43:30.968909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 52230. [D 20:43:30.968923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 52231. [D 20:43:30.968934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 52232. [D 20:43:30.968944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 52233. [D 20:43:30.968958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 52234. [D 20:43:30.968968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 52235. [D 20:43:30.968979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 52236. [D 20:43:30.968988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 52237. [D 20:43:30.969005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 52238. [D 20:43:30.969015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 52239. [D 20:43:30.969049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 52240. [D 20:43:30.969060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 52241. [D 20:43:30.969070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 52242. [D 20:43:30.969080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 52243. [D 20:43:30.969090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 52244. [D 20:43:30.969100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 52245. [D 20:43:30.969110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 52246. [D 20:43:30.969185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 52247. [D 20:43:30.969198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 52248. [D 20:43:30.969210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 52249. [D 20:43:30.969221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 52250. [D 20:43:30.969231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 52251. [D 20:43:30.969242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 52252. [D 20:43:30.969267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 52253. [D 20:43:30.969278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 52254. [D 20:43:30.969288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 52255. [D 20:43:30.969304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 52256. [D 20:43:30.969328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 52257. [D 20:43:30.969349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 52258. [D 20:43:30.969359] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 52259. [D 20:43:30.969465] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7510 [D 20:43:30.969481] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 48/70. [D 20:43:30.976681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.976696] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.976707] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:30.976741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7517 [D 20:43:30.976752] element 0: offset: 0x2aaaab22fd90, size: 24 [D 20:43:30.978521] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 49/70. [D 20:43:30.978545] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:30.978555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.978564] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:30.978581] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7519 [D 20:43:30.978591] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:30.978604] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 50/70. [D 20:43:30.980660] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 52259. [D 20:43:30.980677] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 51/70. [D 20:43:30.980711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 52259. [D 20:43:30.980722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 52260. [D 20:43:30.980735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 52261. [D 20:43:30.980745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 52262. [D 20:43:30.980756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 52263. [D 20:43:30.980767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 52264. [D 20:43:30.980777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 52265. [D 20:43:30.980788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 52266. [D 20:43:30.980799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 52267. [D 20:43:30.980809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 52268. [D 20:43:30.983910] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7519 [D 20:43:30.983991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 52269. [D 20:43:30.984005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 52270. [D 20:43:30.984015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 52271. [D 20:43:30.984025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 52272. [D 20:43:30.984035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 52273. [D 20:43:30.984045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 52274. [D 20:43:30.984055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 52275. [D 20:43:30.984079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 52276. [D 20:43:30.984089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 52277. [D 20:43:30.984098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 52278. [D 20:43:30.984108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 52279. [D 20:43:30.984150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 52280. [D 20:43:30.984161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 52281. [D 20:43:30.984172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 52282. [D 20:43:30.984183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 52283. [D 20:43:30.984192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 52284. [D 20:43:30.984202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 52285. [D 20:43:30.984213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 52286. [D 20:43:30.984223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 52287. [D 20:43:30.984242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 52288. [D 20:43:30.984284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 52289. [D 20:43:30.984296] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 52290. [D 20:43:30.984321] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 52/70. [D 20:43:30.984338] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7517 [D 20:43:30.984349] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 53/70. [D 20:43:30.984439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.984454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.984464] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:30.992360] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52290. [D 20:43:30.992376] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 54/70. [D 20:43:30.992390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 52290. [D 20:43:30.992401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 52291. [D 20:43:30.992416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 52292. [D 20:43:30.992426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 52293. [D 20:43:30.992439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 52294. [D 20:43:30.992454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52295. [D 20:43:30.992464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52296. [D 20:43:30.992474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 52297. [D 20:43:30.992490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 52298. [D 20:43:30.992500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 52299. [D 20:43:30.992510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 52300. [D 20:43:30.992525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 52301. [D 20:43:30.992535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 52302. [D 20:43:30.992545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 52303. [D 20:43:30.992584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 52304. [D 20:43:30.992595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 52305. [D 20:43:30.992605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 52306. [D 20:43:30.992616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 52307. [D 20:43:30.992627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 52308. [D 20:43:30.992637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 52309. [D 20:43:30.992647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 52310. [D 20:43:30.992668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 52311. [D 20:43:30.992678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 52312. [D 20:43:30.992688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 52313. [D 20:43:30.992698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 52314. [D 20:43:30.992708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 52315. [D 20:43:30.992718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 52316. [D 20:43:30.992738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 52317. [D 20:43:30.992749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 52318. [D 20:43:30.992759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 52319. [D 20:43:30.992769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 52320. [D 20:43:30.992780] openib_post_sr_rdmaw: ibv_post_send wr_id 64d010 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 52321. [D 20:43:30.992809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 52322. [D 20:43:30.992824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 52323. [D 20:43:30.992835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 52324. [D 20:43:30.992845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 52325. [D 20:43:30.992860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 52326. [D 20:43:30.992870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 52327. [D 20:43:30.992880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 52328. [D 20:43:30.992904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 52329. [D 20:43:30.992914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 52330. [D 20:43:30.992924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 52331. [D 20:43:30.992940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 52332. [D 20:43:30.992950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 52333. [D 20:43:30.992960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 52334. [D 20:43:30.992976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 52335. [D 20:43:30.992986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 52336. [D 20:43:30.992996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 52337. [D 20:43:30.993027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 52338. [D 20:43:30.993037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 52339. [D 20:43:30.993051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 52340. [D 20:43:30.993061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 52341. [D 20:43:30.993074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 52342. [D 20:43:30.993089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 52343. [D 20:43:30.993099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 52344. [D 20:43:30.993109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 52345. [D 20:43:30.993134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 52346. [D 20:43:30.993144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 52347. [D 20:43:30.993159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 52348. [D 20:43:30.993169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 52349. [D 20:43:30.993179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 52350. [D 20:43:30.993193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 52351. [D 20:43:30.993203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 52352. [D 20:43:30.993213] openib_post_sr_rdmaw: ibv_post_send wr_id 63fbb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 52353. [D 20:43:30.995611] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:30.995625] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:30.995634] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:30.998363] openib_check_cq: completed rdma wr_id 64d010, nic_wr_credit 52353. [D 20:43:30.998378] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 55/70. [D 20:43:31.004681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.004696] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.004707] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:31.004738] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7521 [D 20:43:31.004750] element 0: offset: 0x2aaaab2090a0, size: 24 [D 20:43:31.004995] openib_check_cq: completed rdma wr_id 63fbb0, nic_wr_credit 52352. [D 20:43:31.005009] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 56/70. [D 20:43:31.007221] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 57/70. [D 20:43:31.007249] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.007259] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.007268] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:31.007282] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.007291] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.007300] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:31.011476] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7521 [D 20:43:31.011494] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 58/70. [D 20:43:31.011541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 52352. [D 20:43:31.011553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 52353. [D 20:43:31.011564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 52354. [D 20:43:31.011574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 52355. [D 20:43:31.011584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 52356. [D 20:43:31.011604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 52357. [D 20:43:31.011614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 52358. [D 20:43:31.011624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 52359. [D 20:43:31.011635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 52360. [D 20:43:31.011645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 52361. [D 20:43:31.011655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 52362. [D 20:43:31.011666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 52363. [D 20:43:31.011684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 52364. [D 20:43:31.011694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 52365. [D 20:43:31.011704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 52366. [D 20:43:31.011720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 52367. [D 20:43:31.011746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 52368. [D 20:43:31.011758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 52369. [D 20:43:31.011768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 52370. [D 20:43:31.011783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 52371. [D 20:43:31.011806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 52372. [D 20:43:31.011817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 52373. [D 20:43:31.011828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 52374. [D 20:43:31.011838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 52375. [D 20:43:31.011848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 52376. [D 20:43:31.011859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 52377. [D 20:43:31.011878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 52378. [D 20:43:31.011888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 52379. [D 20:43:31.011907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 52380. [D 20:43:31.011917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 52381. [D 20:43:31.011927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 52382. [D 20:43:31.011943] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 52383. [D 20:43:31.017405] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 52383. [D 20:43:31.017419] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 59/70. [D 20:43:31.019693] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.019706] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.019716] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.128203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.128218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.128229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.128244] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7525 [D 20:43:31.128254] element 0: offset: 0x2aaaab208910, size: 24 [D 20:43:31.128264] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 60/70. [D 20:43:31.130491] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7525 [D 20:43:31.130561] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 0/70. [D 20:43:31.130624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 52383. [D 20:43:31.130641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 52384. [D 20:43:31.130652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 52385. [D 20:43:31.130663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 52386. [D 20:43:31.130673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 52387. [D 20:43:31.130683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 52388. [D 20:43:31.130693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 52389. [D 20:43:31.130735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 52390. [D 20:43:31.130745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 52391. [D 20:43:31.130755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 52392. [D 20:43:31.130785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 52393. [D 20:43:31.130796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 52394. [D 20:43:31.130808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 52395. [D 20:43:31.130818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 52396. [D 20:43:31.130828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 52397. [D 20:43:31.130842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 52398. [D 20:43:31.130868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 52399. [D 20:43:31.130882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 52400. [D 20:43:31.130892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 52401. [D 20:43:31.130913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 52402. [D 20:43:31.130924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 52403. [D 20:43:31.130933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 52404. [D 20:43:31.130943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 52405. [D 20:43:31.130953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 52406. [D 20:43:31.130978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 52407. [D 20:43:31.130988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 52408. [D 20:43:31.131008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 52409. [D 20:43:31.131019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 52410. [D 20:43:31.131029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 52411. [D 20:43:31.131045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 52412. [D 20:43:31.131055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 52413. [D 20:43:31.131065] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 52414. [D 20:43:31.136566] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52414. [D 20:43:31.136581] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 1/70. [D 20:43:31.136714] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.136736] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.136746] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.315357] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.315372] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.315383] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.315414] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7528 [D 20:43:31.315424] element 0: offset: 0x2aaaab22fde0, size: 24 [D 20:43:31.315435] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 2/70. [D 20:43:31.317404] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7528 [D 20:43:31.317422] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 3/70. [D 20:43:31.320141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 52414. [D 20:43:31.320156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 52415. [D 20:43:31.320166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 52416. [D 20:43:31.320176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 52417. [D 20:43:31.320192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 52418. [D 20:43:31.320203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52419. [D 20:43:31.320213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52420. [D 20:43:31.320223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 52421. [D 20:43:31.320234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 52422. [D 20:43:31.320244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 52423. [D 20:43:31.320254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 52424. [D 20:43:31.320272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 52425. [D 20:43:31.320282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 52426. [D 20:43:31.320292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 52427. [D 20:43:31.320302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 52428. [D 20:43:31.320316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 52429. [D 20:43:31.320328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 52430. [D 20:43:31.320338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 52431. [D 20:43:31.320349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 52432. [D 20:43:31.320359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 52433. [D 20:43:31.320369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 52434. [D 20:43:31.320393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 52435. [D 20:43:31.320403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 52436. [D 20:43:31.320421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 52437. [D 20:43:31.320431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 52438. [D 20:43:31.320441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 52439. [D 20:43:31.320452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 52440. [D 20:43:31.320463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 52441. [D 20:43:31.320473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 52442. [D 20:43:31.320483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 52443. [D 20:43:31.320493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 52444. [D 20:43:31.320506] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 52445. [D 20:43:31.326184] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 52445. [D 20:43:31.326198] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 4/70. [D 20:43:31.328762] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.328775] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.328785] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.328799] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.328808] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.328818] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.328833] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7531 [D 20:43:31.328844] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:31.328854] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 5/70. [D 20:43:31.328869] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.328882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.328906] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:31.328931] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7534 [D 20:43:31.328941] element 0: offset: 0x2aaaab208910, size: 24 [D 20:43:31.328951] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 6/70. [D 20:43:31.334066] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7531 [D 20:43:31.334135] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 7/70. [D 20:43:31.334207] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7534 [D 20:43:31.334228] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 8/70. [D 20:43:31.334274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 52445. [D 20:43:31.334290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 52446. [D 20:43:31.334301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 52447. [D 20:43:31.334311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 52448. [D 20:43:31.334322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 52449. [D 20:43:31.334332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 52450. [D 20:43:31.334342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 52451. [D 20:43:31.334360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 52452. [D 20:43:31.334370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 52453. [D 20:43:31.334380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 52454. [D 20:43:31.334390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 52455. [D 20:43:31.334452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 52456. [D 20:43:31.334463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 52457. [D 20:43:31.334481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 52458. [D 20:43:31.334491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 52459. [D 20:43:31.334507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 52460. [D 20:43:31.334517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 52461. [D 20:43:31.334527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 52462. [D 20:43:31.334557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 52463. [D 20:43:31.334569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 52464. [D 20:43:31.334580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 52465. [D 20:43:31.334589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 52466. [D 20:43:31.334606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 52467. [D 20:43:31.334616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 52468. [D 20:43:31.334626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 52469. [D 20:43:31.334655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 52470. [D 20:43:31.334665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 52471. [D 20:43:31.334675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 52472. [D 20:43:31.334701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 52473. [D 20:43:31.334711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 52474. [D 20:43:31.334721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 52475. [D 20:43:31.334738] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 52476. [D 20:43:31.334751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 52477. [D 20:43:31.334782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 52478. [D 20:43:31.334793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 52479. [D 20:43:31.334807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 52480. [D 20:43:31.334817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 52481. [D 20:43:31.334827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 52482. [D 20:43:31.334841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 52483. [D 20:43:31.334863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 52484. [D 20:43:31.334876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 52485. [D 20:43:31.334886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 52486. [D 20:43:31.334899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 52487. [D 20:43:31.334924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 52488. [D 20:43:31.334934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 52489. [D 20:43:31.334948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 52490. [D 20:43:31.334959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 52491. [D 20:43:31.334969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 52492. [D 20:43:31.334983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 52493. [D 20:43:31.334993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 52494. [D 20:43:31.335018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 52495. [D 20:43:31.335028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 52496. [D 20:43:31.335038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 52497. [D 20:43:31.335052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 52498. [D 20:43:31.335075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 52499. [D 20:43:31.335089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 52500. [D 20:43:31.335110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 52501. [D 20:43:31.335125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 52502. [D 20:43:31.335148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 52503. [D 20:43:31.335173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 52504. [D 20:43:31.335184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 52505. [D 20:43:31.335196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 52506. [D 20:43:31.335217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 52507. [D 20:43:31.335228] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 52508. [D 20:43:31.341370] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52508. [D 20:43:31.341387] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 9/70. [D 20:43:31.351818] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 52507. [D 20:43:31.351833] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 10/70. [D 20:43:31.354196] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.354211] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.354222] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:31.354238] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.354248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.354256] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.373791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.373807] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.373817] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.373849] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7538 [D 20:43:31.373860] element 0: offset: 0x2aaaab22fde0, size: 24 [D 20:43:31.373871] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 11/70. [D 20:43:31.373888] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.373904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.373913] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:31.373968] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7539 [D 20:43:31.374000] element 0: offset: 0x2aaaab208d50, size: 24 [D 20:43:31.374014] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 12/70. [D 20:43:31.378409] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7538 [D 20:43:31.378472] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 13/70. [D 20:43:31.378490] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7539 [D 20:43:31.378501] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 14/70. [D 20:43:31.378605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 52507. [D 20:43:31.378623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 52508. [D 20:43:31.378642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 52509. [D 20:43:31.378654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 52510. [D 20:43:31.378668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 52511. [D 20:43:31.378678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52512. [D 20:43:31.378688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52513. [D 20:43:31.378700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 52514. [D 20:43:31.378717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 52515. [D 20:43:31.378727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 52516. [D 20:43:31.378737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 52517. [D 20:43:31.378748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 52518. [D 20:43:31.378757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 52519. [D 20:43:31.378797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 52520. [D 20:43:31.378807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 52521. [D 20:43:31.378818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 52522. [D 20:43:31.378828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 52523. [D 20:43:31.378838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 52524. [D 20:43:31.378849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 52525. [D 20:43:31.378858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 52526. [D 20:43:31.378888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 52527. [D 20:43:31.378898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 52528. [D 20:43:31.378908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 52529. [D 20:43:31.378918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 52530. [D 20:43:31.378929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 52531. [D 20:43:31.378939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 52532. [D 20:43:31.378949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 52533. [D 20:43:31.378982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 52534. [D 20:43:31.378992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 52535. [D 20:43:31.379002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 52536. [D 20:43:31.379018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 52537. [D 20:43:31.379028] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 52538. [D 20:43:31.379041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 52539. [D 20:43:31.379054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 52540. [D 20:43:31.379064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 52541. [D 20:43:31.379074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 52542. [D 20:43:31.379099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 52543. [D 20:43:31.379110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 52544. [D 20:43:31.379120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 52545. [D 20:43:31.379130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 52546. [D 20:43:31.379141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 52547. [D 20:43:31.379163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 52548. [D 20:43:31.379174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 52549. [D 20:43:31.379184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 52550. [D 20:43:31.379200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 52551. [D 20:43:31.379210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 52552. [D 20:43:31.379220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 52553. [D 20:43:31.379236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 52554. [D 20:43:31.379246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 52555. [D 20:43:31.379256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 52556. [D 20:43:31.379286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 52557. [D 20:43:31.379296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 52558. [D 20:43:31.379308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 52559. [D 20:43:31.379318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 52560. [D 20:43:31.379328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 52561. [D 20:43:31.379351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 52562. [D 20:43:31.379362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 52563. [D 20:43:31.379372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 52564. [D 20:43:31.379381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 52565. [D 20:43:31.379399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 52566. [D 20:43:31.379409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 52567. [D 20:43:31.379419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 52568. [D 20:43:31.379429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 52569. [D 20:43:31.379459] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 52570. [D 20:43:31.390380] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52570. [D 20:43:31.390397] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 15/70. [D 20:43:31.401297] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 52569. [D 20:43:31.401312] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 16/70. [D 20:43:31.401370] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.401405] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.401414] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:31.401431] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.401440] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.401448] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.414000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.414014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.414023] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.414047] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7543 [D 20:43:31.414057] element 0: offset: 0x2aaaab208910, size: 24 [D 20:43:31.414069] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 17/70. [D 20:43:31.416371] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7543 [D 20:43:31.416390] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 18/70. [D 20:43:31.416443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 52569. [D 20:43:31.416454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 52570. [D 20:43:31.416465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 52571. [D 20:43:31.416478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 52572. [D 20:43:31.416488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 52573. [D 20:43:31.416498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52574. [D 20:43:31.416514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52575. [D 20:43:31.416525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 52576. [D 20:43:31.416534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 52577. [D 20:43:31.416551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 52578. [D 20:43:31.416561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 52579. [D 20:43:31.416571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 52580. [D 20:43:31.416597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 52581. [D 20:43:31.416607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 52582. [D 20:43:31.416621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 52583. [D 20:43:31.416631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 52584. [D 20:43:31.416641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 52585. [D 20:43:31.416669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 52586. [D 20:43:31.416680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 52587. [D 20:43:31.416702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 52588. [D 20:43:31.416712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 52589. [D 20:43:31.416722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 52590. [D 20:43:31.416737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 52591. [D 20:43:31.416747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 52592. [D 20:43:31.416773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 52593. [D 20:43:31.416790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 52594. [D 20:43:31.416800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 52595. [D 20:43:31.416810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 52596. [D 20:43:31.416820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 52597. [D 20:43:31.416831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 52598. [D 20:43:31.416841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 52599. [D 20:43:31.416852] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 52600. [D 20:43:31.426912] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52600. [D 20:43:31.426927] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 19/70. [D 20:43:31.427044] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.427086] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.427095] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.434849] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.434863] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.434871] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.434898] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7546 [D 20:43:31.434908] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:31.434921] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 20/70. [D 20:43:31.439465] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7546 [D 20:43:31.439533] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 21/70. [D 20:43:31.439611] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.439627] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.439635] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:31.439652] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7549 [D 20:43:31.439661] element 0: offset: 0x2aaaab239250, size: 24 [D 20:43:31.439672] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 22/70. [D 20:43:31.439692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 52600. [D 20:43:31.439717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 52601. [D 20:43:31.439728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 52602. [D 20:43:31.439738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 52603. [D 20:43:31.439754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 52604. [D 20:43:31.439764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 52605. [D 20:43:31.439774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 52606. [D 20:43:31.439784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 52607. [D 20:43:31.439794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 52608. [D 20:43:31.439805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 52609. [D 20:43:31.439814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 52610. [D 20:43:31.439832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 52611. [D 20:43:31.439842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 52612. [D 20:43:31.439852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 52613. [D 20:43:31.439863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 52614. [D 20:43:31.439873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 52615. [D 20:43:31.439883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 52616. [D 20:43:31.439913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 52617. [D 20:43:31.439924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 52618. [D 20:43:31.439934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 52619. [D 20:43:31.439947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 52620. [D 20:43:31.439957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 52621. [D 20:43:31.439967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 52622. [D 20:43:31.439982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 52623. [D 20:43:31.439992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 52624. [D 20:43:31.440002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 52625. [D 20:43:31.440018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 52626. [D 20:43:31.440048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 52627. [D 20:43:31.440058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 52628. [D 20:43:31.440068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 52629. [D 20:43:31.440084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 52630. [D 20:43:31.440094] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 52631. [D 20:43:31.442453] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7549 [D 20:43:31.442469] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 23/70. [D 20:43:31.450081] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 52631. [D 20:43:31.450098] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 24/70. [D 20:43:31.450110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 52631. [D 20:43:31.450120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 52632. [D 20:43:31.450131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 52633. [D 20:43:31.450142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 52634. [D 20:43:31.450152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 52635. [D 20:43:31.450162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52636. [D 20:43:31.450172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52637. [D 20:43:31.450182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 52638. [D 20:43:31.450192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 52639. [D 20:43:31.450208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 52640. [D 20:43:31.450218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 52641. [D 20:43:31.450228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 52642. [D 20:43:31.450239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 52643. [D 20:43:31.450250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 52644. [D 20:43:31.450260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 52645. [D 20:43:31.450270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 52646. [D 20:43:31.450281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 52647. [D 20:43:31.450291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 52648. [D 20:43:31.450301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 52649. [D 20:43:31.450319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 52650. [D 20:43:31.450351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 52651. [D 20:43:31.450364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 52652. [D 20:43:31.450374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 52653. [D 20:43:31.450384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 52654. [D 20:43:31.450394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 52655. [D 20:43:31.450404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 52656. [D 20:43:31.450415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 52657. [D 20:43:31.450426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 52658. [D 20:43:31.450436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 52659. [D 20:43:31.450445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 52660. [D 20:43:31.450467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 52661. [D 20:43:31.450478] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 52662. [D 20:43:31.450536] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.450582] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.450591] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:31.456030] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52662. [D 20:43:31.456047] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 25/70. [D 20:43:31.456092] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.456107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.456115] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.457112] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.457125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.457134] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.457160] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7552 [D 20:43:31.457170] element 0: offset: 0x2aaaab208d50, size: 24 [D 20:43:31.457183] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 26/70. [D 20:43:31.459583] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7552 [D 20:43:31.459650] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 27/70. [D 20:43:31.459795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 52662. [D 20:43:31.459810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 52663. [D 20:43:31.459821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 52664. [D 20:43:31.459831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 52665. [D 20:43:31.459842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 52666. [D 20:43:31.459852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 52667. [D 20:43:31.459862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 52668. [D 20:43:31.459879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 52669. [D 20:43:31.459889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 52670. [D 20:43:31.459899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 52671. [D 20:43:31.459909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 52672. [D 20:43:31.459926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 52673. [D 20:43:31.459936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 52674. [D 20:43:31.459945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 52675. [D 20:43:31.459956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 52676. [D 20:43:31.459967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 52677. [D 20:43:31.459976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 52678. [D 20:43:31.460019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 52679. [D 20:43:31.460034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 52680. [D 20:43:31.460045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 52681. [D 20:43:31.460055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 52682. [D 20:43:31.460080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 52683. [D 20:43:31.460091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 52684. [D 20:43:31.460101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 52685. [D 20:43:31.460111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 52686. [D 20:43:31.460121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 52687. [D 20:43:31.460131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 52688. [D 20:43:31.460142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 52689. [D 20:43:31.460152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 52690. [D 20:43:31.460164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 52691. [D 20:43:31.460195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 52692. [D 20:43:31.460205] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 52693. [D 20:43:31.468356] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 52693. [D 20:43:31.468373] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 28/70. [D 20:43:31.468422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.468437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.468446] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.472089] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.472103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.472111] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.472128] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7555 [D 20:43:31.472138] element 0: offset: 0x2aaaab22fde0, size: 24 [D 20:43:31.472148] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 29/70. [D 20:43:31.474512] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7555 [D 20:43:31.474531] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 30/70. [D 20:43:31.474668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 52693. [D 20:43:31.474682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 52694. [D 20:43:31.474693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 52695. [D 20:43:31.474703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 52696. [D 20:43:31.474728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 52697. [D 20:43:31.474738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52698. [D 20:43:31.474748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52699. [D 20:43:31.474760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 52700. [D 20:43:31.474769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 52701. [D 20:43:31.474780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 52702. [D 20:43:31.474790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 52703. [D 20:43:31.474814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 52704. [D 20:43:31.474830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 52705. [D 20:43:31.474840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 52706. [D 20:43:31.474850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 52707. [D 20:43:31.474860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 52708. [D 20:43:31.474885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 52709. [D 20:43:31.474895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 52710. [D 20:43:31.474910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 52711. [D 20:43:31.474921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 52712. [D 20:43:31.474931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 52713. [D 20:43:31.474955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 52714. [D 20:43:31.474965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 52715. [D 20:43:31.474975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 52716. [D 20:43:31.474989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 52717. [D 20:43:31.474999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 52718. [D 20:43:31.475009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 52719. [D 20:43:31.475033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 52720. [D 20:43:31.475044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 52721. [D 20:43:31.475054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 52722. [D 20:43:31.475065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 52723. [D 20:43:31.475075] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 52724. [D 20:43:31.483304] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52724. [D 20:43:31.483318] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 31/70. [D 20:43:31.483383] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.483426] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.483435] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.486796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.486811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.486819] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.486846] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7559 [D 20:43:31.486856] element 0: offset: 0x2aaaab208910, size: 24 [D 20:43:31.486868] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 32/70. [D 20:43:31.486900] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.486910] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.486918] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:31.486933] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7561 [D 20:43:31.486942] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:43:31.486955] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 33/70. [D 20:43:31.490934] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7559 [D 20:43:31.490954] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 34/70. [D 20:43:31.490968] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7561 [D 20:43:31.490984] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 35/70. [D 20:43:31.491087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 52724. [D 20:43:31.491100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 52725. [D 20:43:31.491111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 52726. [D 20:43:31.491121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 52727. [D 20:43:31.491131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 52728. [D 20:43:31.491147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 52729. [D 20:43:31.491157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 52730. [D 20:43:31.491167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 52731. [D 20:43:31.491197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 52732. [D 20:43:31.491209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 52733. [D 20:43:31.491220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 52734. [D 20:43:31.491229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 52735. [D 20:43:31.491246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 52736. [D 20:43:31.491256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 52737. [D 20:43:31.491280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 52738. [D 20:43:31.491291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 52739. [D 20:43:31.491301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 52740. [D 20:43:31.491329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 52741. [D 20:43:31.491339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 52742. [D 20:43:31.491352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 52743. [D 20:43:31.491362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 52744. [D 20:43:31.491378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 52745. [D 20:43:31.491414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 52746. [D 20:43:31.491425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 52747. [D 20:43:31.491434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 52748. [D 20:43:31.491444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 52749. [D 20:43:31.491489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 52750. [D 20:43:31.491499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 52751. [D 20:43:31.491509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 52752. [D 20:43:31.491520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 52753. [D 20:43:31.491530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 52754. [D 20:43:31.491540] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 52755. [D 20:43:31.491551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 52756. [D 20:43:31.491568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 52757. [D 20:43:31.491578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 52758. [D 20:43:31.491588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 52759. [D 20:43:31.491619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 52760. [D 20:43:31.491634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 52761. [D 20:43:31.491645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 52762. [D 20:43:31.491655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 52763. [D 20:43:31.491671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 52764. [D 20:43:31.491694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 52765. [D 20:43:31.491707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 52766. [D 20:43:31.491717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 52767. [D 20:43:31.491729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 52768. [D 20:43:31.491745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 52769. [D 20:43:31.491755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 52770. [D 20:43:31.491765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 52771. [D 20:43:31.491775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 52772. [D 20:43:31.491792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 52773. [D 20:43:31.491802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 52774. [D 20:43:31.491812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 52775. [D 20:43:31.491822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 52776. [D 20:43:31.491833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 52777. [D 20:43:31.491860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 52778. [D 20:43:31.491875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 52779. [D 20:43:31.491885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 52780. [D 20:43:31.491895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 52781. [D 20:43:31.491918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 52782. [D 20:43:31.491928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 52783. [D 20:43:31.491938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 52784. [D 20:43:31.491949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 52785. [D 20:43:31.491959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 52786. [D 20:43:31.491969] openib_post_sr_rdmaw: ibv_post_send wr_id 64d7f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 52787. [D 20:43:31.497928] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52787. [D 20:43:31.497979] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 36/70. [D 20:43:31.503804] openib_check_cq: completed rdma wr_id 64d7f0, nic_wr_credit 52786. [D 20:43:31.503823] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 37/70. [D 20:43:31.503876] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.503892] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.503900] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:31.503918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.503927] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.503935] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.540429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.540444] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.540452] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.540479] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7563 [D 20:43:31.540489] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:43:31.540500] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 38/70. [D 20:43:31.542849] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7563 [D 20:43:31.542868] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 39/70. [D 20:43:31.542911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 52786. [D 20:43:31.542923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 52787. [D 20:43:31.542933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 52788. [D 20:43:31.542944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 52789. [D 20:43:31.542953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 52790. [D 20:43:31.542969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 52791. [D 20:43:31.542979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 52792. [D 20:43:31.542989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 52793. [D 20:43:31.543005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 52794. [D 20:43:31.543033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 52795. [D 20:43:31.543043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 52796. [D 20:43:31.543058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 52797. [D 20:43:31.543068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 52798. [D 20:43:31.543088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 52799. [D 20:43:31.543100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 52800. [D 20:43:31.543110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 52801. [D 20:43:31.543121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 52802. [D 20:43:31.543131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 52803. [D 20:43:31.543141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 52804. [D 20:43:31.543156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 52805. [D 20:43:31.543167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 52806. [D 20:43:31.543189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 52807. [D 20:43:31.543203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 52808. [D 20:43:31.543213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 52809. [D 20:43:31.543223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 52810. [D 20:43:31.543239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 52811. [D 20:43:31.543258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 52812. [D 20:43:31.543269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 52813. [D 20:43:31.543279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 52814. [D 20:43:31.543290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 52815. [D 20:43:31.543300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 52816. [D 20:43:31.543314] openib_post_sr_rdmaw: ibv_post_send wr_id 63fdb0 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 52817. [D 20:43:31.548773] openib_check_cq: completed rdma wr_id 63fdb0, nic_wr_credit 52817. [D 20:43:31.548787] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 40/70. [D 20:43:31.548852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.548889] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.548898] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.740941] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.740955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.740963] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.740990] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7567 [D 20:43:31.741000] element 0: offset: 0x2aaaab239250, size: 24 [D 20:43:31.741013] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 41/70. [D 20:43:31.743313] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7567 [D 20:43:31.743332] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 42/70. [D 20:43:31.743381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 52817. [D 20:43:31.743394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 52818. [D 20:43:31.743406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 52819. [D 20:43:31.743417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 52820. [D 20:43:31.743427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 52821. [D 20:43:31.743437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52822. [D 20:43:31.743447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52823. [D 20:43:31.743462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 52824. [D 20:43:31.743472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 52825. [D 20:43:31.743482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 52826. [D 20:43:31.743492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 52827. [D 20:43:31.743510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 52828. [D 20:43:31.743520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 52829. [D 20:43:31.743550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 52830. [D 20:43:31.743561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 52831. [D 20:43:31.743571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 52832. [D 20:43:31.743586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 52833. [D 20:43:31.743595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 52834. [D 20:43:31.743606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 52835. [D 20:43:31.743632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 52836. [D 20:43:31.743643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 52837. [D 20:43:31.743652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 52838. [D 20:43:31.743667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 52839. [D 20:43:31.743677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 52840. [D 20:43:31.743687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 52841. [D 20:43:31.743703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 52842. [D 20:43:31.743713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 52843. [D 20:43:31.743722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 52844. [D 20:43:31.743750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 52845. [D 20:43:31.743760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 52846. [D 20:43:31.743771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 52847. [D 20:43:31.743785] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 52848. [D 20:43:31.753281] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52848. [D 20:43:31.753296] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 43/70. [D 20:43:31.753411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.753447] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.753456] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.784255] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.784269] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.784278] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.784303] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7572 [D 20:43:31.784313] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:31.784326] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 44/70. [D 20:43:31.784718] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.784733] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.784742] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:31.784760] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7575 [D 20:43:31.784770] element 0: offset: 0x2aaaab208d50, size: 24 [D 20:43:31.784781] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 45/70. [D 20:43:31.784801] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.784811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.784819] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:31.784834] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7576 [D 20:43:31.784843] element 0: offset: 0x2aaaab203000, size: 24 [D 20:43:31.784854] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 46/70. [D 20:43:31.784878] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.784888] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.784896] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:31.784910] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7579 [D 20:43:31.784919] element 0: offset: 0x2aaaab22fde0, size: 24 [D 20:43:31.784929] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 47/70. [D 20:43:31.789270] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7572 [D 20:43:31.789388] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 48/70. [D 20:43:31.789445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 52848. [D 20:43:31.789461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 52849. [D 20:43:31.789488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 52850. [D 20:43:31.789500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 52851. [D 20:43:31.789515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 52852. [D 20:43:31.789525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 52853. [D 20:43:31.789535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 52854. [D 20:43:31.789548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 52855. [D 20:43:31.789558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 52856. [D 20:43:31.789569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 52857. [D 20:43:31.789579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 52858. [D 20:43:31.789589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 52859. [D 20:43:31.789599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 52860. [D 20:43:31.789620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 52861. [D 20:43:31.789630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 52862. [D 20:43:31.789640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 52863. [D 20:43:31.789650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 52864. [D 20:43:31.789661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 52865. [D 20:43:31.789673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 52866. [D 20:43:31.789701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 52867. [D 20:43:31.789712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 52868. [D 20:43:31.789723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 52869. [D 20:43:31.789733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 52870. [D 20:43:31.789743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 52871. [D 20:43:31.789754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 52872. [D 20:43:31.789764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 52873. [D 20:43:31.789774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 52874. [D 20:43:31.789800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 52875. [D 20:43:31.789811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 52876. [D 20:43:31.789821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 52877. [D 20:43:31.789843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 52878. [D 20:43:31.789855] openib_post_sr_rdmaw: ibv_post_send wr_id 63fdb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 52879. [D 20:43:31.793704] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7576 [D 20:43:31.793758] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 49/70. [D 20:43:31.794808] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7575 [D 20:43:31.794827] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 50/70. [D 20:43:31.794840] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7579 [D 20:43:31.794851] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 51/70. [D 20:43:31.796976] openib_check_cq: completed rdma wr_id 63fdb0, nic_wr_credit 52879. [D 20:43:31.797037] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 52/70. [D 20:43:31.797056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 52879. [D 20:43:31.797067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 52880. [D 20:43:31.797078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 52881. [D 20:43:31.797088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 52882. [D 20:43:31.797103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 52883. [D 20:43:31.797113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 52884. [D 20:43:31.797123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 52885. [D 20:43:31.797139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 52886. [D 20:43:31.797148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 52887. [D 20:43:31.797158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 52888. [D 20:43:31.797174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 52889. [D 20:43:31.797184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 52890. [D 20:43:31.797194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 52891. [D 20:43:31.797209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 52892. [D 20:43:31.797219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 52893. [D 20:43:31.797229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 52894. [D 20:43:31.797244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 52895. [D 20:43:31.797254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 52896. [D 20:43:31.797264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 52897. [D 20:43:31.797307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 52898. [D 20:43:31.797317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 52899. [D 20:43:31.797327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 52900. [D 20:43:31.797337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 52901. [D 20:43:31.797348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 52902. [D 20:43:31.797358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 52903. [D 20:43:31.797383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 52904. [D 20:43:31.797393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 52905. [D 20:43:31.797404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 52906. [D 20:43:31.797414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 52907. [D 20:43:31.797424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 52908. [D 20:43:31.797440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 52909. [D 20:43:31.797451] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 52910. [D 20:43:31.797463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 52911. [D 20:43:31.797481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 52912. [D 20:43:31.797492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 52913. [D 20:43:31.797502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 52914. [D 20:43:31.797537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 52915. [D 20:43:31.797547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 52916. [D 20:43:31.797561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 52917. [D 20:43:31.797571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 52918. [D 20:43:31.797581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 52919. [D 20:43:31.797595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 52920. [D 20:43:31.797605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 52921. [D 20:43:31.797615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 52922. [D 20:43:31.797630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 52923. [D 20:43:31.797640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 52924. [D 20:43:31.797650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 52925. [D 20:43:31.797680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 52926. [D 20:43:31.797691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 52927. [D 20:43:31.797702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 52928. [D 20:43:31.797712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 52929. [D 20:43:31.797722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 52930. [D 20:43:31.797733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 52931. [D 20:43:31.797743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 52932. [D 20:43:31.797769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 52933. [D 20:43:31.797778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 52934. [D 20:43:31.797788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 52935. [D 20:43:31.797802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 52936. [D 20:43:31.797812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 52937. [D 20:43:31.797822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 52938. [D 20:43:31.797832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 52939. [D 20:43:31.797842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 52940. [D 20:43:31.797866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 52941. [D 20:43:31.797877] openib_post_sr_rdmaw: ibv_post_send wr_id 64d010 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 52942. [D 20:43:31.797888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 52943. [D 20:43:31.797899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 52944. [D 20:43:31.797911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 52945. [D 20:43:31.797921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 52946. [D 20:43:31.797940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 52947. [D 20:43:31.797958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52948. [E 20:43:31.797972] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52949, block for 10 ms. [D 20:43:31.797997] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 52948. [D 20:43:31.798008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52949. [E 20:43:31.798020] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 52950, block for 10 ms. [D 20:43:31.808590] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 52949. [D 20:43:31.808606] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 53/70. [D 20:43:31.808618] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 52948. [D 20:43:31.808629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 52949. [D 20:43:31.808639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 52950. [D 20:43:31.808649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 52951. [D 20:43:31.808660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 52952. [D 20:43:31.808670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 52953. [D 20:43:31.808680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 52954. [D 20:43:31.808690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 52955. [D 20:43:31.808700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 52956. [D 20:43:31.808722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 52957. [D 20:43:31.808732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 52958. [D 20:43:31.808742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 52959. [D 20:43:31.808753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 52960. [D 20:43:31.808764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 52961. [D 20:43:31.808793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 52962. [D 20:43:31.808808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 52963. [D 20:43:31.808819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 52964. [D 20:43:31.808829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 52965. [D 20:43:31.808857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 52966. [D 20:43:31.808868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 52967. [D 20:43:31.808880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 52968. [D 20:43:31.808890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 52969. [D 20:43:31.808908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 52970. [D 20:43:31.808932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 52971. [D 20:43:31.808943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 52972. [D 20:43:31.808953] openib_post_sr_rdmaw: ibv_post_send wr_id 64d7f0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 52973. [D 20:43:31.809029] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.809044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.809053] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:31.813220] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.813234] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.813242] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:31.813267] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7582 [D 20:43:31.813277] element 0: offset: 0x2aaaab2327e0, size: 24 [D 20:43:31.813289] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 54/70. [D 20:43:31.820272] openib_check_cq: completed rdma wr_id 64d010, nic_wr_credit 52973. [D 20:43:31.820291] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 55/70. [D 20:43:31.822480] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.822495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.822504] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:31.831965] openib_check_cq: completed rdma wr_id 64d7f0, nic_wr_credit 52972. [D 20:43:31.831983] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 56/70. [D 20:43:31.832022] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.832036] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.832044] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:31.832104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.832114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.832122] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:31.834482] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7582 [D 20:43:31.834524] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 57/70. [D 20:43:31.837805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 52972. [D 20:43:31.837824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 52973. [D 20:43:31.837836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 52974. [D 20:43:31.837846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 52975. [D 20:43:31.837856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 52976. [D 20:43:31.837867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 52977. [D 20:43:31.837879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 52978. [D 20:43:31.837889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 52979. [D 20:43:31.837899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 52980. [D 20:43:31.837917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 52981. [D 20:43:31.837927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 52982. [D 20:43:31.837937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 52983. [D 20:43:31.837948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 52984. [D 20:43:31.837959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 52985. [D 20:43:31.837969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 52986. [D 20:43:31.837999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 52987. [D 20:43:31.838011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 52988. [D 20:43:31.838021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 52989. [D 20:43:31.838031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 52990. [D 20:43:31.838041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 52991. [D 20:43:31.838056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 52992. [D 20:43:31.838080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 52993. [D 20:43:31.838090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 52994. [D 20:43:31.838104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 52995. [D 20:43:31.838114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 52996. [D 20:43:31.838124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 52997. [D 20:43:31.838140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 52998. [D 20:43:31.838162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 52999. [D 20:43:31.838175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 53000. [D 20:43:31.838185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 53001. [D 20:43:31.838197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 53002. [D 20:43:31.838213] openib_post_sr_rdmaw: ibv_post_send wr_id 63fdb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 53003. [D 20:43:31.843737] openib_check_cq: completed rdma wr_id 63fdb0, nic_wr_credit 53003. [D 20:43:31.843752] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 58/70. [D 20:43:31.843808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.843824] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.843833] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.852043] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.852057] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.852065] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.852091] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7585 [D 20:43:31.852101] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:43:31.852112] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 59/70. [D 20:43:31.852192] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.852204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.852213] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:31.852228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7588 [D 20:43:31.852237] element 0: offset: 0x2aaaab23f770, size: 24 [D 20:43:31.852248] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 60/70. [D 20:43:31.854998] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7585 [D 20:43:31.855055] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 0/70. [D 20:43:31.855194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 53003. [D 20:43:31.855254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 53004. [D 20:43:31.855265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 53005. [D 20:43:31.855276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 53006. [D 20:43:31.855287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 53007. [D 20:43:31.855297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 53008. [D 20:43:31.855307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 53009. [D 20:43:31.855326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 53010. [D 20:43:31.855337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 53011. [D 20:43:31.855347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 53012. [D 20:43:31.855366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 53013. [D 20:43:31.855376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 53014. [D 20:43:31.855386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 53015. [D 20:43:31.855397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 53016. [D 20:43:31.855407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 53017. [D 20:43:31.855417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 53018. [D 20:43:31.855427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 53019. [D 20:43:31.855445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 53020. [D 20:43:31.855455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 53021. [D 20:43:31.855465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 53022. [D 20:43:31.855476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 53023. [D 20:43:31.855486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 53024. [D 20:43:31.855522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 53025. [D 20:43:31.855537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 53026. [D 20:43:31.855547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 53027. [D 20:43:31.855558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 53028. [D 20:43:31.855574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 53029. [D 20:43:31.855597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 53030. [D 20:43:31.855610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 53031. [D 20:43:31.855620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 53032. [D 20:43:31.855639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 53033. [D 20:43:31.855663] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 53034. [D 20:43:31.859870] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7588 [D 20:43:31.859890] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 1/70. [D 20:43:31.861226] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 53034. [D 20:43:31.861277] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 2/70. [D 20:43:31.861294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 53034. [D 20:43:31.861305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 53035. [D 20:43:31.861317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 53036. [D 20:43:31.861327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 53037. [D 20:43:31.861338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 53038. [D 20:43:31.861348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 53039. [D 20:43:31.861358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53040. [D 20:43:31.861373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 53041. [D 20:43:31.861384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 53042. [D 20:43:31.861394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 53043. [D 20:43:31.861404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 53044. [D 20:43:31.861421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 53045. [D 20:43:31.861450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 53046. [D 20:43:31.861461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 53047. [D 20:43:31.861471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 53048. [D 20:43:31.861492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 53049. [D 20:43:31.861502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 53050. [D 20:43:31.861512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 53051. [D 20:43:31.861538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 53052. [D 20:43:31.861548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 53053. [D 20:43:31.861563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 53054. [D 20:43:31.861574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 53055. [D 20:43:31.861584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 53056. [D 20:43:31.861594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 53057. [D 20:43:31.861604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 53058. [D 20:43:31.861615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 53059. [D 20:43:31.861629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 53060. [D 20:43:31.861639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 53061. [D 20:43:31.861649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 53062. [D 20:43:31.861660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 53063. [D 20:43:31.861679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 53064. [D 20:43:31.861689] openib_post_sr_rdmaw: ibv_post_send wr_id 63fdb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 53065. [D 20:43:31.861770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.861785] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.861794] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:31.863577] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.863591] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.863599] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:31.863625] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7591 [D 20:43:31.863635] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:43:31.863646] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 3/70. [D 20:43:31.872919] openib_check_cq: completed rdma wr_id 63fdb0, nic_wr_credit 53065. [D 20:43:31.872939] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 4/70. [D 20:43:31.873056] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.873070] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.873079] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:31.877124] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7591 [D 20:43:31.877141] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 5/70. [D 20:43:31.878735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 53065. [D 20:43:31.878787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 53066. [D 20:43:31.878798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 53067. [D 20:43:31.878809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 53068. [D 20:43:31.878820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 53069. [D 20:43:31.878829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 53070. [D 20:43:31.878840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 53071. [D 20:43:31.878855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 53072. [D 20:43:31.878866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 53073. [D 20:43:31.878876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 53074. [D 20:43:31.878886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 53075. [D 20:43:31.878902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 53076. [D 20:43:31.878912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 53077. [D 20:43:31.878922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 53078. [D 20:43:31.878954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 53079. [D 20:43:31.878965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 53080. [D 20:43:31.878976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 53081. [D 20:43:31.878986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 53082. [D 20:43:31.878997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 53083. [D 20:43:31.879007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 53084. [D 20:43:31.879028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 53085. [D 20:43:31.879044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 53086. [D 20:43:31.879054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 53087. [D 20:43:31.879078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 53088. [D 20:43:31.879088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 53089. [D 20:43:31.879098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 53090. [D 20:43:31.879114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 53091. [D 20:43:31.879124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 53092. [D 20:43:31.879134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 53093. [D 20:43:31.879162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 53094. [D 20:43:31.879178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 53095. [D 20:43:31.879188] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 53096. [D 20:43:31.885589] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.885605] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.885613] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:31.885630] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7593 [D 20:43:31.885639] element 0: offset: 0x2aaaab239250, size: 24 [D 20:43:31.885650] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 6/70. [D 20:43:31.888154] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.888167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.888176] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:31.888191] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7597 [D 20:43:31.888201] element 0: offset: 0x2aaaab22c060, size: 24 [D 20:43:31.888213] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 7/70. [D 20:43:31.890507] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 53096. [D 20:43:31.890527] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 8/70. [D 20:43:31.890616] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.890631] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.890640] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:31.894607] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7597 [D 20:43:31.894651] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 9/70. [D 20:43:31.895080] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7593 [D 20:43:31.895098] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 10/70. [D 20:43:31.896366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 53096. [D 20:43:31.896385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 53097. [D 20:43:31.896397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 53098. [D 20:43:31.896407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 53099. [D 20:43:31.896418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 53100. [D 20:43:31.896428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 53101. [D 20:43:31.896438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53102. [D 20:43:31.896448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 53103. [D 20:43:31.896464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 53104. [D 20:43:31.896475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 53105. [D 20:43:31.896485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 53106. [D 20:43:31.896495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 53107. [D 20:43:31.896506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 53108. [D 20:43:31.896516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 53109. [D 20:43:31.896531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 53110. [D 20:43:31.896558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 53111. [D 20:43:31.896569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 53112. [D 20:43:31.896579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 53113. [D 20:43:31.896589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 53114. [D 20:43:31.896599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 53115. [D 20:43:31.896623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 53116. [D 20:43:31.896633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 53117. [D 20:43:31.896643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 53118. [D 20:43:31.896654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 53119. [D 20:43:31.896665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 53120. [D 20:43:31.896686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 53121. [D 20:43:31.896701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 53122. [D 20:43:31.896714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 53123. [D 20:43:31.896724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 53124. [D 20:43:31.896734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 53125. [D 20:43:31.896744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 53126. [D 20:43:31.896763] openib_post_sr_rdmaw: ibv_post_send wr_id 63fdb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 53127. [D 20:43:31.896788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 53128. [D 20:43:31.896803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 53129. [D 20:43:31.896813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 53130. [D 20:43:31.896823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 53131. [D 20:43:31.896837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 53132. [D 20:43:31.896847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 53133. [D 20:43:31.896857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 53134. [D 20:43:31.896872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 53135. [D 20:43:31.896893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 53136. [D 20:43:31.896903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 53137. [D 20:43:31.896917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 53138. [D 20:43:31.896927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 53139. [D 20:43:31.896937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 53140. [D 20:43:31.896948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 53141. [D 20:43:31.896958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 53142. [D 20:43:31.896977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 53143. [D 20:43:31.896987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 53144. [D 20:43:31.896997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 53145. [D 20:43:31.897007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 53146. [D 20:43:31.897033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 53147. [D 20:43:31.897043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 53148. [D 20:43:31.897053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 53149. [D 20:43:31.897064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 53150. [D 20:43:31.897075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 53151. [D 20:43:31.897085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 53152. [D 20:43:31.897095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 53153. [D 20:43:31.897106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 53154. [D 20:43:31.897116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 53155. [D 20:43:31.897126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 53156. [D 20:43:31.897143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 53157. [D 20:43:31.897153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 53158. [D 20:43:31.897163] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 53159. [D 20:43:31.898990] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.899007] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.899016] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:31.899044] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7600 [D 20:43:31.899055] element 0: offset: 0x2aaaab208d50, size: 24 [D 20:43:31.899066] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 11/70. [D 20:43:31.907253] openib_check_cq: completed rdma wr_id 63fdb0, nic_wr_credit 53159. [D 20:43:31.907271] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 12/70. [D 20:43:31.913712] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 53158. [D 20:43:31.913726] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 13/70. [D 20:43:31.913775] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.913790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.913799] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:31.913854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.913865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.913873] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:31.917849] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7600 [D 20:43:31.917866] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 14/70. [D 20:43:31.917922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 53158. [D 20:43:31.917976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 53159. [D 20:43:31.917987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 53160. [D 20:43:31.918033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 53161. [D 20:43:31.918045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 53162. [D 20:43:31.918056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 53163. [D 20:43:31.918067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 53164. [D 20:43:31.918077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 53165. [D 20:43:31.918087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 53166. [D 20:43:31.918098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 53167. [D 20:43:31.918108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 53168. [D 20:43:31.918136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 53169. [D 20:43:31.918147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 53170. [D 20:43:31.918157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 53171. [D 20:43:31.918167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 53172. [D 20:43:31.918177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 53173. [D 20:43:31.918187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 53174. [D 20:43:31.918197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 53175. [D 20:43:31.918231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 53176. [D 20:43:31.918242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 53177. [D 20:43:31.918253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 53178. [D 20:43:31.918263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 53179. [D 20:43:31.918292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 53180. [D 20:43:31.918302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 53181. [D 20:43:31.918313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 53182. [D 20:43:31.918326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 53183. [D 20:43:31.918337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 53184. [D 20:43:31.918360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 53185. [D 20:43:31.918371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 53186. [D 20:43:31.918380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 53187. [D 20:43:31.918395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 53188. [D 20:43:31.918405] openib_post_sr_rdmaw: ibv_post_send wr_id 63fdb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 53189. [D 20:43:31.923831] openib_check_cq: completed rdma wr_id 63fdb0, nic_wr_credit 53189. [D 20:43:31.923848] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 15/70. [D 20:43:31.923914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.923929] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.923937] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:31.970994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:31.971008] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.971016] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:31.971033] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7603 [D 20:43:31.971042] element 0: offset: 0x2aaaab203000, size: 24 [D 20:43:31.971053] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 16/70. [D 20:43:31.973446] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7603 [D 20:43:31.973497] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 17/70. [D 20:43:31.973543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 53189. [D 20:43:31.973560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 53190. [D 20:43:31.973570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 53191. [D 20:43:31.973580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 53192. [D 20:43:31.973590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 53193. [D 20:43:31.973600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 53194. [D 20:43:31.973611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 53195. [D 20:43:31.973621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 53196. [D 20:43:31.973638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 53197. [D 20:43:31.973649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 53198. [D 20:43:31.973659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 53199. [D 20:43:31.973669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 53200. [D 20:43:31.973687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 53201. [D 20:43:31.973712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 53202. [D 20:43:31.973727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 53203. [D 20:43:31.973737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 53204. [D 20:43:31.973747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 53205. [D 20:43:31.973761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 53206. [D 20:43:31.973771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 53207. [D 20:43:31.973781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 53208. [D 20:43:31.973796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 53209. [D 20:43:31.973820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 53210. [D 20:43:31.973830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 53211. [D 20:43:31.973845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 53212. [D 20:43:31.973855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 53213. [D 20:43:31.973865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 53214. [D 20:43:31.973893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 53215. [D 20:43:31.973904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 53216. [D 20:43:31.973917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 53217. [D 20:43:31.973927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 53218. [D 20:43:31.973941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 53219. [D 20:43:31.973965] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 53220. [D 20:43:31.979418] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 53220. [D 20:43:31.979434] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 18/70. [D 20:43:31.979497] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:31.979513] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:31.979522] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:32.210108] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.210122] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.210131] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:32.210156] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7606 [D 20:43:32.210166] element 0: offset: 0x2aaaab2327e0, size: 24 [D 20:43:32.210177] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 19/70. [D 20:43:32.210262] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.210274] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.210283] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:32.210298] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7609 [D 20:43:32.210308] element 0: offset: 0x2aaaab22fde0, size: 24 [D 20:43:32.210318] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 20/70. [D 20:43:32.212786] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7606 [D 20:43:32.212831] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 21/70. [D 20:43:32.214792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 53220. [D 20:43:32.214856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 53221. [D 20:43:32.214869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 53222. [D 20:43:32.214880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 53223. [D 20:43:32.214890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 53224. [D 20:43:32.214900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 53225. [D 20:43:32.214910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 53226. [D 20:43:32.214921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 53227. [D 20:43:32.214931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 53228. [D 20:43:32.214940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 53229. [D 20:43:32.214950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 53230. [D 20:43:32.214991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 53231. [D 20:43:32.215001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 53232. [D 20:43:32.215016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 53233. [D 20:43:32.215026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 53234. [D 20:43:32.215051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 53235. [D 20:43:32.215061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 53236. [D 20:43:32.215073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 53237. [D 20:43:32.215101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 53238. [D 20:43:32.215111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 53239. [D 20:43:32.215133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 53240. [D 20:43:32.215143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 53241. [D 20:43:32.215168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 53242. [D 20:43:32.215178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 53243. [D 20:43:32.215202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 53244. [D 20:43:32.215250] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7609 [D 20:43:32.215264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 53245. [D 20:43:32.215280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 53246. [D 20:43:32.215298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 53247. [D 20:43:32.215309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 53248. [D 20:43:32.215332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 53249. [D 20:43:32.215342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 53250. [D 20:43:32.215357] openib_post_sr_rdmaw: ibv_post_send wr_id 63fdb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 53251. [D 20:43:32.215392] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 22/70. [D 20:43:32.219389] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.219406] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.219415] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:32.219441] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7612 [D 20:43:32.219451] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:43:32.219462] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 23/70. [D 20:43:32.225188] openib_check_cq: completed rdma wr_id 63fdb0, nic_wr_credit 53251. [D 20:43:32.225206] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 24/70. [D 20:43:32.225284] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.225299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.225307] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:32.227435] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7612 [D 20:43:32.227453] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 25/70. [D 20:43:32.229171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 53251. [D 20:43:32.229186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 53252. [D 20:43:32.229198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 53253. [D 20:43:32.229208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 53254. [D 20:43:32.229220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 53255. [D 20:43:32.229236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 53256. [D 20:43:32.229246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53257. [D 20:43:32.229256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 53258. [D 20:43:32.229272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 53259. [D 20:43:32.229282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 53260. [D 20:43:32.229292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 53261. [D 20:43:32.229331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 53262. [D 20:43:32.229341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 53263. [D 20:43:32.229351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 53264. [D 20:43:32.229361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 53265. [D 20:43:32.229392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 53266. [D 20:43:32.229402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 53267. [D 20:43:32.229417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 53268. [D 20:43:32.229427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 53269. [D 20:43:32.229437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 53270. [D 20:43:32.229451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 53271. [D 20:43:32.229461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 53272. [D 20:43:32.229471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 53273. [D 20:43:32.229500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 53274. [D 20:43:32.229510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 53275. [D 20:43:32.229523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 53276. [D 20:43:32.229533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 53277. [D 20:43:32.229543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 53278. [D 20:43:32.229556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 53279. [D 20:43:32.229566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 53280. [D 20:43:32.229589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 53281. [D 20:43:32.229604] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 53282. [D 20:43:32.229616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 53283. [D 20:43:32.229638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 53284. [D 20:43:32.229653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 53285. [D 20:43:32.229663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 53286. [D 20:43:32.229673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 53287. [D 20:43:32.229689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 53288. [D 20:43:32.229699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 53289. [D 20:43:32.229725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 53290. [D 20:43:32.229735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 53291. [D 20:43:32.229748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 53292. [D 20:43:32.229763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 53293. [D 20:43:32.229773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 53294. [D 20:43:32.229783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 53295. [D 20:43:32.229810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 53296. [D 20:43:32.229820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 53297. [D 20:43:32.229834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 53298. [D 20:43:32.229844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 53299. [D 20:43:32.229859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 53300. [D 20:43:32.229870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 53301. [D 20:43:32.229895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 53302. [D 20:43:32.229918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 53303. [D 20:43:32.229928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 53304. [D 20:43:32.229939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 53305. [D 20:43:32.229949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 53306. [D 20:43:32.229959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 53307. [D 20:43:32.229970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 53308. [D 20:43:32.229980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 53309. [D 20:43:32.230010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 53310. [D 20:43:32.230022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 53311. [D 20:43:32.230032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 53312. [D 20:43:32.230042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 53313. [D 20:43:32.230052] openib_post_sr_rdmaw: ibv_post_send wr_id 63fdb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 53314. [D 20:43:32.230106] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.230136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.230146] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:32.230176] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7615 [D 20:43:32.230186] element 0: offset: 0x2aaaab20ff10, size: 24 [D 20:43:32.230200] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 26/70. [D 20:43:32.235129] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 53314. [D 20:43:32.235146] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 27/70. [D 20:43:32.245011] openib_check_cq: completed rdma wr_id 63fdb0, nic_wr_credit 53313. [D 20:43:32.245025] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 28/70. [D 20:43:32.245074] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.245089] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.245098] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:32.245182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.245192] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.245200] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:32.247454] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7615 [D 20:43:32.247470] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 29/70. [D 20:43:32.247602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 53313. [D 20:43:32.247617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 53314. [D 20:43:32.247628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 53315. [D 20:43:32.247638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 53316. [D 20:43:32.247649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 53317. [D 20:43:32.247659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 53318. [D 20:43:32.247669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 53319. [D 20:43:32.247696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 53320. [D 20:43:32.247712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 53321. [D 20:43:32.247722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 53322. [D 20:43:32.247733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 53323. [D 20:43:32.247743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 53324. [D 20:43:32.247753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 53325. [D 20:43:32.247763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 53326. [D 20:43:32.247773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 53327. [D 20:43:32.247783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 53328. [D 20:43:32.247802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 53329. [D 20:43:32.247811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 53330. [D 20:43:32.247836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 53331. [D 20:43:32.247847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 53332. [D 20:43:32.247857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 53333. [D 20:43:32.247867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 53334. [D 20:43:32.247879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 53335. [D 20:43:32.247888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 53336. [D 20:43:32.247904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 53337. [D 20:43:32.247927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 53338. [D 20:43:32.247938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 53339. [D 20:43:32.247951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 53340. [D 20:43:32.247961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 53341. [D 20:43:32.247971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 53342. [D 20:43:32.247986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 53343. [D 20:43:32.247997] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 53344. [D 20:43:32.259411] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 53344. [D 20:43:32.259425] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 30/70. [D 20:43:32.259537] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.259566] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.259574] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:32.282360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.282374] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.282382] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:32.282411] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7619 [D 20:43:32.282421] element 0: offset: 0x64d8f0, size: 24 [D 20:43:32.282433] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 31/70. [D 20:43:32.282573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.282586] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.282594] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:32.282612] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7623 [D 20:43:32.282621] element 0: offset: 0x658580, size: 24 [D 20:43:32.282631] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 32/70. [D 20:43:32.284670] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.284683] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.284692] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:32.284707] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7625 [D 20:43:32.284717] element 0: offset: 0x6585a0, size: 24 [D 20:43:32.286572] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 33/70. [D 20:43:32.286583] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7619 [D 20:43:32.286611] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.286653] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 34/70. [D 20:43:32.286722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 53344. [D 20:43:32.286737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 53345. [D 20:43:32.286747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 53346. [D 20:43:32.286757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 53347. [D 20:43:32.286769] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.286776] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7623 [D 20:43:32.286770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 53348. [D 20:43:32.286825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 53349. [D 20:43:32.286793] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:32.286847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 53350. [D 20:43:32.286867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 53351. [D 20:43:32.286878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 53352. [D 20:43:32.286894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 53353. [D 20:43:32.286904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 53354. [D 20:43:32.286914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 53355. [D 20:43:32.286877] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7627 [D 20:43:32.286924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 53356. [D 20:43:32.286939] element 0: offset: 0x5b0030, size: 24 [D 20:43:32.286951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 53357. [D 20:43:32.286975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 53358. [D 20:43:32.287019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 53359. [D 20:43:32.287030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 53360. [D 20:43:32.287040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 53361. [D 20:43:32.287050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 53362. [D 20:43:32.287064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 53363. [D 20:43:32.287074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 53364. [D 20:43:32.287084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 53365. [D 20:43:32.287094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 53366. [D 20:43:32.287104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 53367. [D 20:43:32.287114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 53368. [D 20:43:32.287124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 53369. [D 20:43:32.287134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 53370. [D 20:43:32.287144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 53371. [D 20:43:32.287192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 53372. [D 20:43:32.287202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 53373. [D 20:43:32.287221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 53374. [D 20:43:32.287232] openib_post_sr_rdmaw: ibv_post_send wr_id 61f280 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 53375. [D 20:43:32.287247] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 35/70. [D 20:43:32.287268] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 36/70. [D 20:43:32.289697] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7625 [D 20:43:32.289715] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 37/70. [D 20:43:32.292911] openib_check_cq: completed rdma wr_id 61f280, nic_wr_credit 53375. [D 20:43:32.292927] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 38/70. [D 20:43:32.292951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 53375. [D 20:43:32.292963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 53376. [D 20:43:32.292973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 53377. [D 20:43:32.292983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 53378. [D 20:43:32.292993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 53379. [D 20:43:32.293004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 53380. [D 20:43:32.293014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53381. [D 20:43:32.293024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 53382. [D 20:43:32.293051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 53383. [D 20:43:32.293061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 53384. [D 20:43:32.293071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 53385. [D 20:43:32.293081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 53386. [D 20:43:32.293092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 53387. [D 20:43:32.293103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 53388. [D 20:43:32.293113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 53389. [D 20:43:32.293123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 53390. [D 20:43:32.293133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 53391. [D 20:43:32.293143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 53392. [D 20:43:32.293153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 53393. [D 20:43:32.293163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 53394. [D 20:43:32.293173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 53395. [D 20:43:32.293204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 53396. [D 20:43:32.293214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 53397. [D 20:43:32.295375] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7627 [D 20:43:32.295439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 53398. [D 20:43:32.295451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 53399. [D 20:43:32.295466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 53400. [D 20:43:32.295476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 53401. [D 20:43:32.295486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 53402. [D 20:43:32.295499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 53403. [D 20:43:32.295509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 53404. [D 20:43:32.295519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 53405. [D 20:43:32.295535] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 53406. [D 20:43:32.295552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 53407. [D 20:43:32.295567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 53408. [D 20:43:32.295577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 53409. [D 20:43:32.295587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 53410. [D 20:43:32.295622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 53411. [D 20:43:32.295633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 53412. [D 20:43:32.295644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 53413. [D 20:43:32.295653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 53414. [D 20:43:32.295681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 53415. [D 20:43:32.295691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 53416. [D 20:43:32.295706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 53417. [D 20:43:32.295715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 53418. [D 20:43:32.295725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 53419. [D 20:43:32.295742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 53420. [D 20:43:32.295751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 53421. [D 20:43:32.295761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 53422. [D 20:43:32.295796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 53423. [D 20:43:32.295807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 53424. [D 20:43:32.295817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 53425. [D 20:43:32.295827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 53426. [D 20:43:32.295856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 53427. [D 20:43:32.295875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 53428. [D 20:43:32.295885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 53429. [D 20:43:32.295895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 53430. [D 20:43:32.295911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 53431. [D 20:43:32.295921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 53432. [D 20:43:32.295931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 53433. [D 20:43:32.295963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 53434. [D 20:43:32.295974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 53435. [D 20:43:32.295984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 53436. [D 20:43:32.295994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 53437. [D 20:43:32.296010] openib_post_sr_rdmaw: ibv_post_send wr_id 661fc0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 53438. [D 20:43:32.296029] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 39/70. [D 20:43:32.296123] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.296161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.296170] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:32.304712] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 53438. [D 20:43:32.304736] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 40/70. [D 20:43:32.316278] openib_check_cq: completed rdma wr_id 661fc0, nic_wr_credit 53437. [D 20:43:32.316292] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 41/70. [D 20:43:32.316334] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.316350] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.316358] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:32.316382] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.316391] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.316400] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:32.321460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 53437. [D 20:43:32.321477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 53438. [D 20:43:32.321490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 53439. [D 20:43:32.321500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 53440. [D 20:43:32.321510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 53441. [D 20:43:32.321524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 53442. [D 20:43:32.321534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 53443. [D 20:43:32.321544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 53444. [D 20:43:32.321559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 53445. [D 20:43:32.321571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 53446. [D 20:43:32.321586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 53447. [D 20:43:32.321597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 53448. [D 20:43:32.321607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 53449. [D 20:43:32.321617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 53450. [D 20:43:32.321627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 53451. [D 20:43:32.321637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 53452. [D 20:43:32.321664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 53453. [D 20:43:32.321675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 53454. [D 20:43:32.321685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 53455. [D 20:43:32.321708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 53456. [D 20:43:32.321718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 53457. [D 20:43:32.321728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 53458. [D 20:43:32.321739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 53459. [D 20:43:32.321749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 53460. [D 20:43:32.321759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 53461. [D 20:43:32.321783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 53462. [D 20:43:32.321793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 53463. [D 20:43:32.321803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 53464. [D 20:43:32.321813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 53465. [D 20:43:32.321823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 53466. [D 20:43:32.321847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 53467. [D 20:43:32.321857] openib_post_sr_rdmaw: ibv_post_send wr_id 655d10 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 53468. [D 20:43:32.328203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.328219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.328228] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:32.328253] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7629 [D 20:43:32.328263] element 0: offset: 0x64d8f0, size: 24 [D 20:43:32.328275] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 42/70. [D 20:43:32.333374] openib_check_cq: completed rdma wr_id 655d10, nic_wr_credit 53468. [D 20:43:32.333391] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 43/70. [D 20:43:32.335778] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7629 [D 20:43:32.335798] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 44/70. [D 20:43:32.335814] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.335863] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.335872] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:32.339163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 53468. [D 20:43:32.339180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 53469. [D 20:43:32.339192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 53470. [D 20:43:32.339202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 53471. [D 20:43:32.339212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 53472. [D 20:43:32.339227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 53473. [D 20:43:32.339237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 53474. [D 20:43:32.339247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 53475. [D 20:43:32.339263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 53476. [D 20:43:32.339273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 53477. [D 20:43:32.339283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 53478. [D 20:43:32.339314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 53479. [D 20:43:32.339325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 53480. [D 20:43:32.339336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 53481. [D 20:43:32.339346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 53482. [D 20:43:32.339374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 53483. [D 20:43:32.339385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 53484. [D 20:43:32.339399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 53485. [D 20:43:32.339409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 53486. [D 20:43:32.339419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 53487. [D 20:43:32.339446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 53488. [D 20:43:32.339456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 53489. [D 20:43:32.339466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 53490. [D 20:43:32.339480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 53491. [D 20:43:32.339490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 53492. [D 20:43:32.339515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 53493. [D 20:43:32.339526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 53494. [D 20:43:32.339536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 53495. [D 20:43:32.339550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 53496. [D 20:43:32.339560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 53497. [D 20:43:32.339570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 53498. [D 20:43:32.339599] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 53499. [D 20:43:32.345831] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.345848] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.345857] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:32.345884] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7634 [D 20:43:32.345895] element 0: offset: 0x61f010, size: 24 [D 20:43:32.345908] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 45/70. [D 20:43:32.345939] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.345948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.345956] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:32.345971] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7636 [D 20:43:32.345980] element 0: offset: 0x662650, size: 24 [D 20:43:32.345990] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 46/70. [D 20:43:32.350985] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 53499. [D 20:43:32.351002] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 47/70. [D 20:43:32.351108] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.351123] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.351131] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:32.354927] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7636 [D 20:43:32.354944] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 48/70. [D 20:43:32.357292] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7634 [D 20:43:32.357309] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 49/70. [D 20:43:32.357332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 53499. [D 20:43:32.357345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 53500. [D 20:43:32.357355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 53501. [D 20:43:32.357365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 53502. [D 20:43:32.357379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 53503. [D 20:43:32.357389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 53504. [D 20:43:32.357399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 53505. [D 20:43:32.357409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 53506. [D 20:43:32.357427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 53507. [D 20:43:32.357437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 53508. [D 20:43:32.357447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 53509. [D 20:43:32.357458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 53510. [D 20:43:32.357468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 53511. [D 20:43:32.357495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 53512. [D 20:43:32.357507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 53513. [D 20:43:32.357517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 53514. [D 20:43:32.357527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 53515. [D 20:43:32.357537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 53516. [D 20:43:32.357548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 53517. [D 20:43:32.357585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 53518. [D 20:43:32.357596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 53519. [D 20:43:32.357610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 53520. [D 20:43:32.357619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 53521. [D 20:43:32.357634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 53522. [D 20:43:32.357645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 53523. [D 20:43:32.357655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 53524. [D 20:43:32.357665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 53525. [D 20:43:32.357690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 53526. [D 20:43:32.357700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 53527. [D 20:43:32.357714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 53528. [D 20:43:32.357724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 53529. [D 20:43:32.357734] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 53530. [D 20:43:32.357750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 53531. [D 20:43:32.357760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 53532. [D 20:43:32.357788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 53533. [D 20:43:32.357798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 53534. [D 20:43:32.357808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 53535. [D 20:43:32.357822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 53536. [D 20:43:32.357832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53537. [D 20:43:32.357854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 53538. [D 20:43:32.357865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 53539. [D 20:43:32.357875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 53540. [D 20:43:32.357891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 53541. [D 20:43:32.357901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 53542. [D 20:43:32.357924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 53543. [D 20:43:32.357934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 53544. [D 20:43:32.357944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 53545. [D 20:43:32.357959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 53546. [D 20:43:32.357978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 53547. [D 20:43:32.357988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 53548. [D 20:43:32.358005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 53549. [D 20:43:32.358014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 53550. [D 20:43:32.358024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 53551. [D 20:43:32.358050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 53552. [D 20:43:32.358061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 53553. [D 20:43:32.358074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 53554. [D 20:43:32.358085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 53555. [D 20:43:32.358095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 53556. [D 20:43:32.358108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 53557. [D 20:43:32.358118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 53558. [D 20:43:32.358128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 53559. [D 20:43:32.358143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 53560. [D 20:43:32.358171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 53561. [D 20:43:32.358184] openib_post_sr_rdmaw: ibv_post_send wr_id 661c70 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 53562. [D 20:43:32.358230] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.358267] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.358276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:32.358306] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7638 [D 20:43:32.358316] element 0: offset: 0x64d8f0, size: 24 [D 20:43:32.358330] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 50/70. [D 20:43:32.364675] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 53562. [D 20:43:32.364692] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 51/70. [D 20:43:32.370509] openib_check_cq: completed rdma wr_id 661c70, nic_wr_credit 53561. [D 20:43:32.370523] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 52/70. [D 20:43:32.370571] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.370586] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.370594] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:32.370652] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.370662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.370670] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:32.372734] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7638 [D 20:43:32.372753] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 53/70. [D 20:43:32.372802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 53561. [D 20:43:32.372814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 53562. [D 20:43:32.372824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 53563. [D 20:43:32.372840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 53564. [D 20:43:32.372850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 53565. [D 20:43:32.372860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 53566. [D 20:43:32.372875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 53567. [D 20:43:32.372885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 53568. [D 20:43:32.372895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 53569. [D 20:43:32.372926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 53570. [D 20:43:32.372940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 53571. [D 20:43:32.372953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 53572. [D 20:43:32.372963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 53573. [D 20:43:32.372976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 53574. [D 20:43:32.372991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 53575. [D 20:43:32.373001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 53576. [D 20:43:32.373011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 53577. [D 20:43:32.373021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 53578. [D 20:43:32.373031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 53579. [D 20:43:32.373041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 53580. [D 20:43:32.373062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 53581. [D 20:43:32.373072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 53582. [D 20:43:32.373082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 53583. [D 20:43:32.373092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 53584. [D 20:43:32.373118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 53585. [D 20:43:32.373129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 53586. [D 20:43:32.373139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 53587. [D 20:43:32.373150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 53588. [D 20:43:32.373160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 53589. [D 20:43:32.373170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 53590. [D 20:43:32.373180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 53591. [D 20:43:32.373195] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 53592. [D 20:43:32.378666] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 53592. [D 20:43:32.378680] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 54/70. [D 20:43:32.378742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.378771] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.378780] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:32.463121] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.463136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.463144] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:32.463171] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7642 [D 20:43:32.463181] element 0: offset: 0x5b0030, size: 24 [D 20:43:32.463193] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 55/70. [D 20:43:32.465486] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7642 [D 20:43:32.465504] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 56/70. [D 20:43:32.465547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 53592. [D 20:43:32.465560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 53593. [D 20:43:32.465570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 53594. [D 20:43:32.465580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 53595. [D 20:43:32.465594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 53596. [D 20:43:32.465605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 53597. [D 20:43:32.465616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 53598. [D 20:43:32.465626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 53599. [D 20:43:32.465636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 53600. [D 20:43:32.465657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 53601. [D 20:43:32.465669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 53602. [D 20:43:32.465689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 53603. [D 20:43:32.465699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 53604. [D 20:43:32.465716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 53605. [D 20:43:32.465727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 53606. [D 20:43:32.465736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 53607. [D 20:43:32.465747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 53608. [D 20:43:32.465756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 53609. [D 20:43:32.465767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 53610. [D 20:43:32.465778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 53611. [D 20:43:32.465788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 53612. [D 20:43:32.465798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 53613. [D 20:43:32.465808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 53614. [D 20:43:32.465831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 53615. [D 20:43:32.465841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 53616. [D 20:43:32.465852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 53617. [D 20:43:32.465872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 53618. [D 20:43:32.465883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 53619. [D 20:43:32.465896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 53620. [D 20:43:32.465906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 53621. [D 20:43:32.465916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 53622. [D 20:43:32.465943] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 53623. [D 20:43:32.471457] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 53623. [D 20:43:32.471471] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 57/70. [D 20:43:32.471536] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.471574] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.471583] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:32.683341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.683355] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.683364] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:32.683391] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7645 [D 20:43:32.683401] element 0: offset: 0x61f010, size: 24 [D 20:43:32.683414] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 58/70. [D 20:43:32.685763] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7645 [D 20:43:32.685781] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 59/70. [D 20:43:32.685917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 53623. [D 20:43:32.685931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 53624. [D 20:43:32.685942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 53625. [D 20:43:32.685952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 53626. [D 20:43:32.685975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 53627. [D 20:43:32.685993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 53628. [D 20:43:32.686003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53629. [D 20:43:32.686019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 53630. [D 20:43:32.686029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 53631. [D 20:43:32.686048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 53632. [D 20:43:32.686058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 53633. [D 20:43:32.686079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 53634. [D 20:43:32.686093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 53635. [D 20:43:32.686103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 53636. [D 20:43:32.686113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 53637. [D 20:43:32.686139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 53638. [D 20:43:32.686149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 53639. [D 20:43:32.686168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 53640. [D 20:43:32.686178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 53641. [D 20:43:32.686193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 53642. [D 20:43:32.686215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 53643. [D 20:43:32.686225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 53644. [D 20:43:32.686245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 53645. [D 20:43:32.686258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 53646. [D 20:43:32.686282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 53647. [D 20:43:32.686292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 53648. [D 20:43:32.686315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 53649. [D 20:43:32.686325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 53650. [D 20:43:32.686346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 53651. [D 20:43:32.686356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 53652. [D 20:43:32.686366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 53653. [D 20:43:32.686387] openib_post_sr_rdmaw: ibv_post_send wr_id 61ede0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 53654. [D 20:43:32.697596] openib_check_cq: completed rdma wr_id 61ede0, nic_wr_credit 53654. [D 20:43:32.697611] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 60/70. [D 20:43:32.697730] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.697772] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.697781] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:32.697947] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.697960] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.697968] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:32.697995] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7648 [D 20:43:32.698005] element 0: offset: 0x64dd40, size: 24 [D 20:43:32.698017] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 0/70. [D 20:43:32.700327] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7648 [D 20:43:32.700346] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 1/70. [D 20:43:32.700481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 53654. [D 20:43:32.700497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 53655. [D 20:43:32.700577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 53656. [D 20:43:32.700619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 53657. [D 20:43:32.700660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 53658. [D 20:43:32.700712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 53659. [D 20:43:32.700757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 53660. [D 20:43:32.700769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 53661. [D 20:43:32.700789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 53662. [D 20:43:32.700799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 53663. [D 20:43:32.700856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 53664. [D 20:43:32.700897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 53665. [D 20:43:32.700938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 53666. [D 20:43:32.700987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 53667. [D 20:43:32.701037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 53668. [D 20:43:32.701079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 53669. [D 20:43:32.701120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 53670. [D 20:43:32.701132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 53671. [D 20:43:32.701177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 53672. [D 20:43:32.701229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 53673. [D 20:43:32.701270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 53674. [D 20:43:32.701320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 53675. [D 20:43:32.701362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 53676. [D 20:43:32.701413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 53677. [D 20:43:32.701454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 53678. [D 20:43:32.701505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 53679. [D 20:43:32.701547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 53680. [D 20:43:32.701598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 53681. [D 20:43:32.701642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 53682. [D 20:43:32.701693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 53683. [D 20:43:32.701735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 53684. [D 20:43:32.701785] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 53685. [D 20:43:32.706437] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 53685. [D 20:43:32.706452] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 2/70. [D 20:43:32.706521] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.706559] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.706568] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:32.726270] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.726284] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.726292] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:32.726318] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7652 [D 20:43:32.726328] element 0: offset: 0x5b0030, size: 24 [D 20:43:32.726341] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 3/70. [D 20:43:32.726377] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.726387] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.726395] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:32.726410] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7654 [D 20:43:32.726419] element 0: offset: 0x2aaaab23f770, size: 24 [D 20:43:32.726430] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 4/70. [D 20:43:32.730673] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7654 [D 20:43:32.730696] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 5/70. [D 20:43:32.730710] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7652 [D 20:43:32.730737] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 6/70. [D 20:43:32.730807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 53685. [D 20:43:32.730822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 53686. [D 20:43:32.730837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 53687. [D 20:43:32.730849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 53688. [D 20:43:32.730860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 53689. [D 20:43:32.730870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 53690. [D 20:43:32.730886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53691. [D 20:43:32.730898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 53692. [D 20:43:32.730919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 53693. [D 20:43:32.730932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 53694. [D 20:43:32.730944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 53695. [D 20:43:32.730956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 53696. [D 20:43:32.730969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 53697. [D 20:43:32.730982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 53698. [D 20:43:32.730994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 53699. [D 20:43:32.731006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 53700. [D 20:43:32.731019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 53701. [D 20:43:32.731031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 53702. [D 20:43:32.731043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 53703. [D 20:43:32.731056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 53704. [D 20:43:32.731068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 53705. [D 20:43:32.731080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 53706. [D 20:43:32.731093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 53707. [D 20:43:32.731105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 53708. [D 20:43:32.731117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 53709. [D 20:43:32.731130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 53710. [D 20:43:32.731142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 53711. [D 20:43:32.731154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 53712. [D 20:43:32.731167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 53713. [D 20:43:32.731179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 53714. [D 20:43:32.731191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 53715. [D 20:43:32.731202] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 53716. [D 20:43:32.731213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 53717. [D 20:43:32.731223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 53718. [D 20:43:32.731233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 53719. [D 20:43:32.731243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 53720. [D 20:43:32.731253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 53721. [D 20:43:32.731264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 53722. [D 20:43:32.731273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 53723. [D 20:43:32.731283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 53724. [D 20:43:32.731293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 53725. [D 20:43:32.731303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 53726. [D 20:43:32.731313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 53727. [D 20:43:32.731323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 53728. [D 20:43:32.731333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 53729. [D 20:43:32.731343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 53730. [D 20:43:32.731353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 53731. [D 20:43:32.731363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 53732. [D 20:43:32.731373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 53733. [D 20:43:32.731383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 53734. [D 20:43:32.731393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 53735. [D 20:43:32.731403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 53736. [D 20:43:32.731413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 53737. [D 20:43:32.731423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 53738. [D 20:43:32.731433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 53739. [D 20:43:32.731443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 53740. [D 20:43:32.731453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 53741. [D 20:43:32.731463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 53742. [D 20:43:32.731473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 53743. [D 20:43:32.731483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 53744. [D 20:43:32.731494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 53745. [D 20:43:32.731504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 53746. [D 20:43:32.731514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 53747. [D 20:43:32.731524] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 53748. [D 20:43:32.740630] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 53748. [D 20:43:32.740646] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 7/70. [D 20:43:32.752340] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 53747. [D 20:43:32.752355] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 8/70. [D 20:43:32.752413] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.752454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.752463] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:32.752486] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.752495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.752503] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:32.767307] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.767320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.767328] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:32.767354] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7658 [D 20:43:32.767364] element 0: offset: 0x2aaaab208fa0, size: 24 [D 20:43:32.767377] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 9/70. [D 20:43:32.767410] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.767420] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.767428] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:32.767443] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7660 [D 20:43:32.767452] element 0: offset: 0x5b0030, size: 24 [D 20:43:32.767462] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 10/70. [D 20:43:32.769782] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7658 [D 20:43:32.769800] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 11/70. [D 20:43:32.769846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 53747. [D 20:43:32.769858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 53748. [D 20:43:32.769868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 53749. [D 20:43:32.769879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 53750. [D 20:43:32.769889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 53751. [D 20:43:32.769899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 53752. [D 20:43:32.769909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 53753. [D 20:43:32.769919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 53754. [D 20:43:32.769929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 53755. [D 20:43:32.769939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 53756. [D 20:43:32.769949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 53757. [D 20:43:32.769959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 53758. [D 20:43:32.769969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 53759. [D 20:43:32.769979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 53760. [D 20:43:32.769989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 53761. [D 20:43:32.769999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 53762. [D 20:43:32.770009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 53763. [D 20:43:32.770019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 53764. [D 20:43:32.770029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 53765. [D 20:43:32.770039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 53766. [D 20:43:32.770050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 53767. [D 20:43:32.770060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 53768. [D 20:43:32.770070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 53769. [D 20:43:32.770080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 53770. [D 20:43:32.770090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 53771. [D 20:43:32.770100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 53772. [D 20:43:32.770110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 53773. [D 20:43:32.770120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 53774. [D 20:43:32.770130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 53775. [D 20:43:32.770140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 53776. [D 20:43:32.770150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 53777. [D 20:43:32.770160] openib_post_sr_rdmaw: ibv_post_send wr_id 61fa20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 53778. [D 20:43:32.772680] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7660 [D 20:43:32.772697] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 12/70. [D 20:43:32.777867] openib_check_cq: completed rdma wr_id 61fa20, nic_wr_credit 53778. [D 20:43:32.777882] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 13/70. [D 20:43:32.777922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 53778. [D 20:43:32.777935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 53779. [D 20:43:32.777947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 53780. [D 20:43:32.777960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 53781. [D 20:43:32.777972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 53782. [D 20:43:32.777984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 53783. [D 20:43:32.777997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53784. [D 20:43:32.778009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 53785. [D 20:43:32.778022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 53786. [D 20:43:32.778033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 53787. [D 20:43:32.778045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 53788. [D 20:43:32.778058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 53789. [D 20:43:32.778070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 53790. [D 20:43:32.778083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 53791. [D 20:43:32.778095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 53792. [D 20:43:32.778108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 53793. [D 20:43:32.778120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 53794. [D 20:43:32.778133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 53795. [D 20:43:32.778146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 53796. [D 20:43:32.778158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 53797. [D 20:43:32.778171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 53798. [D 20:43:32.778183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 53799. [D 20:43:32.778196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 53800. [D 20:43:32.778209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 53801. [D 20:43:32.778221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 53802. [D 20:43:32.778234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 53803. [D 20:43:32.778246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 53804. [D 20:43:32.778259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 53805. [D 20:43:32.778271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 53806. [D 20:43:32.778284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 53807. [D 20:43:32.778294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 53808. [D 20:43:32.778304] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 53809. [D 20:43:32.778359] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.778399] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.778407] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:32.789667] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 53809. [D 20:43:32.789686] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 14/70. [D 20:43:32.789789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.789804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.789813] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:32.792243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.792256] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.792264] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:32.792290] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7663 [D 20:43:32.792300] element 0: offset: 0x2aaaab22c060, size: 24 [D 20:43:32.792312] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 15/70. [D 20:43:32.794672] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7663 [D 20:43:32.794691] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 16/70. [D 20:43:32.799947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 53809. [D 20:43:32.799963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 53810. [D 20:43:32.799979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 53811. [D 20:43:32.799992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 53812. [D 20:43:32.800005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 53813. [D 20:43:32.800018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 53814. [D 20:43:32.800031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 53815. [D 20:43:32.800043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 53816. [D 20:43:32.800056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 53817. [D 20:43:32.800068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 53818. [D 20:43:32.800081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 53819. [D 20:43:32.800093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 53820. [D 20:43:32.800106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 53821. [D 20:43:32.800118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 53822. [D 20:43:32.800131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 53823. [D 20:43:32.800143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 53824. [D 20:43:32.800156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 53825. [D 20:43:32.800168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 53826. [D 20:43:32.800181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 53827. [D 20:43:32.800193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 53828. [D 20:43:32.800205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 53829. [D 20:43:32.800218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 53830. [D 20:43:32.800230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 53831. [D 20:43:32.800243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 53832. [D 20:43:32.800255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 53833. [D 20:43:32.800268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 53834. [D 20:43:32.800281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 53835. [D 20:43:32.800292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 53836. [D 20:43:32.800306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 53837. [D 20:43:32.800318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 53838. [D 20:43:32.800331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 53839. [D 20:43:32.800341] openib_post_sr_rdmaw: ibv_post_send wr_id 61fa20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 53840. [D 20:43:32.800553] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.800594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.800603] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:32.800632] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7666 [D 20:43:32.800642] element 0: offset: 0x2aaaab208d50, size: 24 [D 20:43:32.800656] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 17/70. [D 20:43:32.811601] openib_check_cq: completed rdma wr_id 61fa20, nic_wr_credit 53840. [D 20:43:32.811619] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 18/70. [D 20:43:32.811701] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.811717] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.811726] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:32.813977] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7666 [D 20:43:32.813995] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 19/70. [D 20:43:32.817753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 53840. [D 20:43:32.817769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 53841. [D 20:43:32.817784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 53842. [D 20:43:32.817797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 53843. [D 20:43:32.817809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 53844. [D 20:43:32.817822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 53845. [D 20:43:32.817834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 53846. [D 20:43:32.817846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 53847. [D 20:43:32.817859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 53848. [D 20:43:32.817871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 53849. [D 20:43:32.817884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 53850. [D 20:43:32.817896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 53851. [D 20:43:32.817908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 53852. [D 20:43:32.817921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 53853. [D 20:43:32.817933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 53854. [D 20:43:32.817945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 53855. [D 20:43:32.817957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 53856. [D 20:43:32.817968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 53857. [D 20:43:32.817979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 53858. [D 20:43:32.817991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 53859. [D 20:43:32.818003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 53860. [D 20:43:32.818016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 53861. [D 20:43:32.818028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 53862. [D 20:43:32.818040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 53863. [D 20:43:32.818053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 53864. [D 20:43:32.818065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 53865. [D 20:43:32.818077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 53866. [D 20:43:32.818090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 53867. [D 20:43:32.818102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 53868. [D 20:43:32.818114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 53869. [D 20:43:32.818127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 53870. [D 20:43:32.818138] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 53871. [D 20:43:32.818338] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.818378] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.818387] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:32.818417] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7669 [D 20:43:32.818428] element 0: offset: 0x2aaaab239250, size: 24 [D 20:43:32.818440] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 20/70. [D 20:43:32.829460] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 53871. [D 20:43:32.829479] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 21/70. [D 20:43:32.829568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.829583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.829592] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:32.831857] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7669 [D 20:43:32.831875] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 22/70. [D 20:43:32.836260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 53871. [D 20:43:32.836276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 53872. [D 20:43:32.836292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 53873. [D 20:43:32.836304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 53874. [D 20:43:32.836317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 53875. [D 20:43:32.836329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 53876. [D 20:43:32.836342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 53877. [D 20:43:32.836352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 53878. [D 20:43:32.836363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 53879. [D 20:43:32.836375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 53880. [D 20:43:32.836388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 53881. [D 20:43:32.836400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 53882. [D 20:43:32.836413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 53883. [D 20:43:32.836425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 53884. [D 20:43:32.836438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 53885. [D 20:43:32.836450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 53886. [D 20:43:32.836462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 53887. [D 20:43:32.836475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 53888. [D 20:43:32.836487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 53889. [D 20:43:32.836499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 53890. [D 20:43:32.836512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 53891. [D 20:43:32.836524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 53892. [D 20:43:32.836537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 53893. [D 20:43:32.836549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 53894. [D 20:43:32.836561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 53895. [D 20:43:32.836574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 53896. [D 20:43:32.836586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 53897. [D 20:43:32.836598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 53898. [D 20:43:32.836611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 53899. [D 20:43:32.836623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 53900. [D 20:43:32.836636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 53901. [D 20:43:32.836646] openib_post_sr_rdmaw: ibv_post_send wr_id 61fa20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 53902. [D 20:43:32.836907] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.836942] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.836992] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:32.837024] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7672 [D 20:43:32.837035] element 0: offset: 0x2aaaab236c30, size: 24 [D 20:43:32.837048] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 23/70. [D 20:43:32.840402] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.840415] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.840424] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:32.840440] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7674 [D 20:43:32.840449] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:32.840461] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 24/70. [D 20:43:32.842326] openib_check_cq: completed rdma wr_id 61fa20, nic_wr_credit 53902. [D 20:43:32.842345] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 25/70. [D 20:43:32.842448] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.842463] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.842471] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:32.846866] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7674 [D 20:43:32.846884] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 26/70. [D 20:43:32.846956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 53902. [D 20:43:32.846971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 53903. [D 20:43:32.846988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 53904. [D 20:43:32.847002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 53905. [D 20:43:32.847014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 53906. [D 20:43:32.847036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 53907. [D 20:43:32.847049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 53908. [D 20:43:32.847062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 53909. [D 20:43:32.847074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 53910. [D 20:43:32.847087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 53911. [D 20:43:32.847099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 53912. [D 20:43:32.847112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 53913. [D 20:43:32.847124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 53914. [D 20:43:32.847137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 53915. [D 20:43:32.847150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 53916. [D 20:43:32.847163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 53917. [D 20:43:32.847175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 53918. [D 20:43:32.847188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 53919. [D 20:43:32.847200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 53920. [D 20:43:32.847212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 53921. [D 20:43:32.847225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 53922. [D 20:43:32.847238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 53923. [D 20:43:32.847250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 53924. [D 20:43:32.847261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 53925. [D 20:43:32.847271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 53926. [D 20:43:32.847283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 53927. [D 20:43:32.847296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 53928. [D 20:43:32.847308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 53929. [D 20:43:32.847321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 53930. [D 20:43:32.847334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 53931. [D 20:43:32.847347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 53932. [D 20:43:32.847357] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 53933. [D 20:43:32.849678] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7672 [D 20:43:32.849690] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 27/70. [D 20:43:32.852827] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 53933. [D 20:43:32.852843] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 28/70. [D 20:43:32.852859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 53933. [D 20:43:32.852872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 53934. [D 20:43:32.852884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 53935. [D 20:43:32.852896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 53936. [D 20:43:32.852909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 53937. [D 20:43:32.852922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 53938. [D 20:43:32.852935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 53939. [D 20:43:32.852947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 53940. [D 20:43:32.852960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 53941. [D 20:43:32.852973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 53942. [D 20:43:32.852985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 53943. [D 20:43:32.852997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 53944. [D 20:43:32.853010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 53945. [D 20:43:32.853022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 53946. [D 20:43:32.853035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 53947. [D 20:43:32.853047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 53948. [D 20:43:32.853060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 53949. [D 20:43:32.853073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 53950. [D 20:43:32.853083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 53951. [D 20:43:32.853094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 53952. [D 20:43:32.853107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 53953. [D 20:43:32.853120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 53954. [D 20:43:32.853133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 53955. [D 20:43:32.853145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 53956. [D 20:43:32.853158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 53957. [D 20:43:32.853170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 53958. [D 20:43:32.853183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 53959. [D 20:43:32.853195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 53960. [D 20:43:32.853208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 53961. [D 20:43:32.853220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 53962. [D 20:43:32.853231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 53963. [D 20:43:32.853241] openib_post_sr_rdmaw: ibv_post_send wr_id 61fa20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 53964. [D 20:43:32.853293] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.853330] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.853339] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:32.858725] openib_check_cq: completed rdma wr_id 61fa20, nic_wr_credit 53964. [D 20:43:32.858744] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 29/70. [D 20:43:32.858790] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.858805] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.858813] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:32.946115] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:32.946129] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.946137] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:32.946165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7678 [D 20:43:32.946175] element 0: offset: 0x2aaaab2327e0, size: 24 [D 20:43:32.946188] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 30/70. [D 20:43:32.948493] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7678 [D 20:43:32.948512] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 31/70. [D 20:43:32.948572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 53964. [D 20:43:32.948588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 53965. [D 20:43:32.948632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 53966. [D 20:43:32.948682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 53967. [D 20:43:32.948733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 53968. [D 20:43:32.948785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 53969. [D 20:43:32.948797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 53970. [D 20:43:32.948815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 53971. [D 20:43:32.948831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 53972. [D 20:43:32.948895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 53973. [D 20:43:32.948907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 53974. [D 20:43:32.948950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 53975. [D 20:43:32.949003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 53976. [D 20:43:32.949045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 53977. [D 20:43:32.949137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 53978. [D 20:43:32.949152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 53979. [D 20:43:32.949202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 53980. [D 20:43:32.949251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 53981. [D 20:43:32.949301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 53982. [D 20:43:32.949383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 53983. [D 20:43:32.949398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 53984. [D 20:43:32.949481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 53985. [D 20:43:32.949496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 53986. [D 20:43:32.949547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 53987. [D 20:43:32.949590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 53988. [D 20:43:32.949642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 53989. [D 20:43:32.949691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 53990. [D 20:43:32.949744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 53991. [D 20:43:32.949795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 53992. [D 20:43:32.949844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 53993. [D 20:43:32.949895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 53994. [D 20:43:32.949943] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 53995. [D 20:43:32.954443] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 53995. [D 20:43:32.954458] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 32/70. [D 20:43:32.954528] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:32.954566] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:32.954575] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:33.168857] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.168900] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.168909] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:33.168938] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7681 [D 20:43:33.168948] element 0: offset: 0x2aaaab202ae0, size: 24 [D 20:43:33.168961] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 33/70. [D 20:43:33.171212] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7681 [D 20:43:33.171264] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 34/70. [D 20:43:33.171350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 53995. [D 20:43:33.171367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 53996. [D 20:43:33.171411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 53997. [D 20:43:33.171464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 53998. [D 20:43:33.171515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 53999. [D 20:43:33.171568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 54000. [D 20:43:33.171619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 54001. [D 20:43:33.171669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 54002. [D 20:43:33.171720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 54003. [D 20:43:33.171771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 54004. [D 20:43:33.171821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 54005. [D 20:43:33.171872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 54006. [D 20:43:33.171923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 54007. [D 20:43:33.171965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 54008. [D 20:43:33.171977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 54009. [D 20:43:33.172055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 54010. [D 20:43:33.172069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 54011. [D 20:43:33.172082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 54012. [D 20:43:33.172095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 54013. [D 20:43:33.172120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 54014. [D 20:43:33.172132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 54015. [D 20:43:33.172144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 54016. [D 20:43:33.172157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 54017. [D 20:43:33.172169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 54018. [D 20:43:33.172182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 54019. [D 20:43:33.172194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 54020. [D 20:43:33.172205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 54021. [D 20:43:33.172215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 54022. [D 20:43:33.172228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 54023. [D 20:43:33.172241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 54024. [D 20:43:33.172253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 54025. [D 20:43:33.172266] openib_post_sr_rdmaw: ibv_post_send wr_id 61fa20 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 54026. [D 20:43:33.177729] openib_check_cq: completed rdma wr_id 61fa20, nic_wr_credit 54026. [D 20:43:33.177745] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 35/70. [D 20:43:33.177870] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.177906] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.177915] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:33.212558] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.212571] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.212580] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:33.212606] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7686 [D 20:43:33.212616] element 0: offset: 0x2aaaab20ff10, size: 24 [D 20:43:33.212628] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 36/70. [D 20:43:33.212709] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.212721] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.212729] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:33.212744] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7688 [D 20:43:33.212754] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:43:33.212764] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 37/70. [D 20:43:33.212882] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.212894] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.212902] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:33.212918] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7691 [D 20:43:33.212928] element 0: offset: 0x2aaaab23f770, size: 24 [D 20:43:33.212938] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 38/70. [D 20:43:33.214910] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.214942] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.214950] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:33.214973] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7693 [D 20:43:33.214983] element 0: offset: 0x2aaaab233c80, size: 24 [D 20:43:33.214996] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 39/70. [D 20:43:33.220162] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7686 [D 20:43:33.220235] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 40/70. [D 20:43:33.220266] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7691 [D 20:43:33.220278] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 41/70. [D 20:43:33.220289] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7693 [D 20:43:33.220299] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 42/70. [D 20:43:33.220378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54026. [D 20:43:33.220395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54027. [D 20:43:33.220406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54028. [D 20:43:33.220416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54029. [D 20:43:33.220427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54030. [D 20:43:33.220437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54031. [D 20:43:33.220447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54032. [D 20:43:33.220457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54033. [D 20:43:33.220467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54034. [D 20:43:33.220477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54035. [D 20:43:33.220487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54036. [D 20:43:33.220507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54037. [D 20:43:33.220517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54038. [D 20:43:33.220527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54039. [D 20:43:33.220543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54040. [D 20:43:33.220553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54041. [D 20:43:33.220563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54042. [D 20:43:33.220578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54043. [D 20:43:33.220588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54044. [D 20:43:33.220598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54045. [D 20:43:33.220608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54046. [D 20:43:33.220618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54047. [D 20:43:33.220629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54048. [D 20:43:33.220640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54049. [D 20:43:33.220650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54050. [D 20:43:33.220660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54051. [D 20:43:33.220670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54052. [D 20:43:33.220680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54053. [D 20:43:33.220691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54054. [D 20:43:33.220701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54055. [D 20:43:33.220711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54056. [D 20:43:33.220721] openib_post_sr_rdmaw: ibv_post_send wr_id 691e20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54057. [D 20:43:33.220735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 54058. [D 20:43:33.220745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 54059. [D 20:43:33.220756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 54060. [D 20:43:33.220766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 54061. [D 20:43:33.220776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 54062. [D 20:43:33.220794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 54063. [D 20:43:33.220804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 54064. [D 20:43:33.220815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 54065. [D 20:43:33.220833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 54066. [D 20:43:33.220845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 54067. [D 20:43:33.220856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 54068. [D 20:43:33.220866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 54069. [D 20:43:33.220876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 54070. [D 20:43:33.220887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 54071. [D 20:43:33.220897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 54072. [D 20:43:33.220907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 54073. [D 20:43:33.220924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 54074. [D 20:43:33.220933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 54075. [D 20:43:33.220944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 54076. [D 20:43:33.220957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 54077. [D 20:43:33.220967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 54078. [D 20:43:33.220977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 54079. [D 20:43:33.220990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 54080. [D 20:43:33.221001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 54081. [D 20:43:33.221011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 54082. [D 20:43:33.221021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 54083. [D 20:43:33.221031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 54084. [D 20:43:33.221041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 54085. [D 20:43:33.221101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 54086. [D 20:43:33.221115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 54087. [D 20:43:33.221125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 54088. [D 20:43:33.221135] openib_post_sr_rdmaw: ibv_post_send wr_id 625520 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 54089. [D 20:43:33.221147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 54090. [D 20:43:33.221157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 54091. [D 20:43:33.221168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 54092. [D 20:43:33.221179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 54093. [D 20:43:33.221189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 54094. [D 20:43:33.221200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 54095. [D 20:43:33.221218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 54096. [E 20:43:33.221232] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 54097, block for 10 ms. [D 20:43:33.221289] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7688 [D 20:43:33.232011] openib_check_cq: completed rdma wr_id 691e20, nic_wr_credit 54096. [D 20:43:33.232026] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 43/70. [D 20:43:33.232038] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 54095. [D 20:43:33.232049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 54096. [D 20:43:33.232064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 54097. [D 20:43:33.232075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 54098. [D 20:43:33.232085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 54099. [D 20:43:33.232096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 54100. [D 20:43:33.232106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 54101. [D 20:43:33.232116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 54102. [D 20:43:33.232126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 54103. [D 20:43:33.232142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 54104. [D 20:43:33.232152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 54105. [D 20:43:33.232162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 54106. [D 20:43:33.232195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 54107. [D 20:43:33.232207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 54108. [D 20:43:33.232217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 54109. [D 20:43:33.232227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 54110. [D 20:43:33.232243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 54111. [D 20:43:33.232253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 54112. [D 20:43:33.232263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 54113. [D 20:43:33.232280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 54114. [D 20:43:33.232306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 54115. [D 20:43:33.232321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 54116. [D 20:43:33.232331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 54117. [D 20:43:33.232341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 54118. [D 20:43:33.232355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 54119. [D 20:43:33.232378] openib_post_sr_rdmaw: ibv_post_send wr_id 61f6d0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 54120. [D 20:43:33.232396] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 44/70. [D 20:43:33.243682] openib_check_cq: completed rdma wr_id 625520, nic_wr_credit 54120. [D 20:43:33.243697] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 45/70. [D 20:43:33.245905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.245947] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.245956] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:33.252776] openib_check_cq: completed rdma wr_id 61f6d0, nic_wr_credit 54119. [D 20:43:33.252795] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 46/70. [D 20:43:33.252821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 54119. [D 20:43:33.252832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 54120. [D 20:43:33.252839] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.252851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 54121. [D 20:43:33.252868] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.252879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 54122. [D 20:43:33.252914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 54123. [D 20:43:33.252924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 54124. [D 20:43:33.252900] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:33.252938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 54125. [D 20:43:33.252962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 54126. [D 20:43:33.252973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 54127. [D 20:43:33.252989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 54128. [D 20:43:33.252999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 54129. [D 20:43:33.253013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 54130. [D 20:43:33.253023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 54131. [D 20:43:33.253041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 54132. [D 20:43:33.253051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 54133. [D 20:43:33.253061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 54134. [D 20:43:33.253072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 54135. [D 20:43:33.253083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 54136. [D 20:43:33.253093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 54137. [D 20:43:33.253103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 54138. [D 20:43:33.253139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 54139. [D 20:43:33.253150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 54140. [D 20:43:33.253161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 54141. [D 20:43:33.253171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 54142. [D 20:43:33.253182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 54143. [D 20:43:33.253192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 54144. [D 20:43:33.253203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 54145. [D 20:43:33.253213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 54146. [D 20:43:33.253224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 54147. [D 20:43:33.253234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 54148. [D 20:43:33.253244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 54149. [D 20:43:33.253254] openib_post_sr_rdmaw: ibv_post_send wr_id 63fc20 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 54150. [D 20:43:33.253311] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.253326] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.253334] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:33.258569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.258583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.258591] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:33.258619] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7696 [D 20:43:33.258629] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:33.258642] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 47/70. [D 20:43:33.261230] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.261243] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.261252] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:33.261268] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7699 [D 20:43:33.261277] element 0: offset: 0x2aaaab2327e0, size: 24 [D 20:43:33.261287] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 48/70. [D 20:43:33.264452] openib_check_cq: completed rdma wr_id 63fc20, nic_wr_credit 54150. [D 20:43:33.264469] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 49/70. [D 20:43:33.264572] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.264587] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.264596] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:33.266972] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7696 [D 20:43:33.266998] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 50/70. [D 20:43:33.269762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 54150. [D 20:43:33.269778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54151. [D 20:43:33.269788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54152. [D 20:43:33.269806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54153. [D 20:43:33.269816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54154. [D 20:43:33.269826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54155. [D 20:43:33.269836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54156. [D 20:43:33.269846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54157. [D 20:43:33.269857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54158. [D 20:43:33.269867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54159. [D 20:43:33.269877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54160. [D 20:43:33.269904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54161. [D 20:43:33.269914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54162. [D 20:43:33.269924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54163. [D 20:43:33.269934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54164. [D 20:43:33.269948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54165. [D 20:43:33.269958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54166. [D 20:43:33.269968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54167. [D 20:43:33.269978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54168. [D 20:43:33.269989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54169. [D 20:43:33.269999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54170. [D 20:43:33.270009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54171. [D 20:43:33.270019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54172. [D 20:43:33.270037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54173. [D 20:43:33.270062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54174. [D 20:43:33.270077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54175. [D 20:43:33.270087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54176. [D 20:43:33.270097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54177. [D 20:43:33.270122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54178. [D 20:43:33.270132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54179. [D 20:43:33.270147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54180. [D 20:43:33.270157] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54181. [D 20:43:33.272513] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7699 [D 20:43:33.272528] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 51/70. [D 20:43:33.276020] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 54181. [D 20:43:33.276034] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 52/70. [D 20:43:33.276076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 54181. [D 20:43:33.276087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 54182. [D 20:43:33.276097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 54183. [D 20:43:33.276108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 54184. [D 20:43:33.276118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 54185. [D 20:43:33.276134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 54186. [D 20:43:33.276144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 54187. [D 20:43:33.276154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 54188. [D 20:43:33.276171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 54189. [D 20:43:33.276181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 54190. [D 20:43:33.276191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 54191. [D 20:43:33.276207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 54192. [D 20:43:33.276218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 54193. [D 20:43:33.276228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 54194. [D 20:43:33.276272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 54195. [D 20:43:33.276283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 54196. [D 20:43:33.276293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 54197. [D 20:43:33.276322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 54198. [D 20:43:33.276332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 54199. [D 20:43:33.276345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 54200. [D 20:43:33.276355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 54201. [D 20:43:33.276371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 54202. [D 20:43:33.276382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 54203. [D 20:43:33.276392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 54204. [D 20:43:33.276402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 54205. [D 20:43:33.276426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 54206. [D 20:43:33.276438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 54207. [D 20:43:33.276448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 54208. [D 20:43:33.276458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 54209. [D 20:43:33.276468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 54210. [D 20:43:33.276492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 54211. [D 20:43:33.276503] openib_post_sr_rdmaw: ibv_post_send wr_id 61f8f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 54212. [D 20:43:33.276565] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.276608] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.276617] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:33.277893] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.277907] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.277916] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:33.277947] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7703 [D 20:43:33.277957] element 0: offset: 0x2aaaab203100, size: 24 [D 20:43:33.277971] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 53/70. [D 20:43:33.278002] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.278011] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.278019] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:33.278034] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7704 [D 20:43:33.278044] element 0: offset: 0x2aaaab236cf0, size: 24 [D 20:43:33.278053] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 54/70. [D 20:43:33.287791] openib_check_cq: completed rdma wr_id 61f8f0, nic_wr_credit 54212. [D 20:43:33.287810] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 55/70. [D 20:43:33.287925] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.287940] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.287949] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:33.290266] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7703 [D 20:43:33.290284] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 56/70. [D 20:43:33.290422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 54212. [D 20:43:33.290438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 54213. [D 20:43:33.290448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 54214. [D 20:43:33.290458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 54215. [D 20:43:33.290483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 54216. [D 20:43:33.290493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 54217. [D 20:43:33.290503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 54218. [D 20:43:33.290514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 54219. [D 20:43:33.290524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 54220. [D 20:43:33.290534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 54221. [D 20:43:33.290545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 54222. [D 20:43:33.290555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 54223. [D 20:43:33.290566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 54224. [D 20:43:33.290576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 54225. [D 20:43:33.290586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 54226. [D 20:43:33.290596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 54227. [D 20:43:33.290607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 54228. [D 20:43:33.290617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 54229. [D 20:43:33.290628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 54230. [D 20:43:33.290638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 54231. [D 20:43:33.290648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 54232. [D 20:43:33.290658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 54233. [D 20:43:33.290668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 54234. [D 20:43:33.290678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 54235. [D 20:43:33.290688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 54236. [D 20:43:33.290698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 54237. [D 20:43:33.290708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 54238. [D 20:43:33.290719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 54239. [D 20:43:33.290729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 54240. [D 20:43:33.290738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 54241. [D 20:43:33.290750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 54242. [D 20:43:33.290761] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 54243. [D 20:43:33.293089] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7704 [D 20:43:33.293125] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 57/70. [D 20:43:33.299114] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 54243. [D 20:43:33.299129] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 58/70. [D 20:43:33.299193] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.299235] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.299244] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:33.307914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 54243. [D 20:43:33.307932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 54244. [D 20:43:33.307943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 54245. [D 20:43:33.307952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 54246. [D 20:43:33.307963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 54247. [D 20:43:33.307973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 54248. [D 20:43:33.307983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 54249. [D 20:43:33.307993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 54250. [D 20:43:33.308003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 54251. [D 20:43:33.308013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 54252. [D 20:43:33.308023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 54253. [D 20:43:33.308033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 54254. [D 20:43:33.308043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 54255. [D 20:43:33.308052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 54256. [D 20:43:33.308063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 54257. [D 20:43:33.308073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 54258. [D 20:43:33.308082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 54259. [D 20:43:33.308092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 54260. [D 20:43:33.308103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 54261. [D 20:43:33.308112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 54262. [D 20:43:33.308123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 54263. [D 20:43:33.308132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 54264. [D 20:43:33.308142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 54265. [D 20:43:33.308153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 54266. [D 20:43:33.308162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 54267. [D 20:43:33.308172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 54268. [D 20:43:33.308182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 54269. [D 20:43:33.308192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 54270. [D 20:43:33.308202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 54271. [D 20:43:33.308212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 54272. [D 20:43:33.308223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 54273. [D 20:43:33.308233] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 54274. [D 20:43:33.310715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.310732] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.310741] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:33.310770] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7708 [D 20:43:33.310780] element 0: offset: 0x5b0030, size: 24 [D 20:43:33.310793] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 59/70. [D 20:43:33.319519] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 54274. [D 20:43:33.319537] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 60/70. [D 20:43:33.319639] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.319653] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.319661] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:33.322107] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7708 [D 20:43:33.322128] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 0/70. [D 20:43:33.322260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54274. [D 20:43:33.322274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54275. [D 20:43:33.322284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54276. [D 20:43:33.322295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54277. [D 20:43:33.322305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54278. [D 20:43:33.322314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54279. [D 20:43:33.322324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54280. [D 20:43:33.322334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54281. [D 20:43:33.322344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54282. [D 20:43:33.322354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54283. [D 20:43:33.322364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54284. [D 20:43:33.322374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54285. [D 20:43:33.322384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54286. [D 20:43:33.322394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54287. [D 20:43:33.322404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54288. [D 20:43:33.322414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54289. [D 20:43:33.322424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54290. [D 20:43:33.322434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54291. [D 20:43:33.322444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54292. [D 20:43:33.322454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54293. [D 20:43:33.322464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54294. [D 20:43:33.322474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54295. [D 20:43:33.322484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54296. [D 20:43:33.322494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54297. [D 20:43:33.322504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54298. [D 20:43:33.322514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54299. [D 20:43:33.322523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54300. [D 20:43:33.322533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54301. [D 20:43:33.322543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54302. [D 20:43:33.322553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54303. [D 20:43:33.322564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54304. [D 20:43:33.322574] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54305. [D 20:43:33.331277] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 54305. [D 20:43:33.331291] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 1/70. [D 20:43:33.331351] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.331387] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.331395] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:33.342345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.342360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.342368] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:33.342396] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7712 [D 20:43:33.342406] element 0: offset: 0x64dd40, size: 24 [D 20:43:33.342419] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 2/70. [D 20:43:33.342461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.342472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.342480] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:33.342496] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7713 [D 20:43:33.342505] element 0: offset: 0x662650, size: 24 [D 20:43:33.342515] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 3/70. [D 20:43:33.344933] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7712 [D 20:43:33.344953] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 4/70. [D 20:43:33.344999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 54305. [D 20:43:33.345013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 54306. [D 20:43:33.345023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 54307. [D 20:43:33.345033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 54308. [D 20:43:33.345043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 54309. [D 20:43:33.345054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 54310. [D 20:43:33.345064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 54311. [D 20:43:33.345074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 54312. [D 20:43:33.345084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 54313. [D 20:43:33.345094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 54314. [D 20:43:33.345104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 54315. [D 20:43:33.345114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 54316. [D 20:43:33.345124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 54317. [D 20:43:33.345138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 54318. [D 20:43:33.345148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 54319. [D 20:43:33.345158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 54320. [D 20:43:33.345168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 54321. [D 20:43:33.345178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 54322. [D 20:43:33.345188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 54323. [D 20:43:33.345198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 54324. [D 20:43:33.345208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 54325. [D 20:43:33.345218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 54326. [D 20:43:33.345228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 54327. [D 20:43:33.345238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 54328. [D 20:43:33.345248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 54329. [D 20:43:33.345258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 54330. [D 20:43:33.345268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 54331. [D 20:43:33.345277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 54332. [D 20:43:33.345288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 54333. [D 20:43:33.345298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 54334. [D 20:43:33.345308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 54335. [D 20:43:33.345319] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 54336. [D 20:43:33.347620] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7713 [D 20:43:33.347633] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 5/70. [D 20:43:33.350922] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 54336. [D 20:43:33.350937] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 6/70. [D 20:43:33.350948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 54336. [D 20:43:33.350958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 54337. [D 20:43:33.350968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 54338. [D 20:43:33.350978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 54339. [D 20:43:33.350988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 54340. [D 20:43:33.350998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 54341. [D 20:43:33.351008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 54342. [D 20:43:33.351018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 54343. [D 20:43:33.351028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 54344. [D 20:43:33.351038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 54345. [D 20:43:33.351048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 54346. [D 20:43:33.351058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 54347. [D 20:43:33.351068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 54348. [D 20:43:33.351078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 54349. [D 20:43:33.351088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 54350. [D 20:43:33.351098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 54351. [D 20:43:33.351108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 54352. [D 20:43:33.351118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 54353. [D 20:43:33.351128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 54354. [D 20:43:33.351138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 54355. [D 20:43:33.351148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 54356. [D 20:43:33.351158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 54357. [D 20:43:33.351168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 54358. [D 20:43:33.351178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 54359. [D 20:43:33.351188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 54360. [D 20:43:33.351198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 54361. [D 20:43:33.351208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 54362. [D 20:43:33.351218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 54363. [D 20:43:33.351228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 54364. [D 20:43:33.351238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 54365. [D 20:43:33.351249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 54366. [D 20:43:33.351259] openib_post_sr_rdmaw: ibv_post_send wr_id 63f9c0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 54367. [D 20:43:33.351316] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.351361] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.351370] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:33.356817] openib_check_cq: completed rdma wr_id 63f9c0, nic_wr_credit 54367. [D 20:43:33.356835] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 7/70. [D 20:43:33.356881] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.356895] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.356904] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:33.443197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.443212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.443220] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:33.443247] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7717 [D 20:43:33.443258] element 0: offset: 0x2aaaab20d840, size: 24 [D 20:43:33.443270] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 8/70. [D 20:43:33.445679] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7717 [D 20:43:33.445711] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 9/70. [D 20:43:33.445777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 54367. [D 20:43:33.445791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 54368. [D 20:43:33.445802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 54369. [D 20:43:33.445812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 54370. [D 20:43:33.445822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 54371. [D 20:43:33.445832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 54372. [D 20:43:33.445842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 54373. [D 20:43:33.445852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 54374. [D 20:43:33.445866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 54375. [D 20:43:33.445876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 54376. [D 20:43:33.445886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 54377. [D 20:43:33.445896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 54378. [D 20:43:33.445906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 54379. [D 20:43:33.445916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 54380. [D 20:43:33.445926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 54381. [D 20:43:33.445937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 54382. [D 20:43:33.445946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 54383. [D 20:43:33.445957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 54384. [D 20:43:33.445967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 54385. [D 20:43:33.445977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 54386. [D 20:43:33.445987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 54387. [D 20:43:33.445997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 54388. [D 20:43:33.446007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 54389. [D 20:43:33.446017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 54390. [D 20:43:33.446027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 54391. [D 20:43:33.446037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 54392. [D 20:43:33.446047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 54393. [D 20:43:33.446057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 54394. [D 20:43:33.446067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 54395. [D 20:43:33.446077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 54396. [D 20:43:33.446089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 54397. [D 20:43:33.446099] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 54398. [D 20:43:33.451647] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 54398. [D 20:43:33.451662] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 10/70. [D 20:43:33.451729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.451770] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.451779] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:33.642997] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.643012] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.643020] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:33.643047] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7720 [D 20:43:33.643057] element 0: offset: 0x2aaaab241270, size: 24 [D 20:43:33.643070] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 11/70. [D 20:43:33.645427] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7720 [D 20:43:33.645448] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 12/70. [D 20:43:33.645507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54398. [D 20:43:33.645522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54399. [D 20:43:33.645532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54400. [D 20:43:33.645542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54401. [D 20:43:33.645552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54402. [D 20:43:33.645562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54403. [D 20:43:33.645572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54404. [D 20:43:33.645582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54405. [D 20:43:33.645592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54406. [D 20:43:33.645602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54407. [D 20:43:33.645612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54408. [D 20:43:33.645622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54409. [D 20:43:33.645632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54410. [D 20:43:33.645642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54411. [D 20:43:33.645652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54412. [D 20:43:33.645662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54413. [D 20:43:33.645671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54414. [D 20:43:33.645681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54415. [D 20:43:33.645691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54416. [D 20:43:33.645701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54417. [D 20:43:33.645711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54418. [D 20:43:33.645721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54419. [D 20:43:33.645731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54420. [D 20:43:33.645741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54421. [D 20:43:33.645751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54422. [D 20:43:33.645761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54423. [D 20:43:33.645771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54424. [D 20:43:33.645781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54425. [D 20:43:33.645790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54426. [D 20:43:33.645803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54427. [D 20:43:33.645814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54428. [D 20:43:33.645824] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54429. [D 20:43:33.655070] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 54429. [D 20:43:33.655085] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 13/70. [D 20:43:33.655198] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.655236] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.655245] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:33.686295] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.686309] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.686318] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:33.686345] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7725 [D 20:43:33.686355] element 0: offset: 0x2aaaab2093f0, size: 24 [D 20:43:33.686368] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 14/70. [D 20:43:33.688658] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7725 [D 20:43:33.688676] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 15/70. [D 20:43:33.688738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 54429. [D 20:43:33.688752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 54430. [D 20:43:33.688763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 54431. [D 20:43:33.688773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 54432. [D 20:43:33.688782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 54433. [D 20:43:33.688793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 54434. [D 20:43:33.688803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 54435. [D 20:43:33.688817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 54436. [D 20:43:33.688827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 54437. [D 20:43:33.688837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 54438. [D 20:43:33.688847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 54439. [D 20:43:33.688857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 54440. [D 20:43:33.688867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 54441. [D 20:43:33.688877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 54442. [D 20:43:33.688887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 54443. [D 20:43:33.688897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 54444. [D 20:43:33.688907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 54445. [D 20:43:33.688917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 54446. [D 20:43:33.688927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 54447. [D 20:43:33.688937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 54448. [D 20:43:33.688946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 54449. [D 20:43:33.688957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 54450. [D 20:43:33.688967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 54451. [D 20:43:33.688976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 54452. [D 20:43:33.688986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 54453. [D 20:43:33.688996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 54454. [D 20:43:33.689006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 54455. [D 20:43:33.689016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 54456. [D 20:43:33.689026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 54457. [D 20:43:33.689036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 54458. [D 20:43:33.689047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 54459. [D 20:43:33.689057] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 54460. [D 20:43:33.689099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.689138] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.689147] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:33.689176] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7727 [D 20:43:33.689186] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:43:33.689198] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 16/70. [D 20:43:33.691229] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.691242] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.691252] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:33.691267] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7730 [D 20:43:33.691277] element 0: offset: 0x2aaaab20ff10, size: 24 [D 20:43:33.691286] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 17/70. [D 20:43:33.692832] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.692845] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.692855] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:33.692871] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7732 [D 20:43:33.692883] element 0: offset: 0x2aaaab22f8e0, size: 24 [D 20:43:33.692893] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 18/70. [D 20:43:33.694631] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 54460. [D 20:43:33.694649] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 19/70. [D 20:43:33.694782] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.694795] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.694804] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:33.701596] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7732 [D 20:43:33.701615] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 20/70. [D 20:43:33.701631] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7727 [D 20:43:33.701645] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 21/70. [D 20:43:33.701657] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7730 [D 20:43:33.701667] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 22/70. [D 20:43:33.701692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54460. [D 20:43:33.701704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54461. [D 20:43:33.701714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54462. [D 20:43:33.701724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54463. [D 20:43:33.701734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54464. [D 20:43:33.701744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54465. [D 20:43:33.701754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54466. [D 20:43:33.701764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54467. [D 20:43:33.701774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54468. [D 20:43:33.701784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54469. [D 20:43:33.701793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54470. [D 20:43:33.701803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54471. [D 20:43:33.701814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54472. [D 20:43:33.701824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54473. [D 20:43:33.701834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54474. [D 20:43:33.701844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54475. [D 20:43:33.701854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54476. [D 20:43:33.701864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54477. [D 20:43:33.701874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54478. [D 20:43:33.701883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54479. [D 20:43:33.701893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54480. [D 20:43:33.701904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54481. [D 20:43:33.701913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54482. [D 20:43:33.701923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54483. [D 20:43:33.701933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54484. [D 20:43:33.701943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54485. [D 20:43:33.701954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54486. [D 20:43:33.701964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54487. [D 20:43:33.701974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54488. [D 20:43:33.701984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54489. [D 20:43:33.701994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54490. [D 20:43:33.702004] openib_post_sr_rdmaw: ibv_post_send wr_id 61f530 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54491. [D 20:43:33.702015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 54492. [D 20:43:33.702025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 54493. [D 20:43:33.702035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 54494. [D 20:43:33.702045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 54495. [D 20:43:33.702056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 54496. [D 20:43:33.702066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 54497. [D 20:43:33.702076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 54498. [D 20:43:33.702086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 54499. [D 20:43:33.702096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 54500. [D 20:43:33.702106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 54501. [D 20:43:33.702116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 54502. [D 20:43:33.702126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 54503. [D 20:43:33.702136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 54504. [D 20:43:33.702146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 54505. [D 20:43:33.702156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 54506. [D 20:43:33.702166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 54507. [D 20:43:33.702176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 54508. [D 20:43:33.702186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 54509. [D 20:43:33.702196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 54510. [D 20:43:33.702206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 54511. [D 20:43:33.702216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 54512. [D 20:43:33.702226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 54513. [D 20:43:33.702236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 54514. [D 20:43:33.702247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 54515. [D 20:43:33.702257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 54516. [D 20:43:33.702267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 54517. [D 20:43:33.702277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 54518. [D 20:43:33.702287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 54519. [D 20:43:33.702297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 54520. [D 20:43:33.702307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 54521. [D 20:43:33.702317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 54522. [D 20:43:33.702327] openib_post_sr_rdmaw: ibv_post_send wr_id 657020 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 54523. [D 20:43:33.702337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 54524. [D 20:43:33.702348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 54525. [D 20:43:33.702358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 54526. [D 20:43:33.702368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 54527. [D 20:43:33.702378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 54528. [D 20:43:33.702388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 54529. [D 20:43:33.702398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 54530. [E 20:43:33.702410] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 54531, block for 10 ms. [D 20:43:33.707633] openib_check_cq: completed rdma wr_id 61f530, nic_wr_credit 54530. [D 20:43:33.707649] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 23/70. [D 20:43:33.707659] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 54529. [D 20:43:33.707670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 54530. [D 20:43:33.707680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 54531. [D 20:43:33.707690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 54532. [D 20:43:33.707700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 54533. [D 20:43:33.707710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 54534. [D 20:43:33.707720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 54535. [D 20:43:33.707730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 54536. [D 20:43:33.707740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 54537. [D 20:43:33.707750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 54538. [D 20:43:33.707760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 54539. [D 20:43:33.707770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 54540. [D 20:43:33.707780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 54541. [D 20:43:33.707790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 54542. [D 20:43:33.707800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 54543. [D 20:43:33.707810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 54544. [D 20:43:33.707820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 54545. [D 20:43:33.707830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 54546. [D 20:43:33.707840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 54547. [D 20:43:33.707850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 54548. [D 20:43:33.707860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 54549. [D 20:43:33.707870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 54550. [D 20:43:33.707880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 54551. [D 20:43:33.707890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 54552. [D 20:43:33.707899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 54553. [D 20:43:33.707910] openib_post_sr_rdmaw: ibv_post_send wr_id 648d40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 54554. [D 20:43:33.719220] openib_check_cq: completed rdma wr_id 657020, nic_wr_credit 54554. [D 20:43:33.719235] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 24/70. [D 20:43:33.721441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.721482] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.721491] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:33.730888] openib_check_cq: completed rdma wr_id 648d40, nic_wr_credit 54553. [D 20:43:33.730906] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 25/70. [D 20:43:33.730941] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.730954] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.730962] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:33.730998] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.731008] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.731016] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:33.754241] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.754256] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.754265] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:33.754293] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7737 [D 20:43:33.754303] element 0: offset: 0x61f010, size: 24 [D 20:43:33.754316] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 26/70. [D 20:43:33.756606] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7737 [D 20:43:33.756624] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 27/70. [D 20:43:33.756685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 54553. [D 20:43:33.756699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 54554. [D 20:43:33.756710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 54555. [D 20:43:33.756720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 54556. [D 20:43:33.756730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 54557. [D 20:43:33.756740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 54558. [D 20:43:33.756750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 54559. [D 20:43:33.756762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 54560. [D 20:43:33.756772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 54561. [D 20:43:33.756782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 54562. [D 20:43:33.756792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 54563. [D 20:43:33.756802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 54564. [D 20:43:33.756814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 54565. [D 20:43:33.756824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 54566. [D 20:43:33.756834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 54567. [D 20:43:33.756844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 54568. [D 20:43:33.756854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 54569. [D 20:43:33.756864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 54570. [D 20:43:33.756874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 54571. [D 20:43:33.756883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 54572. [D 20:43:33.756893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 54573. [D 20:43:33.756903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 54574. [D 20:43:33.756913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 54575. [D 20:43:33.756923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 54576. [D 20:43:33.756933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 54577. [D 20:43:33.756943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 54578. [D 20:43:33.756953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 54579. [D 20:43:33.756963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 54580. [D 20:43:33.756973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 54581. [D 20:43:33.756983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 54582. [D 20:43:33.756994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 54583. [D 20:43:33.757004] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 54584. [D 20:43:33.757045] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.757084] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.757094] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:33.757121] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7739 [D 20:43:33.757131] element 0: offset: 0x61ee50, size: 24 [D 20:43:33.757144] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 28/70. [D 20:43:33.757170] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.757180] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.757189] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:33.757203] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7742 [D 20:43:33.757213] element 0: offset: 0x662650, size: 24 [D 20:43:33.757222] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 29/70. [D 20:43:33.757243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.757256] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.757265] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:33.757279] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7744 [D 20:43:33.757288] element 0: offset: 0x64d8f0, size: 24 [D 20:43:33.757298] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 30/70. [D 20:43:33.767078] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 54584. [D 20:43:33.767097] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 31/70. [D 20:43:33.767220] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.767235] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.767243] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:33.773708] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7744 [D 20:43:33.773727] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 32/70. [D 20:43:33.773743] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7739 [D 20:43:33.773754] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 33/70. [D 20:43:33.773767] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7742 [D 20:43:33.773777] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 34/70. [D 20:43:33.773856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54584. [D 20:43:33.773871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54585. [D 20:43:33.773881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54586. [D 20:43:33.773891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54587. [D 20:43:33.773901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54588. [D 20:43:33.773911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54589. [D 20:43:33.773931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54590. [D 20:43:33.773941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54591. [D 20:43:33.773951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54592. [D 20:43:33.773961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54593. [D 20:43:33.773971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54594. [D 20:43:33.773981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54595. [D 20:43:33.773991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54596. [D 20:43:33.774001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54597. [D 20:43:33.774011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54598. [D 20:43:33.774021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54599. [D 20:43:33.774031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54600. [D 20:43:33.774041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54601. [D 20:43:33.774050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54602. [D 20:43:33.774061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54603. [D 20:43:33.774071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54604. [D 20:43:33.774080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54605. [D 20:43:33.774090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54606. [D 20:43:33.774100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54607. [D 20:43:33.774110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54608. [D 20:43:33.774120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54609. [D 20:43:33.774130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54610. [D 20:43:33.774140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54611. [D 20:43:33.774150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54612. [D 20:43:33.774160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54613. [D 20:43:33.774171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54614. [D 20:43:33.774181] openib_post_sr_rdmaw: ibv_post_send wr_id 661c70 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54615. [D 20:43:33.774192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 54616. [D 20:43:33.774203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 54617. [D 20:43:33.774213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 54618. [D 20:43:33.774223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 54619. [D 20:43:33.774233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 54620. [D 20:43:33.774243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 54621. [D 20:43:33.774253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 54622. [D 20:43:33.774263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 54623. [D 20:43:33.774273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 54624. [D 20:43:33.774283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 54625. [D 20:43:33.774293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 54626. [D 20:43:33.774303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 54627. [D 20:43:33.774313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 54628. [D 20:43:33.774323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 54629. [D 20:43:33.774333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 54630. [D 20:43:33.774343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 54631. [D 20:43:33.774353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 54632. [D 20:43:33.774363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 54633. [D 20:43:33.774373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 54634. [D 20:43:33.774384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 54635. [D 20:43:33.774393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 54636. [D 20:43:33.774404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 54637. [D 20:43:33.774413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 54638. [D 20:43:33.774423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 54639. [D 20:43:33.774434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 54640. [D 20:43:33.774444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 54641. [D 20:43:33.774454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 54642. [D 20:43:33.774464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 54643. [D 20:43:33.774474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 54644. [D 20:43:33.774484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 54645. [D 20:43:33.774494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 54646. [D 20:43:33.774504] openib_post_sr_rdmaw: ibv_post_send wr_id 6255e0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 54647. [D 20:43:33.774515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 54648. [D 20:43:33.774525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 54649. [D 20:43:33.774536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 54650. [D 20:43:33.774546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 54651. [D 20:43:33.774556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 54652. [D 20:43:33.774566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 54653. [D 20:43:33.774576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 54654. [E 20:43:33.774587] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 54655, block for 10 ms. [D 20:43:33.776300] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 54654. [E 20:43:33.776316] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 54655, block for 10 ms. [D 20:43:33.785576] openib_check_cq: completed rdma wr_id 661c70, nic_wr_credit 54654. [D 20:43:33.785591] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 35/70. [D 20:43:33.785601] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 54653. [D 20:43:33.785611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 54654. [D 20:43:33.785621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 54655. [D 20:43:33.785631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 54656. [D 20:43:33.785641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 54657. [D 20:43:33.785651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 54658. [D 20:43:33.785661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 54659. [D 20:43:33.785671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 54660. [D 20:43:33.785681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 54661. [D 20:43:33.785691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 54662. [D 20:43:33.785701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 54663. [D 20:43:33.785711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 54664. [D 20:43:33.785721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 54665. [D 20:43:33.785731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 54666. [D 20:43:33.785741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 54667. [D 20:43:33.785751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 54668. [D 20:43:33.785761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 54669. [D 20:43:33.785771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 54670. [D 20:43:33.785781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 54671. [D 20:43:33.785791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 54672. [D 20:43:33.785801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 54673. [D 20:43:33.785811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 54674. [D 20:43:33.785823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 54675. [D 20:43:33.785834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 54676. [D 20:43:33.785844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 54677. [D 20:43:33.785853] openib_post_sr_rdmaw: ibv_post_send wr_id 657190 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 54678. [D 20:43:33.785899] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.785943] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.785953] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:33.785982] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7747 [D 20:43:33.785994] element 0: offset: 0x61f010, size: 24 [D 20:43:33.786007] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 36/70. [D 20:43:33.797157] openib_check_cq: completed rdma wr_id 6255e0, nic_wr_credit 54678. [D 20:43:33.797175] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 37/70. [D 20:43:33.799231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.799245] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.799254] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:33.806358] openib_check_cq: completed rdma wr_id 657190, nic_wr_credit 54677. [D 20:43:33.806376] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 38/70. [D 20:43:33.806416] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.806430] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.806438] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:33.806501] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.806511] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.806519] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:33.808636] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7747 [D 20:43:33.808653] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 39/70. [D 20:43:33.811854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 54677. [D 20:43:33.811870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 54678. [D 20:43:33.811880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 54679. [D 20:43:33.811890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 54680. [D 20:43:33.811900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 54681. [D 20:43:33.811910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 54682. [D 20:43:33.811920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 54683. [D 20:43:33.811930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 54684. [D 20:43:33.811940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 54685. [D 20:43:33.811949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 54686. [D 20:43:33.811959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 54687. [D 20:43:33.811969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 54688. [D 20:43:33.811979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 54689. [D 20:43:33.811989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 54690. [D 20:43:33.811999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 54691. [D 20:43:33.812009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 54692. [D 20:43:33.812019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 54693. [D 20:43:33.812029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 54694. [D 20:43:33.812039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 54695. [D 20:43:33.812049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 54696. [D 20:43:33.812059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 54697. [D 20:43:33.812068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 54698. [D 20:43:33.812078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 54699. [D 20:43:33.812088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 54700. [D 20:43:33.812098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 54701. [D 20:43:33.812108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 54702. [D 20:43:33.812118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 54703. [D 20:43:33.812128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 54704. [D 20:43:33.812138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 54705. [D 20:43:33.812148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 54706. [D 20:43:33.812159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 54707. [D 20:43:33.812169] openib_post_sr_rdmaw: ibv_post_send wr_id 63e4f0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 54708. [D 20:43:33.812216] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.812248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.812257] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:33.812287] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7750 [D 20:43:33.812297] element 0: offset: 0x64d8f0, size: 24 [D 20:43:33.812310] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 40/70. [D 20:43:33.817803] openib_check_cq: completed rdma wr_id 63e4f0, nic_wr_credit 54708. [D 20:43:33.817822] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 41/70. [D 20:43:33.817916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.817931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.817939] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:33.820104] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7750 [D 20:43:33.820120] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 42/70. [D 20:43:33.820189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54708. [D 20:43:33.820204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54709. [D 20:43:33.820214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54710. [D 20:43:33.820224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54711. [D 20:43:33.820234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54712. [D 20:43:33.820244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54713. [D 20:43:33.820254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54714. [D 20:43:33.820266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54715. [D 20:43:33.820277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54716. [D 20:43:33.820286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54717. [D 20:43:33.820296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54718. [D 20:43:33.820306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54719. [D 20:43:33.820316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54720. [D 20:43:33.820326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54721. [D 20:43:33.820336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54722. [D 20:43:33.820346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54723. [D 20:43:33.820356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54724. [D 20:43:33.820366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54725. [D 20:43:33.820376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54726. [D 20:43:33.820386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54727. [D 20:43:33.820396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54728. [D 20:43:33.820406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54729. [D 20:43:33.820415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54730. [D 20:43:33.820425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54731. [D 20:43:33.820436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54732. [D 20:43:33.820445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54733. [D 20:43:33.820455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54734. [D 20:43:33.820465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54735. [D 20:43:33.820475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54736. [D 20:43:33.820485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54737. [D 20:43:33.820496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54738. [D 20:43:33.820506] openib_post_sr_rdmaw: ibv_post_send wr_id 6255e0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54739. [D 20:43:33.820747] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.820778] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.820787] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:33.820828] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7753 [D 20:43:33.820838] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:33.820852] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 43/70. [D 20:43:33.820963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:33.820974] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.820982] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:33.820999] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7756 [D 20:43:33.821008] element 0: offset: 0x2aaaab236cf0, size: 24 [D 20:43:33.821018] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 44/70. [D 20:43:33.826161] openib_check_cq: completed rdma wr_id 6255e0, nic_wr_credit 54739. [D 20:43:33.826180] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 45/70. [D 20:43:33.826283] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.826297] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.826306] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:33.830420] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7753 [D 20:43:33.830439] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 46/70. [D 20:43:33.830453] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7756 [D 20:43:33.830464] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 47/70. [D 20:43:33.830487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 54739. [D 20:43:33.830499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 54740. [D 20:43:33.830509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 54741. [D 20:43:33.830519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 54742. [D 20:43:33.830529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 54743. [D 20:43:33.830539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 54744. [D 20:43:33.830549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 54745. [D 20:43:33.830558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 54746. [D 20:43:33.830568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 54747. [D 20:43:33.830578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 54748. [D 20:43:33.830588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 54749. [D 20:43:33.830598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 54750. [D 20:43:33.830608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 54751. [D 20:43:33.830618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 54752. [D 20:43:33.830628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 54753. [D 20:43:33.830638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 54754. [D 20:43:33.830648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 54755. [D 20:43:33.830658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 54756. [D 20:43:33.830668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 54757. [D 20:43:33.830677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 54758. [D 20:43:33.830687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 54759. [D 20:43:33.830697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 54760. [D 20:43:33.830707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 54761. [D 20:43:33.830717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 54762. [D 20:43:33.830727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 54763. [D 20:43:33.830737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 54764. [D 20:43:33.830747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 54765. [D 20:43:33.830758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 54766. [D 20:43:33.830768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 54767. [D 20:43:33.830778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 54768. [D 20:43:33.830788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 54769. [D 20:43:33.830798] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 54770. [D 20:43:33.830809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 54771. [D 20:43:33.830819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 54772. [D 20:43:33.830829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 54773. [D 20:43:33.830839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 54774. [D 20:43:33.830849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 54775. [D 20:43:33.830859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 54776. [D 20:43:33.830869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 54777. [D 20:43:33.830879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 54778. [D 20:43:33.830889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 54779. [D 20:43:33.830899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 54780. [D 20:43:33.830910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 54781. [D 20:43:33.830919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 54782. [D 20:43:33.830929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 54783. [D 20:43:33.830939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 54784. [D 20:43:33.830950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 54785. [D 20:43:33.830960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 54786. [D 20:43:33.830970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 54787. [D 20:43:33.830979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 54788. [D 20:43:33.830990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 54789. [D 20:43:33.831000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 54790. [D 20:43:33.831010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 54791. [D 20:43:33.831020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 54792. [D 20:43:33.831030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 54793. [D 20:43:33.831040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 54794. [D 20:43:33.831050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 54795. [D 20:43:33.831060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 54796. [D 20:43:33.831070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 54797. [D 20:43:33.831080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 54798. [D 20:43:33.831090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 54799. [D 20:43:33.831100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 54800. [D 20:43:33.831110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 54801. [D 20:43:33.831120] openib_post_sr_rdmaw: ibv_post_send wr_id 6255e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 54802. [D 20:43:33.836354] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 54802. [D 20:43:33.836370] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 48/70. [D 20:43:33.842254] openib_check_cq: completed rdma wr_id 6255e0, nic_wr_credit 54801. [D 20:43:33.842269] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 49/70. [D 20:43:33.842324] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.842360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.842369] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:33.842391] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:33.842400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:33.842408] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.110849] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.110863] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.110872] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.110899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7758 [D 20:43:34.110910] element 0: offset: 0x2aaaab203100, size: 24 [D 20:43:34.110923] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 50/70. [D 20:43:34.113240] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7758 [D 20:43:34.113285] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 51/70. [D 20:43:34.113424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 54801. [D 20:43:34.113443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 54802. [D 20:43:34.113454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 54803. [D 20:43:34.113463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 54804. [D 20:43:34.113473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 54805. [D 20:43:34.113484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 54806. [D 20:43:34.113494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 54807. [D 20:43:34.113503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 54808. [D 20:43:34.113513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 54809. [D 20:43:34.113523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 54810. [D 20:43:34.113533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 54811. [D 20:43:34.113543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 54812. [D 20:43:34.113553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 54813. [D 20:43:34.113563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 54814. [D 20:43:34.113573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 54815. [D 20:43:34.113583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 54816. [D 20:43:34.113593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 54817. [D 20:43:34.113603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 54818. [D 20:43:34.113613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 54819. [D 20:43:34.113623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 54820. [D 20:43:34.113633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 54821. [D 20:43:34.113643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 54822. [D 20:43:34.113653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 54823. [D 20:43:34.113663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 54824. [D 20:43:34.113673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 54825. [D 20:43:34.113682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 54826. [D 20:43:34.113693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 54827. [D 20:43:34.113703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 54828. [D 20:43:34.113712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 54829. [D 20:43:34.113722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 54830. [D 20:43:34.113733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 54831. [D 20:43:34.113743] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 54832. [D 20:43:34.120167] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 54832. [D 20:43:34.120182] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 52/70. [D 20:43:34.120237] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.120251] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.120260] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.137906] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.137921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.137929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.137955] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7762 [D 20:43:34.137965] element 0: offset: 0x2aaaab20d840, size: 24 [D 20:43:34.137975] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 53/70. [D 20:43:34.140348] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7762 [D 20:43:34.140393] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 54/70. [D 20:43:34.140452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 54832. [D 20:43:34.140469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 54833. [D 20:43:34.140480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 54834. [D 20:43:34.140490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 54835. [D 20:43:34.140500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 54836. [D 20:43:34.140510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 54837. [D 20:43:34.140522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 54838. [D 20:43:34.140532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 54839. [D 20:43:34.140542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 54840. [D 20:43:34.140552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 54841. [D 20:43:34.140562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 54842. [D 20:43:34.140572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 54843. [D 20:43:34.140582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 54844. [D 20:43:34.140592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 54845. [D 20:43:34.140602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 54846. [D 20:43:34.140612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 54847. [D 20:43:34.140621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 54848. [D 20:43:34.140631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 54849. [D 20:43:34.140641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 54850. [D 20:43:34.140651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 54851. [D 20:43:34.140661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 54852. [D 20:43:34.140671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 54853. [D 20:43:34.140681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 54854. [D 20:43:34.140691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 54855. [D 20:43:34.140701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 54856. [D 20:43:34.140711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 54857. [D 20:43:34.140721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 54858. [D 20:43:34.140730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 54859. [D 20:43:34.140740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 54860. [D 20:43:34.140750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 54861. [D 20:43:34.140761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 54862. [D 20:43:34.140771] openib_post_sr_rdmaw: ibv_post_send wr_id 6255e0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 54863. [D 20:43:34.151438] openib_check_cq: completed rdma wr_id 6255e0, nic_wr_credit 54863. [D 20:43:34.151453] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 55/70. [D 20:43:34.151566] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.151581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.151589] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.162050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.162064] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.162073] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.162097] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7765 [D 20:43:34.162107] element 0: offset: 0x2aaaab2303e0, size: 24 [D 20:43:34.162118] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 56/70. [D 20:43:34.164390] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7765 [D 20:43:34.164435] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 57/70. [D 20:43:34.164490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54863. [D 20:43:34.164508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54864. [D 20:43:34.164518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54865. [D 20:43:34.164528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54866. [D 20:43:34.164541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54867. [D 20:43:34.164551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54868. [D 20:43:34.164561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54869. [D 20:43:34.164571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54870. [D 20:43:34.164581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54871. [D 20:43:34.164590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54872. [D 20:43:34.164600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54873. [D 20:43:34.164610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54874. [D 20:43:34.164620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54875. [D 20:43:34.164630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54876. [D 20:43:34.164640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54877. [D 20:43:34.164650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54878. [D 20:43:34.164660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54879. [D 20:43:34.164670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54880. [D 20:43:34.164680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54881. [D 20:43:34.164690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54882. [D 20:43:34.164699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54883. [D 20:43:34.164709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54884. [D 20:43:34.164719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54885. [D 20:43:34.164729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54886. [D 20:43:34.164739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54887. [D 20:43:34.164749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54888. [D 20:43:34.164759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54889. [D 20:43:34.164769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54890. [D 20:43:34.164779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54891. [D 20:43:34.164788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54892. [D 20:43:34.164799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54893. [D 20:43:34.164809] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54894. [D 20:43:34.175228] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 54894. [D 20:43:34.175243] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 58/70. [D 20:43:34.175352] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.175368] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.175377] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.186421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.186435] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.186443] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.186468] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7768 [D 20:43:34.186478] element 0: offset: 0x2aaaab2093f0, size: 24 [D 20:43:34.186489] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 59/70. [D 20:43:34.188851] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7768 [D 20:43:34.188896] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 60/70. [D 20:43:34.188953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54894. [D 20:43:34.188970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54895. [D 20:43:34.188981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54896. [D 20:43:34.188990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54897. [D 20:43:34.189001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54898. [D 20:43:34.189011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54899. [D 20:43:34.189023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54900. [D 20:43:34.189033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54901. [D 20:43:34.189043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54902. [D 20:43:34.189053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54903. [D 20:43:34.189063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54904. [D 20:43:34.189073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54905. [D 20:43:34.189082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54906. [D 20:43:34.189092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54907. [D 20:43:34.189102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54908. [D 20:43:34.189112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54909. [D 20:43:34.189122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54910. [D 20:43:34.189132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54911. [D 20:43:34.189142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54912. [D 20:43:34.189152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54913. [D 20:43:34.189162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54914. [D 20:43:34.189172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54915. [D 20:43:34.189182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54916. [D 20:43:34.189192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54917. [D 20:43:34.189201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54918. [D 20:43:34.189211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54919. [D 20:43:34.189221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54920. [D 20:43:34.189231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54921. [D 20:43:34.189241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54922. [D 20:43:34.189251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54923. [D 20:43:34.189262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54924. [D 20:43:34.189272] openib_post_sr_rdmaw: ibv_post_send wr_id 6255e0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54925. [D 20:43:34.199834] openib_check_cq: completed rdma wr_id 6255e0, nic_wr_credit 54925. [D 20:43:34.199850] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 0/70. [D 20:43:34.199960] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.199975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.199984] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.210497] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.210511] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.210519] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.210544] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7771 [D 20:43:34.210554] element 0: offset: 0x2aaaab236cf0, size: 24 [D 20:43:34.210566] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 1/70. [D 20:43:34.212937] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7771 [D 20:43:34.212983] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 2/70. [D 20:43:34.213039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54925. [D 20:43:34.213056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54926. [D 20:43:34.213067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54927. [D 20:43:34.213077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54928. [D 20:43:34.213087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54929. [D 20:43:34.213097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54930. [D 20:43:34.213109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54931. [D 20:43:34.213119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54932. [D 20:43:34.213129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54933. [D 20:43:34.213139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54934. [D 20:43:34.213149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54935. [D 20:43:34.213159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54936. [D 20:43:34.213169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54937. [D 20:43:34.213179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54938. [D 20:43:34.213189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54939. [D 20:43:34.213198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54940. [D 20:43:34.213208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54941. [D 20:43:34.213218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54942. [D 20:43:34.213228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54943. [D 20:43:34.213238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54944. [D 20:43:34.213248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54945. [D 20:43:34.213258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54946. [D 20:43:34.213268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54947. [D 20:43:34.213278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54948. [D 20:43:34.213288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54949. [D 20:43:34.213298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54950. [D 20:43:34.213308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54951. [D 20:43:34.213317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54952. [D 20:43:34.213327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54953. [D 20:43:34.213337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54954. [D 20:43:34.213348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54955. [D 20:43:34.213358] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54956. [D 20:43:34.223877] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 54956. [D 20:43:34.223891] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 3/70. [D 20:43:34.224000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.224015] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.224024] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.241553] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.241567] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.241575] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.241601] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7774 [D 20:43:34.241611] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:34.241622] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 4/70. [D 20:43:34.244125] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7774 [D 20:43:34.244172] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 5/70. [D 20:43:34.244229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54956. [D 20:43:34.244247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54957. [D 20:43:34.244258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54958. [D 20:43:34.244268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54959. [D 20:43:34.244277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54960. [D 20:43:34.244288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54961. [D 20:43:34.244308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54962. [D 20:43:34.244318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54963. [D 20:43:34.244327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54964. [D 20:43:34.244337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54965. [D 20:43:34.244347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54966. [D 20:43:34.244357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54967. [D 20:43:34.244367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54968. [D 20:43:34.244377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 54969. [D 20:43:34.244387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 54970. [D 20:43:34.244397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 54971. [D 20:43:34.244407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 54972. [D 20:43:34.244417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 54973. [D 20:43:34.244427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 54974. [D 20:43:34.244437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 54975. [D 20:43:34.244446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 54976. [D 20:43:34.244457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 54977. [D 20:43:34.244466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 54978. [D 20:43:34.244476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 54979. [D 20:43:34.244486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 54980. [D 20:43:34.244496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 54981. [D 20:43:34.244506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 54982. [D 20:43:34.244516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 54983. [D 20:43:34.244526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 54984. [D 20:43:34.244536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 54985. [D 20:43:34.244546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 54986. [D 20:43:34.244557] openib_post_sr_rdmaw: ibv_post_send wr_id 6255e0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 54987. [D 20:43:34.254940] openib_check_cq: completed rdma wr_id 6255e0, nic_wr_credit 54987. [D 20:43:34.254955] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 6/70. [D 20:43:34.255064] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.255079] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.255087] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.264981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.264994] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.265003] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.265028] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7777 [D 20:43:34.265038] element 0: offset: 0x2aaaab202db0, size: 24 [D 20:43:34.265049] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 7/70. [D 20:43:34.267685] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7777 [D 20:43:34.267731] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 8/70. [D 20:43:34.267789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 54987. [D 20:43:34.267807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 54988. [D 20:43:34.267817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 54989. [D 20:43:34.267827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 54990. [D 20:43:34.267837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 54991. [D 20:43:34.267847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 54992. [D 20:43:34.267867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 54993. [D 20:43:34.267878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 54994. [D 20:43:34.267888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 54995. [D 20:43:34.267898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 54996. [D 20:43:34.267907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 54997. [D 20:43:34.267917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 54998. [D 20:43:34.267927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 54999. [D 20:43:34.267937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 55000. [D 20:43:34.267947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 55001. [D 20:43:34.267957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 55002. [D 20:43:34.267967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 55003. [D 20:43:34.267977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 55004. [D 20:43:34.267987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 55005. [D 20:43:34.267997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 55006. [D 20:43:34.268006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 55007. [D 20:43:34.268017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 55008. [D 20:43:34.268027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 55009. [D 20:43:34.268036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 55010. [D 20:43:34.268046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 55011. [D 20:43:34.268056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 55012. [D 20:43:34.268066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 55013. [D 20:43:34.268076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 55014. [D 20:43:34.268086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 55015. [D 20:43:34.268096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 55016. [D 20:43:34.268106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 55017. [D 20:43:34.268116] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 55018. [D 20:43:34.275948] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.275965] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.275974] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:34.276009] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7781 [D 20:43:34.276021] element 0: offset: 0x2aaaab202ae0, size: 24 [D 20:43:34.276032] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 9/70. [D 20:43:34.276064] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.276073] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.276082] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:34.276096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7782 [D 20:43:34.276106] element 0: offset: 0x2aaaab203100, size: 24 [D 20:43:34.276116] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 10/70. [D 20:43:34.278588] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 55018. [D 20:43:34.278608] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 11/70. [D 20:43:34.278703] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.278716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.278725] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:34.282625] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7782 [D 20:43:34.282646] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 12/70. [D 20:43:34.282661] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7781 [D 20:43:34.282671] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 13/70. [D 20:43:34.285208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 55018. [D 20:43:34.285224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 55019. [D 20:43:34.285234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 55020. [D 20:43:34.285244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 55021. [D 20:43:34.285254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 55022. [D 20:43:34.285264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 55023. [D 20:43:34.285274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 55024. [D 20:43:34.285284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 55025. [D 20:43:34.285294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 55026. [D 20:43:34.285304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 55027. [D 20:43:34.285314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 55028. [D 20:43:34.285324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 55029. [D 20:43:34.285334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 55030. [D 20:43:34.285343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 55031. [D 20:43:34.285353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 55032. [D 20:43:34.285363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 55033. [D 20:43:34.285373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 55034. [D 20:43:34.285383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 55035. [D 20:43:34.285393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 55036. [D 20:43:34.285403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 55037. [D 20:43:34.285413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 55038. [D 20:43:34.285423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 55039. [D 20:43:34.285433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 55040. [D 20:43:34.285443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 55041. [D 20:43:34.285453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 55042. [D 20:43:34.285462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 55043. [D 20:43:34.285473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 55044. [D 20:43:34.285482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 55045. [D 20:43:34.285492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 55046. [D 20:43:34.285502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 55047. [D 20:43:34.285513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 55048. [D 20:43:34.285523] openib_post_sr_rdmaw: ibv_post_send wr_id 6255e0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 55049. [D 20:43:34.285534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 55050. [D 20:43:34.285545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 55051. [D 20:43:34.285555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 55052. [D 20:43:34.285565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 55053. [D 20:43:34.285575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 55054. [D 20:43:34.285585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 55055. [D 20:43:34.285595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 55056. [D 20:43:34.285605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 55057. [D 20:43:34.285615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 55058. [D 20:43:34.285625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 55059. [D 20:43:34.285635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 55060. [D 20:43:34.285645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 55061. [D 20:43:34.285655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 55062. [D 20:43:34.285665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 55063. [D 20:43:34.285675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 55064. [D 20:43:34.285685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 55065. [D 20:43:34.285695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 55066. [D 20:43:34.285705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 55067. [D 20:43:34.285715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 55068. [D 20:43:34.285725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 55069. [D 20:43:34.285735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 55070. [D 20:43:34.285745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 55071. [D 20:43:34.285755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 55072. [D 20:43:34.285765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 55073. [D 20:43:34.285775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 55074. [D 20:43:34.285785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 55075. [D 20:43:34.285795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 55076. [D 20:43:34.285805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 55077. [D 20:43:34.285815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 55078. [D 20:43:34.285825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 55079. [D 20:43:34.285835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 55080. [D 20:43:34.285845] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 55081. [D 20:43:34.287892] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.287935] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.287944] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:34.287974] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7786 [D 20:43:34.287984] element 0: offset: 0x2aaaab20d840, size: 24 [D 20:43:34.287997] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 14/70. [D 20:43:34.296509] openib_check_cq: completed rdma wr_id 6255e0, nic_wr_credit 55081. [D 20:43:34.296528] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 15/70. [D 20:43:34.308040] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 55080. [D 20:43:34.308055] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 16/70. [D 20:43:34.308096] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.308110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.308118] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:34.308194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.308204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.308213] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:34.310376] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7786 [D 20:43:34.310394] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 17/70. [D 20:43:34.314015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 55080. [D 20:43:34.314031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 55081. [D 20:43:34.314042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 55082. [D 20:43:34.314052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 55083. [D 20:43:34.314061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 55084. [D 20:43:34.314072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 55085. [D 20:43:34.314082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55086. [D 20:43:34.314091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 55087. [D 20:43:34.314101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 55088. [D 20:43:34.314111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 55089. [D 20:43:34.314121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 55090. [D 20:43:34.314131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 55091. [D 20:43:34.314141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 55092. [D 20:43:34.314151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 55093. [D 20:43:34.314161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 55094. [D 20:43:34.314171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 55095. [D 20:43:34.314181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 55096. [D 20:43:34.314191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 55097. [D 20:43:34.314201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 55098. [D 20:43:34.314210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 55099. [D 20:43:34.314221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 55100. [D 20:43:34.314231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 55101. [D 20:43:34.314240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 55102. [D 20:43:34.314250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 55103. [D 20:43:34.314260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 55104. [D 20:43:34.314270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 55105. [D 20:43:34.314280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 55106. [D 20:43:34.314290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 55107. [D 20:43:34.314300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 55108. [D 20:43:34.314310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 55109. [D 20:43:34.314320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 55110. [D 20:43:34.314331] openib_post_sr_rdmaw: ibv_post_send wr_id 662450 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 55111. [D 20:43:34.316670] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.316705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.316714] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:34.316745] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7789 [D 20:43:34.316755] element 0: offset: 0x662650, size: 24 [D 20:43:34.316768] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 18/70. [D 20:43:34.319898] openib_check_cq: completed rdma wr_id 662450, nic_wr_credit 55111. [D 20:43:34.319917] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 19/70. [D 20:43:34.319993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.320007] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.320015] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:34.321993] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7789 [D 20:43:34.322038] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 20/70. [D 20:43:34.322092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 55111. [D 20:43:34.322110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 55112. [D 20:43:34.322120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 55113. [D 20:43:34.322130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 55114. [D 20:43:34.322140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 55115. [D 20:43:34.322150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 55116. [D 20:43:34.322163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 55117. [D 20:43:34.322173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 55118. [D 20:43:34.322183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 55119. [D 20:43:34.322193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 55120. [D 20:43:34.322203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 55121. [D 20:43:34.322213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 55122. [D 20:43:34.322222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 55123. [D 20:43:34.322232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 55124. [D 20:43:34.322242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 55125. [D 20:43:34.322252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 55126. [D 20:43:34.322262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 55127. [D 20:43:34.322272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 55128. [D 20:43:34.322282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 55129. [D 20:43:34.322292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 55130. [D 20:43:34.322302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 55131. [D 20:43:34.322312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 55132. [D 20:43:34.322322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 55133. [D 20:43:34.322332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 55134. [D 20:43:34.322342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 55135. [D 20:43:34.322352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 55136. [D 20:43:34.322362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 55137. [D 20:43:34.322372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 55138. [D 20:43:34.322381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 55139. [D 20:43:34.322392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 55140. [D 20:43:34.322402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 55141. [D 20:43:34.322412] openib_post_sr_rdmaw: ibv_post_send wr_id 61e530 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 55142. [D 20:43:34.328035] openib_check_cq: completed rdma wr_id 61e530, nic_wr_credit 55142. [D 20:43:34.328050] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 21/70. [D 20:43:34.328103] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.328118] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.328127] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.365856] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.365870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.365879] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.365904] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7792 [D 20:43:34.365914] element 0: offset: 0x64dd40, size: 24 [D 20:43:34.365926] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 22/70. [D 20:43:34.367957] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7792 [D 20:43:34.368002] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 23/70. [D 20:43:34.368055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 55142. [D 20:43:34.368074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 55143. [D 20:43:34.368084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 55144. [D 20:43:34.368094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 55145. [D 20:43:34.368104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 55146. [D 20:43:34.368116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 55147. [D 20:43:34.368126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 55148. [D 20:43:34.368136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 55149. [D 20:43:34.368146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 55150. [D 20:43:34.368155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 55151. [D 20:43:34.368165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 55152. [D 20:43:34.368175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 55153. [D 20:43:34.368185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 55154. [D 20:43:34.368195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 55155. [D 20:43:34.368205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 55156. [D 20:43:34.368215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 55157. [D 20:43:34.368225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 55158. [D 20:43:34.368235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 55159. [D 20:43:34.368245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 55160. [D 20:43:34.368255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 55161. [D 20:43:34.368264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 55162. [D 20:43:34.368274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 55163. [D 20:43:34.368284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 55164. [D 20:43:34.368294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 55165. [D 20:43:34.368304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 55166. [D 20:43:34.368314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 55167. [D 20:43:34.368324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 55168. [D 20:43:34.368334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 55169. [D 20:43:34.368344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 55170. [D 20:43:34.368354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 55171. [D 20:43:34.368364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 55172. [D 20:43:34.368374] openib_post_sr_rdmaw: ibv_post_send wr_id 6255e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 55173. [D 20:43:34.373929] openib_check_cq: completed rdma wr_id 6255e0, nic_wr_credit 55173. [D 20:43:34.373945] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 24/70. [D 20:43:34.374005] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.374020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.374029] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.538991] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.539006] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.539014] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.539039] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7794 [D 20:43:34.539049] element 0: offset: 0x5b0030, size: 24 [D 20:43:34.539060] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 25/70. [D 20:43:34.541095] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7794 [D 20:43:34.541139] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 26/70. [D 20:43:34.541189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 55173. [D 20:43:34.541208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 55174. [D 20:43:34.541218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 55175. [D 20:43:34.541228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 55176. [D 20:43:34.541238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 55177. [D 20:43:34.541250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 55178. [D 20:43:34.541260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 55179. [D 20:43:34.541269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 55180. [D 20:43:34.541279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 55181. [D 20:43:34.541289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 55182. [D 20:43:34.541299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 55183. [D 20:43:34.541309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 55184. [D 20:43:34.541319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 55185. [D 20:43:34.541329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 55186. [D 20:43:34.541338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 55187. [D 20:43:34.541348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 55188. [D 20:43:34.541358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 55189. [D 20:43:34.541368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 55190. [D 20:43:34.541378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 55191. [D 20:43:34.541388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 55192. [D 20:43:34.541398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 55193. [D 20:43:34.541407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 55194. [D 20:43:34.541417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 55195. [D 20:43:34.541427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 55196. [D 20:43:34.541437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 55197. [D 20:43:34.541447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 55198. [D 20:43:34.541457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 55199. [D 20:43:34.541467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 55200. [D 20:43:34.541476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 55201. [D 20:43:34.541487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 55202. [D 20:43:34.541497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 55203. [D 20:43:34.541507] openib_post_sr_rdmaw: ibv_post_send wr_id 6622c0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 55204. [D 20:43:34.541541] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.541555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.541564] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:34.541592] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7798 [D 20:43:34.541602] element 0: offset: 0x625660, size: 24 [D 20:43:34.541612] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 27/70. [D 20:43:34.552153] openib_check_cq: completed rdma wr_id 6622c0, nic_wr_credit 55204. [D 20:43:34.552172] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 28/70. [D 20:43:34.552278] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.552293] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.552301] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:34.554812] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7798 [D 20:43:34.554860] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 29/70. [D 20:43:34.554992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 55204. [D 20:43:34.555017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 55205. [D 20:43:34.555028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 55206. [D 20:43:34.555038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 55207. [D 20:43:34.555048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 55208. [D 20:43:34.555057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 55209. [D 20:43:34.555067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55210. [D 20:43:34.555077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 55211. [D 20:43:34.555087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 55212. [D 20:43:34.555097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 55213. [D 20:43:34.555107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 55214. [D 20:43:34.555117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 55215. [D 20:43:34.555127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 55216. [D 20:43:34.555137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 55217. [D 20:43:34.555147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 55218. [D 20:43:34.555156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 55219. [D 20:43:34.555166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 55220. [D 20:43:34.555176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 55221. [D 20:43:34.555186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 55222. [D 20:43:34.555196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 55223. [D 20:43:34.555206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 55224. [D 20:43:34.555216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 55225. [D 20:43:34.555226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 55226. [D 20:43:34.555236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 55227. [D 20:43:34.555246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 55228. [D 20:43:34.555255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 55229. [D 20:43:34.555265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 55230. [D 20:43:34.555275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 55231. [D 20:43:34.555285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 55232. [D 20:43:34.555295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 55233. [D 20:43:34.555306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 55234. [D 20:43:34.555316] openib_post_sr_rdmaw: ibv_post_send wr_id 6622c0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 55235. [D 20:43:34.564585] openib_check_cq: completed rdma wr_id 6622c0, nic_wr_credit 55235. [D 20:43:34.564601] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 30/70. [D 20:43:34.564656] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.564671] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.564680] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.576327] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.576342] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.576350] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.576375] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7802 [D 20:43:34.576385] element 0: offset: 0x625390, size: 24 [D 20:43:34.576403] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 31/70. [D 20:43:34.576437] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.576447] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.576455] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:34.576470] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7804 [D 20:43:34.576479] element 0: offset: 0x61ee50, size: 24 [D 20:43:34.576489] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 32/70. [D 20:43:34.580964] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7802 [D 20:43:34.581017] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 33/70. [D 20:43:34.581055] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7804 [D 20:43:34.581067] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 34/70. [D 20:43:34.581147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 55235. [D 20:43:34.581165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 55236. [D 20:43:34.581183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 55237. [D 20:43:34.581200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 55238. [D 20:43:34.581211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 55239. [D 20:43:34.581220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 55240. [D 20:43:34.581230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 55241. [D 20:43:34.581240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 55242. [D 20:43:34.581250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 55243. [D 20:43:34.581260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 55244. [D 20:43:34.581270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 55245. [D 20:43:34.581280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 55246. [D 20:43:34.581290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 55247. [D 20:43:34.581300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 55248. [D 20:43:34.581310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 55249. [D 20:43:34.581320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 55250. [D 20:43:34.581330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 55251. [D 20:43:34.581339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 55252. [D 20:43:34.581349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 55253. [D 20:43:34.581359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 55254. [D 20:43:34.581369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 55255. [D 20:43:34.581379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 55256. [D 20:43:34.581389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 55257. [D 20:43:34.581399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 55258. [D 20:43:34.581409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 55259. [D 20:43:34.581419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 55260. [D 20:43:34.581429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 55261. [D 20:43:34.581438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 55262. [D 20:43:34.581448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 55263. [D 20:43:34.581458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 55264. [D 20:43:34.581469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 55265. [D 20:43:34.581479] openib_post_sr_rdmaw: ibv_post_send wr_id 6432c0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 55266. [D 20:43:34.581491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 55267. [D 20:43:34.581501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 55268. [D 20:43:34.581511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 55269. [D 20:43:34.581521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 55270. [D 20:43:34.581531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 55271. [D 20:43:34.581541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 55272. [D 20:43:34.581551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 55273. [D 20:43:34.581561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 55274. [D 20:43:34.581571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 55275. [D 20:43:34.581581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 55276. [D 20:43:34.581592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 55277. [D 20:43:34.581602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 55278. [D 20:43:34.581612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 55279. [D 20:43:34.581621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 55280. [D 20:43:34.581631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 55281. [D 20:43:34.581642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 55282. [D 20:43:34.581652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 55283. [D 20:43:34.581662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 55284. [D 20:43:34.581672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 55285. [D 20:43:34.581682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 55286. [D 20:43:34.581692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 55287. [D 20:43:34.581702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 55288. [D 20:43:34.581712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 55289. [D 20:43:34.581722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 55290. [D 20:43:34.581732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 55291. [D 20:43:34.581742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 55292. [D 20:43:34.581752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 55293. [D 20:43:34.581763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 55294. [D 20:43:34.581773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 55295. [D 20:43:34.581783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 55296. [D 20:43:34.581793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 55297. [D 20:43:34.581803] openib_post_sr_rdmaw: ibv_post_send wr_id 61f210 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 55298. [D 20:43:34.591219] openib_check_cq: completed rdma wr_id 6432c0, nic_wr_credit 55298. [D 20:43:34.591239] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 35/70. [D 20:43:34.599429] openib_check_cq: completed rdma wr_id 61f210, nic_wr_credit 55297. [D 20:43:34.599448] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 36/70. [D 20:43:34.599496] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.599511] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.599519] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:34.599586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.599596] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.599605] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.602807] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.602821] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.602830] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.602855] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7807 [D 20:43:34.602865] element 0: offset: 0x5b0030, size: 24 [D 20:43:34.602875] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 37/70. [D 20:43:34.605049] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.605062] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.605072] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:34.605086] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7810 [D 20:43:34.605096] element 0: offset: 0x61ee50, size: 24 [D 20:43:34.605105] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 38/70. [D 20:43:34.607476] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7807 [D 20:43:34.607496] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 39/70. [D 20:43:34.608739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 55297. [D 20:43:34.608755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 55298. [D 20:43:34.608766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 55299. [D 20:43:34.608776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 55300. [D 20:43:34.608786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 55301. [D 20:43:34.608796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 55302. [D 20:43:34.608806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 55303. [D 20:43:34.608816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 55304. [D 20:43:34.608826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 55305. [D 20:43:34.608836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 55306. [D 20:43:34.608846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 55307. [D 20:43:34.608855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 55308. [D 20:43:34.608868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 55309. [D 20:43:34.608878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 55310. [D 20:43:34.608888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 55311. [D 20:43:34.608898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 55312. [D 20:43:34.608908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 55313. [D 20:43:34.608918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 55314. [D 20:43:34.608928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 55315. [D 20:43:34.608937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 55316. [D 20:43:34.608948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 55317. [D 20:43:34.608957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 55318. [D 20:43:34.608967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 55319. [D 20:43:34.608978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 55320. [D 20:43:34.608987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 55321. [D 20:43:34.608997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 55322. [D 20:43:34.609007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 55323. [D 20:43:34.609017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 55324. [D 20:43:34.609027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 55325. [D 20:43:34.609037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 55326. [D 20:43:34.609048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 55327. [D 20:43:34.609058] openib_post_sr_rdmaw: ibv_post_send wr_id 63e4f0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 55328. [D 20:43:34.611366] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7810 [D 20:43:34.611380] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 40/70. [D 20:43:34.614790] openib_check_cq: completed rdma wr_id 63e4f0, nic_wr_credit 55328. [D 20:43:34.614805] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 41/70. [D 20:43:34.614873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 55328. [D 20:43:34.614868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.614928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.614889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 55329. [D 20:43:34.614945] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:34.614970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 55330. [D 20:43:34.614984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 55331. [D 20:43:34.614994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 55332. [D 20:43:34.615006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 55333. [D 20:43:34.615016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55334. [D 20:43:34.615026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 55335. [D 20:43:34.615036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 55336. [D 20:43:34.615046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 55337. [D 20:43:34.615056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 55338. [D 20:43:34.615066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 55339. [D 20:43:34.615076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 55340. [D 20:43:34.615086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 55341. [D 20:43:34.615095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 55342. [D 20:43:34.615105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 55343. [D 20:43:34.615115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 55344. [D 20:43:34.615125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 55345. [D 20:43:34.615135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 55346. [D 20:43:34.615145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 55347. [D 20:43:34.615155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 55348. [D 20:43:34.615165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 55349. [D 20:43:34.615175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 55350. [D 20:43:34.615184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 55351. [D 20:43:34.615194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 55352. [D 20:43:34.615204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 55353. [D 20:43:34.615214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 55354. [D 20:43:34.615224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 55355. [D 20:43:34.615234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 55356. [D 20:43:34.615244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 55357. [D 20:43:34.615254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 55358. [D 20:43:34.615264] openib_post_sr_rdmaw: ibv_post_send wr_id 643200 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 55359. [D 20:43:34.615296] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.615309] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.615318] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:34.615344] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7813 [D 20:43:34.615354] element 0: offset: 0x5b0030, size: 24 [D 20:43:34.615366] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 42/70. [D 20:43:34.617749] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.617762] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.617770] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:34.617786] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7816 [D 20:43:34.617796] element 0: offset: 0x64dd40, size: 24 [D 20:43:34.617806] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 43/70. [D 20:43:34.626560] openib_check_cq: completed rdma wr_id 643200, nic_wr_credit 55359. [D 20:43:34.626579] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 44/70. [D 20:43:34.626678] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.626693] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.626701] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:34.631041] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7813 [D 20:43:34.631060] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 45/70. [D 20:43:34.631074] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7816 [D 20:43:34.631085] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 46/70. [D 20:43:34.632113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 55359. [D 20:43:34.632128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 55360. [D 20:43:34.632138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 55361. [D 20:43:34.632148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 55362. [D 20:43:34.632158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 55363. [D 20:43:34.632168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 55364. [D 20:43:34.632178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 55365. [D 20:43:34.632188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 55366. [D 20:43:34.632198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 55367. [D 20:43:34.632207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 55368. [D 20:43:34.632217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 55369. [D 20:43:34.632227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 55370. [D 20:43:34.632237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 55371. [D 20:43:34.632247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 55372. [D 20:43:34.632257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 55373. [D 20:43:34.632267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 55374. [D 20:43:34.632277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 55375. [D 20:43:34.632287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 55376. [D 20:43:34.632297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 55377. [D 20:43:34.632306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 55378. [D 20:43:34.632316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 55379. [D 20:43:34.632326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 55380. [D 20:43:34.632336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 55381. [D 20:43:34.632346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 55382. [D 20:43:34.632356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 55383. [D 20:43:34.632366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 55384. [D 20:43:34.632376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 55385. [D 20:43:34.632385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 55386. [D 20:43:34.632395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 55387. [D 20:43:34.632405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 55388. [D 20:43:34.632416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 55389. [D 20:43:34.632426] openib_post_sr_rdmaw: ibv_post_send wr_id 63e4f0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 55390. [D 20:43:34.632437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 55391. [D 20:43:34.632447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 55392. [D 20:43:34.632457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 55393. [D 20:43:34.632467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 55394. [D 20:43:34.632477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 55395. [D 20:43:34.632487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 55396. [D 20:43:34.632497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 55397. [D 20:43:34.632507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 55398. [D 20:43:34.632517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 55399. [D 20:43:34.632527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 55400. [D 20:43:34.632537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 55401. [D 20:43:34.632547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 55402. [D 20:43:34.632557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 55403. [D 20:43:34.632567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 55404. [D 20:43:34.632577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 55405. [D 20:43:34.632587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 55406. [D 20:43:34.632596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 55407. [D 20:43:34.632606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 55408. [D 20:43:34.632616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 55409. [D 20:43:34.632626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 55410. [D 20:43:34.632636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 55411. [D 20:43:34.632646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 55412. [D 20:43:34.632656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 55413. [D 20:43:34.632666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 55414. [D 20:43:34.632676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 55415. [D 20:43:34.632686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 55416. [D 20:43:34.632696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 55417. [D 20:43:34.632706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 55418. [D 20:43:34.632716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 55419. [D 20:43:34.632726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 55420. [D 20:43:34.632736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 55421. [D 20:43:34.632746] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 55422. [D 20:43:34.638473] openib_check_cq: completed rdma wr_id 63e4f0, nic_wr_credit 55422. [D 20:43:34.638488] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 47/70. [D 20:43:34.638740] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.638778] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.638787] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:34.638817] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7818 [D 20:43:34.638827] element 0: offset: 0x625660, size: 24 [D 20:43:34.638840] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 48/70. [D 20:43:34.641268] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.641282] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.641290] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:34.641307] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7822 [D 20:43:34.641316] element 0: offset: 0x61f040, size: 24 [D 20:43:34.641327] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 49/70. [D 20:43:34.649920] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 55421. [D 20:43:34.649939] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 50/70. [D 20:43:34.649979] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.649994] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.650002] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:34.650085] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.650095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.650104] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:34.654389] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7822 [D 20:43:34.654409] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 51/70. [D 20:43:34.654423] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7818 [D 20:43:34.654434] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 52/70. [D 20:43:34.654541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 55421. [D 20:43:34.654555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 55422. [D 20:43:34.654565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 55423. [D 20:43:34.654575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 55424. [D 20:43:34.654586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 55425. [D 20:43:34.654596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 55426. [D 20:43:34.654606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55427. [D 20:43:34.654615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 55428. [D 20:43:34.654625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 55429. [D 20:43:34.654635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 55430. [D 20:43:34.654645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 55431. [D 20:43:34.654655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 55432. [D 20:43:34.654665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 55433. [D 20:43:34.654675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 55434. [D 20:43:34.654685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 55435. [D 20:43:34.654695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 55436. [D 20:43:34.654704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 55437. [D 20:43:34.654714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 55438. [D 20:43:34.654724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 55439. [D 20:43:34.654734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 55440. [D 20:43:34.654744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 55441. [D 20:43:34.654754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 55442. [D 20:43:34.654764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 55443. [D 20:43:34.654774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 55444. [D 20:43:34.654784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 55445. [D 20:43:34.654793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 55446. [D 20:43:34.654803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 55447. [D 20:43:34.654813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 55448. [D 20:43:34.654823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 55449. [D 20:43:34.654833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 55450. [D 20:43:34.654844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 55451. [D 20:43:34.654854] openib_post_sr_rdmaw: ibv_post_send wr_id 63e4f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 55452. [D 20:43:34.654865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 55453. [D 20:43:34.654875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 55454. [D 20:43:34.654885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 55455. [D 20:43:34.654895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 55456. [D 20:43:34.654905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 55457. [D 20:43:34.654915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 55458. [D 20:43:34.654925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 55459. [D 20:43:34.654935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 55460. [D 20:43:34.654945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 55461. [D 20:43:34.654955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 55462. [D 20:43:34.654965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 55463. [D 20:43:34.654975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 55464. [D 20:43:34.654985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 55465. [D 20:43:34.654995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 55466. [D 20:43:34.655004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 55467. [D 20:43:34.655014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 55468. [D 20:43:34.655024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 55469. [D 20:43:34.655034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 55470. [D 20:43:34.655044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 55471. [D 20:43:34.655054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 55472. [D 20:43:34.655064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 55473. [D 20:43:34.655074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 55474. [D 20:43:34.655084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 55475. [D 20:43:34.655094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 55476. [D 20:43:34.655104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 55477. [D 20:43:34.655114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 55478. [D 20:43:34.655124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 55479. [D 20:43:34.655134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 55480. [D 20:43:34.655144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 55481. [D 20:43:34.655154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 55482. [D 20:43:34.655164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 55483. [D 20:43:34.655174] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233d40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 55484. [D 20:43:34.661859] openib_check_cq: completed rdma wr_id 63e4f0, nic_wr_credit 55484. [D 20:43:34.661874] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 53/70. [D 20:43:34.667722] openib_check_cq: completed rdma wr_id 2aaaab233d40, nic_wr_credit 55483. [D 20:43:34.667737] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 54/70. [D 20:43:34.667790] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.667827] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.667836] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:34.667858] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.667867] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.667875] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:34.671666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.671678] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.671687] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:34.671713] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7826 [D 20:43:34.671723] element 0: offset: 0x61e5b0, size: 24 [D 20:43:34.671735] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 55/70. [D 20:43:34.673890] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:34.673903] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.673913] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:34.673928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7828 [D 20:43:34.673938] element 0: offset: 0x625660, size: 24 [D 20:43:34.673947] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 56/70. [D 20:43:34.678667] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7828 [D 20:43:34.678740] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 57/70. [D 20:43:34.678762] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7826 [D 20:43:34.678782] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 58/70. [D 20:43:34.678809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 55483. [D 20:43:34.678860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 55484. [D 20:43:34.678871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 55485. [D 20:43:34.678880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 55486. [D 20:43:34.678890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 55487. [D 20:43:34.678899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 55488. [D 20:43:34.678908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 55489. [D 20:43:34.678918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 55490. [D 20:43:34.678931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 55491. [D 20:43:34.678941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 55492. [D 20:43:34.678950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 55493. [D 20:43:34.678960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 55494. [D 20:43:34.678969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 55495. [D 20:43:34.678979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 55496. [D 20:43:34.678990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 55497. [D 20:43:34.679000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 55498. [D 20:43:34.679009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 55499. [D 20:43:34.679019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 55500. [D 20:43:34.679028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 55501. [D 20:43:34.679037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 55502. [D 20:43:34.679052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 55503. [D 20:43:34.679067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 55504. [D 20:43:34.679077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 55505. [D 20:43:34.679086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 55506. [D 20:43:34.679096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 55507. [D 20:43:34.679114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 55508. [D 20:43:34.679123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 55509. [D 20:43:34.679133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 55510. [D 20:43:34.679142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 55511. [D 20:43:34.679152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 55512. [D 20:43:34.679169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 55513. [D 20:43:34.679179] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 55514. [D 20:43:34.679192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 55515. [D 20:43:34.679202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 55516. [D 20:43:34.679212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 55517. [D 20:43:34.679221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 55518. [D 20:43:34.679231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 55519. [D 20:43:34.679255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 55520. [D 20:43:34.679265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 55521. [D 20:43:34.679274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 55522. [D 20:43:34.679283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 55523. [D 20:43:34.679299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 55524. [D 20:43:34.679308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 55525. [D 20:43:34.679318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 55526. [D 20:43:34.679327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 55527. [D 20:43:34.679337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 55528. [D 20:43:34.679347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 55529. [D 20:43:34.679356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 55530. [D 20:43:34.679366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 55531. [D 20:43:34.679375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 55532. [D 20:43:34.679385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 55533. [D 20:43:34.679395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 55534. [D 20:43:34.679404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 55535. [D 20:43:34.679414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 55536. [D 20:43:34.679423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 55537. [D 20:43:34.679432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 55538. [D 20:43:34.679442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 55539. [D 20:43:34.679452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 55540. [D 20:43:34.679475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 55541. [D 20:43:34.679484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 55542. [D 20:43:34.679494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 55543. [D 20:43:34.679503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 55544. [D 20:43:34.679513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 55545. [D 20:43:34.679525] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233d40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 55546. [D 20:43:34.684778] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 55546. [D 20:43:34.684797] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 59/70. [D 20:43:34.690707] openib_check_cq: completed rdma wr_id 2aaaab233d40, nic_wr_credit 55545. [D 20:43:34.690728] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 60/70. [D 20:43:34.690785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.690800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.690809] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:34.690830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:34.690839] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:34.690847] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.006543] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.006557] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.006566] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.006592] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7831 [D 20:43:35.006602] element 0: offset: 0x625390, size: 24 [D 20:43:35.006613] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 0/70. [D 20:43:35.006673] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.006683] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.006692] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.006707] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7834 [D 20:43:35.006716] element 0: offset: 0x61e5b0, size: 24 [D 20:43:35.006726] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 1/70. [D 20:43:35.011198] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7831 [D 20:43:35.011218] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 2/70. [D 20:43:35.011232] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7834 [D 20:43:35.011243] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 3/70. [D 20:43:35.015435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 55545. [D 20:43:35.015451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 55546. [D 20:43:35.015461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 55547. [D 20:43:35.015470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 55548. [D 20:43:35.015480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 55549. [D 20:43:35.015490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 55550. [D 20:43:35.015500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 55551. [D 20:43:35.015510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 55552. [D 20:43:35.015519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 55553. [D 20:43:35.015529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 55554. [D 20:43:35.015539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 55555. [D 20:43:35.015549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 55556. [D 20:43:35.015558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 55557. [D 20:43:35.015568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 55558. [D 20:43:35.015578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 55559. [D 20:43:35.015588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 55560. [D 20:43:35.015597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 55561. [D 20:43:35.015607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 55562. [D 20:43:35.015617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 55563. [D 20:43:35.015627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 55564. [D 20:43:35.015636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 55565. [D 20:43:35.015646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 55566. [D 20:43:35.015656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 55567. [D 20:43:35.015666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 55568. [D 20:43:35.015676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 55569. [D 20:43:35.015685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 55570. [D 20:43:35.015695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 55571. [D 20:43:35.015705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 55572. [D 20:43:35.015714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 55573. [D 20:43:35.015724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 55574. [D 20:43:35.015735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 55575. [D 20:43:35.015745] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 55576. [D 20:43:35.015756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 55577. [D 20:43:35.015766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 55578. [D 20:43:35.015776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 55579. [D 20:43:35.015785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 55580. [D 20:43:35.015795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 55581. [D 20:43:35.015805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 55582. [D 20:43:35.015814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55583. [D 20:43:35.015824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 55584. [D 20:43:35.015834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 55585. [D 20:43:35.015843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 55586. [D 20:43:35.015853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 55587. [D 20:43:35.015863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 55588. [D 20:43:35.015872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 55589. [D 20:43:35.015882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 55590. [D 20:43:35.015892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 55591. [D 20:43:35.015901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 55592. [D 20:43:35.015911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 55593. [D 20:43:35.015921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 55594. [D 20:43:35.015930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 55595. [D 20:43:35.015940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 55596. [D 20:43:35.015950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 55597. [D 20:43:35.015959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 55598. [D 20:43:35.015969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 55599. [D 20:43:35.015979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 55600. [D 20:43:35.015988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 55601. [D 20:43:35.015998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 55602. [D 20:43:35.016008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 55603. [D 20:43:35.016018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 55604. [D 20:43:35.016028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 55605. [D 20:43:35.016038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 55606. [D 20:43:35.016047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 55607. [D 20:43:35.016057] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233d40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 55608. [D 20:43:35.018259] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.018305] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.018314] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:35.018343] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7837 [D 20:43:35.018353] element 0: offset: 0x620cf0, size: 24 [D 20:43:35.018366] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 4/70. [D 20:43:35.026059] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 55608. [D 20:43:35.026078] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 5/70. [D 20:43:35.037675] openib_check_cq: completed rdma wr_id 2aaaab233d40, nic_wr_credit 55607. [D 20:43:35.037690] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 6/70. [D 20:43:35.037730] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.037744] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.037753] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:35.037824] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.037834] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.037843] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.040315] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7837 [D 20:43:35.040333] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 7/70. [D 20:43:35.044751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 55607. [D 20:43:35.044766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 55608. [D 20:43:35.044776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 55609. [D 20:43:35.044786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 55610. [D 20:43:35.044796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 55611. [D 20:43:35.044805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 55612. [D 20:43:35.044815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 55613. [D 20:43:35.044824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 55614. [D 20:43:35.044834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 55615. [D 20:43:35.044844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 55616. [D 20:43:35.044853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 55617. [D 20:43:35.044863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 55618. [D 20:43:35.044872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 55619. [D 20:43:35.044882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 55620. [D 20:43:35.044894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 55621. [D 20:43:35.044904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 55622. [D 20:43:35.044914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 55623. [D 20:43:35.044923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 55624. [D 20:43:35.044933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 55625. [D 20:43:35.044942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 55626. [D 20:43:35.044952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 55627. [D 20:43:35.044962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 55628. [D 20:43:35.044971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 55629. [D 20:43:35.044981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 55630. [D 20:43:35.044991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 55631. [D 20:43:35.045000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 55632. [D 20:43:35.045010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 55633. [D 20:43:35.045020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 55634. [D 20:43:35.045029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 55635. [D 20:43:35.045039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 55636. [D 20:43:35.045049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 55637. [D 20:43:35.045059] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233d40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 55638. [D 20:43:35.050888] openib_check_cq: completed rdma wr_id 2aaaab233d40, nic_wr_credit 55638. [D 20:43:35.050902] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 8/70. [D 20:43:35.051014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.051043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.051051] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.055858] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.055871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.055880] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.055907] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7841 [D 20:43:35.055917] element 0: offset: 0x2aaaab202db0, size: 24 [D 20:43:35.055930] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 9/70. [D 20:43:35.060343] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7841 [D 20:43:35.060363] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 10/70. [D 20:43:35.062350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 55638. [D 20:43:35.062399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 55639. [D 20:43:35.062410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 55640. [D 20:43:35.062419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 55641. [D 20:43:35.062460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 55642. [D 20:43:35.062474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 55643. [D 20:43:35.062483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 55644. [D 20:43:35.062493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 55645. [D 20:43:35.062503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 55646. [D 20:43:35.062513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 55647. [D 20:43:35.062522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 55648. [D 20:43:35.062536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 55649. [D 20:43:35.062547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 55650. [D 20:43:35.062557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 55651. [D 20:43:35.062566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 55652. [D 20:43:35.062583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 55653. [D 20:43:35.062595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 55654. [D 20:43:35.062605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 55655. [D 20:43:35.062614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 55656. [D 20:43:35.062624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 55657. [D 20:43:35.062635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 55658. [D 20:43:35.062645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 55659. [D 20:43:35.062654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 55660. [D 20:43:35.062664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 55661. [D 20:43:35.062683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 55662. [D 20:43:35.062692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 55663. [D 20:43:35.062702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 55664. [D 20:43:35.062711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 55665. [D 20:43:35.062722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 55666. [D 20:43:35.062731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 55667. [D 20:43:35.062741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 55668. [D 20:43:35.062750] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2093f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 55669. [D 20:43:35.064887] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.064900] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.064910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.064939] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7844 [D 20:43:35.064950] element 0: offset: 0x2aaaab2302d0, size: 24 [D 20:43:35.064966] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 11/70. [D 20:43:35.064990] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.064999] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.065008] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:35.065023] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7845 [D 20:43:35.065035] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:35.065044] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 12/70. [D 20:43:35.065254] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.065266] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.065275] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:35.065290] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7849 [D 20:43:35.065299] element 0: offset: 0x2aaaab241510, size: 24 [D 20:43:35.065309] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 13/70. [D 20:43:35.074061] openib_check_cq: completed rdma wr_id 2aaaab2093f0, nic_wr_credit 55669. [D 20:43:35.074080] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 14/70. [D 20:43:35.074207] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.074221] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.074230] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:35.076885] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7845 [D 20:43:35.076905] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 15/70. [D 20:43:35.079344] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7849 [D 20:43:35.079362] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 16/70. [D 20:43:35.079376] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 655360, tag: 7844 [D 20:43:35.079391] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 17/70. [D 20:43:35.080065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 55669. [D 20:43:35.080076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 55670. [D 20:43:35.080086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 55671. [D 20:43:35.080096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 55672. [D 20:43:35.080106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 55673. [D 20:43:35.080115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 55674. [D 20:43:35.080125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 55675. [D 20:43:35.080135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 55676. [D 20:43:35.080144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 55677. [D 20:43:35.080154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 55678. [D 20:43:35.080163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 55679. [D 20:43:35.080173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 55680. [D 20:43:35.080183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 55681. [D 20:43:35.080192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 55682. [D 20:43:35.080202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 55683. [D 20:43:35.080211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 55684. [D 20:43:35.080221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 55685. [D 20:43:35.080231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 55686. [D 20:43:35.080240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 55687. [D 20:43:35.080250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 55688. [D 20:43:35.080259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 55689. [D 20:43:35.080269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 55690. [D 20:43:35.080279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 55691. [D 20:43:35.080288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 55692. [D 20:43:35.080298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 55693. [D 20:43:35.080308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 55694. [D 20:43:35.080317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 55695. [D 20:43:35.080327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 55696. [D 20:43:35.080337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 55697. [D 20:43:35.080347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 55698. [D 20:43:35.080356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 55699. [D 20:43:35.080366] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2093f0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 55700. [D 20:43:35.080377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 55701. [D 20:43:35.080387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 55702. [D 20:43:35.080396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 55703. [D 20:43:35.080406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 55704. [D 20:43:35.080416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 55705. [D 20:43:35.080425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 55706. [D 20:43:35.080435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 55707. [D 20:43:35.080444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 55708. [D 20:43:35.080454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 55709. [D 20:43:35.080464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 55710. [D 20:43:35.080473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 55711. [D 20:43:35.080483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 55712. [D 20:43:35.080493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 55713. [D 20:43:35.080502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 55714. [D 20:43:35.080512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 55715. [D 20:43:35.080522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 55716. [D 20:43:35.080531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 55717. [D 20:43:35.080541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 55718. [D 20:43:35.080551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 55719. [D 20:43:35.080560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 55720. [D 20:43:35.080570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 55721. [D 20:43:35.080580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 55722. [D 20:43:35.080589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 55723. [D 20:43:35.080599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 55724. [D 20:43:35.080609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 55725. [D 20:43:35.080619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 55726. [D 20:43:35.080629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 55727. [D 20:43:35.080638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 55728. [D 20:43:35.080648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 55729. [D 20:43:35.080658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 55730. [D 20:43:35.080667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 55731. [D 20:43:35.080677] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22f910 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 55732. [D 20:43:35.080688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 55733. [D 20:43:35.080698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 55734. [D 20:43:35.080707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 55735. [D 20:43:35.080717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 55736. [D 20:43:35.080727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 55737. [D 20:43:35.080736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 55738. [D 20:43:35.080746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55739. [E 20:43:35.080759] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 55740, block for 10 ms. [D 20:43:35.082692] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55739. [E 20:43:35.082708] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 55740, block for 10 ms. [D 20:43:35.091570] openib_check_cq: completed rdma wr_id 2aaaab2093f0, nic_wr_credit 55739. [D 20:43:35.091585] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 18/70. [D 20:43:35.091595] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 55738. [D 20:43:35.091605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 55739. [D 20:43:35.091615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 55740. [D 20:43:35.091624] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 55741. [D 20:43:35.091666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.091710] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.091719] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:35.091749] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7852 [D 20:43:35.091759] element 0: offset: 0x2aaaab215800, size: 24 [D 20:43:35.091774] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 19/70. [D 20:43:35.102605] openib_check_cq: completed rdma wr_id 2aaaab22f910, nic_wr_credit 55741. [D 20:43:35.102623] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 20/70. [D 20:43:35.104694] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.104708] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.104717] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:35.106060] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 55740. [D 20:43:35.106074] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 21/70. [D 20:43:35.106102] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.106115] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.106124] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:35.106185] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.106195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.106203] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.108498] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7852 [D 20:43:35.108517] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 22/70. [D 20:43:35.111001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 55740. [D 20:43:35.111016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 55741. [D 20:43:35.111026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 55742. [D 20:43:35.111036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 55743. [D 20:43:35.111045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 55744. [D 20:43:35.111055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 55745. [D 20:43:35.111065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 55746. [D 20:43:35.111074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 55747. [D 20:43:35.111084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 55748. [D 20:43:35.111094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 55749. [D 20:43:35.111103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 55750. [D 20:43:35.111113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 55751. [D 20:43:35.111122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 55752. [D 20:43:35.111132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 55753. [D 20:43:35.111142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 55754. [D 20:43:35.111151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 55755. [D 20:43:35.111161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 55756. [D 20:43:35.111170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 55757. [D 20:43:35.111180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 55758. [D 20:43:35.111189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 55759. [D 20:43:35.111199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 55760. [D 20:43:35.111208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 55761. [D 20:43:35.111218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 55762. [D 20:43:35.111228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 55763. [D 20:43:35.111237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 55764. [D 20:43:35.111247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 55765. [D 20:43:35.111256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 55766. [D 20:43:35.111266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 55767. [D 20:43:35.111275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 55768. [D 20:43:35.111285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 55769. [D 20:43:35.111295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 55770. [D 20:43:35.111305] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2093f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 55771. [D 20:43:35.122267] openib_check_cq: completed rdma wr_id 2aaaab2093f0, nic_wr_credit 55771. [D 20:43:35.122302] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 23/70. [D 20:43:35.124356] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.124370] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.124379] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.124407] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7856 [D 20:43:35.124417] element 0: offset: 0x2aaaab241560, size: 24 [D 20:43:35.124428] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 24/70. [D 20:43:35.124448] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.124457] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.124466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:35.124480] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7859 [D 20:43:35.124489] element 0: offset: 0x2aaaab202ae0, size: 24 [D 20:43:35.124501] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 25/70. [D 20:43:35.124516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.124524] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.124533] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:35.124547] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7861 [D 20:43:35.124557] element 0: offset: 0x2aaaab2302d0, size: 24 [D 20:43:35.124566] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 26/70. [D 20:43:35.124588] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.124597] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.124609] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:35.126819] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.126834] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.126845] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:35.128846] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7856 [D 20:43:35.128866] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 27/70. [D 20:43:35.129996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 55771. [D 20:43:35.130012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 55772. [D 20:43:35.130021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 55773. [D 20:43:35.130031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 55774. [D 20:43:35.130041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 55775. [D 20:43:35.130050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 55776. [D 20:43:35.130063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 55777. [D 20:43:35.130073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 55778. [D 20:43:35.130083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 55779. [D 20:43:35.130092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 55780. [D 20:43:35.130102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 55781. [D 20:43:35.130112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 55782. [D 20:43:35.130121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 55783. [D 20:43:35.130131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 55784. [D 20:43:35.130141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 55785. [D 20:43:35.130150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 55786. [D 20:43:35.130160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 55787. [D 20:43:35.130170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 55788. [D 20:43:35.130180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 55789. [D 20:43:35.130189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 55790. [D 20:43:35.130199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 55791. [D 20:43:35.130209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 55792. [D 20:43:35.130218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 55793. [D 20:43:35.130228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 55794. [D 20:43:35.130238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 55795. [D 20:43:35.130248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 55796. [D 20:43:35.130257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 55797. [D 20:43:35.130267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 55798. [D 20:43:35.130277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 55799. [D 20:43:35.130286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 55800. [D 20:43:35.130297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 55801. [D 20:43:35.130307] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22f910 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 55802. [D 20:43:35.133366] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.133378] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.133387] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:35.133422] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7864 [D 20:43:35.133432] element 0: offset: 0x2aaaab202e70, size: 24 [D 20:43:35.133443] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 28/70. [D 20:43:35.133470] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7861 [D 20:43:35.133481] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 29/70. [D 20:43:35.141624] openib_check_cq: completed rdma wr_id 2aaaab22f910, nic_wr_credit 55802. [D 20:43:35.141640] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 30/70. [D 20:43:35.141687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 55802. [D 20:43:35.141698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 55803. [D 20:43:35.141707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 55804. [D 20:43:35.141717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 55805. [D 20:43:35.141727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 55806. [D 20:43:35.141736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 55807. [D 20:43:35.141746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 55808. [D 20:43:35.141756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 55809. [D 20:43:35.141766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 55810. [D 20:43:35.141776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 55811. [D 20:43:35.141785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 55812. [D 20:43:35.141795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 55813. [D 20:43:35.141805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 55814. [D 20:43:35.141814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 55815. [D 20:43:35.141824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 55816. [D 20:43:35.141834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 55817. [D 20:43:35.141843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 55818. [D 20:43:35.141853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 55819. [D 20:43:35.141863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 55820. [D 20:43:35.141873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 55821. [D 20:43:35.141882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 55822. [D 20:43:35.141892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 55823. [D 20:43:35.141902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 55824. [D 20:43:35.141912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 55825. [D 20:43:35.141921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 55826. [D 20:43:35.141931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 55827. [D 20:43:35.141941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 55828. [D 20:43:35.141950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 55829. [D 20:43:35.141960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 55830. [D 20:43:35.141971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 55831. [D 20:43:35.141981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 55832. [D 20:43:35.141990] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cc80 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 55833. [D 20:43:35.144372] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.144383] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.144392] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:35.146778] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7864 [D 20:43:35.146794] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 31/70. [D 20:43:35.152122] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.152135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.152143] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:35.152159] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7866 [D 20:43:35.152168] element 0: offset: 0x2aaaab23cd10, size: 24 [D 20:43:35.152177] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 32/70. [D 20:43:35.153357] openib_check_cq: completed rdma wr_id 2aaaab23cc80, nic_wr_credit 55833. [D 20:43:35.153372] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 33/70. [D 20:43:35.153409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 55833. [D 20:43:35.153420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 55834. [D 20:43:35.153430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 55835. [D 20:43:35.153440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 55836. [D 20:43:35.153449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 55837. [D 20:43:35.153459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 55838. [D 20:43:35.153468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 55839. [D 20:43:35.153478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 55840. [D 20:43:35.153488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 55841. [D 20:43:35.153497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 55842. [D 20:43:35.153507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 55843. [D 20:43:35.153517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 55844. [D 20:43:35.153526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 55845. [D 20:43:35.153536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 55846. [D 20:43:35.153546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 55847. [D 20:43:35.153556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 55848. [D 20:43:35.153565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 55849. [D 20:43:35.153575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 55850. [D 20:43:35.153584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 55851. [D 20:43:35.153594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 55852. [D 20:43:35.153604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 55853. [D 20:43:35.153613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 55854. [D 20:43:35.153623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 55855. [D 20:43:35.153633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 55856. [D 20:43:35.153642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 55857. [D 20:43:35.153652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 55858. [D 20:43:35.153662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 55859. [D 20:43:35.153671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 55860. [D 20:43:35.153681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 55861. [D 20:43:35.153691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 55862. [D 20:43:35.153701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 55863. [D 20:43:35.153711] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 55864. [D 20:43:35.156039] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.156049] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.156058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:35.158114] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7866 [D 20:43:35.158130] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 34/70. [D 20:43:35.163529] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 55864. [D 20:43:35.163544] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 35/70. [D 20:43:35.164901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.164911] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.164920] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.187746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 55864. [D 20:43:35.187761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 55865. [D 20:43:35.187771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 55866. [D 20:43:35.187781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 55867. [D 20:43:35.187790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 55868. [D 20:43:35.187800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 55869. [D 20:43:35.187810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 55870. [D 20:43:35.187819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 55871. [D 20:43:35.187829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 55872. [D 20:43:35.187838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 55873. [D 20:43:35.187848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 55874. [D 20:43:35.187858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 55875. [D 20:43:35.187868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 55876. [D 20:43:35.187877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 55877. [D 20:43:35.187887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 55878. [D 20:43:35.187897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 55879. [D 20:43:35.187906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 55880. [D 20:43:35.187916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 55881. [D 20:43:35.187926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 55882. [D 20:43:35.187935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 55883. [D 20:43:35.187945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 55884. [D 20:43:35.187955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 55885. [D 20:43:35.187964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 55886. [D 20:43:35.187974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 55887. [D 20:43:35.187984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 55888. [D 20:43:35.187993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 55889. [D 20:43:35.188003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 55890. [D 20:43:35.188013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 55891. [D 20:43:35.188022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 55892. [D 20:43:35.188032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 55893. [D 20:43:35.188042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 55894. [D 20:43:35.188052] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cc80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 55895. [D 20:43:35.198803] openib_check_cq: completed rdma wr_id 2aaaab23cc80, nic_wr_credit 55895. [D 20:43:35.198818] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 36/70. [D 20:43:35.201086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.201096] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.201105] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.201120] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7870 [D 20:43:35.201129] element 0: offset: 0x2aaaab202ae0, size: 24 [D 20:43:35.201138] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 37/70. [D 20:43:35.201153] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.201166] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.201175] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.205613] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7870 [D 20:43:35.205629] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 38/70. [D 20:43:35.205686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 55895. [D 20:43:35.205700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 55896. [D 20:43:35.205709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 55897. [D 20:43:35.205719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 55898. [D 20:43:35.205729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 55899. [D 20:43:35.205738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 55900. [D 20:43:35.205748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 55901. [D 20:43:35.205760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 55902. [D 20:43:35.205770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 55903. [D 20:43:35.205779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 55904. [D 20:43:35.205789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 55905. [D 20:43:35.205799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 55906. [D 20:43:35.205809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 55907. [D 20:43:35.205818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 55908. [D 20:43:35.205828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 55909. [D 20:43:35.205837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 55910. [D 20:43:35.205847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 55911. [D 20:43:35.205857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 55912. [D 20:43:35.205866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 55913. [D 20:43:35.205876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 55914. [D 20:43:35.205885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 55915. [D 20:43:35.205895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 55916. [D 20:43:35.205905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 55917. [D 20:43:35.205914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 55918. [D 20:43:35.205924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 55919. [D 20:43:35.205933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 55920. [D 20:43:35.205943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 55921. [D 20:43:35.205952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 55922. [D 20:43:35.205962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 55923. [D 20:43:35.205972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 55924. [D 20:43:35.205982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 55925. [D 20:43:35.205992] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab233d40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 55926. [D 20:43:35.211571] openib_check_cq: completed rdma wr_id 2aaaab233d40, nic_wr_credit 55926. [D 20:43:35.211586] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 39/70. [D 20:43:35.213848] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.213858] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.213867] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.300140] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.300153] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.300162] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.300177] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7873 [D 20:43:35.300186] element 0: offset: 0x2aaaab2302d0, size: 24 [D 20:43:35.300195] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 40/70. [D 20:43:35.300441] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 131072, tag: 7873 [D 20:43:35.300899] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 41/70. [D 20:43:35.300939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 55926. [D 20:43:35.300950] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 55927. [D 20:43:35.301325] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 55927. [D 20:43:35.301334] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 42/70. [D 20:43:35.301369] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.301379] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.301387] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.473635] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.473649] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.473657] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.473671] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7876 [D 20:43:35.473681] element 0: offset: 0x2aaaab202ae0, size: 24 [D 20:43:35.473690] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 43/70. [D 20:43:35.473782] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.473794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.473803] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.583468] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.583481] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.583490] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.583504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7878 [D 20:43:35.583513] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:35.583523] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 44/70. [D 20:43:35.585939] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7878 [D 20:43:35.585956] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 45/70. [D 20:43:35.586089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 55927. [D 20:43:35.586104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 55928. [D 20:43:35.586115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 55929. [D 20:43:35.586124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 55930. [D 20:43:35.586137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 55931. [D 20:43:35.586147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 55932. [D 20:43:35.586157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 55933. [D 20:43:35.586167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 55934. [D 20:43:35.586176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 55935. [D 20:43:35.586186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 55936. [D 20:43:35.586196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 55937. [D 20:43:35.586205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 55938. [D 20:43:35.586215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 55939. [D 20:43:35.586225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 55940. [D 20:43:35.586235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 55941. [D 20:43:35.586244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 55942. [D 20:43:35.586254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 55943. [D 20:43:35.586264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 55944. [D 20:43:35.586273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 55945. [D 20:43:35.586283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 55946. [D 20:43:35.586293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 55947. [D 20:43:35.586302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 55948. [D 20:43:35.586312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 55949. [D 20:43:35.586322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 55950. [D 20:43:35.586331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 55951. [D 20:43:35.586341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 55952. [D 20:43:35.586350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 55953. [D 20:43:35.586360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 55954. [D 20:43:35.586370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 55955. [D 20:43:35.586380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 55956. [D 20:43:35.586390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 55957. [D 20:43:35.586400] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23cc80 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 55958. [D 20:43:35.597000] openib_check_cq: completed rdma wr_id 2aaaab23cc80, nic_wr_credit 55958. [D 20:43:35.597015] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 46/70. [D 20:43:35.599277] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.599287] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.599296] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.607465] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.607479] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.607487] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.607502] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7882 [D 20:43:35.607511] element 0: offset: 0x2aaaab241560, size: 24 [D 20:43:35.607520] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 47/70. [D 20:43:35.607805] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.607818] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.607826] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.607841] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7885 [D 20:43:35.607850] element 0: offset: 0x2aaaab209230, size: 24 [D 20:43:35.607859] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 48/70. [D 20:43:35.609917] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7882 [D 20:43:35.609973] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 49/70. [D 20:43:35.610024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 55958. [D 20:43:35.610041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 55959. [D 20:43:35.610051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 55960. [D 20:43:35.610060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 55961. [D 20:43:35.610070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 55962. [D 20:43:35.610080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 55963. [D 20:43:35.610090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 55964. [D 20:43:35.610099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 55965. [D 20:43:35.610109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 55966. [D 20:43:35.610119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 55967. [D 20:43:35.610128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 55968. [D 20:43:35.610142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 55969. [D 20:43:35.610153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 55970. [D 20:43:35.610162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 55971. [D 20:43:35.610172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 55972. [D 20:43:35.610182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 55973. [D 20:43:35.610191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 55974. [D 20:43:35.610201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 55975. [D 20:43:35.610211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 55976. [D 20:43:35.610221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 55977. [D 20:43:35.610230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 55978. [D 20:43:35.610240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 55979. [D 20:43:35.610250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 55980. [D 20:43:35.610259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 55981. [D 20:43:35.610269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 55982. [D 20:43:35.610280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 55983. [D 20:43:35.610290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 55984. [D 20:43:35.610300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 55985. [D 20:43:35.610309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 55986. [D 20:43:35.610319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 55987. [D 20:43:35.610329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 55988. [D 20:43:35.610339] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2346f0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 55989. [D 20:43:35.612608] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7885 [D 20:43:35.612647] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 50/70. [D 20:43:35.619521] openib_check_cq: completed rdma wr_id 2aaaab2346f0, nic_wr_credit 55989. [D 20:43:35.619539] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 51/70. [D 20:43:35.619566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 55989. [D 20:43:35.619576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 55990. [D 20:43:35.619585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 55991. [D 20:43:35.619595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 55992. [D 20:43:35.619605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 55993. [D 20:43:35.619614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 55994. [D 20:43:35.619624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 55995. [D 20:43:35.619634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 55996. [D 20:43:35.619644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 55997. [D 20:43:35.619653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 55998. [D 20:43:35.619663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 55999. [D 20:43:35.619672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 56000. [D 20:43:35.619682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 56001. [D 20:43:35.619692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 56002. [D 20:43:35.619701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56003. [D 20:43:35.619711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56004. [D 20:43:35.619720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56005. [D 20:43:35.619730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 56006. [D 20:43:35.619740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 56007. [D 20:43:35.619749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 56008. [D 20:43:35.619759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 56009. [D 20:43:35.619769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 56010. [D 20:43:35.619778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56011. [D 20:43:35.619788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56012. [D 20:43:35.619798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56013. [D 20:43:35.619807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 56014. [D 20:43:35.619817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 56015. [D 20:43:35.619827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 56016. [D 20:43:35.619836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 56017. [D 20:43:35.619847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 56018. [D 20:43:35.619856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56019. [D 20:43:35.619866] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56020. [D 20:43:35.622192] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.622203] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.622211] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.631278] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56020. [D 20:43:35.631292] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 52/70. [D 20:43:35.632928] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.632938] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.632946] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.649281] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.649294] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.649302] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.649317] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7888 [D 20:43:35.649326] element 0: offset: 0x61f040, size: 24 [D 20:43:35.649336] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 53/70. [D 20:43:35.649350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.649359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.649371] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.649385] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7891 [D 20:43:35.649394] element 0: offset: 0x643630, size: 24 [D 20:43:35.649404] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 54/70. [D 20:43:35.654211] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7891 [D 20:43:35.654229] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 55/70. [D 20:43:35.654359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56020. [D 20:43:35.654373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 56021. [D 20:43:35.654384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 56022. [D 20:43:35.654393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 56023. [D 20:43:35.654403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 56024. [D 20:43:35.654413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 56025. [D 20:43:35.654422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56026. [D 20:43:35.654432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56027. [D 20:43:35.654442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56028. [D 20:43:35.654451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 56029. [D 20:43:35.654461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 56030. [D 20:43:35.654471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 56031. [D 20:43:35.654481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 56032. [D 20:43:35.654490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 56033. [D 20:43:35.654500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56034. [D 20:43:35.654510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56035. [D 20:43:35.654519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56036. [D 20:43:35.654529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 56037. [D 20:43:35.654539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 56038. [D 20:43:35.654548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 56039. [D 20:43:35.654558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 56040. [D 20:43:35.654568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 56041. [D 20:43:35.654578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56042. [D 20:43:35.654587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56043. [D 20:43:35.654597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56044. [D 20:43:35.654607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 56045. [D 20:43:35.654617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 56046. [D 20:43:35.654626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 56047. [D 20:43:35.654636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 56048. [D 20:43:35.654645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 56049. [D 20:43:35.654656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56050. [D 20:43:35.654666] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56051. [D 20:43:35.657003] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7888 [D 20:43:35.657015] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 56/70. [D 20:43:35.666118] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 56051. [D 20:43:35.666133] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 57/70. [D 20:43:35.666163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56051. [D 20:43:35.666173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56052. [D 20:43:35.666183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56053. [D 20:43:35.666193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56054. [D 20:43:35.666203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56055. [D 20:43:35.666212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56056. [D 20:43:35.666222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56057. [D 20:43:35.666232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56058. [D 20:43:35.666241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56059. [D 20:43:35.666251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56060. [D 20:43:35.666260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56061. [D 20:43:35.666270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56062. [D 20:43:35.666280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56063. [D 20:43:35.666289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56064. [D 20:43:35.666299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56065. [D 20:43:35.666309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56066. [D 20:43:35.666318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56067. [D 20:43:35.666328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56068. [D 20:43:35.666338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56069. [D 20:43:35.666347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56070. [D 20:43:35.666357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56071. [D 20:43:35.666366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56072. [D 20:43:35.666376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56073. [D 20:43:35.666386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56074. [D 20:43:35.666395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56075. [D 20:43:35.666405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56076. [D 20:43:35.666415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56077. [D 20:43:35.666424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56078. [D 20:43:35.666434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56079. [D 20:43:35.666444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56080. [D 20:43:35.666454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56081. [D 20:43:35.666464] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56082. [D 20:43:35.668752] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.668762] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.668771] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.676959] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56082. [D 20:43:35.676974] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 58/70. [D 20:43:35.679120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.679130] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.679138] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.691880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.691893] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.691902] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.691916] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7895 [D 20:43:35.691925] element 0: offset: 0x5b0030, size: 24 [D 20:43:35.691935] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 59/70. [D 20:43:35.691949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.691958] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.691970] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.691982] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7896 [D 20:43:35.691992] element 0: offset: 0x643630, size: 24 [D 20:43:35.692001] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 60/70. [D 20:43:35.699074] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7896 [D 20:43:35.699091] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 0/70. [D 20:43:35.699103] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7895 [D 20:43:35.699113] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 1/70. [D 20:43:35.699220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56082. [D 20:43:35.699236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56083. [D 20:43:35.699255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56084. [D 20:43:35.699265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56085. [D 20:43:35.699275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56086. [D 20:43:35.699284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56087. [D 20:43:35.699294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56088. [D 20:43:35.699304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56089. [D 20:43:35.699313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56090. [D 20:43:35.699323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56091. [D 20:43:35.699332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56092. [D 20:43:35.699342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56093. [D 20:43:35.699351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56094. [D 20:43:35.699361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56095. [D 20:43:35.699370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56096. [D 20:43:35.699380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56097. [D 20:43:35.699390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56098. [D 20:43:35.699399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56099. [D 20:43:35.699409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56100. [D 20:43:35.699419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56101. [D 20:43:35.699428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56102. [D 20:43:35.699438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56103. [D 20:43:35.699447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56104. [D 20:43:35.699457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56105. [D 20:43:35.699467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56106. [D 20:43:35.699476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56107. [D 20:43:35.699486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56108. [D 20:43:35.699495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56109. [D 20:43:35.699505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56110. [D 20:43:35.699515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56111. [D 20:43:35.699525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56112. [D 20:43:35.699535] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56113. [D 20:43:35.699546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56114. [D 20:43:35.699556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 56115. [D 20:43:35.699566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 56116. [D 20:43:35.699575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 56117. [D 20:43:35.699585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 56118. [D 20:43:35.699595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 56119. [D 20:43:35.699604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56120. [D 20:43:35.699614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56121. [D 20:43:35.699624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56122. [D 20:43:35.699633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 56123. [D 20:43:35.699643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 56124. [D 20:43:35.699652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 56125. [D 20:43:35.699662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 56126. [D 20:43:35.699672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 56127. [D 20:43:35.699681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56128. [D 20:43:35.699691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56129. [D 20:43:35.699701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56130. [D 20:43:35.699711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 56131. [D 20:43:35.699720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 56132. [D 20:43:35.699730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 56133. [D 20:43:35.699740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 56134. [D 20:43:35.699749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 56135. [D 20:43:35.699759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56136. [D 20:43:35.699769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56137. [D 20:43:35.699778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56138. [D 20:43:35.699788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 56139. [D 20:43:35.699798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 56140. [D 20:43:35.699808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 56141. [D 20:43:35.699817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 56142. [D 20:43:35.699827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 56143. [D 20:43:35.699837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56144. [D 20:43:35.699846] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56145. [D 20:43:35.710946] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 56145. [D 20:43:35.710961] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 2/70. [D 20:43:35.717023] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56144. [D 20:43:35.717038] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 3/70. [D 20:43:35.719301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.719311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.719319] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.719332] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.719341] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.719349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.732816] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.732829] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.732838] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.732853] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7900 [D 20:43:35.732863] element 0: offset: 0x5b0030, size: 24 [D 20:43:35.732873] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 4/70. [D 20:43:35.732887] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.732896] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.732908] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.732921] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7903 [D 20:43:35.732933] element 0: offset: 0x61f040, size: 24 [D 20:43:35.732942] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 5/70. [D 20:43:35.737624] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7903 [D 20:43:35.737641] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 6/70. [D 20:43:35.737761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56144. [D 20:43:35.737778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 56145. [D 20:43:35.737789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 56146. [D 20:43:35.737799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 56147. [D 20:43:35.737809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 56148. [D 20:43:35.737819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 56149. [D 20:43:35.737828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56150. [D 20:43:35.737838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56151. [D 20:43:35.737848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56152. [D 20:43:35.737858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 56153. [D 20:43:35.737868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 56154. [D 20:43:35.737878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 56155. [D 20:43:35.737888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 56156. [D 20:43:35.737898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 56157. [D 20:43:35.737908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56158. [D 20:43:35.737918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56159. [D 20:43:35.737928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56160. [D 20:43:35.737938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 56161. [D 20:43:35.737948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 56162. [D 20:43:35.737958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 56163. [D 20:43:35.737968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 56164. [D 20:43:35.737977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 56165. [D 20:43:35.737987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56166. [D 20:43:35.737998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56167. [D 20:43:35.738007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56168. [D 20:43:35.738017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 56169. [D 20:43:35.738027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 56170. [D 20:43:35.738037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 56171. [D 20:43:35.738047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 56172. [D 20:43:35.738057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 56173. [D 20:43:35.738067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56174. [D 20:43:35.738078] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56175. [D 20:43:35.740258] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7900 [D 20:43:35.740270] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 7/70. [D 20:43:35.749440] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 56175. [D 20:43:35.749455] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 8/70. [D 20:43:35.749487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56175. [D 20:43:35.749498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56176. [D 20:43:35.749508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56177. [D 20:43:35.749518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56178. [D 20:43:35.749527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56179. [D 20:43:35.749537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56180. [D 20:43:35.749547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56181. [D 20:43:35.749557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56182. [D 20:43:35.749567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56183. [D 20:43:35.749577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56184. [D 20:43:35.749587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56185. [D 20:43:35.749597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56186. [D 20:43:35.749606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56187. [D 20:43:35.749617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56188. [D 20:43:35.749626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56189. [D 20:43:35.749636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56190. [D 20:43:35.749646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56191. [D 20:43:35.749656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56192. [D 20:43:35.749666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56193. [D 20:43:35.749676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56194. [D 20:43:35.749686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56195. [D 20:43:35.749696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56196. [D 20:43:35.749706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56197. [D 20:43:35.749715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56198. [D 20:43:35.749726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56199. [D 20:43:35.749735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56200. [D 20:43:35.749745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56201. [D 20:43:35.749755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56202. [D 20:43:35.749765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56203. [D 20:43:35.749776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56204. [D 20:43:35.749785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56205. [D 20:43:35.749795] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56206. [D 20:43:35.752101] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.752111] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.752120] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.760604] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56206. [D 20:43:35.760619] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 9/70. [D 20:43:35.762783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.762793] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.762802] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.776039] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.776052] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.776061] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.776076] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7907 [D 20:43:35.776085] element 0: offset: 0x620cf0, size: 24 [D 20:43:35.776095] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 10/70. [D 20:43:35.776110] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.776119] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.776131] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.776143] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7908 [D 20:43:35.776153] element 0: offset: 0x61f040, size: 24 [D 20:43:35.776162] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 11/70. [D 20:43:35.783233] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7908 [D 20:43:35.783250] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 12/70. [D 20:43:35.783264] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7907 [D 20:43:35.783274] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 13/70. [D 20:43:35.783331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56206. [D 20:43:35.783342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56207. [D 20:43:35.783352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56208. [D 20:43:35.783362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56209. [D 20:43:35.783372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56210. [D 20:43:35.783382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56211. [D 20:43:35.783392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56212. [D 20:43:35.783402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56213. [D 20:43:35.783412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56214. [D 20:43:35.783422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56215. [D 20:43:35.783431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56216. [D 20:43:35.783441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56217. [D 20:43:35.783451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56218. [D 20:43:35.783461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56219. [D 20:43:35.783471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56220. [D 20:43:35.783481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56221. [D 20:43:35.783491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56222. [D 20:43:35.783500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56223. [D 20:43:35.783511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56224. [D 20:43:35.783520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56225. [D 20:43:35.783530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56226. [D 20:43:35.783540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56227. [D 20:43:35.783550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56228. [D 20:43:35.783560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56229. [D 20:43:35.783570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56230. [D 20:43:35.783580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56231. [D 20:43:35.783589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56232. [D 20:43:35.783600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56233. [D 20:43:35.783610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56234. [D 20:43:35.783620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56235. [D 20:43:35.783630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56236. [D 20:43:35.783640] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56237. [D 20:43:35.783651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56238. [D 20:43:35.783661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 56239. [D 20:43:35.783671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 56240. [D 20:43:35.783681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 56241. [D 20:43:35.783691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 56242. [D 20:43:35.783701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 56243. [D 20:43:35.783711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56244. [D 20:43:35.783721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56245. [D 20:43:35.783731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56246. [D 20:43:35.783741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 56247. [D 20:43:35.783751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 56248. [D 20:43:35.783761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 56249. [D 20:43:35.783771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 56250. [D 20:43:35.783781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 56251. [D 20:43:35.783791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56252. [D 20:43:35.783801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56253. [D 20:43:35.783810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56254. [D 20:43:35.783820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 56255. [D 20:43:35.783830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 56256. [D 20:43:35.783840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 56257. [D 20:43:35.783850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 56258. [D 20:43:35.783860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 56259. [D 20:43:35.783870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56260. [D 20:43:35.783880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56261. [D 20:43:35.783891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56262. [D 20:43:35.783900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 56263. [D 20:43:35.783910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 56264. [D 20:43:35.783920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 56265. [D 20:43:35.783930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 56266. [D 20:43:35.783940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 56267. [D 20:43:35.783950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56268. [D 20:43:35.783960] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56269. [D 20:43:35.795081] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 56269. [D 20:43:35.795096] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 14/70. [D 20:43:35.800916] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56268. [D 20:43:35.800931] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 15/70. [D 20:43:35.803202] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.803212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.803221] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.803233] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.803242] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.803251] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.816963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.816977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.816985] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.817001] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7912 [D 20:43:35.817010] element 0: offset: 0x662340, size: 24 [D 20:43:35.817019] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 16/70. [D 20:43:35.817035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.817047] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.817055] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.817068] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7915 [D 20:43:35.817077] element 0: offset: 0x620cf0, size: 24 [D 20:43:35.817087] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 17/70. [D 20:43:35.821758] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7915 [D 20:43:35.821776] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 18/70. [D 20:43:35.821908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56268. [D 20:43:35.821923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 56269. [D 20:43:35.821934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 56270. [D 20:43:35.821944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 56271. [D 20:43:35.821953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 56272. [D 20:43:35.821964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 56273. [D 20:43:35.821973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56274. [D 20:43:35.821983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56275. [D 20:43:35.821993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56276. [D 20:43:35.822003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 56277. [D 20:43:35.822013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 56278. [D 20:43:35.822023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 56279. [D 20:43:35.822033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 56280. [D 20:43:35.822043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 56281. [D 20:43:35.822053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56282. [D 20:43:35.822063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56283. [D 20:43:35.822072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56284. [D 20:43:35.822083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 56285. [D 20:43:35.822093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 56286. [D 20:43:35.822102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 56287. [D 20:43:35.822113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 56288. [D 20:43:35.822122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 56289. [D 20:43:35.822132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56290. [D 20:43:35.822142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56291. [D 20:43:35.822152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56292. [D 20:43:35.822162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 56293. [D 20:43:35.822172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 56294. [D 20:43:35.822185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 56295. [D 20:43:35.822195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 56296. [D 20:43:35.822205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 56297. [D 20:43:35.822221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56298. [D 20:43:35.822232] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56299. [D 20:43:35.824549] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7912 [D 20:43:35.824561] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 19/70. [D 20:43:35.830956] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 56299. [D 20:43:35.830971] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 20/70. [D 20:43:35.830982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56299. [D 20:43:35.830992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56300. [D 20:43:35.831002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56301. [D 20:43:35.831012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56302. [D 20:43:35.831022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56303. [D 20:43:35.831032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56304. [D 20:43:35.831042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56305. [D 20:43:35.831052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56306. [D 20:43:35.831062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56307. [D 20:43:35.831072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56308. [D 20:43:35.831082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56309. [D 20:43:35.831092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56310. [D 20:43:35.831102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56311. [D 20:43:35.831112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56312. [D 20:43:35.831122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56313. [D 20:43:35.831132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56314. [D 20:43:35.831142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56315. [D 20:43:35.831152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56316. [D 20:43:35.831162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56317. [D 20:43:35.831172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56318. [D 20:43:35.831182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56319. [D 20:43:35.831192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56320. [D 20:43:35.831202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56321. [D 20:43:35.831212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56322. [D 20:43:35.831222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56323. [D 20:43:35.831232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56324. [D 20:43:35.831242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56325. [D 20:43:35.831252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56326. [D 20:43:35.831262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56327. [D 20:43:35.831272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56328. [D 20:43:35.831283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56329. [D 20:43:35.831293] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56330. [D 20:43:35.832946] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.832956] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.832965] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.836852] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56330. [D 20:43:35.836867] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 21/70. [D 20:43:35.839131] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.839142] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.839150] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.881441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.881455] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.881463] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.881479] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7917 [D 20:43:35.881489] element 0: offset: 0x5b0030, size: 24 [D 20:43:35.881498] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 22/70. [D 20:43:35.881829] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.881841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.881849] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:35.881863] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7921 [D 20:43:35.881873] element 0: offset: 0x64dd40, size: 24 [D 20:43:35.881882] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 23/70. [D 20:43:35.884034] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7917 [D 20:43:35.884088] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 24/70. [D 20:43:35.884166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56330. [D 20:43:35.884185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56331. [D 20:43:35.884195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56332. [D 20:43:35.884205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56333. [D 20:43:35.884215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56334. [D 20:43:35.884225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56335. [D 20:43:35.884244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56336. [D 20:43:35.884255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56337. [D 20:43:35.884265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56338. [D 20:43:35.884275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56339. [D 20:43:35.884285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56340. [D 20:43:35.884295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56341. [D 20:43:35.884305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56342. [D 20:43:35.884315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56343. [D 20:43:35.884325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56344. [D 20:43:35.884335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56345. [D 20:43:35.884345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56346. [D 20:43:35.884355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56347. [D 20:43:35.884365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56348. [D 20:43:35.884375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56349. [D 20:43:35.884385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56350. [D 20:43:35.884395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56351. [D 20:43:35.884405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56352. [D 20:43:35.884415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56353. [D 20:43:35.884425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56354. [D 20:43:35.884436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56355. [D 20:43:35.884446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56356. [D 20:43:35.884456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56357. [D 20:43:35.884466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56358. [D 20:43:35.884476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56359. [D 20:43:35.884486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56360. [D 20:43:35.884496] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241840 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56361. [D 20:43:35.886682] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7921 [D 20:43:35.886727] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 25/70. [D 20:43:35.893699] openib_check_cq: completed rdma wr_id 2aaaab241840, nic_wr_credit 56361. [D 20:43:35.893717] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 26/70. [D 20:43:35.893745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56361. [D 20:43:35.893755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 56362. [D 20:43:35.893765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 56363. [D 20:43:35.893775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 56364. [D 20:43:35.893785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 56365. [D 20:43:35.893795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 56366. [D 20:43:35.893805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56367. [D 20:43:35.893815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56368. [D 20:43:35.893825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56369. [D 20:43:35.893835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 56370. [D 20:43:35.893845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 56371. [D 20:43:35.893854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 56372. [D 20:43:35.893864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 56373. [D 20:43:35.893874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 56374. [D 20:43:35.893884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56375. [D 20:43:35.893894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56376. [D 20:43:35.893904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56377. [D 20:43:35.893914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 56378. [D 20:43:35.893924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 56379. [D 20:43:35.893934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 56380. [D 20:43:35.893943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 56381. [D 20:43:35.893953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 56382. [D 20:43:35.893963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56383. [D 20:43:35.893973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56384. [D 20:43:35.893983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56385. [D 20:43:35.893993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 56386. [D 20:43:35.894003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 56387. [D 20:43:35.894013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 56388. [D 20:43:35.894023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 56389. [D 20:43:35.894033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 56390. [D 20:43:35.894043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56391. [D 20:43:35.894053] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56392. [D 20:43:35.896377] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.896387] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.896396] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:35.905555] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56392. [D 20:43:35.905570] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 27/70. [D 20:43:35.907816] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.907826] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.907835] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:35.923449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:35.923462] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.923471] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:35.923486] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7924 [D 20:43:35.923495] element 0: offset: 0x643630, size: 24 [D 20:43:35.923504] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 28/70. [D 20:43:35.926081] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7924 [D 20:43:35.926132] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 29/70. [D 20:43:35.926267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56392. [D 20:43:35.926285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 56393. [D 20:43:35.926296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 56394. [D 20:43:35.926306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 56395. [D 20:43:35.926315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 56396. [D 20:43:35.926326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 56397. [D 20:43:35.926335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 56398. [D 20:43:35.926345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 56399. [D 20:43:35.926355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 56400. [D 20:43:35.926365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 56401. [D 20:43:35.926375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 56402. [D 20:43:35.926385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 56403. [D 20:43:35.926395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 56404. [D 20:43:35.926405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 56405. [D 20:43:35.926415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 56406. [D 20:43:35.926424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 56407. [D 20:43:35.926434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 56408. [D 20:43:35.926444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 56409. [D 20:43:35.926454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 56410. [D 20:43:35.926464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 56411. [D 20:43:35.926474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 56412. [D 20:43:35.926484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 56413. [D 20:43:35.926494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 56414. [D 20:43:35.926504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 56415. [D 20:43:35.926514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 56416. [D 20:43:35.926523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 56417. [D 20:43:35.926533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 56418. [D 20:43:35.926543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 56419. [D 20:43:35.926553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 56420. [D 20:43:35.926563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 56421. [D 20:43:35.926574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 56422. [D 20:43:35.926584] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 56423. [D 20:43:35.936615] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56423. [D 20:43:35.936630] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 30/70. [D 20:43:35.938916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:35.938927] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:35.938935] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.058094] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.058109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.058117] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.058132] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7926 [D 20:43:36.058142] element 0: offset: 0x662340, size: 24 [D 20:43:36.058151] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 31/70. [D 20:43:36.060461] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7926 [D 20:43:36.060509] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 32/70. [D 20:43:36.060556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 56423. [D 20:43:36.060574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 56424. [D 20:43:36.060585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56425. [D 20:43:36.060594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56426. [D 20:43:36.060604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56427. [D 20:43:36.060617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56428. [D 20:43:36.060627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56429. [D 20:43:36.060637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56430. [D 20:43:36.060647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56431. [D 20:43:36.060657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56432. [D 20:43:36.060667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56433. [D 20:43:36.060677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56434. [D 20:43:36.060687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56435. [D 20:43:36.060697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56436. [D 20:43:36.060707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56437. [D 20:43:36.060717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56438. [D 20:43:36.060727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56439. [D 20:43:36.060737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56440. [D 20:43:36.060747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56441. [D 20:43:36.060757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56442. [D 20:43:36.060767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56443. [D 20:43:36.060776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56444. [D 20:43:36.060786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56445. [D 20:43:36.060796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56446. [D 20:43:36.060806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56447. [D 20:43:36.060816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56448. [D 20:43:36.060826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56449. [D 20:43:36.060836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56450. [D 20:43:36.060846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56451. [D 20:43:36.060857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56452. [D 20:43:36.060867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56453. [D 20:43:36.060877] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56454. [D 20:43:36.066792] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56454. [D 20:43:36.066807] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 33/70. [D 20:43:36.068967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.068977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.068986] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.084183] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.084196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.084205] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.084220] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7930 [D 20:43:36.084229] element 0: offset: 0x5b0030, size: 24 [D 20:43:36.084238] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 34/70. [D 20:43:36.084253] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.084262] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.084274] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:36.084286] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7933 [D 20:43:36.084296] element 0: offset: 0x61f040, size: 24 [D 20:43:36.084305] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 35/70. [D 20:43:36.089061] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7930 [D 20:43:36.089079] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 36/70. [D 20:43:36.089125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 56454. [D 20:43:36.089137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 56455. [D 20:43:36.089147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56456. [D 20:43:36.089157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56457. [D 20:43:36.089167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56458. [D 20:43:36.089177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56459. [D 20:43:36.089187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56460. [D 20:43:36.089197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56461. [D 20:43:36.089207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56462. [D 20:43:36.089217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56463. [D 20:43:36.089228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56464. [D 20:43:36.089238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56465. [D 20:43:36.089248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56466. [D 20:43:36.089258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56467. [D 20:43:36.089268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56468. [D 20:43:36.089278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56469. [D 20:43:36.089288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56470. [D 20:43:36.089298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56471. [D 20:43:36.089308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56472. [D 20:43:36.089318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56473. [D 20:43:36.089328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56474. [D 20:43:36.089338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56475. [D 20:43:36.089349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56476. [D 20:43:36.089359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56477. [D 20:43:36.089369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56478. [D 20:43:36.089379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56479. [D 20:43:36.089390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56480. [D 20:43:36.089400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56481. [D 20:43:36.089410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56482. [D 20:43:36.089421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56483. [D 20:43:36.089431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56484. [D 20:43:36.089441] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56485. [D 20:43:36.091782] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 237056, tag: 7933 [D 20:43:36.091794] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 37/70. [D 20:43:36.099642] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56485. [D 20:43:36.099658] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 38/70. [D 20:43:36.099685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 56485. [D 20:43:36.099696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 56486. [D 20:43:36.099706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 56487. [D 20:43:36.099716] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241270 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 56488. [D 20:43:36.101077] openib_check_cq: completed rdma wr_id 2aaaab241270, nic_wr_credit 56488. [D 20:43:36.101088] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 39/70. [D 20:43:36.103418] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.103428] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.103437] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:36.103449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.103458] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.103466] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.113542] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.113555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.113564] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.113579] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7937 [D 20:43:36.113588] element 0: offset: 0x625390, size: 24 [D 20:43:36.113598] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 40/70. [D 20:43:36.113612] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.113621] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.113632] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:36.113645] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7938 [D 20:43:36.113654] element 0: offset: 0x649540, size: 24 [D 20:43:36.113664] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 41/70. [D 20:43:36.115868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.115879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.115888] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:36.117905] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7938 [D 20:43:36.117922] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 42/70. [D 20:43:36.118055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56488. [D 20:43:36.118070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56489. [D 20:43:36.118081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56490. [D 20:43:36.118090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56491. [D 20:43:36.118101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56492. [D 20:43:36.118110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56493. [D 20:43:36.118120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56494. [D 20:43:36.118130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56495. [D 20:43:36.118140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56496. [D 20:43:36.118150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56497. [D 20:43:36.118160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56498. [D 20:43:36.118170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56499. [D 20:43:36.118180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56500. [D 20:43:36.118189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56501. [D 20:43:36.118199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56502. [D 20:43:36.118209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56503. [D 20:43:36.118219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56504. [D 20:43:36.118232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56505. [D 20:43:36.118242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56506. [D 20:43:36.118252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56507. [D 20:43:36.118262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56508. [D 20:43:36.118272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56509. [D 20:43:36.118282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56510. [D 20:43:36.118291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56511. [D 20:43:36.118301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56512. [D 20:43:36.118311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56513. [D 20:43:36.118321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56514. [D 20:43:36.118331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56515. [D 20:43:36.118341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56516. [D 20:43:36.118351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56517. [D 20:43:36.118361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56518. [D 20:43:36.118372] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56519. [D 20:43:36.128125] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56519. [D 20:43:36.128140] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 43/70. [D 20:43:36.130408] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.130418] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.130427] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.136974] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.136987] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.136996] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.137010] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7941 [D 20:43:36.137020] element 0: offset: 0x643630, size: 24 [D 20:43:36.137029] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 44/70. [D 20:43:36.141564] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7941 [D 20:43:36.141580] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 45/70. [D 20:43:36.141712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56519. [D 20:43:36.141727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56520. [D 20:43:36.141738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56521. [D 20:43:36.141747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56522. [D 20:43:36.141757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56523. [D 20:43:36.141767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56524. [D 20:43:36.141777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56525. [D 20:43:36.141787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56526. [D 20:43:36.141797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56527. [D 20:43:36.141807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56528. [D 20:43:36.141816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56529. [D 20:43:36.141826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56530. [D 20:43:36.141836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56531. [D 20:43:36.141846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56532. [D 20:43:36.141856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56533. [D 20:43:36.141866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56534. [D 20:43:36.141876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56535. [D 20:43:36.141886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56536. [D 20:43:36.141896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56537. [D 20:43:36.141905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56538. [D 20:43:36.141916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56539. [D 20:43:36.141926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56540. [D 20:43:36.141935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56541. [D 20:43:36.141945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56542. [D 20:43:36.141955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56543. [D 20:43:36.141965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56544. [D 20:43:36.141975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56545. [D 20:43:36.141985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56546. [D 20:43:36.141995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56547. [D 20:43:36.142005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56548. [D 20:43:36.142015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56549. [D 20:43:36.142025] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56550. [D 20:43:36.151326] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56550. [D 20:43:36.151341] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 46/70. [D 20:43:36.153603] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.153614] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.153622] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.161480] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.161494] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.161502] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.161517] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7944 [D 20:43:36.161526] element 0: offset: 0x6494f0, size: 24 [D 20:43:36.161535] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 47/70. [D 20:43:36.163936] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7944 [D 20:43:36.163953] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 48/70. [D 20:43:36.164087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56550. [D 20:43:36.164103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56551. [D 20:43:36.164113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56552. [D 20:43:36.164123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56553. [D 20:43:36.164132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56554. [D 20:43:36.164142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56555. [D 20:43:36.164152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56556. [D 20:43:36.164162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56557. [D 20:43:36.164172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56558. [D 20:43:36.164182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56559. [D 20:43:36.164192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56560. [D 20:43:36.164202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56561. [D 20:43:36.164211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56562. [D 20:43:36.164221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56563. [D 20:43:36.164231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56564. [D 20:43:36.164241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56565. [D 20:43:36.164251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56566. [D 20:43:36.164261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56567. [D 20:43:36.164271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56568. [D 20:43:36.164281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56569. [D 20:43:36.164291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56570. [D 20:43:36.164301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56571. [D 20:43:36.164311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56572. [D 20:43:36.164321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56573. [D 20:43:36.164331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56574. [D 20:43:36.164340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56575. [D 20:43:36.164350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56576. [D 20:43:36.164360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56577. [D 20:43:36.164370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56578. [D 20:43:36.164380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56579. [D 20:43:36.164391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56580. [D 20:43:36.164401] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56581. [D 20:43:36.174588] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56581. [D 20:43:36.174603] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 49/70. [D 20:43:36.176864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.176874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.176882] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.184691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.184704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.184713] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.184727] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7947 [D 20:43:36.184737] element 0: offset: 0x662340, size: 24 [D 20:43:36.184746] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 50/70. [D 20:43:36.187205] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7947 [D 20:43:36.187223] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 51/70. [D 20:43:36.187357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56581. [D 20:43:36.187372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56582. [D 20:43:36.187382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56583. [D 20:43:36.187392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56584. [D 20:43:36.187402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56585. [D 20:43:36.187412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56586. [D 20:43:36.187422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56587. [D 20:43:36.187432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56588. [D 20:43:36.187442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56589. [D 20:43:36.187452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56590. [D 20:43:36.187462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56591. [D 20:43:36.187472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56592. [D 20:43:36.187481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56593. [D 20:43:36.187491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56594. [D 20:43:36.187501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56595. [D 20:43:36.187511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56596. [D 20:43:36.187521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56597. [D 20:43:36.187531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56598. [D 20:43:36.187541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56599. [D 20:43:36.187551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56600. [D 20:43:36.187561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56601. [D 20:43:36.187571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56602. [D 20:43:36.187581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56603. [D 20:43:36.187591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56604. [D 20:43:36.187600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56605. [D 20:43:36.187610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56606. [D 20:43:36.187620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56607. [D 20:43:36.187630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56608. [D 20:43:36.187640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56609. [D 20:43:36.187650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56610. [D 20:43:36.187660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56611. [D 20:43:36.187671] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56612. [D 20:43:36.197852] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56612. [D 20:43:36.197867] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 52/70. [D 20:43:36.200129] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.200140] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.200148] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.207814] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.207827] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.207836] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.207850] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7950 [D 20:43:36.207860] element 0: offset: 0x625390, size: 24 [D 20:43:36.207869] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 53/70. [D 20:43:36.210532] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7950 [D 20:43:36.210548] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 54/70. [D 20:43:36.210682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 56612. [D 20:43:36.210697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 56613. [D 20:43:36.210707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56614. [D 20:43:36.210717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56615. [D 20:43:36.210727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56616. [D 20:43:36.210737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56617. [D 20:43:36.210747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56618. [D 20:43:36.210757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56619. [D 20:43:36.210767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56620. [D 20:43:36.210777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56621. [D 20:43:36.210787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56622. [D 20:43:36.210797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56623. [D 20:43:36.210806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56624. [D 20:43:36.210816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56625. [D 20:43:36.210826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56626. [D 20:43:36.210836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56627. [D 20:43:36.210846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56628. [D 20:43:36.210856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56629. [D 20:43:36.210866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56630. [D 20:43:36.210876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56631. [D 20:43:36.210886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56632. [D 20:43:36.210895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56633. [D 20:43:36.210905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56634. [D 20:43:36.210915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56635. [D 20:43:36.210925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56636. [D 20:43:36.210935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56637. [D 20:43:36.210945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56638. [D 20:43:36.210955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56639. [D 20:43:36.210965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56640. [D 20:43:36.210975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56641. [D 20:43:36.210985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56642. [D 20:43:36.210996] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56643. [D 20:43:36.220942] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56643. [D 20:43:36.220957] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 55/70. [D 20:43:36.223221] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.223232] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.223240] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.231143] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.231157] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.231165] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.231179] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7953 [D 20:43:36.231189] element 0: offset: 0x620cf0, size: 24 [D 20:43:36.231198] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 56/70. [D 20:43:36.233879] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7953 [D 20:43:36.233896] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 57/70. [D 20:43:36.233954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 56643. [D 20:43:36.233968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 56644. [D 20:43:36.233978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56645. [D 20:43:36.233988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56646. [D 20:43:36.233998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56647. [D 20:43:36.234008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56648. [D 20:43:36.234018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56649. [D 20:43:36.234039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56650. [D 20:43:36.234049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56651. [D 20:43:36.234059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56652. [D 20:43:36.234069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56653. [D 20:43:36.234079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 56654. [D 20:43:36.234089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 56655. [D 20:43:36.234099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 56656. [D 20:43:36.234109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 56657. [D 20:43:36.234119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 56658. [D 20:43:36.234129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 56659. [D 20:43:36.234139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 56660. [D 20:43:36.234148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 56661. [D 20:43:36.234158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 56662. [D 20:43:36.234168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 56663. [D 20:43:36.234178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 56664. [D 20:43:36.234188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 56665. [D 20:43:36.234198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 56666. [D 20:43:36.234208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 56667. [D 20:43:36.234218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 56668. [D 20:43:36.234228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 56669. [D 20:43:36.234237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 56670. [D 20:43:36.234250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 56671. [D 20:43:36.234260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 56672. [D 20:43:36.234271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 56673. [D 20:43:36.234281] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 56674. [D 20:43:36.239898] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56674. [D 20:43:36.239913] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 58/70. [D 20:43:36.242176] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.242187] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.242195] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.471246] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.471260] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.471268] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.471283] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7956 [D 20:43:36.471292] element 0: offset: 0x643630, size: 24 [D 20:43:36.471301] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 59/70. [D 20:43:36.472192] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 675520, tag: 7956 [D 20:43:36.473679] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 60/70. [D 20:43:36.473740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 56674. [D 20:43:36.473755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 56675. [D 20:43:36.473765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 56676. [D 20:43:36.473775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 56677. [D 20:43:36.473784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 56678. [D 20:43:36.473795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 56679. [D 20:43:36.473804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 56680. [D 20:43:36.473817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 56681. [D 20:43:36.473827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 56682. [D 20:43:36.473836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 56683. [D 20:43:36.473846] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e90 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 56684. [D 20:43:36.477418] openib_check_cq: completed rdma wr_id 2aaaab240e90, nic_wr_credit 56684. [D 20:43:36.477433] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 0/70. [D 20:43:36.479726] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.479736] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.479745] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.484866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.484879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.484887] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.484902] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7959 [D 20:43:36.484911] element 0: offset: 0x6494f0, size: 24 [D 20:43:36.484921] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 1/70. [D 20:43:36.485015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.485027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.485036] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.503497] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.503510] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.503519] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.503610] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7963 [D 20:43:36.503624] element 0: offset: 0x5b0030, size: 24 [D 20:43:36.503634] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 2/70. [D 20:43:36.503688] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7963 [D 20:43:36.503715] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 3/70. [D 20:43:36.504755] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7963 [D 20:43:36.504766] element 0: offset: 0x5b0030, size: 24 [D 20:43:36.504775] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 4/70. [D 20:43:36.504861] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.504871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.504879] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.627324] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.627337] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.627346] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.627360] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7969 [D 20:43:36.627370] element 0: offset: 0x649540, size: 24 [D 20:43:36.627379] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 5/70. [D 20:43:36.629904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.629916] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.629924] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:36.629938] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7972 [D 20:43:36.629947] element 0: offset: 0x625390, size: 24 [D 20:43:36.629957] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 6/70. [D 20:43:36.629971] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.629980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.629992] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:36.630012] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.630022] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.630030] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:36.630043] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7976 [D 20:43:36.630053] element 0: offset: 0x64dd40, size: 24 [D 20:43:36.630062] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 7/70. [D 20:43:36.632263] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7969 [D 20:43:36.632316] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 8/70. [D 20:43:36.632388] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7974 [D 20:43:36.632404] element 0: offset: 0x61f040, size: 24 [D 20:43:36.632414] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 9/70. [D 20:43:36.632436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56684. [D 20:43:36.632447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56685. [D 20:43:36.632457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 56686. [D 20:43:36.632468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 56687. [D 20:43:36.632477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 56688. [D 20:43:36.632487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 56689. [D 20:43:36.632497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 56690. [D 20:43:36.632507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56691. [D 20:43:36.632517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56692. [D 20:43:36.632527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56693. [D 20:43:36.632537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 56694. [D 20:43:36.632547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 56695. [D 20:43:36.632557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 56696. [D 20:43:36.632567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 56697. [D 20:43:36.632577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 56698. [D 20:43:36.632587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56699. [D 20:43:36.632597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56700. [D 20:43:36.632607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56701. [D 20:43:36.632617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 56702. [D 20:43:36.632627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 56703. [D 20:43:36.632637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 56704. [D 20:43:36.632647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 56705. [D 20:43:36.632657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 56706. [D 20:43:36.632667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56707. [D 20:43:36.632677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56708. [D 20:43:36.632687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56709. [D 20:43:36.632697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 56710. [D 20:43:36.632707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 56711. [D 20:43:36.632717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 56712. [D 20:43:36.632727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 56713. [D 20:43:36.632737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 56714. [D 20:43:36.632747] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230260 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56715. [D 20:43:36.632780] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7974 [D 20:43:36.632792] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 10/70. [D 20:43:36.636840] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7972 [D 20:43:36.636899] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 11/70. [D 20:43:36.636954] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7976 [D 20:43:36.636968] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 12/70. [D 20:43:36.639233] openib_check_cq: completed rdma wr_id 2aaaab230260, nic_wr_credit 56715. [D 20:43:36.639251] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 13/70. [D 20:43:36.640387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 56715. [D 20:43:36.640398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 56716. [D 20:43:36.640407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 56717. [D 20:43:36.640417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 56718. [D 20:43:36.640427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 56719. [D 20:43:36.640437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 56720. [D 20:43:36.640447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 56721. [D 20:43:36.640457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 56722. [D 20:43:36.640467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 56723. [D 20:43:36.640477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 56724. [D 20:43:36.640487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 56725. [D 20:43:36.640497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 56726. [D 20:43:36.640506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 56727. [D 20:43:36.640516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 56728. [D 20:43:36.640526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 56729. [D 20:43:36.640536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 56730. [D 20:43:36.640546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 56731. [D 20:43:36.640556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 56732. [D 20:43:36.640565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 56733. [D 20:43:36.640575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 56734. [D 20:43:36.640585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 56735. [D 20:43:36.640595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 56736. [D 20:43:36.640605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 56737. [D 20:43:36.640615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 56738. [D 20:43:36.640625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 56739. [D 20:43:36.640635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 56740. [D 20:43:36.640644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 56741. [D 20:43:36.640654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 56742. [D 20:43:36.640664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 56743. [D 20:43:36.640675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 56744. [D 20:43:36.640685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 56745. [D 20:43:36.640695] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241270 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 56746. [D 20:43:36.640706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 56747. [D 20:43:36.640716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 56748. [D 20:43:36.640726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 56749. [D 20:43:36.640736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 56750. [D 20:43:36.640746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 56751. [D 20:43:36.640756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 56752. [D 20:43:36.640765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 56753. [D 20:43:36.640775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 56754. [D 20:43:36.640785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 56755. [D 20:43:36.640795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 56756. [D 20:43:36.640805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 56757. [D 20:43:36.640815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 56758. [D 20:43:36.640825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 56759. [D 20:43:36.640835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 56760. [D 20:43:36.640845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 56761. [D 20:43:36.640855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 56762. [D 20:43:36.640864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 56763. [D 20:43:36.640874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 56764. [D 20:43:36.640884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 56765. [D 20:43:36.640894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 56766. [D 20:43:36.640904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 56767. [D 20:43:36.640914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 56768. [D 20:43:36.640924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 56769. [D 20:43:36.640934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 56770. [D 20:43:36.640944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 56771. [D 20:43:36.640954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 56772. [D 20:43:36.640964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 56773. [D 20:43:36.640974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 56774. [D 20:43:36.640984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 56775. [D 20:43:36.641019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 56776. [D 20:43:36.641029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 56777. [D 20:43:36.641039] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab236b30 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 56778. [D 20:43:36.641006] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.643449] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.643460] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:36.643476] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7974 [D 20:43:36.643485] element 0: offset: 0x61f040, size: 24 [D 20:43:36.643495] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 14/70. [D 20:43:36.652153] openib_check_cq: completed rdma wr_id 2aaaab241270, nic_wr_credit 56778. [D 20:43:36.652175] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 15/70. [D 20:43:36.658889] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.658905] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.658914] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:36.658929] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7978 [D 20:43:36.658938] element 0: offset: 0x662340, size: 24 [D 20:43:36.658948] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 16/70. [D 20:43:36.663784] openib_check_cq: completed rdma wr_id 2aaaab236b30, nic_wr_credit 56777. [D 20:43:36.663800] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 17/70. [D 20:43:36.666075] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.666085] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.666094] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:36.666106] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.666115] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.666123] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:36.666160] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.666170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.666178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:36.668049] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7978 [D 20:43:36.668099] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 18/70. [D 20:43:36.668105] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.668122] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.668131] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:36.668159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56777. [D 20:43:36.668171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56778. [D 20:43:36.668182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 56779. [D 20:43:36.668191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 56780. [D 20:43:36.668201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 56781. [D 20:43:36.668212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 56782. [D 20:43:36.668222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 56783. [D 20:43:36.668232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56784. [D 20:43:36.668235] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7982 [D 20:43:36.668262] element 0: offset: 0x620cf0, size: 24 [D 20:43:36.668246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56785. [D 20:43:36.668294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56786. [D 20:43:36.668304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 56787. [D 20:43:36.668314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 56788. [D 20:43:36.668324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 56789. [D 20:43:36.668334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 56790. [D 20:43:36.668344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 56791. [D 20:43:36.668353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56792. [D 20:43:36.668363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56793. [D 20:43:36.668373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56794. [D 20:43:36.668383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 56795. [D 20:43:36.668393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 56796. [D 20:43:36.668403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 56797. [D 20:43:36.668413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 56798. [D 20:43:36.668422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 56799. [D 20:43:36.668432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56800. [D 20:43:36.668442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56801. [D 20:43:36.668452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56802. [D 20:43:36.668462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 56803. [D 20:43:36.668472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 56804. [D 20:43:36.668481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 56805. [D 20:43:36.668491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 56806. [D 20:43:36.668501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 56807. [D 20:43:36.668511] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20fcd0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56808. [D 20:43:36.668529] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 19/70. [D 20:43:36.674213] openib_check_cq: completed rdma wr_id 2aaaab20fcd0, nic_wr_credit 56808. [D 20:43:36.674232] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 20/70. [D 20:43:36.674277] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7982 [D 20:43:36.674336] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.674347] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.674356] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:36.679346] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 21/70. [D 20:43:36.681416] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7982 [D 20:43:36.681431] element 0: offset: 0x620cf0, size: 24 [D 20:43:36.681444] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 22/70. [D 20:43:36.681496] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.681507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.681515] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.686509] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.686522] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.686530] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.686553] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7986 [D 20:43:36.686562] element 0: offset: 0x62d470, size: 24 [D 20:43:36.686572] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 23/70. [D 20:43:36.686628] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.686638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.686646] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:36.686661] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7988 [D 20:43:36.686670] element 0: offset: 0x643630, size: 24 [D 20:43:36.686680] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 24/70. [D 20:43:36.689846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.689896] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.689905] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:36.689934] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7991 [D 20:43:36.689945] element 0: offset: 0x625390, size: 24 [D 20:43:36.689958] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 25/70. [D 20:43:36.689994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.690003] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.690012] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:36.690027] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7994 [D 20:43:36.690037] element 0: offset: 0x64dd40, size: 24 [D 20:43:36.690047] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 26/70. [D 20:43:36.695217] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 7994 [D 20:43:36.695238] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 27/70. [D 20:43:36.695254] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 7986 [D 20:43:36.695269] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 28/70. [D 20:43:36.695280] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7988 [D 20:43:36.695291] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 29/70. [D 20:43:36.695303] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 7991 [D 20:43:36.695314] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 30/70. [D 20:43:36.695335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 56808. [D 20:43:36.695347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 56809. [D 20:43:36.695357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 56810. [D 20:43:36.695367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 56811. [D 20:43:36.695377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 56812. [D 20:43:36.695387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 56813. [D 20:43:36.695397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56814. [D 20:43:36.695407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56815. [D 20:43:36.695416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56816. [D 20:43:36.695426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 56817. [D 20:43:36.695436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 56818. [D 20:43:36.695446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 56819. [D 20:43:36.695456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 56820. [D 20:43:36.695466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 56821. [D 20:43:36.695476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56822. [D 20:43:36.695486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56823. [D 20:43:36.695496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56824. [D 20:43:36.695506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 56825. [D 20:43:36.695516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 56826. [D 20:43:36.695526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 56827. [D 20:43:36.695535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 56828. [D 20:43:36.695546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 56829. [D 20:43:36.695556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56830. [D 20:43:36.695565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56831. [D 20:43:36.695575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56832. [D 20:43:36.695586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 56833. [D 20:43:36.695596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 56834. [D 20:43:36.695606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 56835. [D 20:43:36.695616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 56836. [D 20:43:36.695626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 56837. [D 20:43:36.695636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56838. [D 20:43:36.695646] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202d20 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56839. [D 20:43:36.695658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 56840. [D 20:43:36.695668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 56841. [D 20:43:36.695678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 56842. [D 20:43:36.695688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 56843. [D 20:43:36.695698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 56844. [D 20:43:36.695708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 56845. [D 20:43:36.695718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 56846. [D 20:43:36.695728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 56847. [D 20:43:36.695738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 56848. [D 20:43:36.695748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 56849. [D 20:43:36.695758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 56850. [D 20:43:36.695768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 56851. [D 20:43:36.695777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 56852. [D 20:43:36.695787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 56853. [D 20:43:36.695798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 56854. [D 20:43:36.695807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 56855. [D 20:43:36.695817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 56856. [D 20:43:36.695827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 56857. [D 20:43:36.695837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 56858. [D 20:43:36.695847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 56859. [D 20:43:36.695857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 56860. [D 20:43:36.695867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 56861. [D 20:43:36.695878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 56862. [D 20:43:36.695888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 56863. [D 20:43:36.695898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 56864. [D 20:43:36.695907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 56865. [D 20:43:36.695917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 56866. [D 20:43:36.695927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 56867. [D 20:43:36.695937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 56868. [D 20:43:36.695947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 56869. [D 20:43:36.695957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 56870. [D 20:43:36.695967] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20fe00 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 56871. [D 20:43:36.695978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 56872. [D 20:43:36.695988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 56873. [D 20:43:36.695998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 56874. [D 20:43:36.696008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 56875. [D 20:43:36.696018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 56876. [D 20:43:36.696028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 56877. [E 20:43:36.696040] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 56878, block for 10 ms. [D 20:43:36.696066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56878. [D 20:43:36.696079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56879. [E 20:43:36.696091] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 56880, block for 10 ms. [D 20:43:36.704867] openib_check_cq: completed rdma wr_id 2aaaab202d20, nic_wr_credit 56879. [D 20:43:36.704883] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 31/70. [D 20:43:36.704893] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56878. [D 20:43:36.704903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 56879. [D 20:43:36.704913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 56880. [D 20:43:36.704923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 56881. [D 20:43:36.704933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 56882. [D 20:43:36.704943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 56883. [D 20:43:36.704953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 56884. [D 20:43:36.704963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 56885. [D 20:43:36.704973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 56886. [D 20:43:36.704983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 56887. [D 20:43:36.704993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 56888. [D 20:43:36.705008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 56889. [D 20:43:36.705018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 56890. [D 20:43:36.705027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 56891. [D 20:43:36.705037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 56892. [D 20:43:36.705047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 56893. [D 20:43:36.705057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 56894. [D 20:43:36.705067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 56895. [D 20:43:36.705077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 56896. [D 20:43:36.705087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 56897. [D 20:43:36.705097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 56898. [D 20:43:36.705107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 56899. [D 20:43:36.705117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 56900. [D 20:43:36.705127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 56901. [D 20:43:36.705137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 56902. [D 20:43:36.705146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 56903. [D 20:43:36.705156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 56904. [D 20:43:36.705166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 56905. [D 20:43:36.705176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 56906. [D 20:43:36.705187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 56907. [D 20:43:36.705197] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c8a0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 56908. [D 20:43:36.705208] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 56908. [E 20:43:36.705219] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 56909, block for 10 ms. [D 20:43:36.716549] openib_check_cq: completed rdma wr_id 2aaaab20fe00, nic_wr_credit 56908. [D 20:43:36.716564] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 32/70. [D 20:43:36.716574] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 56907. [D 20:43:36.716585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 56908. [D 20:43:36.716595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 56909. [D 20:43:36.716605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 56910. [D 20:43:36.716615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 56911. [D 20:43:36.716625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 56912. [D 20:43:36.716635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 56913. [D 20:43:36.716645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 56914. [D 20:43:36.716655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 56915. [D 20:43:36.716665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 56916. [D 20:43:36.716674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 56917. [D 20:43:36.716684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 56918. [D 20:43:36.716695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 56919. [D 20:43:36.716704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 56920. [D 20:43:36.716714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 56921. [D 20:43:36.716724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 56922. [D 20:43:36.716734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 56923. [D 20:43:36.716744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 56924. [D 20:43:36.716754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 56925. [D 20:43:36.716764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 56926. [D 20:43:36.716774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 56927. [D 20:43:36.716784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 56928. [D 20:43:36.716794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 56929. [D 20:43:36.716804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 56930. [D 20:43:36.716814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 56931. [D 20:43:36.716824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 56932. [D 20:43:36.716834] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c760 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 56933. [D 20:43:36.718779] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.718820] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.718829] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:36.730113] openib_check_cq: completed rdma wr_id 2aaaab23c8a0, nic_wr_credit 56933. [D 20:43:36.730131] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 33/70. [D 20:43:36.730164] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.730178] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.730187] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:36.737000] openib_check_cq: completed rdma wr_id 2aaaab23c760, nic_wr_credit 56932. [D 20:43:36.737018] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 34/70. [D 20:43:36.737050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.737063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.737072] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:36.737110] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.737120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.737129] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.742319] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.742332] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.742341] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.742368] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 7997 [D 20:43:36.742378] element 0: offset: 0x2aaaab209230, size: 24 [D 20:43:36.742391] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 35/70. [D 20:43:36.744686] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 7997 [D 20:43:36.744704] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 36/70. [D 20:43:36.747679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 56932. [D 20:43:36.747694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 56933. [D 20:43:36.747705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 56934. [D 20:43:36.747715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 56935. [D 20:43:36.747724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 56936. [D 20:43:36.747735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 56937. [D 20:43:36.747745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 56938. [D 20:43:36.747754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 56939. [D 20:43:36.747764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 56940. [D 20:43:36.747774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 56941. [D 20:43:36.747784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 56942. [D 20:43:36.747794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 56943. [D 20:43:36.747804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 56944. [D 20:43:36.747814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 56945. [D 20:43:36.747824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 56946. [D 20:43:36.747833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 56947. [D 20:43:36.747843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 56948. [D 20:43:36.747853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 56949. [D 20:43:36.747863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 56950. [D 20:43:36.747873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 56951. [D 20:43:36.747883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 56952. [D 20:43:36.747893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 56953. [D 20:43:36.747903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 56954. [D 20:43:36.747912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 56955. [D 20:43:36.747922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 56956. [D 20:43:36.747932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 56957. [D 20:43:36.747942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 56958. [D 20:43:36.747952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 56959. [D 20:43:36.747962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 56960. [D 20:43:36.747972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 56961. [D 20:43:36.747982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 56962. [D 20:43:36.747992] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202ca0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 56963. [D 20:43:36.753949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.753991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.754001] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:36.754030] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8000 [D 20:43:36.754040] element 0: offset: 0x2aaaab241310, size: 24 [D 20:43:36.754053] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 37/70. [D 20:43:36.756658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.756671] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.756680] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:36.756694] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8004 [D 20:43:36.756704] element 0: offset: 0x2aaaab23c910, size: 24 [D 20:43:36.756714] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 38/70. [D 20:43:36.756769] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.756779] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.756787] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:36.756802] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8006 [D 20:43:36.756812] element 0: offset: 0x2aaaab241560, size: 24 [D 20:43:36.756822] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 39/70. [D 20:43:36.759333] openib_check_cq: completed rdma wr_id 2aaaab202ca0, nic_wr_credit 56963. [D 20:43:36.759353] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 40/70. [D 20:43:36.759474] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.759487] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.759496] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:36.765544] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8006 [D 20:43:36.765564] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 41/70. [D 20:43:36.765577] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8000 [D 20:43:36.765587] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 42/70. [D 20:43:36.765600] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8004 [D 20:43:36.765610] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 43/70. [D 20:43:36.765666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 56963. [D 20:43:36.765677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 56964. [D 20:43:36.765687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 56965. [D 20:43:36.765698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 56966. [D 20:43:36.765707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 56967. [D 20:43:36.765717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 56968. [D 20:43:36.765727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 56969. [D 20:43:36.765737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 56970. [D 20:43:36.765747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 56971. [D 20:43:36.765757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 56972. [D 20:43:36.765767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 56973. [D 20:43:36.765777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 56974. [D 20:43:36.765787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 56975. [D 20:43:36.765796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 56976. [D 20:43:36.765806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 56977. [D 20:43:36.765816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 56978. [D 20:43:36.765826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 56979. [D 20:43:36.765836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 56980. [D 20:43:36.765846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 56981. [D 20:43:36.765856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 56982. [D 20:43:36.765866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 56983. [D 20:43:36.765876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 56984. [D 20:43:36.765886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 56985. [D 20:43:36.765896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 56986. [D 20:43:36.765906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 56987. [D 20:43:36.765915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 56988. [D 20:43:36.765926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 56989. [D 20:43:36.765936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 56990. [D 20:43:36.765946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 56991. [D 20:43:36.765956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 56992. [D 20:43:36.765966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 56993. [D 20:43:36.765976] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c880 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 56994. [D 20:43:36.765987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 56995. [D 20:43:36.765997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 56996. [D 20:43:36.766008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 56997. [D 20:43:36.766017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 56998. [D 20:43:36.766027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 56999. [D 20:43:36.766038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 57000. [D 20:43:36.766048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 57001. [D 20:43:36.766057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 57002. [D 20:43:36.766067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 57003. [D 20:43:36.766077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 57004. [D 20:43:36.766087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 57005. [D 20:43:36.766097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 57006. [D 20:43:36.766107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 57007. [D 20:43:36.766117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 57008. [D 20:43:36.766127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 57009. [D 20:43:36.766137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 57010. [D 20:43:36.766147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 57011. [D 20:43:36.766157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 57012. [D 20:43:36.766167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 57013. [D 20:43:36.766177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 57014. [D 20:43:36.766187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 57015. [D 20:43:36.766197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 57016. [D 20:43:36.766207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 57017. [D 20:43:36.766217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 57018. [D 20:43:36.766227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 57019. [D 20:43:36.766237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 57020. [D 20:43:36.766247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 57021. [D 20:43:36.766257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 57022. [D 20:43:36.766266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 57023. [D 20:43:36.766276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 57024. [D 20:43:36.766286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 57025. [D 20:43:36.766296] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab236b30 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 57026. [D 20:43:36.766307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 57027. [D 20:43:36.766317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 57028. [D 20:43:36.766327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 57029. [D 20:43:36.766337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 57030. [D 20:43:36.766350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 57031. [D 20:43:36.766360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 57032. [D 20:43:36.766370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57033. [E 20:43:36.766381] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 57034, block for 10 ms. [D 20:43:36.767921] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57033. [E 20:43:36.767937] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 57034, block for 10 ms. [D 20:43:36.777313] openib_check_cq: completed rdma wr_id 2aaaab23c880, nic_wr_credit 57033. [D 20:43:36.777328] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 44/70. [D 20:43:36.777338] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57032. [D 20:43:36.777348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 57033. [D 20:43:36.777358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 57034. [D 20:43:36.777368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 57035. [D 20:43:36.777378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 57036. [D 20:43:36.777388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 57037. [D 20:43:36.777398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 57038. [D 20:43:36.777408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 57039. [D 20:43:36.777418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 57040. [D 20:43:36.777428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 57041. [D 20:43:36.777438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 57042. [D 20:43:36.777447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 57043. [D 20:43:36.777457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 57044. [D 20:43:36.777467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 57045. [D 20:43:36.777477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 57046. [D 20:43:36.777487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 57047. [D 20:43:36.777497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 57048. [D 20:43:36.777507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 57049. [D 20:43:36.777517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 57050. [D 20:43:36.777527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 57051. [D 20:43:36.777537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 57052. [D 20:43:36.777547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 57053. [D 20:43:36.777557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 57054. [D 20:43:36.777566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 57055. [D 20:43:36.777577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 57056. [D 20:43:36.777586] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e50 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 57057. [D 20:43:36.777629] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.777672] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.777682] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:36.777712] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8009 [D 20:43:36.777724] element 0: offset: 0x2aaaab203230, size: 24 [D 20:43:36.777737] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 45/70. [D 20:43:36.788982] openib_check_cq: completed rdma wr_id 2aaaab236b30, nic_wr_credit 57057. [D 20:43:36.789002] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 46/70. [D 20:43:36.791185] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.791199] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.791207] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:36.800476] openib_check_cq: completed rdma wr_id 2aaaab240e50, nic_wr_credit 57056. [D 20:43:36.800493] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 47/70. [D 20:43:36.800527] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.800541] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.800549] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:36.800612] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.800622] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.800630] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:36.802545] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8009 [D 20:43:36.802589] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 48/70. [D 20:43:36.806170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 57056. [D 20:43:36.806188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 57057. [D 20:43:36.806199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 57058. [D 20:43:36.806209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 57059. [D 20:43:36.806219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 57060. [D 20:43:36.806229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 57061. [D 20:43:36.806239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 57062. [D 20:43:36.806248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 57063. [D 20:43:36.806259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 57064. [D 20:43:36.806268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 57065. [D 20:43:36.806278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 57066. [D 20:43:36.806288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 57067. [D 20:43:36.806298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 57068. [D 20:43:36.806308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 57069. [D 20:43:36.806318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 57070. [D 20:43:36.806328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 57071. [D 20:43:36.806338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 57072. [D 20:43:36.806350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 57073. [D 20:43:36.806361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 57074. [D 20:43:36.806371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 57075. [D 20:43:36.806380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 57076. [D 20:43:36.806390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 57077. [D 20:43:36.806400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 57078. [D 20:43:36.806410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 57079. [D 20:43:36.806420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 57080. [D 20:43:36.806430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 57081. [D 20:43:36.806440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 57082. [D 20:43:36.806450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 57083. [D 20:43:36.806460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 57084. [D 20:43:36.806470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 57085. [D 20:43:36.806481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 57086. [D 20:43:36.806491] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab240e50 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 57087. [D 20:43:36.812096] openib_check_cq: completed rdma wr_id 2aaaab240e50, nic_wr_credit 57087. [D 20:43:36.812111] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 49/70. [D 20:43:36.812167] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.812182] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.812191] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.822504] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.822518] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.822526] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.822553] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8014 [D 20:43:36.822563] element 0: offset: 0x2aaaab209230, size: 24 [D 20:43:36.822574] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 50/70. [D 20:43:36.824588] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8014 [D 20:43:36.824633] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 51/70. [D 20:43:36.824680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 57087. [D 20:43:36.824698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 57088. [D 20:43:36.824708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 57089. [D 20:43:36.824718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 57090. [D 20:43:36.824728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 57091. [D 20:43:36.824740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 57092. [D 20:43:36.824750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 57093. [D 20:43:36.824760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 57094. [D 20:43:36.824770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 57095. [D 20:43:36.824780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 57096. [D 20:43:36.824790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 57097. [D 20:43:36.824800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 57098. [D 20:43:36.824810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 57099. [D 20:43:36.824820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 57100. [D 20:43:36.824830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 57101. [D 20:43:36.824840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 57102. [D 20:43:36.824849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 57103. [D 20:43:36.824859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 57104. [D 20:43:36.824869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 57105. [D 20:43:36.824879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 57106. [D 20:43:36.824889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 57107. [D 20:43:36.824899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 57108. [D 20:43:36.824909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 57109. [D 20:43:36.824919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 57110. [D 20:43:36.824929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 57111. [D 20:43:36.824939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 57112. [D 20:43:36.824948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 57113. [D 20:43:36.824958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 57114. [D 20:43:36.824968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 57115. [D 20:43:36.824979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 57116. [D 20:43:36.824989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 57117. [D 20:43:36.824999] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c800 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 57118. [D 20:43:36.825095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.825111] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.825120] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:36.825148] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8016 [D 20:43:36.825158] element 0: offset: 0x2aaaab202ab0, size: 24 [D 20:43:36.825169] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 52/70. [D 20:43:36.825193] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.825205] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.825213] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:36.825228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8019 [D 20:43:36.825237] element 0: offset: 0x2aaaab2042e0, size: 24 [D 20:43:36.825247] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 53/70. [D 20:43:36.825267] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.825292] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.825300] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:36.825314] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8021 [D 20:43:36.825324] element 0: offset: 0x2aaaab23ccd0, size: 24 [D 20:43:36.825334] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 54/70. [D 20:43:36.831488] openib_check_cq: completed rdma wr_id 2aaaab23c800, nic_wr_credit 57118. [D 20:43:36.831506] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 55/70. [D 20:43:36.831625] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.831638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.831647] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:36.833938] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8016 [D 20:43:36.833960] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 56/70. [D 20:43:36.834095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 57118. [D 20:43:36.834110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 57119. [D 20:43:36.834120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 57120. [D 20:43:36.834130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 57121. [D 20:43:36.834140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 57122. [D 20:43:36.834160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 57123. [D 20:43:36.834171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 57124. [D 20:43:36.834181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 57125. [D 20:43:36.834190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 57126. [D 20:43:36.834201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 57127. [D 20:43:36.834211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 57128. [D 20:43:36.834221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 57129. [D 20:43:36.834231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 57130. [D 20:43:36.834240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 57131. [D 20:43:36.834251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 57132. [D 20:43:36.834261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 57133. [D 20:43:36.834270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 57134. [D 20:43:36.834280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 57135. [D 20:43:36.834291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 57136. [D 20:43:36.834300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 57137. [D 20:43:36.834310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 57138. [D 20:43:36.834320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 57139. [D 20:43:36.834330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 57140. [D 20:43:36.834340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 57141. [D 20:43:36.834354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 57142. [D 20:43:36.834365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 57143. [D 20:43:36.834375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 57144. [D 20:43:36.834384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 57145. [D 20:43:36.834394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 57146. [D 20:43:36.834405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 57147. [D 20:43:36.834415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 57148. [D 20:43:36.834425] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23d0b0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 57149. [D 20:43:36.836983] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8019 [D 20:43:36.837013] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 57/70. [D 20:43:36.837632] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8021 [D 20:43:36.837649] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 58/70. [D 20:43:36.845770] openib_check_cq: completed rdma wr_id 2aaaab23d0b0, nic_wr_credit 57149. [D 20:43:36.845785] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 59/70. [D 20:43:36.845817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 57149. [D 20:43:36.845827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 57150. [D 20:43:36.845837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 57151. [D 20:43:36.845847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 57152. [D 20:43:36.845857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 57153. [D 20:43:36.845867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 57154. [D 20:43:36.845877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57155. [D 20:43:36.845887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 57156. [D 20:43:36.845897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 57157. [D 20:43:36.845907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 57158. [D 20:43:36.845917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 57159. [D 20:43:36.845927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 57160. [D 20:43:36.845936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 57161. [D 20:43:36.845946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 57162. [D 20:43:36.845956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 57163. [D 20:43:36.845966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 57164. [D 20:43:36.845976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 57165. [D 20:43:36.845986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 57166. [D 20:43:36.845996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 57167. [D 20:43:36.846006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 57168. [D 20:43:36.846015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 57169. [D 20:43:36.846025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 57170. [D 20:43:36.846036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 57171. [D 20:43:36.846045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 57172. [D 20:43:36.846055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 57173. [D 20:43:36.846065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 57174. [D 20:43:36.846075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 57175. [D 20:43:36.846085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 57176. [D 20:43:36.846095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 57177. [D 20:43:36.846105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 57178. [D 20:43:36.846115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 57179. [D 20:43:36.846125] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab237da0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 57180. [D 20:43:36.846136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 57181. [D 20:43:36.846146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 57182. [D 20:43:36.846156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 57183. [D 20:43:36.846166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 57184. [D 20:43:36.846176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 57185. [D 20:43:36.846186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 57186. [D 20:43:36.846196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 57187. [D 20:43:36.846206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 57188. [D 20:43:36.846216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 57189. [D 20:43:36.846226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 57190. [D 20:43:36.846236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 57191. [D 20:43:36.846245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 57192. [D 20:43:36.846255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 57193. [D 20:43:36.846265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 57194. [D 20:43:36.846275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 57195. [D 20:43:36.846285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 57196. [D 20:43:36.846295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 57197. [D 20:43:36.846305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 57198. [D 20:43:36.846315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 57199. [D 20:43:36.846325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 57200. [D 20:43:36.846335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 57201. [D 20:43:36.846344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 57202. [D 20:43:36.846357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 57203. [D 20:43:36.846367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 57204. [D 20:43:36.846377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 57205. [D 20:43:36.846387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 57206. [D 20:43:36.846397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 57207. [D 20:43:36.846407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 57208. [D 20:43:36.846417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 57209. [D 20:43:36.846427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 57210. [D 20:43:36.846437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 57211. [D 20:43:36.846447] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2031c0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 57212. [D 20:43:36.846500] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.846540] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.846549] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:36.847497] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.847507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.847515] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:36.847542] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8024 [D 20:43:36.847552] element 0: offset: 0x2aaaab202ab0, size: 24 [D 20:43:36.847565] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 60/70. [D 20:43:36.857564] openib_check_cq: completed rdma wr_id 2aaaab237da0, nic_wr_credit 57212. [D 20:43:36.857582] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 0/70. [D 20:43:36.869241] openib_check_cq: completed rdma wr_id 2aaaab2031c0, nic_wr_credit 57211. [D 20:43:36.869256] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 1/70. [D 20:43:36.869290] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.869304] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.869313] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:36.869377] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.869387] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.869395] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:36.871617] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8024 [D 20:43:36.871632] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 2/70. [D 20:43:36.874518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 57211. [D 20:43:36.874534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 57212. [D 20:43:36.874544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 57213. [D 20:43:36.874554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 57214. [D 20:43:36.874564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 57215. [D 20:43:36.874574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 57216. [D 20:43:36.874584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 57217. [D 20:43:36.874593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 57218. [D 20:43:36.874603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 57219. [D 20:43:36.874613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 57220. [D 20:43:36.874623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 57221. [D 20:43:36.874633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 57222. [D 20:43:36.874643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 57223. [D 20:43:36.874653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 57224. [D 20:43:36.874663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 57225. [D 20:43:36.874673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 57226. [D 20:43:36.874682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 57227. [D 20:43:36.874693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 57228. [D 20:43:36.874703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 57229. [D 20:43:36.874712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 57230. [D 20:43:36.874722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 57231. [D 20:43:36.874732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 57232. [D 20:43:36.874742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 57233. [D 20:43:36.874752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 57234. [D 20:43:36.874762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 57235. [D 20:43:36.874772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 57236. [D 20:43:36.874782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 57237. [D 20:43:36.874791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 57238. [D 20:43:36.874801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 57239. [D 20:43:36.874811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 57240. [D 20:43:36.874822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 57241. [D 20:43:36.874832] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2031c0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 57242. [D 20:43:36.880436] openib_check_cq: completed rdma wr_id 2aaaab2031c0, nic_wr_credit 57242. [D 20:43:36.880451] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 3/70. [D 20:43:36.880512] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.880542] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.880551] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:36.887875] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.887889] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.887897] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:36.887926] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8029 [D 20:43:36.887937] element 0: offset: 0x2aaaab237e60, size: 24 [D 20:43:36.887949] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 4/70. [D 20:43:36.887983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.887992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.888001] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:36.888015] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8030 [D 20:43:36.888025] element 0: offset: 0x2aaaab209230, size: 24 [D 20:43:36.888035] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 5/70. [D 20:43:36.888109] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.888119] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.888128] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:36.888142] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8033 [D 20:43:36.888152] element 0: offset: 0x2aaaab202ab0, size: 24 [D 20:43:36.888162] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 6/70. [D 20:43:36.892361] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8030 [D 20:43:36.892381] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 7/70. [D 20:43:36.894749] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8033 [D 20:43:36.894764] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 8/70. [D 20:43:36.894776] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8029 [D 20:43:36.894786] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 9/70. [D 20:43:36.897183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 57242. [D 20:43:36.897195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 57243. [D 20:43:36.897205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 57244. [D 20:43:36.897215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 57245. [D 20:43:36.897225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 57246. [D 20:43:36.897235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 57247. [D 20:43:36.897245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 57248. [D 20:43:36.897254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 57249. [D 20:43:36.897264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 57250. [D 20:43:36.897274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 57251. [D 20:43:36.897284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 57252. [D 20:43:36.897294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 57253. [D 20:43:36.897304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 57254. [D 20:43:36.897314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 57255. [D 20:43:36.897323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 57256. [D 20:43:36.897334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 57257. [D 20:43:36.897344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 57258. [D 20:43:36.897353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 57259. [D 20:43:36.897363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 57260. [D 20:43:36.897373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 57261. [D 20:43:36.897383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 57262. [D 20:43:36.897393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 57263. [D 20:43:36.897403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 57264. [D 20:43:36.897413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 57265. [D 20:43:36.897423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 57266. [D 20:43:36.897433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 57267. [D 20:43:36.897443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 57268. [D 20:43:36.897453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 57269. [D 20:43:36.897463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 57270. [D 20:43:36.897473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 57271. [D 20:43:36.897483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 57272. [D 20:43:36.897493] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202dd0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 57273. [D 20:43:36.897504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 57274. [D 20:43:36.897514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 57275. [D 20:43:36.897524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 57276. [D 20:43:36.897534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 57277. [D 20:43:36.897544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 57278. [D 20:43:36.897554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 57279. [D 20:43:36.897564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 57280. [D 20:43:36.897574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 57281. [D 20:43:36.897584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 57282. [D 20:43:36.897594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 57283. [D 20:43:36.897604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 57284. [D 20:43:36.897614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 57285. [D 20:43:36.897624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 57286. [D 20:43:36.897634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 57287. [D 20:43:36.897644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 57288. [D 20:43:36.897653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 57289. [D 20:43:36.897663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 57290. [D 20:43:36.897673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 57291. [D 20:43:36.897683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 57292. [D 20:43:36.897693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 57293. [D 20:43:36.897703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 57294. [D 20:43:36.897713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 57295. [D 20:43:36.897723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 57296. [D 20:43:36.897733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 57297. [D 20:43:36.897743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 57298. [D 20:43:36.897753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 57299. [D 20:43:36.897763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 57300. [D 20:43:36.897773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 57301. [D 20:43:36.897783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 57302. [D 20:43:36.897793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 57303. [D 20:43:36.897803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 57304. [D 20:43:36.897813] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c960 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 57305. [D 20:43:36.897824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 57306. [D 20:43:36.897834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 57307. [D 20:43:36.897844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 57308. [D 20:43:36.897854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 57309. [D 20:43:36.897864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 57310. [D 20:43:36.897874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 57311. [D 20:43:36.897885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57312. [E 20:43:36.897895] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 57313, block for 10 ms. [D 20:43:36.899801] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57312. [E 20:43:36.899818] Warning: openib_post_sr_rdmaw: post_send failed, ret: -1001, wr_credit: 57313, block for 10 ms. [D 20:43:36.908040] openib_check_cq: completed rdma wr_id 2aaaab202dd0, nic_wr_credit 57312. [D 20:43:36.908055] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 10/70. [D 20:43:36.908065] openib_post_sr_rdmaw: RETRY ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57311. [D 20:43:36.908076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 57312. [D 20:43:36.908085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 57313. [D 20:43:36.908095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 57314. [D 20:43:36.908105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 57315. [D 20:43:36.908115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 57316. [D 20:43:36.908125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 57317. [D 20:43:36.908135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 57318. [D 20:43:36.908145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 57319. [D 20:43:36.908155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 57320. [D 20:43:36.908165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 57321. [D 20:43:36.908174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 57322. [D 20:43:36.908185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 57323. [D 20:43:36.908194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 57324. [D 20:43:36.908204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 57325. [D 20:43:36.908214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 57326. [D 20:43:36.908224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 57327. [D 20:43:36.908234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 57328. [D 20:43:36.908244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 57329. [D 20:43:36.908254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 57330. [D 20:43:36.908264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 57331. [D 20:43:36.908274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 57332. [D 20:43:36.908284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 57333. [D 20:43:36.908293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 57334. [D 20:43:36.908304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 57335. [D 20:43:36.908313] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241780 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 57336. [D 20:43:36.908357] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.908406] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.908415] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:36.908445] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8036 [D 20:43:36.908456] element 0: offset: 0x2aaaab2418e0, size: 24 [D 20:43:36.908470] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 11/70. [D 20:43:36.919743] openib_check_cq: completed rdma wr_id 2aaaab23c960, nic_wr_credit 57336. [D 20:43:36.919761] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 12/70. [D 20:43:36.921949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.921963] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.921972] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:36.931432] openib_check_cq: completed rdma wr_id 2aaaab241780, nic_wr_credit 57335. [D 20:43:36.931440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.931449] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 13/70. [D 20:43:36.931454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.931473] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:36.931490] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8038 [D 20:43:36.931500] element 0: offset: 0x2aaaab2418c0, size: 24 [D 20:43:36.931512] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 14/70. [D 20:43:36.931546] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.931555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.931564] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:36.931623] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.931634] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.931642] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:36.935454] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8038 [D 20:43:36.935474] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 15/70. [D 20:43:36.935488] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8036 [D 20:43:36.935500] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 16/70. [D 20:43:36.937587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 57335. [D 20:43:36.937598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 57336. [D 20:43:36.937609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 57337. [D 20:43:36.937618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 57338. [D 20:43:36.937629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 57339. [D 20:43:36.937638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 57340. [D 20:43:36.937648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 57341. [D 20:43:36.937658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 57342. [D 20:43:36.937668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 57343. [D 20:43:36.937678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 57344. [D 20:43:36.937688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 57345. [D 20:43:36.937698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 57346. [D 20:43:36.937708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 57347. [D 20:43:36.937718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 57348. [D 20:43:36.937727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 57349. [D 20:43:36.937737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 57350. [D 20:43:36.937747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 57351. [D 20:43:36.937757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 57352. [D 20:43:36.937767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 57353. [D 20:43:36.937777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 57354. [D 20:43:36.937787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 57355. [D 20:43:36.937797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 57356. [D 20:43:36.937807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 57357. [D 20:43:36.937816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 57358. [D 20:43:36.937826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 57359. [D 20:43:36.937836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 57360. [D 20:43:36.937846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 57361. [D 20:43:36.937857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 57362. [D 20:43:36.937867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 57363. [D 20:43:36.937877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 57364. [D 20:43:36.937887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 57365. [D 20:43:36.937897] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 57366. [D 20:43:36.937908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 57367. [D 20:43:36.937918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 57368. [D 20:43:36.937928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 57369. [D 20:43:36.937938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 57370. [D 20:43:36.937948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 57371. [D 20:43:36.937958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 57372. [D 20:43:36.937968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 57373. [D 20:43:36.937978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 57374. [D 20:43:36.937988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 57375. [D 20:43:36.937998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 57376. [D 20:43:36.938008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 57377. [D 20:43:36.938017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 57378. [D 20:43:36.938028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 57379. [D 20:43:36.938037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 57380. [D 20:43:36.938047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 57381. [D 20:43:36.938057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 57382. [D 20:43:36.938067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 57383. [D 20:43:36.938077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 57384. [D 20:43:36.938087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 57385. [D 20:43:36.938097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 57386. [D 20:43:36.938107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 57387. [D 20:43:36.938117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 57388. [D 20:43:36.938127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 57389. [D 20:43:36.938137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 57390. [D 20:43:36.938147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 57391. [D 20:43:36.938157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 57392. [D 20:43:36.938167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 57393. [D 20:43:36.938176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 57394. [D 20:43:36.938187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 57395. [D 20:43:36.938196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 57396. [D 20:43:36.938206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 57397. [D 20:43:36.938216] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab237da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 57398. [D 20:43:36.946208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.946254] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.946263] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:36.946294] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8043 [D 20:43:36.946305] element 0: offset: 0x2aaaab23ca90, size: 24 [D 20:43:36.946317] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 17/70. [D 20:43:36.946354] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.946364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.946374] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:36.946389] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8045 [D 20:43:36.946398] element 0: offset: 0x2aaaab241410, size: 24 [D 20:43:36.946408] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 18/70. [D 20:43:36.949283] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 57398. [D 20:43:36.949302] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 19/70. [D 20:43:36.960859] openib_check_cq: completed rdma wr_id 2aaaab237da0, nic_wr_credit 57397. [D 20:43:36.960874] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 20/70. [D 20:43:36.960917] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.960931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.960939] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:36.961023] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.961034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.961043] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:36.964864] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8043 [D 20:43:36.964884] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 21/70. [D 20:43:36.964898] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8045 [D 20:43:36.964909] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 22/70. [D 20:43:36.966866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 57397. [D 20:43:36.966878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 57398. [D 20:43:36.966888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 57399. [D 20:43:36.966899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 57400. [D 20:43:36.966909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 57401. [D 20:43:36.966918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 57402. [D 20:43:36.966928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57403. [D 20:43:36.966938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 57404. [D 20:43:36.966948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 57405. [D 20:43:36.966957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 57406. [D 20:43:36.966968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 57407. [D 20:43:36.966977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 57408. [D 20:43:36.966987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 57409. [D 20:43:36.966997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 57410. [D 20:43:36.967007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 57411. [D 20:43:36.967017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 57412. [D 20:43:36.967027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 57413. [D 20:43:36.967037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 57414. [D 20:43:36.967046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 57415. [D 20:43:36.967056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 57416. [D 20:43:36.967066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 57417. [D 20:43:36.967076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 57418. [D 20:43:36.967086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 57419. [D 20:43:36.967096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 57420. [D 20:43:36.967105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 57421. [D 20:43:36.967115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 57422. [D 20:43:36.967125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 57423. [D 20:43:36.967136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 57424. [D 20:43:36.967146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 57425. [D 20:43:36.967156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 57426. [D 20:43:36.967166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 57427. [D 20:43:36.967176] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241110 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 57428. [D 20:43:36.967187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 57429. [D 20:43:36.967197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 57430. [D 20:43:36.967207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 57431. [D 20:43:36.967217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 57432. [D 20:43:36.967227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 57433. [D 20:43:36.967237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 57434. [D 20:43:36.967247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 57435. [D 20:43:36.967257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 57436. [D 20:43:36.967267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 57437. [D 20:43:36.967277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 57438. [D 20:43:36.967287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 57439. [D 20:43:36.967297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 57440. [D 20:43:36.967306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 57441. [D 20:43:36.967317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 57442. [D 20:43:36.967327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 57443. [D 20:43:36.967336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 57444. [D 20:43:36.967346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 57445. [D 20:43:36.967356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 57446. [D 20:43:36.967367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 57447. [D 20:43:36.967376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 57448. [D 20:43:36.967386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 57449. [D 20:43:36.967396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 57450. [D 20:43:36.967406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 57451. [D 20:43:36.967416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 57452. [D 20:43:36.967427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 57453. [D 20:43:36.967437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 57454. [D 20:43:36.967447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 57455. [D 20:43:36.967457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 57456. [D 20:43:36.967467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 57457. [D 20:43:36.967477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 57458. [D 20:43:36.967487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 57459. [D 20:43:36.967496] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241040 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 57460. [D 20:43:36.974645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.974685] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.974694] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:36.974724] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8049 [D 20:43:36.974734] element 0: offset: 0x2aaaab237e60, size: 24 [D 20:43:36.974747] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 23/70. [D 20:43:36.974784] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:36.974793] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.974802] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:36.974817] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8050 [D 20:43:36.974826] element 0: offset: 0x2aaaab236cf0, size: 24 [D 20:43:36.974836] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 24/70. [D 20:43:36.978580] openib_check_cq: completed rdma wr_id 2aaaab241110, nic_wr_credit 57460. [D 20:43:36.978597] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 25/70. [D 20:43:36.985696] openib_check_cq: completed rdma wr_id 2aaaab241040, nic_wr_credit 57459. [D 20:43:36.985716] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 26/70. [D 20:43:36.985762] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.985775] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.985784] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:36.985864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:36.985874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:36.985883] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:36.989669] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8050 [D 20:43:36.989687] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 27/70. [D 20:43:36.989701] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8049 [D 20:43:36.989716] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 28/70. [D 20:43:36.989737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 57459. [D 20:43:36.989749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 57460. [D 20:43:36.989759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 57461. [D 20:43:36.989769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 57462. [D 20:43:36.989779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 57463. [D 20:43:36.989789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 57464. [D 20:43:36.989799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 57465. [D 20:43:36.989808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 57466. [D 20:43:36.989818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 57467. [D 20:43:36.989828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 57468. [D 20:43:36.989838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 57469. [D 20:43:36.989848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 57470. [D 20:43:36.989857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 57471. [D 20:43:36.989867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 57472. [D 20:43:36.989877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 57473. [D 20:43:36.989887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 57474. [D 20:43:36.989897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 57475. [D 20:43:36.989907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 57476. [D 20:43:36.989917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 57477. [D 20:43:36.989927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 57478. [D 20:43:36.989937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 57479. [D 20:43:36.989946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 57480. [D 20:43:36.989956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 57481. [D 20:43:36.989966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 57482. [D 20:43:36.989976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 57483. [D 20:43:36.989986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 57484. [D 20:43:36.989996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 57485. [D 20:43:36.990006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 57486. [D 20:43:36.990016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 57487. [D 20:43:36.990026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 57488. [D 20:43:36.990036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 57489. [D 20:43:36.990046] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab237da0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 57490. [D 20:43:36.990057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 57491. [D 20:43:36.990067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 57492. [D 20:43:36.990077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 57493. [D 20:43:36.990087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 57494. [D 20:43:36.990097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 57495. [D 20:43:36.990107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 57496. [D 20:43:36.990116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 57497. [D 20:43:36.990127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 57498. [D 20:43:36.990136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 57499. [D 20:43:36.990146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 57500. [D 20:43:36.990156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 57501. [D 20:43:36.990166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 57502. [D 20:43:36.990176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 57503. [D 20:43:36.990186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 57504. [D 20:43:36.990196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 57505. [D 20:43:36.990206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 57506. [D 20:43:36.990215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 57507. [D 20:43:36.990225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 57508. [D 20:43:36.990235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 57509. [D 20:43:36.990245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 57510. [D 20:43:36.990255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 57511. [D 20:43:36.990265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 57512. [D 20:43:36.990275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 57513. [D 20:43:36.990285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 57514. [D 20:43:36.990295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 57515. [D 20:43:36.990305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 57516. [D 20:43:36.990315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 57517. [D 20:43:36.990325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 57518. [D 20:43:36.990335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 57519. [D 20:43:36.990345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 57520. [D 20:43:36.990355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 57521. [D 20:43:36.990365] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202990 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 57522. [D 20:43:36.995677] openib_check_cq: completed rdma wr_id 2aaaab237da0, nic_wr_credit 57522. [D 20:43:36.995692] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 29/70. [D 20:43:37.001570] openib_check_cq: completed rdma wr_id 2aaaab202990, nic_wr_credit 57521. [D 20:43:37.001584] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 30/70. [D 20:43:37.001640] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.001678] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.001687] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:37.001711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.001720] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.001728] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:37.212105] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.212119] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.212128] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:37.212155] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8055 [D 20:43:37.212165] element 0: offset: 0x2aaaab23d320, size: 24 [D 20:43:37.212183] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 31/70. [D 20:43:37.212218] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.212228] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.212236] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:37.212251] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8057 [D 20:43:37.212260] element 0: offset: 0x2aaaab202ab0, size: 24 [D 20:43:37.212271] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 32/70. [D 20:43:37.216238] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8057 [D 20:43:37.216258] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 33/70. [D 20:43:37.216272] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8055 [D 20:43:37.216283] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 34/70. [D 20:43:37.216308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 57521. [D 20:43:37.216319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 57522. [D 20:43:37.216329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 57523. [D 20:43:37.216340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 57524. [D 20:43:37.216349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 57525. [D 20:43:37.216359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 57526. [D 20:43:37.216369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 57527. [D 20:43:37.216379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 57528. [D 20:43:37.216389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 57529. [D 20:43:37.216399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 57530. [D 20:43:37.216409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 57531. [D 20:43:37.216418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 57532. [D 20:43:37.216428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 57533. [D 20:43:37.216438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 57534. [D 20:43:37.216448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 57535. [D 20:43:37.216458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 57536. [D 20:43:37.216467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 57537. [D 20:43:37.216478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 57538. [D 20:43:37.216487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 57539. [D 20:43:37.216497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 57540. [D 20:43:37.216507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 57541. [D 20:43:37.216517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 57542. [D 20:43:37.216526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 57543. [D 20:43:37.216537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 57544. [D 20:43:37.216546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 57545. [D 20:43:37.216556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 57546. [D 20:43:37.216566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 57547. [D 20:43:37.216576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 57548. [D 20:43:37.216587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 57549. [D 20:43:37.216596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 57550. [D 20:43:37.216606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 57551. [D 20:43:37.216616] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 57552. [D 20:43:37.216627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 57553. [D 20:43:37.216637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 57554. [D 20:43:37.216647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 57555. [D 20:43:37.216656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 57556. [D 20:43:37.216666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 57557. [D 20:43:37.216676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 57558. [D 20:43:37.216686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57559. [D 20:43:37.216696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 57560. [D 20:43:37.216706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 57561. [D 20:43:37.216715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 57562. [D 20:43:37.216725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 57563. [D 20:43:37.216735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 57564. [D 20:43:37.216745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 57565. [D 20:43:37.216754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 57566. [D 20:43:37.216764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 57567. [D 20:43:37.216774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 57568. [D 20:43:37.216784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 57569. [D 20:43:37.216794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 57570. [D 20:43:37.216804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 57571. [D 20:43:37.216813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 57572. [D 20:43:37.216823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 57573. [D 20:43:37.216833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 57574. [D 20:43:37.216843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 57575. [D 20:43:37.216853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 57576. [D 20:43:37.216863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 57577. [D 20:43:37.216873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 57578. [D 20:43:37.216883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 57579. [D 20:43:37.216892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 57580. [D 20:43:37.216903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 57581. [D 20:43:37.216912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 57582. [D 20:43:37.216922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 57583. [D 20:43:37.216932] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241830 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 57584. [D 20:43:37.226195] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.226243] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.226252] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:37.226281] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8060 [D 20:43:37.226291] element 0: offset: 0x2aaaab203230, size: 24 [D 20:43:37.226304] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 35/70. [D 20:43:37.226885] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 57584. [D 20:43:37.226904] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 36/70. [D 20:43:37.238513] openib_check_cq: completed rdma wr_id 2aaaab241830, nic_wr_credit 57583. [D 20:43:37.238528] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 37/70. [D 20:43:37.238570] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.238583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.238592] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:37.238655] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.238665] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.238674] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:37.240895] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8060 [D 20:43:37.240911] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 38/70. [D 20:43:37.245295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 57583. [D 20:43:37.245310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 57584. [D 20:43:37.245320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 57585. [D 20:43:37.245330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 57586. [D 20:43:37.245340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 57587. [D 20:43:37.245350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 57588. [D 20:43:37.245360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 57589. [D 20:43:37.245369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 57590. [D 20:43:37.245379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 57591. [D 20:43:37.245389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 57592. [D 20:43:37.245399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 57593. [D 20:43:37.245409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 57594. [D 20:43:37.245419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 57595. [D 20:43:37.245428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 57596. [D 20:43:37.245438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 57597. [D 20:43:37.245448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 57598. [D 20:43:37.245458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 57599. [D 20:43:37.245468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 57600. [D 20:43:37.245478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 57601. [D 20:43:37.245487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 57602. [D 20:43:37.245497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 57603. [D 20:43:37.245507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 57604. [D 20:43:37.245517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 57605. [D 20:43:37.245527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 57606. [D 20:43:37.245537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 57607. [D 20:43:37.245546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 57608. [D 20:43:37.245556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 57609. [D 20:43:37.245566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 57610. [D 20:43:37.245576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 57611. [D 20:43:37.245586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 57612. [D 20:43:37.245596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 57613. [D 20:43:37.245606] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202dd0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 57614. [D 20:43:37.247868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.247901] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.247910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:37.247939] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8063 [D 20:43:37.247949] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:37.247962] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 39/70. [D 20:43:37.257078] openib_check_cq: completed rdma wr_id 2aaaab202dd0, nic_wr_credit 57614. [D 20:43:37.257096] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 40/70. [D 20:43:37.257197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.257211] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.257220] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:37.259466] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8063 [D 20:43:37.259481] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 41/70. [D 20:43:37.263094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 57614. [D 20:43:37.263110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 57615. [D 20:43:37.263120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 57616. [D 20:43:37.263130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 57617. [D 20:43:37.263140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 57618. [D 20:43:37.263150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 57619. [D 20:43:37.263160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 57620. [D 20:43:37.263169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 57621. [D 20:43:37.263179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 57622. [D 20:43:37.263189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 57623. [D 20:43:37.263199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 57624. [D 20:43:37.263209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 57625. [D 20:43:37.263219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 57626. [D 20:43:37.263228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 57627. [D 20:43:37.263238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 57628. [D 20:43:37.263248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 57629. [D 20:43:37.263258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 57630. [D 20:43:37.263268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 57631. [D 20:43:37.263278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 57632. [D 20:43:37.263287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 57633. [D 20:43:37.263297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 57634. [D 20:43:37.263307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 57635. [D 20:43:37.263317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 57636. [D 20:43:37.263327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 57637. [D 20:43:37.263337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 57638. [D 20:43:37.263347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 57639. [D 20:43:37.263357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 57640. [D 20:43:37.263366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 57641. [D 20:43:37.263376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 57642. [D 20:43:37.263386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 57643. [D 20:43:37.263397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 57644. [D 20:43:37.263407] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c8a0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 57645. [D 20:43:37.273085] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.273117] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.273126] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:37.273155] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8066 [D 20:43:37.273166] element 0: offset: 0x2aaaab202ab0, size: 24 [D 20:43:37.273179] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 42/70. [D 20:43:37.275196] openib_check_cq: completed rdma wr_id 2aaaab23c8a0, nic_wr_credit 57645. [D 20:43:37.275215] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 43/70. [D 20:43:37.275290] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.275304] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.275312] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:37.277307] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8066 [D 20:43:37.277345] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 44/70. [D 20:43:37.301729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 57645. [D 20:43:37.301748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 57646. [D 20:43:37.301758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 57647. [D 20:43:37.301768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 57648. [D 20:43:37.301778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 57649. [D 20:43:37.301788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 57650. [D 20:43:37.301797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 57651. [D 20:43:37.301807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 57652. [D 20:43:37.301817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 57653. [D 20:43:37.301827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 57654. [D 20:43:37.301837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 57655. [D 20:43:37.301847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 57656. [D 20:43:37.301856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 57657. [D 20:43:37.301867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 57658. [D 20:43:37.301876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 57659. [D 20:43:37.301886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 57660. [D 20:43:37.301896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 57661. [D 20:43:37.301906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 57662. [D 20:43:37.301915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 57663. [D 20:43:37.301925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 57664. [D 20:43:37.301935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 57665. [D 20:43:37.301945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 57666. [D 20:43:37.301955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 57667. [D 20:43:37.301965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 57668. [D 20:43:37.301975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 57669. [D 20:43:37.301985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 57670. [D 20:43:37.301994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 57671. [D 20:43:37.302004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 57672. [D 20:43:37.302014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 57673. [D 20:43:37.302024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 57674. [D 20:43:37.302035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 57675. [D 20:43:37.302045] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202dd0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 57676. [D 20:43:37.313436] openib_check_cq: completed rdma wr_id 2aaaab202dd0, nic_wr_credit 57676. [D 20:43:37.313452] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 45/70. [D 20:43:37.313524] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.313540] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.313548] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:37.363742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.363756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.363764] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:37.363790] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8068 [D 20:43:37.363800] element 0: offset: 0x2aaaab23d320, size: 24 [D 20:43:37.363811] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 46/70. [D 20:43:37.365860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.365901] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.365910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:37.365937] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8072 [D 20:43:37.365948] element 0: offset: 0x2aaaab236cf0, size: 24 [D 20:43:37.365960] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 47/70. [D 20:43:37.367998] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8068 [D 20:43:37.368042] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 48/70. [D 20:43:37.368104] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8072 [D 20:43:37.368117] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 49/70. [D 20:43:37.368160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 57676. [D 20:43:37.368179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 57677. [D 20:43:37.368188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 57678. [D 20:43:37.368198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 57679. [D 20:43:37.368208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 57680. [D 20:43:37.368218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 57681. [D 20:43:37.368236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 57682. [D 20:43:37.368246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 57683. [D 20:43:37.368256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 57684. [D 20:43:37.368266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 57685. [D 20:43:37.368276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 57686. [D 20:43:37.368286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 57687. [D 20:43:37.368295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 57688. [D 20:43:37.368305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 57689. [D 20:43:37.368315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 57690. [D 20:43:37.368325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 57691. [D 20:43:37.368335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 57692. [D 20:43:37.368344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 57693. [D 20:43:37.368354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 57694. [D 20:43:37.368364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 57695. [D 20:43:37.368374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 57696. [D 20:43:37.368384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 57697. [D 20:43:37.368394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 57698. [D 20:43:37.368403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 57699. [D 20:43:37.368413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 57700. [D 20:43:37.368423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 57701. [D 20:43:37.368433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 57702. [D 20:43:37.368443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 57703. [D 20:43:37.368453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 57704. [D 20:43:37.368463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 57705. [D 20:43:37.368473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 57706. [D 20:43:37.368483] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab23c8a0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 57707. [D 20:43:37.368495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 57708. [D 20:43:37.368505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 57709. [D 20:43:37.368514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 57710. [D 20:43:37.368524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 57711. [D 20:43:37.368534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 57712. [D 20:43:37.368544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 57713. [D 20:43:37.368554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 57714. [D 20:43:37.368564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 57715. [D 20:43:37.368573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 57716. [D 20:43:37.368583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 57717. [D 20:43:37.368593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 57718. [D 20:43:37.368603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 57719. [D 20:43:37.368612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 57720. [D 20:43:37.368622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 57721. [D 20:43:37.368632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 57722. [D 20:43:37.368642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 57723. [D 20:43:37.368652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 57724. [D 20:43:37.368661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 57725. [D 20:43:37.368671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 57726. [D 20:43:37.368681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 57727. [D 20:43:37.368691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 57728. [D 20:43:37.368700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 57729. [D 20:43:37.368710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 57730. [D 20:43:37.368720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 57731. [D 20:43:37.368730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 57732. [D 20:43:37.368740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 57733. [D 20:43:37.368750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 57734. [D 20:43:37.368760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 57735. [D 20:43:37.368769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 57736. [D 20:43:37.368779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 57737. [D 20:43:37.368789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 57738. [D 20:43:37.368799] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab207820 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 57739. [D 20:43:37.379768] openib_check_cq: completed rdma wr_id 2aaaab23c8a0, nic_wr_credit 57739. [D 20:43:37.379784] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 50/70. [D 20:43:37.391019] openib_check_cq: completed rdma wr_id 2aaaab207820, nic_wr_credit 57738. [D 20:43:37.391034] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 51/70. [D 20:43:37.391085] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.391101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.391110] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:37.391132] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.391141] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.391149] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:37.404973] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.404986] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.404995] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:37.405025] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8077 [D 20:43:37.405036] element 0: offset: 0x2aaaab240760, size: 24 [D 20:43:37.405046] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 52/70. [D 20:43:37.405079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.405089] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.405097] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:37.405112] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8078 [D 20:43:37.405122] element 0: offset: 0x2aaaab23ca90, size: 24 [D 20:43:37.405132] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 53/70. [D 20:43:37.405199] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.405209] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.405217] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:37.405231] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8081 [D 20:43:37.405241] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:37.405251] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 54/70. [D 20:43:37.409232] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 8077 [D 20:43:37.409283] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 55/70. [D 20:43:37.409340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 57738. [D 20:43:37.409361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 57739. [D 20:43:37.409372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 57740. [D 20:43:37.409382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 57741. [D 20:43:37.409392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 57742. [D 20:43:37.409402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 57743. [D 20:43:37.409412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 57744. [D 20:43:37.409422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 57745. [D 20:43:37.409432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 57746. [D 20:43:37.409442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 57747. [D 20:43:37.409451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 57748. [D 20:43:37.409461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 57749. [D 20:43:37.409471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 57750. [D 20:43:37.409481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 57751. [D 20:43:37.409491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 57752. [D 20:43:37.409501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 57753. [D 20:43:37.409510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 57754. [D 20:43:37.409520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 57755. [D 20:43:37.409530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 57756. [D 20:43:37.409540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 57757. [D 20:43:37.409550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 57758. [D 20:43:37.409560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 57759. [D 20:43:37.409570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 57760. [D 20:43:37.409580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 57761. [D 20:43:37.409589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 57762. [D 20:43:37.409599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 57763. [D 20:43:37.409609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 57764. [D 20:43:37.409619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 57765. [D 20:43:37.409629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 57766. [D 20:43:37.409640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 57767. [D 20:43:37.409650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 57768. [D 20:43:37.409660] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241390 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 57769. [D 20:43:37.413748] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8081 [D 20:43:37.413764] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 56/70. [D 20:43:37.414163] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8078 [D 20:43:37.414177] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 57/70. [D 20:43:37.420844] openib_check_cq: completed rdma wr_id 2aaaab241390, nic_wr_credit 57769. [D 20:43:37.420885] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 58/70. [D 20:43:37.420900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 57769. [D 20:43:37.420911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 57770. [D 20:43:37.420921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 57771. [D 20:43:37.420931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 57772. [D 20:43:37.420941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 57773. [D 20:43:37.420951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 57774. [D 20:43:37.420961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 57775. [D 20:43:37.420970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 57776. [D 20:43:37.420980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 57777. [D 20:43:37.420990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 57778. [D 20:43:37.421000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 57779. [D 20:43:37.421009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 57780. [D 20:43:37.421022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 57781. [D 20:43:37.421033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 57782. [D 20:43:37.421043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 57783. [D 20:43:37.421052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 57784. [D 20:43:37.421062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 57785. [D 20:43:37.421072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 57786. [D 20:43:37.421082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 57787. [D 20:43:37.421092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 57788. [D 20:43:37.421102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 57789. [D 20:43:37.421112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 57790. [D 20:43:37.421121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 57791. [D 20:43:37.421131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 57792. [D 20:43:37.421141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 57793. [D 20:43:37.421151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 57794. [D 20:43:37.421161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 57795. [D 20:43:37.421171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 57796. [D 20:43:37.421181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 57797. [D 20:43:37.421195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 57798. [D 20:43:37.421205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 57799. [D 20:43:37.421215] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241850 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 57800. [D 20:43:37.421227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 57801. [D 20:43:37.421237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 57802. [D 20:43:37.421247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 57803. [D 20:43:37.421257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 57804. [D 20:43:37.421267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 57805. [D 20:43:37.421277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 57806. [D 20:43:37.421287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 57807. [D 20:43:37.421297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 57808. [D 20:43:37.421307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 57809. [D 20:43:37.421317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 57810. [D 20:43:37.421326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 57811. [D 20:43:37.421336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 57812. [D 20:43:37.421346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 57813. [D 20:43:37.421356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 57814. [D 20:43:37.421366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 57815. [D 20:43:37.421376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 57816. [D 20:43:37.421386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 57817. [D 20:43:37.421396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 57818. [D 20:43:37.421406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 57819. [D 20:43:37.421416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 57820. [D 20:43:37.421425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 57821. [D 20:43:37.421435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 57822. [D 20:43:37.421445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 57823. [D 20:43:37.421455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 57824. [D 20:43:37.421465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 57825. [D 20:43:37.421474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 57826. [D 20:43:37.421485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 57827. [D 20:43:37.421495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 57828. [D 20:43:37.421505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 57829. [D 20:43:37.421514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 57830. [D 20:43:37.421524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 57831. [D 20:43:37.421534] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab213830 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 57832. [D 20:43:37.421583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.421598] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.421607] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:37.430233] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.430247] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.430255] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:37.430280] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8084 [D 20:43:37.430290] element 0: offset: 0x2aaaab202ab0, size: 24 [D 20:43:37.430301] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 59/70. [D 20:43:37.432569] openib_check_cq: completed rdma wr_id 2aaaab241850, nic_wr_credit 57832. [D 20:43:37.432587] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 60/70. [D 20:43:37.438419] openib_check_cq: completed rdma wr_id 2aaaab213830, nic_wr_credit 57831. [D 20:43:37.438435] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 0/70. [D 20:43:37.438474] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.438488] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.438497] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:37.438544] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.438553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.438562] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:37.440513] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8084 [D 20:43:37.440548] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 1/70. [D 20:43:37.440613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 57831. [D 20:43:37.440631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 57832. [D 20:43:37.440641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 57833. [D 20:43:37.440651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 57834. [D 20:43:37.440661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 57835. [D 20:43:37.440671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 57836. [D 20:43:37.440681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 57837. [D 20:43:37.440691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 57838. [D 20:43:37.440711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 57839. [D 20:43:37.440721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 57840. [D 20:43:37.440731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 57841. [D 20:43:37.440741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 57842. [D 20:43:37.440750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 57843. [D 20:43:37.440760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 57844. [D 20:43:37.440770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 57845. [D 20:43:37.440780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 57846. [D 20:43:37.440790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 57847. [D 20:43:37.440800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 57848. [D 20:43:37.440809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 57849. [D 20:43:37.440819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 57850. [D 20:43:37.440829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 57851. [D 20:43:37.440839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 57852. [D 20:43:37.440848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 57853. [D 20:43:37.440858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 57854. [D 20:43:37.440868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 57855. [D 20:43:37.440878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 57856. [D 20:43:37.440888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 57857. [D 20:43:37.440897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 57858. [D 20:43:37.440907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 57859. [D 20:43:37.440918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 57860. [D 20:43:37.440928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 57861. [D 20:43:37.440937] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 57862. [D 20:43:37.446586] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 57862. [D 20:43:37.446601] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 2/70. [D 20:43:37.446655] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.446671] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.446679] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:37.469197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.469211] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.469220] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:37.469246] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8087 [D 20:43:37.469256] element 0: offset: 0x2aaaab236cf0, size: 24 [D 20:43:37.469267] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 3/70. [D 20:43:37.473769] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8087 [D 20:43:37.473786] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 4/70. [D 20:43:37.473921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 57862. [D 20:43:37.473988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 57863. [D 20:43:37.473998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 57864. [D 20:43:37.474009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 57865. [D 20:43:37.474018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 57866. [D 20:43:37.474028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 57867. [D 20:43:37.474038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57868. [D 20:43:37.474048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 57869. [D 20:43:37.474057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 57870. [D 20:43:37.474067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 57871. [D 20:43:37.474077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 57872. [D 20:43:37.474087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 57873. [D 20:43:37.474097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 57874. [D 20:43:37.474106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 57875. [D 20:43:37.474116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 57876. [D 20:43:37.474126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 57877. [D 20:43:37.474135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 57878. [D 20:43:37.474145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 57879. [D 20:43:37.474155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 57880. [D 20:43:37.474165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 57881. [D 20:43:37.474174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 57882. [D 20:43:37.474184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 57883. [D 20:43:37.474194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 57884. [D 20:43:37.474204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 57885. [D 20:43:37.474214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 57886. [D 20:43:37.474223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 57887. [D 20:43:37.474233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 57888. [D 20:43:37.474243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 57889. [D 20:43:37.474252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 57890. [D 20:43:37.474263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 57891. [D 20:43:37.474273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 57892. [D 20:43:37.474283] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 57893. [D 20:43:37.479845] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 57893. [D 20:43:37.479862] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 5/70. [D 20:43:37.479910] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.479923] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.479932] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:37.664652] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.664666] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.664675] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:37.664691] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8090 [D 20:43:37.664701] element 0: offset: 0x2aaaab23c910, size: 24 [D 20:43:37.664711] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 6/70. [D 20:43:37.664778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.664788] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.664796] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:37.664812] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8093 [D 20:43:37.664821] element 0: offset: 0x2aaaab203230, size: 24 [D 20:43:37.664831] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 7/70. [D 20:43:37.668859] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8090 [D 20:43:37.668909] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 8/70. [D 20:43:37.668964] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8093 [D 20:43:37.668978] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 9/70. [D 20:43:37.669039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 57893. [D 20:43:37.669066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 57894. [D 20:43:37.669076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 57895. [D 20:43:37.669086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 57896. [D 20:43:37.669096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 57897. [D 20:43:37.669106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 57898. [D 20:43:37.669123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 57899. [D 20:43:37.669133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 57900. [D 20:43:37.669143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 57901. [D 20:43:37.669153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 57902. [D 20:43:37.669163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 57903. [D 20:43:37.669172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 57904. [D 20:43:37.669182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 57905. [D 20:43:37.669192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 57906. [D 20:43:37.669201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 57907. [D 20:43:37.669211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 57908. [D 20:43:37.669221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 57909. [D 20:43:37.669231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 57910. [D 20:43:37.669240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 57911. [D 20:43:37.669250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 57912. [D 20:43:37.669260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 57913. [D 20:43:37.669270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 57914. [D 20:43:37.669280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 57915. [D 20:43:37.669289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 57916. [D 20:43:37.669299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 57917. [D 20:43:37.669309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 57918. [D 20:43:37.669318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 57919. [D 20:43:37.669328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 57920. [D 20:43:37.669338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 57921. [D 20:43:37.669349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 57922. [D 20:43:37.669358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 57923. [D 20:43:37.669368] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 57924. [D 20:43:37.669380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 57925. [D 20:43:37.669390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 57926. [D 20:43:37.669400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 57927. [D 20:43:37.669410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 57928. [D 20:43:37.669420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 57929. [D 20:43:37.669430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 57930. [D 20:43:37.669440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 57931. [D 20:43:37.669450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 57932. [D 20:43:37.669460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 57933. [D 20:43:37.669469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 57934. [D 20:43:37.669479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 57935. [D 20:43:37.669489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 57936. [D 20:43:37.669499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 57937. [D 20:43:37.669509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 57938. [D 20:43:37.669519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 57939. [D 20:43:37.669529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 57940. [D 20:43:37.669538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 57941. [D 20:43:37.669548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 57942. [D 20:43:37.669558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 57943. [D 20:43:37.669568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 57944. [D 20:43:37.669578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 57945. [D 20:43:37.669588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 57946. [D 20:43:37.669598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 57947. [D 20:43:37.669608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 57948. [D 20:43:37.669617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 57949. [D 20:43:37.669627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 57950. [D 20:43:37.669637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 57951. [D 20:43:37.669648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 57952. [D 20:43:37.669657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 57953. [D 20:43:37.669667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 57954. [D 20:43:37.669677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 57955. [D 20:43:37.669687] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22e350 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 57956. [D 20:43:37.679731] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 57956. [D 20:43:37.679752] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 10/70. [D 20:43:37.685594] openib_check_cq: completed rdma wr_id 2aaaab22e350, nic_wr_credit 57955. [D 20:43:37.685613] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 11/70. [D 20:43:37.685666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.685680] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.685689] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:37.685711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.685720] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.685728] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:37.692494] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.692507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.692515] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:37.692541] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8097 [D 20:43:37.692550] element 0: offset: 0x2aaaab23ca90, size: 24 [D 20:43:37.692562] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 12/70. [D 20:43:37.692618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.692628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.692636] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:37.692651] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8099 [D 20:43:37.692661] element 0: offset: 0x2aaaab23cf30, size: 24 [D 20:43:37.692670] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 13/70. [D 20:43:37.696685] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8099 [D 20:43:37.696740] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 14/70. [D 20:43:37.696794] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8097 [D 20:43:37.696808] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 15/70. [D 20:43:37.696878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 57955. [D 20:43:37.696904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 57956. [D 20:43:37.696915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 57957. [D 20:43:37.696924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 57958. [D 20:43:37.696934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 57959. [D 20:43:37.696952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 57960. [D 20:43:37.696962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 57961. [D 20:43:37.696971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 57962. [D 20:43:37.696981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 57963. [D 20:43:37.696991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 57964. [D 20:43:37.697001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 57965. [D 20:43:37.697011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 57966. [D 20:43:37.697020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 57967. [D 20:43:37.697033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 57968. [D 20:43:37.697042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 57969. [D 20:43:37.697052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 57970. [D 20:43:37.697062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 57971. [D 20:43:37.697072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 57972. [D 20:43:37.697082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 57973. [D 20:43:37.697091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 57974. [D 20:43:37.697101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 57975. [D 20:43:37.697111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 57976. [D 20:43:37.697121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 57977. [D 20:43:37.697131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 57978. [D 20:43:37.697140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 57979. [D 20:43:37.697150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 57980. [D 20:43:37.697160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 57981. [D 20:43:37.697170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 57982. [D 20:43:37.697179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 57983. [D 20:43:37.697190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 57984. [D 20:43:37.697200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 57985. [D 20:43:37.697209] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 57986. [D 20:43:37.697221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 57987. [D 20:43:37.697231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 57988. [D 20:43:37.697241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 57989. [D 20:43:37.697251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 57990. [D 20:43:37.697261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 57991. [D 20:43:37.697270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 57992. [D 20:43:37.697280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 57993. [D 20:43:37.697290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 57994. [D 20:43:37.697300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 57995. [D 20:43:37.697310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 57996. [D 20:43:37.697320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 57997. [D 20:43:37.697330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 57998. [D 20:43:37.697339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 57999. [D 20:43:37.697349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 58000. [D 20:43:37.697359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 58001. [D 20:43:37.697369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 58002. [D 20:43:37.697379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 58003. [D 20:43:37.697389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 58004. [D 20:43:37.697398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 58005. [D 20:43:37.697409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 58006. [D 20:43:37.697418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 58007. [D 20:43:37.697428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 58008. [D 20:43:37.697438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 58009. [D 20:43:37.697448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 58010. [D 20:43:37.697458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 58011. [D 20:43:37.697467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 58012. [D 20:43:37.697478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 58013. [D 20:43:37.697488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 58014. [D 20:43:37.697498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 58015. [D 20:43:37.697507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 58016. [D 20:43:37.697517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 58017. [D 20:43:37.697527] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab241850 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 58018. [D 20:43:37.707478] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58018. [D 20:43:37.707493] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 16/70. [D 20:43:37.713364] openib_check_cq: completed rdma wr_id 2aaaab241850, nic_wr_credit 58017. [D 20:43:37.713379] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 17/70. [D 20:43:37.713433] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.713448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.713457] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:37.713479] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.713488] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.713497] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:37.719838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.719851] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.719859] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:37.719884] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8102 [D 20:43:37.719894] element 0: offset: 0x2aaaab202d00, size: 24 [D 20:43:37.719905] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 18/70. [D 20:43:37.719961] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.719971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.719979] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:37.719994] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8105 [D 20:43:37.720004] element 0: offset: 0x2aaaab234400, size: 24 [D 20:43:37.720014] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 19/70. [D 20:43:37.724228] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8105 [D 20:43:37.724280] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 20/70. [D 20:43:37.724333] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8102 [D 20:43:37.724348] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 21/70. [D 20:43:37.724412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 58017. [D 20:43:37.724437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 58018. [D 20:43:37.724447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 58019. [D 20:43:37.724457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 58020. [D 20:43:37.724467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 58021. [D 20:43:37.724477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 58022. [D 20:43:37.724494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 58023. [D 20:43:37.724504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 58024. [D 20:43:37.724514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 58025. [D 20:43:37.724523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 58026. [D 20:43:37.724534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 58027. [D 20:43:37.724543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 58028. [D 20:43:37.724553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 58029. [D 20:43:37.724563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 58030. [D 20:43:37.724572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 58031. [D 20:43:37.724582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 58032. [D 20:43:37.724592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 58033. [D 20:43:37.724602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 58034. [D 20:43:37.724612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 58035. [D 20:43:37.724622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 58036. [D 20:43:37.724631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 58037. [D 20:43:37.724641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 58038. [D 20:43:37.724651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 58039. [D 20:43:37.724661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 58040. [D 20:43:37.724670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 58041. [D 20:43:37.724680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 58042. [D 20:43:37.724690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 58043. [D 20:43:37.724700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 58044. [D 20:43:37.724710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 58045. [D 20:43:37.724720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 58046. [D 20:43:37.724730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 58047. [D 20:43:37.724740] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 58048. [D 20:43:37.724751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 58049. [D 20:43:37.724762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 58050. [D 20:43:37.724772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 58051. [D 20:43:37.724781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 58052. [D 20:43:37.724791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 58053. [D 20:43:37.724801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 58054. [D 20:43:37.724811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 58055. [D 20:43:37.724820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 58056. [D 20:43:37.724831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 58057. [D 20:43:37.724840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 58058. [D 20:43:37.724850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 58059. [D 20:43:37.724860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 58060. [D 20:43:37.724870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 58061. [D 20:43:37.724879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 58062. [D 20:43:37.724889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 58063. [D 20:43:37.724899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 58064. [D 20:43:37.724909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 58065. [D 20:43:37.724919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 58066. [D 20:43:37.724928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 58067. [D 20:43:37.724938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 58068. [D 20:43:37.724948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 58069. [D 20:43:37.724958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 58070. [D 20:43:37.724968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 58071. [D 20:43:37.724978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 58072. [D 20:43:37.724987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 58073. [D 20:43:37.724997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 58074. [D 20:43:37.725007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 58075. [D 20:43:37.725017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 58076. [D 20:43:37.725029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 58077. [D 20:43:37.725040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 58078. [D 20:43:37.725050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 58079. [D 20:43:37.725060] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 58080. [D 20:43:37.734826] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58080. [D 20:43:37.734848] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 22/70. [D 20:43:37.742029] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 58079. [D 20:43:37.742049] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 23/70. [D 20:43:37.742096] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.742112] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.742120] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:37.742166] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.742177] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.742185] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:37.752459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.752472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.752481] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:37.752506] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8109 [D 20:43:37.752516] element 0: offset: 0x2aaaab236cf0, size: 24 [D 20:43:37.752526] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 24/70. [D 20:43:37.752559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.752569] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.752577] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:37.752592] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8111 [D 20:43:37.752601] element 0: offset: 0x2aaaab203230, size: 24 [D 20:43:37.752611] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 25/70. [D 20:43:37.756592] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8111 [D 20:43:37.756643] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 26/70. [D 20:43:37.756698] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8109 [D 20:43:37.756711] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 27/70. [D 20:43:37.757959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 58079. [D 20:43:37.757978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 58080. [D 20:43:37.757988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 58081. [D 20:43:37.757998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 58082. [D 20:43:37.758008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 58083. [D 20:43:37.758018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 58084. [D 20:43:37.758028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 58085. [D 20:43:37.758038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 58086. [D 20:43:37.758047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 58087. [D 20:43:37.758057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 58088. [D 20:43:37.758067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 58089. [D 20:43:37.758076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 58090. [D 20:43:37.758086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 58091. [D 20:43:37.758096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 58092. [D 20:43:37.758106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 58093. [D 20:43:37.758115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 58094. [D 20:43:37.758125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 58095. [D 20:43:37.758135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 58096. [D 20:43:37.758145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 58097. [D 20:43:37.758155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 58098. [D 20:43:37.758164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 58099. [D 20:43:37.758174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 58100. [D 20:43:37.758184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 58101. [D 20:43:37.758193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 58102. [D 20:43:37.758203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 58103. [D 20:43:37.758213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 58104. [D 20:43:37.758223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 58105. [D 20:43:37.758232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 58106. [D 20:43:37.758242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 58107. [D 20:43:37.758253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 58108. [D 20:43:37.758262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 58109. [D 20:43:37.758272] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab2416e0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 58110. [D 20:43:37.758283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 58111. [D 20:43:37.758293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 58112. [D 20:43:37.758303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 58113. [D 20:43:37.758312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 58114. [D 20:43:37.758322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 58115. [D 20:43:37.758332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 58116. [D 20:43:37.758341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 58117. [D 20:43:37.758351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 58118. [D 20:43:37.758361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 58119. [D 20:43:37.758370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 58120. [D 20:43:37.758380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 58121. [D 20:43:37.758390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 58122. [D 20:43:37.758400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 58123. [D 20:43:37.758409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 58124. [D 20:43:37.758419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 58125. [D 20:43:37.758429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 58126. [D 20:43:37.758438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 58127. [D 20:43:37.758448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 58128. [D 20:43:37.758458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 58129. [D 20:43:37.758468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 58130. [D 20:43:37.758477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 58131. [D 20:43:37.758487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 58132. [D 20:43:37.758497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 58133. [D 20:43:37.758506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 58134. [D 20:43:37.758519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 58135. [D 20:43:37.758529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 58136. [D 20:43:37.758539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 58137. [D 20:43:37.758549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 58138. [D 20:43:37.758559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 58139. [D 20:43:37.758568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 58140. [D 20:43:37.758578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 58141. [D 20:43:37.758588] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 58142. [D 20:43:37.758625] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.758640] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.758649] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:37.758677] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8113 [D 20:43:37.758687] element 0: offset: 0x2aaaab23ca90, size: 24 [D 20:43:37.758698] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 28/70. [D 20:43:37.758843] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.758853] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.758862] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:37.758892] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8117 [D 20:43:37.758902] element 0: offset: 0x2aaaab237e60, size: 24 [D 20:43:37.758911] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 29/70. [D 20:43:37.769474] openib_check_cq: completed rdma wr_id 2aaaab2416e0, nic_wr_credit 58142. [D 20:43:37.769493] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 30/70. [D 20:43:37.781031] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 58141. [D 20:43:37.781046] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 31/70. [D 20:43:37.781088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.781102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.781110] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:37.781194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.781204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.781212] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:37.785179] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8117 [D 20:43:37.785201] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 32/70. [D 20:43:37.785218] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8113 [D 20:43:37.785233] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 33/70. [D 20:43:37.786675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 58141. [D 20:43:37.786687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 58142. [D 20:43:37.786697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 58143. [D 20:43:37.786707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 58144. [D 20:43:37.786716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 58145. [D 20:43:37.786726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 58146. [D 20:43:37.786736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 58147. [D 20:43:37.786746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 58148. [D 20:43:37.786755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 58149. [D 20:43:37.786765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 58150. [D 20:43:37.786775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 58151. [D 20:43:37.786784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 58152. [D 20:43:37.786794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 58153. [D 20:43:37.786804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 58154. [D 20:43:37.786814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 58155. [D 20:43:37.786824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 58156. [D 20:43:37.786833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 58157. [D 20:43:37.786843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 58158. [D 20:43:37.786853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 58159. [D 20:43:37.786862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 58160. [D 20:43:37.786872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 58161. [D 20:43:37.786882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 58162. [D 20:43:37.786892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 58163. [D 20:43:37.786902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 58164. [D 20:43:37.786911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 58165. [D 20:43:37.786921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 58166. [D 20:43:37.786931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 58167. [D 20:43:37.786941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 58168. [D 20:43:37.786951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 58169. [D 20:43:37.786961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 58170. [D 20:43:37.786970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 58171. [D 20:43:37.786980] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 58172. [D 20:43:37.786991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 58173. [D 20:43:37.787001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 58174. [D 20:43:37.787011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 58175. [D 20:43:37.787020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 58176. [D 20:43:37.787030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 58177. [D 20:43:37.787040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 58178. [D 20:43:37.787050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 58179. [D 20:43:37.787059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 58180. [D 20:43:37.787069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 58181. [D 20:43:37.787079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 58182. [D 20:43:37.787088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 58183. [D 20:43:37.787098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 58184. [D 20:43:37.787108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 58185. [D 20:43:37.787118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 58186. [D 20:43:37.787127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 58187. [D 20:43:37.787137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 58188. [D 20:43:37.787147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 58189. [D 20:43:37.787156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 58190. [D 20:43:37.787166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 58191. [D 20:43:37.787176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 58192. [D 20:43:37.787185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 58193. [D 20:43:37.787195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 58194. [D 20:43:37.787205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 58195. [D 20:43:37.787214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 58196. [D 20:43:37.787225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 58197. [D 20:43:37.787234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 58198. [D 20:43:37.787244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 58199. [D 20:43:37.787254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 58200. [D 20:43:37.787264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 58201. [D 20:43:37.787273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 58202. [D 20:43:37.787283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 58203. [D 20:43:37.787293] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab22f5f0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 58204. [D 20:43:37.793070] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.793109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.793118] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:37.793149] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8121 [D 20:43:37.793159] element 0: offset: 0x2aaaab202d00, size: 24 [D 20:43:37.793172] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 34/70. [D 20:43:37.793208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.793217] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.793225] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:37.793240] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8123 [D 20:43:37.793249] element 0: offset: 0x2aaaab234400, size: 24 [D 20:43:37.793259] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 35/70. [D 20:43:37.798388] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58204. [D 20:43:37.798407] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 36/70. [D 20:43:37.810051] openib_check_cq: completed rdma wr_id 2aaaab22f5f0, nic_wr_credit 58203. [D 20:43:37.810066] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 37/70. [D 20:43:37.810116] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.810130] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.810138] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:37.810218] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.810228] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.810237] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:37.814193] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8123 [D 20:43:37.814212] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 38/70. [D 20:43:37.814226] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8121 [D 20:43:37.814237] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 39/70. [D 20:43:37.821100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 58203. [D 20:43:37.821115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 58204. [D 20:43:37.821125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 58205. [D 20:43:37.821135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 58206. [D 20:43:37.821145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 58207. [D 20:43:37.821155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 58208. [D 20:43:37.821165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 58209. [D 20:43:37.821174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 58210. [D 20:43:37.821184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 58211. [D 20:43:37.821194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 58212. [D 20:43:37.821204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 58213. [D 20:43:37.821214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 58214. [D 20:43:37.821223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 58215. [D 20:43:37.821233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 58216. [D 20:43:37.821243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 58217. [D 20:43:37.821252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 58218. [D 20:43:37.821262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 58219. [D 20:43:37.821272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 58220. [D 20:43:37.821282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 58221. [D 20:43:37.821292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 58222. [D 20:43:37.821302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 58223. [D 20:43:37.821311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 58224. [D 20:43:37.821321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 58225. [D 20:43:37.821331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 58226. [D 20:43:37.821340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 58227. [D 20:43:37.821350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 58228. [D 20:43:37.821360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 58229. [D 20:43:37.821370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 58230. [D 20:43:37.821379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 58231. [D 20:43:37.821389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 58232. [D 20:43:37.821400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 58233. [D 20:43:37.821410] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 58234. [D 20:43:37.821421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 58235. [D 20:43:37.821431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 58236. [D 20:43:37.821441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 58237. [D 20:43:37.821450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 58238. [D 20:43:37.821460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 58239. [D 20:43:37.821470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 58240. [D 20:43:37.821480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 58241. [D 20:43:37.821490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 58242. [D 20:43:37.821500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 58243. [D 20:43:37.821509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 58244. [D 20:43:37.821519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 58245. [D 20:43:37.821529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 58246. [D 20:43:37.821539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 58247. [D 20:43:37.821548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 58248. [D 20:43:37.821558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 58249. [D 20:43:37.821568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 58250. [D 20:43:37.821578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 58251. [D 20:43:37.821588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 58252. [D 20:43:37.821597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 58253. [D 20:43:37.821607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 58254. [D 20:43:37.821617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 58255. [D 20:43:37.821627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 58256. [D 20:43:37.821636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 58257. [D 20:43:37.821646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 58258. [D 20:43:37.821656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 58259. [D 20:43:37.821666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 58260. [D 20:43:37.821676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 58261. [D 20:43:37.821686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 58262. [D 20:43:37.821696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 58263. [D 20:43:37.821705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 58264. [D 20:43:37.821715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 58265. [D 20:43:37.821725] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 58266. [D 20:43:37.821841] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.821881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.821890] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:37.821919] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8126 [D 20:43:37.821929] element 0: offset: 0x2aaaab236cf0, size: 24 [D 20:43:37.821942] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 40/70. [D 20:43:37.822045] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:37.822055] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.822063] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:37.822078] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8129 [D 20:43:37.822087] element 0: offset: 0x2aaaab240760, size: 24 [D 20:43:37.822097] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 41/70. [D 20:43:37.826986] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 58266. [D 20:43:37.827004] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 42/70. [D 20:43:37.832825] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58265. [D 20:43:37.832840] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 43/70. [D 20:43:37.832884] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.832898] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.832907] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:37.832988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.832998] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.833006] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:37.837212] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8129 [D 20:43:37.837231] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 44/70. [D 20:43:37.837244] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8126 [D 20:43:37.837255] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 45/70. [D 20:43:37.837279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 58265. [D 20:43:37.837291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 58266. [D 20:43:37.837301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 58267. [D 20:43:37.837310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 58268. [D 20:43:37.837320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 58269. [D 20:43:37.837330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 58270. [D 20:43:37.837340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 58271. [D 20:43:37.837350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 58272. [D 20:43:37.837359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 58273. [D 20:43:37.837369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 58274. [D 20:43:37.837379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 58275. [D 20:43:37.837389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 58276. [D 20:43:37.837399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 58277. [D 20:43:37.837408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 58278. [D 20:43:37.837418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 58279. [D 20:43:37.837428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 58280. [D 20:43:37.837438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 58281. [D 20:43:37.837448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 58282. [D 20:43:37.837457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 58283. [D 20:43:37.837467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 58284. [D 20:43:37.837477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 58285. [D 20:43:37.837487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 58286. [D 20:43:37.837496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 58287. [D 20:43:37.837506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 58288. [D 20:43:37.837516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 58289. [D 20:43:37.837526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 58290. [D 20:43:37.837535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 58291. [D 20:43:37.837546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 58292. [D 20:43:37.837556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 58293. [D 20:43:37.837566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 58294. [D 20:43:37.837575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 58295. [D 20:43:37.837585] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 58296. [D 20:43:37.837596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 58297. [D 20:43:37.837606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 58298. [D 20:43:37.837616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 58299. [D 20:43:37.837626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 58300. [D 20:43:37.837636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 58301. [D 20:43:37.837645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 58302. [D 20:43:37.837655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 58303. [D 20:43:37.837665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 58304. [D 20:43:37.837675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 58305. [D 20:43:37.837685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 58306. [D 20:43:37.837694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 58307. [D 20:43:37.837704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 58308. [D 20:43:37.837714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 58309. [D 20:43:37.837724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 58310. [D 20:43:37.837734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 58311. [D 20:43:37.837743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 58312. [D 20:43:37.837753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 58313. [D 20:43:37.837763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 58314. [D 20:43:37.837773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 58315. [D 20:43:37.837782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 58316. [D 20:43:37.837792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 58317. [D 20:43:37.837802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 58318. [D 20:43:37.837812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 58319. [D 20:43:37.837822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 58320. [D 20:43:37.837832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 58321. [D 20:43:37.837842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 58322. [D 20:43:37.837852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 58323. [D 20:43:37.837861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 58324. [D 20:43:37.837871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 58325. [D 20:43:37.837881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 58326. [D 20:43:37.837891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 58327. [D 20:43:37.837900] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 58328. [D 20:43:37.843204] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58328. [D 20:43:37.843218] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 46/70. [D 20:43:37.849103] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 58327. [D 20:43:37.849118] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 47/70. [D 20:43:37.849171] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.849209] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.849218] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:37.849240] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:37.849248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:37.849256] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:38.118221] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.118235] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.118244] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:38.118271] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8133 [D 20:43:38.118281] element 0: offset: 0x2aaaab23ca90, size: 24 [D 20:43:38.118293] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 48/70. [D 20:43:38.120580] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8133 [D 20:43:38.120597] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 49/70. [D 20:43:38.124118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.124158] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.124167] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:43:38.124194] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8135 [D 20:43:38.124204] element 0: offset: 0x2aaaab229ca0, size: 24 [D 20:43:38.124217] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 50/70. [D 20:43:38.128309] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8135 [D 20:43:38.128328] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 51/70. [D 20:43:38.129549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 58327. [D 20:43:38.129602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 58328. [D 20:43:38.129612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 58329. [D 20:43:38.129622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 58330. [D 20:43:38.129637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 58331. [D 20:43:38.129648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 58332. [D 20:43:38.129657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 58333. [D 20:43:38.129667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 58334. [D 20:43:38.129677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 58335. [D 20:43:38.129687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 58336. [D 20:43:38.129696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 58337. [D 20:43:38.129706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 58338. [D 20:43:38.129715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 58339. [D 20:43:38.129728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 58340. [D 20:43:38.129737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 58341. [D 20:43:38.129747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 58342. [D 20:43:38.129756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 58343. [D 20:43:38.129770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 58344. [D 20:43:38.129782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 58345. [D 20:43:38.129792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 58346. [D 20:43:38.129801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 58347. [D 20:43:38.129811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 58348. [D 20:43:38.129821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 58349. [D 20:43:38.129834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 58350. [D 20:43:38.129844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 58351. [D 20:43:38.129853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 58352. [D 20:43:38.129863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 58353. [D 20:43:38.129873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 58354. [D 20:43:38.129884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 58355. [D 20:43:38.129894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 58356. [D 20:43:38.129903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 58357. [D 20:43:38.129913] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 58358. [D 20:43:38.129925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 58359. [D 20:43:38.129936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 58360. [D 20:43:38.129946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 58361. [D 20:43:38.129955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 58362. [D 20:43:38.129965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 58363. [D 20:43:38.129974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 58364. [D 20:43:38.129987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 58365. [D 20:43:38.129996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 58366. [D 20:43:38.130006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 58367. [D 20:43:38.130055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 58368. [D 20:43:38.130065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 58369. [D 20:43:38.130075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 58370. [D 20:43:38.130084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 58371. [D 20:43:38.130094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 58372. [D 20:43:38.130104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 58373. [D 20:43:38.130113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 58374. [D 20:43:38.130123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 58375. [D 20:43:38.130132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 58376. [D 20:43:38.130150] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 58377. [D 20:43:38.130160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 58378. [D 20:43:38.130169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 58379. [D 20:43:38.130179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 58380. [D 20:43:38.130188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 58381. [D 20:43:38.130205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 58382. [D 20:43:38.130214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 58383. [D 20:43:38.130223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 58384. [D 20:43:38.130233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 58385. [D 20:43:38.130244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 58386. [D 20:43:38.130253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 58387. [D 20:43:38.130262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 58388. [D 20:43:38.130272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 58389. [D 20:43:38.130282] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab20f860 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 58390. [D 20:43:38.132606] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.132620] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.132631] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:38.132659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8138 [D 20:43:38.132670] element 0: offset: 0x2aaaab23d320, size: 24 [D 20:43:38.132681] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 52/70. [D 20:43:38.132706] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.132717] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.132725] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:38.132739] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8141 [D 20:43:38.132749] element 0: offset: 0x2aaaab23c910, size: 24 [D 20:43:38.132759] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 53/70. [D 20:43:38.141267] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58390. [D 20:43:38.141286] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 54/70. [D 20:43:38.152799] openib_check_cq: completed rdma wr_id 2aaaab20f860, nic_wr_credit 58389. [D 20:43:38.152814] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 55/70. [D 20:43:38.152860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.152874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.152883] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:38.152958] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.152968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.152977] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:38.157239] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8141 [D 20:43:38.157257] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 56/70. [D 20:43:38.157271] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8138 [D 20:43:38.157281] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 57/70. [D 20:43:38.164007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 58389. [D 20:43:38.164022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 58390. [D 20:43:38.164032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 58391. [D 20:43:38.164042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 58392. [D 20:43:38.164052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 58393. [D 20:43:38.164061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 58394. [D 20:43:38.164071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 58395. [D 20:43:38.164081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 58396. [D 20:43:38.164090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 58397. [D 20:43:38.164100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 58398. [D 20:43:38.164110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 58399. [D 20:43:38.164119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 58400. [D 20:43:38.164129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 58401. [D 20:43:38.164138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 58402. [D 20:43:38.164148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 58403. [D 20:43:38.164158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 58404. [D 20:43:38.164167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 58405. [D 20:43:38.164177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 58406. [D 20:43:38.164186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 58407. [D 20:43:38.164196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 58408. [D 20:43:38.164206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 58409. [D 20:43:38.164215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 58410. [D 20:43:38.164225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 58411. [D 20:43:38.164234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 58412. [D 20:43:38.164244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 58413. [D 20:43:38.164253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 58414. [D 20:43:38.164263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 58415. [D 20:43:38.164273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 58416. [D 20:43:38.164282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 58417. [D 20:43:38.164292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 58418. [D 20:43:38.164302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 58419. [D 20:43:38.164312] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 58420. [D 20:43:38.164323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 58421. [D 20:43:38.164333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 58422. [D 20:43:38.164342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 58423. [D 20:43:38.164352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 58424. [D 20:43:38.164362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 58425. [D 20:43:38.164371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 58426. [D 20:43:38.164381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 58427. [D 20:43:38.164390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 58428. [D 20:43:38.164400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 58429. [D 20:43:38.164410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 58430. [D 20:43:38.164419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 58431. [D 20:43:38.164429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 58432. [D 20:43:38.164438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 58433. [D 20:43:38.164448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 58434. [D 20:43:38.164457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 58435. [D 20:43:38.164467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 58436. [D 20:43:38.164476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 58437. [D 20:43:38.164486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 58438. [D 20:43:38.164496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 58439. [D 20:43:38.164505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 58440. [D 20:43:38.164515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 58441. [D 20:43:38.164524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 58442. [D 20:43:38.164534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 58443. [D 20:43:38.164543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 58444. [D 20:43:38.164553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 58445. [D 20:43:38.164563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 58446. [D 20:43:38.164572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 58447. [D 20:43:38.164582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 58448. [D 20:43:38.164592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 58449. [D 20:43:38.164601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 58450. [D 20:43:38.164611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 58451. [D 20:43:38.164621] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 58452. [D 20:43:38.164720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.164758] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.164767] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:38.164796] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8145 [D 20:43:38.164807] element 0: offset: 0x2aaaab203230, size: 24 [D 20:43:38.164819] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 58/70. [D 20:43:38.164852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.164861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.164869] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:38.164884] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8147 [D 20:43:38.164893] element 0: offset: 0x2aaaab202d00, size: 24 [D 20:43:38.164902] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 59/70. [D 20:43:38.175721] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 58452. [D 20:43:38.175739] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 60/70. [D 20:43:38.187405] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58451. [D 20:43:38.187420] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 0/70. [D 20:43:38.187464] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.187479] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.187487] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:38.187572] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.187582] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.187590] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:38.191709] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8145 [D 20:43:38.191728] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 1/70. [D 20:43:38.191742] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8147 [D 20:43:38.191756] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 2/70. [D 20:43:38.198754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 58451. [D 20:43:38.198769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 58452. [D 20:43:38.198779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 58453. [D 20:43:38.198789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 58454. [D 20:43:38.198798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 58455. [D 20:43:38.198808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 58456. [D 20:43:38.198817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 58457. [D 20:43:38.198827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 58458. [D 20:43:38.198837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 58459. [D 20:43:38.198846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 58460. [D 20:43:38.198856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 58461. [D 20:43:38.198865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 58462. [D 20:43:38.198875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 58463. [D 20:43:38.198884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 58464. [D 20:43:38.198894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 58465. [D 20:43:38.198904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 58466. [D 20:43:38.198913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 58467. [D 20:43:38.198923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 58468. [D 20:43:38.198932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 58469. [D 20:43:38.198942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 58470. [D 20:43:38.198951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 58471. [D 20:43:38.198961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 58472. [D 20:43:38.198971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 58473. [D 20:43:38.198980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 58474. [D 20:43:38.198990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 58475. [D 20:43:38.198999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 58476. [D 20:43:38.199009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 58477. [D 20:43:38.199019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 58478. [D 20:43:38.199028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 58479. [D 20:43:38.199038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 58480. [D 20:43:38.199048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 58481. [D 20:43:38.199058] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 58482. [D 20:43:38.199069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 58483. [D 20:43:38.199079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 58484. [D 20:43:38.199088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 58485. [D 20:43:38.199098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 58486. [D 20:43:38.199108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 58487. [D 20:43:38.199118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 58488. [D 20:43:38.199127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 58489. [D 20:43:38.199137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 58490. [D 20:43:38.199147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 58491. [D 20:43:38.199157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 58492. [D 20:43:38.199167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 58493. [D 20:43:38.199177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 58494. [D 20:43:38.199186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 58495. [D 20:43:38.199196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 58496. [D 20:43:38.199206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 58497. [D 20:43:38.199216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 58498. [D 20:43:38.199225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 58499. [D 20:43:38.199235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 58500. [D 20:43:38.199245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 58501. [D 20:43:38.199255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 58502. [D 20:43:38.199265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 58503. [D 20:43:38.199274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 58504. [D 20:43:38.199284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 58505. [D 20:43:38.199294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 58506. [D 20:43:38.199304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 58507. [D 20:43:38.199314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 58508. [D 20:43:38.199323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 58509. [D 20:43:38.199334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 58510. [D 20:43:38.199343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 58511. [D 20:43:38.199353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 58512. [D 20:43:38.199363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 58513. [D 20:43:38.199373] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 58514. [D 20:43:38.199419] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.199464] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.199473] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:38.199504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8150 [D 20:43:38.199514] element 0: offset: 0x2aaaab22f680, size: 24 [D 20:43:38.199527] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 3/70. [D 20:43:38.199581] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.199590] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.199599] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:38.199613] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8153 [D 20:43:38.199623] element 0: offset: 0x2aaaab237e60, size: 24 [D 20:43:38.199633] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 4/70. [D 20:43:38.210423] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58514. [D 20:43:38.210441] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 5/70. [D 20:43:38.222096] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 58513. [D 20:43:38.222112] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 6/70. [D 20:43:38.222153] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.222167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.222176] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:38.222259] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.222270] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.222278] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:38.226543] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8153 [D 20:43:38.226562] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 7/70. [D 20:43:38.226577] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8150 [D 20:43:38.226592] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 8/70. [D 20:43:38.233495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 58513. [D 20:43:38.233510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 58514. [D 20:43:38.233520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 58515. [D 20:43:38.233530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 58516. [D 20:43:38.233540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 58517. [D 20:43:38.233549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 58518. [D 20:43:38.233559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 58519. [D 20:43:38.233569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 58520. [D 20:43:38.233578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 58521. [D 20:43:38.233588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 58522. [D 20:43:38.233597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 58523. [D 20:43:38.233607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 58524. [D 20:43:38.233617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 58525. [D 20:43:38.233626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 58526. [D 20:43:38.233636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 58527. [D 20:43:38.233645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 58528. [D 20:43:38.233655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 58529. [D 20:43:38.233664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 58530. [D 20:43:38.233674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 58531. [D 20:43:38.233684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 58532. [D 20:43:38.233693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 58533. [D 20:43:38.233703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 58534. [D 20:43:38.233712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 58535. [D 20:43:38.233722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 58536. [D 20:43:38.233731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 58537. [D 20:43:38.233741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 58538. [D 20:43:38.233751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 58539. [D 20:43:38.233760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 58540. [D 20:43:38.233770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 58541. [D 20:43:38.233780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 58542. [D 20:43:38.233790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 58543. [D 20:43:38.233800] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 58544. [D 20:43:38.233811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 58545. [D 20:43:38.233821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 58546. [D 20:43:38.233830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 58547. [D 20:43:38.233840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 58548. [D 20:43:38.233850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 58549. [D 20:43:38.233860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 58550. [D 20:43:38.233870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 58551. [D 20:43:38.233880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 58552. [D 20:43:38.233890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 58553. [D 20:43:38.233900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 58554. [D 20:43:38.233909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 58555. [D 20:43:38.233919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 58556. [D 20:43:38.233929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 58557. [D 20:43:38.233939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 58558. [D 20:43:38.233949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 58559. [D 20:43:38.233959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 58560. [D 20:43:38.233968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 58561. [D 20:43:38.233978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 58562. [D 20:43:38.233988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 58563. [D 20:43:38.233998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 58564. [D 20:43:38.234008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 58565. [D 20:43:38.234018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 58566. [D 20:43:38.234028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 58567. [D 20:43:38.234037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 58568. [D 20:43:38.234047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 58569. [D 20:43:38.234057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 58570. [D 20:43:38.234067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 58571. [D 20:43:38.234077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 58572. [D 20:43:38.234087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 58573. [D 20:43:38.234097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 58574. [D 20:43:38.234106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 58575. [D 20:43:38.234116] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab230140 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 58576. [D 20:43:38.234227] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.234267] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.234276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:43:38.234306] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8157 [D 20:43:38.234316] element 0: offset: 0x2aaaab23ca90, size: 24 [D 20:43:38.234329] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 9/70. [D 20:43:38.234362] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.234371] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.234379] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:43:38.234395] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8159 [D 20:43:38.234404] element 0: offset: 0x2aaaab23d1d0, size: 24 [D 20:43:38.234413] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 10/70. [D 20:43:38.245110] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58576. [D 20:43:38.245128] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 11/70. [D 20:43:38.256773] openib_check_cq: completed rdma wr_id 2aaaab230140, nic_wr_credit 58575. [D 20:43:38.256787] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 12/70. [D 20:43:38.256828] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.256842] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.256851] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:43:38.256956] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.256966] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.256974] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:43:38.260996] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 8157 [D 20:43:38.261015] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 13/70. [D 20:43:38.261028] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8159 [D 20:43:38.261043] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 14/70. [D 20:43:38.261066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 58575. [D 20:43:38.261078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 58576. [D 20:43:38.261088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 58577. [D 20:43:38.261097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 58578. [D 20:43:38.261107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 58579. [D 20:43:38.261116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 58580. [D 20:43:38.261126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 58581. [D 20:43:38.261135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 58582. [D 20:43:38.261145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 58583. [D 20:43:38.261155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 58584. [D 20:43:38.261164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 58585. [D 20:43:38.261174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 58586. [D 20:43:38.261183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 58587. [D 20:43:38.261193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 58588. [D 20:43:38.261202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 58589. [D 20:43:38.261212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 58590. [D 20:43:38.261221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 58591. [D 20:43:38.261231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 58592. [D 20:43:38.261240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 58593. [D 20:43:38.261250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 58594. [D 20:43:38.261259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 58595. [D 20:43:38.261269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 58596. [D 20:43:38.261278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 58597. [D 20:43:38.261288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 58598. [D 20:43:38.261297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 58599. [D 20:43:38.261307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 58600. [D 20:43:38.261317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 58601. [D 20:43:38.261327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 58602. [D 20:43:38.261337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 58603. [D 20:43:38.261346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 58604. [D 20:43:38.261356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 58605. [D 20:43:38.261366] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 58606. [D 20:43:38.261377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 58607. [D 20:43:38.261387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 58608. [D 20:43:38.261397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 58609. [D 20:43:38.261406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 58610. [D 20:43:38.261416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 58611. [D 20:43:38.261426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 58612. [D 20:43:38.261436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 58613. [D 20:43:38.261445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 58614. [D 20:43:38.261455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 58615. [D 20:43:38.261465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 58616. [D 20:43:38.261475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 58617. [D 20:43:38.261484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 58618. [D 20:43:38.261494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 58619. [D 20:43:38.261504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 58620. [D 20:43:38.261514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 58621. [D 20:43:38.261523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 58622. [D 20:43:38.261533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 58623. [D 20:43:38.261543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 58624. [D 20:43:38.261553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 58625. [D 20:43:38.261563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 58626. [D 20:43:38.261572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 58627. [D 20:43:38.261582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 58628. [D 20:43:38.261592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 58629. [D 20:43:38.261601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 58630. [D 20:43:38.261612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 58631. [D 20:43:38.261621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 58632. [D 20:43:38.261631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 58633. [D 20:43:38.261640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 58634. [D 20:43:38.261650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 58635. [D 20:43:38.261660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 58636. [D 20:43:38.261670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 58637. [D 20:43:38.261679] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab213550 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 58638. [D 20:43:38.267042] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58638. [D 20:43:38.267087] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 15/70. [D 20:43:38.272914] openib_check_cq: completed rdma wr_id 2aaaab213550, nic_wr_credit 58637. [D 20:43:38.272933] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 16/70. [D 20:43:38.272983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.272997] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.273006] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:43:38.273027] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.273036] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.273044] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:38.588207] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:38.588220] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.588229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:38.588256] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 8162 [D 20:43:38.588266] element 0: offset: 0x5b0030, size: 24 [D 20:43:38.588278] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 17/70. [D 20:43:38.590797] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 8162 [D 20:43:38.590817] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 18/70. [D 20:43:38.590874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 58637. [D 20:43:38.590888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 58638. [D 20:43:38.590897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 58639. [D 20:43:38.590907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 58640. [D 20:43:38.590917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 58641. [D 20:43:38.590927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 58642. [D 20:43:38.590936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 58643. [D 20:43:38.590946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 58644. [D 20:43:38.590955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 58645. [D 20:43:38.590965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 58646. [D 20:43:38.590975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 58647. [D 20:43:38.590984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 58648. [D 20:43:38.590994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 58649. [D 20:43:38.591003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 58650. [D 20:43:38.591013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 58651. [D 20:43:38.591022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 58652. [D 20:43:38.591032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 58653. [D 20:43:38.591041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 58654. [D 20:43:38.591051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 58655. [D 20:43:38.591060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 58656. [D 20:43:38.591070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 58657. [D 20:43:38.591080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 58658. [D 20:43:38.591089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 58659. [D 20:43:38.591099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 58660. [D 20:43:38.591108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 58661. [D 20:43:38.591118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 58662. [D 20:43:38.591128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 58663. [D 20:43:38.591137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 58664. [D 20:43:38.591147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 58665. [D 20:43:38.591156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 58666. [D 20:43:38.591167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 58667. [D 20:43:38.591176] openib_post_sr_rdmaw: ibv_post_send wr_id 2aaaab202de0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 58668. [D 20:43:38.601522] openib_check_cq: completed rdma wr_id 2aaaab202de0, nic_wr_credit 58668. [D 20:43:38.601537] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 19/70. [D 20:43:38.601654] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:38.601695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:38.601703] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.648761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.648775] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.648784] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.648814] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8176 [D 20:43:39.648824] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.648836] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 20/70. [D 20:43:39.648890] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.648899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.648908] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.649795] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.649804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.649813] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.652014] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8180 [D 20:43:39.652031] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.652041] openib_post_sr: 10.1.4.240:38258 bh 5 len 88 wr 21/70. [D 20:43:39.652104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.652114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.652123] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.662253] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.662266] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.662275] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.662292] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8185 [D 20:43:39.662301] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.662311] openib_post_sr: 10.1.4.240:38258 bh 6 len 88 wr 22/70. [D 20:43:39.662363] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.662372] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.662381] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.670678] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.670691] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.670700] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.670716] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8192 [D 20:43:39.670725] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.670736] openib_post_sr: 10.1.4.240:38258 bh 7 len 88 wr 23/70. [D 20:43:39.670787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.670797] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.670805] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.676854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.676867] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.676875] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.676891] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8197 [D 20:43:39.676900] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.676910] openib_post_sr: 10.1.4.240:38258 bh 8 len 88 wr 24/70. [D 20:43:39.676961] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.676971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.676979] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.687307] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.687321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.687329] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.687345] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8204 [D 20:43:39.687354] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.687364] openib_post_sr: 10.1.4.240:38258 bh 9 len 88 wr 25/70. [D 20:43:39.687416] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.687426] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.687434] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.696319] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.696333] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.696341] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.696358] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8210 [D 20:43:39.696367] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.696377] openib_post_sr: 10.1.4.240:38258 bh 10 len 88 wr 26/70. [D 20:43:39.696429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.696438] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.696446] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.712129] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.712142] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.712151] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.712167] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8217 [D 20:43:39.712176] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.712186] openib_post_sr: 10.1.4.240:38258 bh 11 len 88 wr 27/70. [D 20:43:39.712238] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.712248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.712256] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.722661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.722674] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.722682] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.722698] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8223 [D 20:43:39.722707] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.722717] openib_post_sr: 10.1.4.240:38258 bh 12 len 88 wr 28/70. [D 20:43:39.722769] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.722779] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.722787] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.732530] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.732543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.732552] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.732568] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8229 [D 20:43:39.732577] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.732587] openib_post_sr: 10.1.4.240:38258 bh 13 len 88 wr 29/70. [D 20:43:39.732640] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.732649] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.732658] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.742942] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.742956] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.742965] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.742980] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8235 [D 20:43:39.742989] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.742999] openib_post_sr: 10.1.4.240:38258 bh 14 len 88 wr 30/70. [D 20:43:39.743051] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.743061] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.743069] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.751270] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.751283] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.751291] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.751307] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8241 [D 20:43:39.751317] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.751327] openib_post_sr: 10.1.4.240:38258 bh 15 len 88 wr 31/70. [D 20:43:39.751378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.751388] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.751396] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.759537] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.759551] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.759559] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.759575] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8247 [D 20:43:39.759584] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.759594] openib_post_sr: 10.1.4.240:38258 bh 16 len 88 wr 32/70. [D 20:43:39.759646] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.759655] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.759664] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.769812] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.769824] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.769833] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.769848] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8252 [D 20:43:39.769858] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.769868] openib_post_sr: 10.1.4.240:38258 bh 17 len 88 wr 33/70. [D 20:43:39.769920] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.769929] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.769937] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.780204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.780217] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.780226] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.780242] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8258 [D 20:43:39.780251] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.780261] openib_post_sr: 10.1.4.240:38258 bh 18 len 88 wr 34/70. [D 20:43:39.780312] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.780322] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.780330] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.788496] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.788509] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.788518] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.788533] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8265 [D 20:43:39.788543] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.788553] openib_post_sr: 10.1.4.240:38258 bh 19 len 88 wr 35/70. [D 20:43:39.788603] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.788613] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.788621] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.796811] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.796825] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.796833] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.796849] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8271 [D 20:43:39.796858] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.796868] openib_post_sr: 10.1.4.240:38258 bh 0 len 88 wr 36/70. [D 20:43:39.796920] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.796929] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.796938] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.804986] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.804999] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.805008] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.805023] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8277 [D 20:43:39.805032] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.805042] openib_post_sr: 10.1.4.240:38258 bh 1 len 88 wr 37/70. [D 20:43:39.805093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.805103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.805111] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.813276] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.813289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.813298] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.813314] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8283 [D 20:43:39.813323] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.813333] openib_post_sr: 10.1.4.240:38258 bh 2 len 88 wr 38/70. [D 20:43:39.813384] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.813394] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.813403] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.823573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.823586] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.823595] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.823611] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8288 [D 20:43:39.823620] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.823630] openib_post_sr: 10.1.4.240:38258 bh 3 len 88 wr 39/70. [D 20:43:39.823682] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.823691] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.823699] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.831823] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.831835] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.831844] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.831859] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8294 [D 20:43:39.831869] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.831878] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 40/70. [D 20:43:39.831930] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.831940] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.831948] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.845689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.845702] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.845711] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.845726] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8304 [D 20:43:39.845736] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.845745] openib_post_sr: 10.1.4.240:38258 bh 5 len 88 wr 41/70. [D 20:43:39.845797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.845807] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.845815] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.856165] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.856178] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.856186] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.856202] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8310 [D 20:43:39.856212] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.856221] openib_post_sr: 10.1.4.240:38258 bh 6 len 88 wr 42/70. [D 20:43:39.856273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.856283] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.856291] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.864534] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.864548] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.864556] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.864572] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8315 [D 20:43:39.864581] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.864591] openib_post_sr: 10.1.4.240:38258 bh 7 len 88 wr 43/70. [D 20:43:39.864642] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.864651] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.864660] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.873865] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.873879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.873887] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.873903] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8322 [D 20:43:39.873912] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.873922] openib_post_sr: 10.1.4.240:38258 bh 8 len 88 wr 44/70. [D 20:43:39.873975] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.873985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.873993] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.884307] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.884321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.884329] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.884344] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8327 [D 20:43:39.884353] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.884364] openib_post_sr: 10.1.4.240:38258 bh 9 len 88 wr 45/70. [D 20:43:39.884416] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.884426] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.884434] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.892603] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.892616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.892624] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.892640] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8334 [D 20:43:39.892650] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.892659] openib_post_sr: 10.1.4.240:38258 bh 10 len 88 wr 46/70. [D 20:43:39.892711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.892720] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.892728] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.902932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.902945] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.902954] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.902969] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8340 [D 20:43:39.902979] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.902989] openib_post_sr: 10.1.4.240:38258 bh 11 len 88 wr 47/70. [D 20:43:39.903040] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.903050] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.903058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.916507] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.916520] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.916529] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.916544] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8347 [D 20:43:39.916554] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.916563] openib_post_sr: 10.1.4.240:38258 bh 12 len 88 wr 48/70. [D 20:43:39.916615] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.916624] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.916633] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.917777] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.917788] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.917796] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.968485] BMI_post_send_list: addr: 6416064, count: 1, total_size: 16, tag: 8350 [D 20:43:39.968501] element 0: offset: 0x620cf0, size: 16 [D 20:43:39.968515] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 49/70. [D 20:43:39.968561] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.968571] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.968579] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.981346] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.981360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.981368] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:39.981385] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8357 [D 20:43:39.981394] element 0: offset: 0x668fd0, size: 72 [D 20:43:39.981403] openib_post_sr: 10.1.4.240:38258 bh 14 len 88 wr 50/70. [D 20:43:39.981456] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:39.981465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.981473] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:39.984381] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:39.984393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:39.984401] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.054108] BMI_post_send_list: addr: 6416064, count: 1, total_size: 16, tag: 8360 [D 20:43:40.054123] element 0: offset: 0x5b0030, size: 16 [D 20:43:40.054134] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 51/70. [D 20:43:40.054192] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.054202] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.054210] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:40.242759] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:40.242773] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.242781] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.242798] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8367 [D 20:43:40.242807] element 0: offset: 0x668fd0, size: 72 [D 20:43:40.242817] openib_post_sr: 10.1.4.240:38258 bh 16 len 88 wr 52/70. [D 20:43:40.242871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.242880] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.242888] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:40.243641] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:40.243650] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.243658] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.345211] BMI_post_send_list: addr: 6416064, count: 1, total_size: 16, tag: 8370 [D 20:43:40.345225] element 0: offset: 0x649540, size: 16 [D 20:43:40.345240] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 53/70. [D 20:43:40.345366] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.345376] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.345384] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:40.383610] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:40.383623] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.383632] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.383648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8376 [D 20:43:40.383657] element 0: offset: 0x668fd0, size: 72 [D 20:43:40.383667] openib_post_sr: 10.1.4.240:38258 bh 18 len 88 wr 54/70. [D 20:43:40.383720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.383730] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.383738] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:40.384460] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:40.384470] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.384478] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.461418] BMI_post_send_list: addr: 6416064, count: 1, total_size: 16, tag: 8379 [D 20:43:40.461433] element 0: offset: 0x64da70, size: 16 [D 20:43:40.461443] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 55/70. [D 20:43:40.461545] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.461555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.461563] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:40.540453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:40.540467] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.540475] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.540491] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8387 [D 20:43:40.540501] element 0: offset: 0x668fd0, size: 72 [D 20:43:40.540511] openib_post_sr: 10.1.4.240:38258 bh 0 len 88 wr 56/70. [D 20:43:40.540571] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.540581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.540589] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:40.541339] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:40.541351] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.541359] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.588849] BMI_post_send_list: addr: 6416064, count: 1, total_size: 16, tag: 8390 [D 20:43:40.588864] element 0: offset: 0x61f670, size: 16 [D 20:43:40.588877] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 57/70. [D 20:43:40.588938] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.588948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.588956] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:40.687372] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:40.687385] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.687394] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.687410] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8397 [D 20:43:40.687420] element 0: offset: 0x668fd0, size: 72 [D 20:43:40.687430] openib_post_sr: 10.1.4.240:38258 bh 2 len 88 wr 58/70. [D 20:43:40.687489] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.687498] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.687507] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:40.690222] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:40.690233] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.690242] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.703459] BMI_post_send_list: addr: 6416064, count: 1, total_size: 16, tag: 8400 [D 20:43:40.703476] element 0: offset: 0x625390, size: 16 [D 20:43:40.703490] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 59/70. [D 20:43:40.703536] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.703546] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.703555] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:40.714045] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:40.714058] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.714066] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.714082] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 8406 [D 20:43:40.714091] element 0: offset: 0x668fd0, size: 72 [D 20:43:40.714102] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 60/70. [D 20:43:40.714153] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.714163] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.714171] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:40.719954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:40.719968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.719977] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:40.722233] BMI_post_send_list: addr: 6416064, count: 1, total_size: 16, tag: 8409 [D 20:43:40.722249] element 0: offset: 0x643630, size: 16 [D 20:43:40.722259] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 0/70. [D 20:43:40.722320] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:40.722330] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:40.722339] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:43:45.491067] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:43:45.491100] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:45.491109] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:43:45.491156] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 8414 [D 20:43:45.491166] element 0: offset: 0x661c80, size: 104 [D 20:43:45.491178] openib_post_sr: 10.1.4.240:38258 bh 6 len 120 wr 1/70. [D 20:43:45.491240] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:43:45.491250] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:43:45.491258] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:44:30.514296] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:44:30.514347] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:44:30.514357] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:44:30.514412] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 8417 [D 20:44:30.514422] element 0: offset: 0x64dcb0, size: 104 [D 20:44:30.514436] openib_post_sr: 10.1.4.240:38258 bh 7 len 120 wr 2/70. [D 20:44:30.514487] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:44:30.514497] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:44:30.514506] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:45:15.539367] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:45:15.539416] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:45:15.539426] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:45:15.539480] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 8420 [D 20:45:15.539490] element 0: offset: 0x661c80, size: 104 [D 20:45:15.539503] openib_post_sr: 10.1.4.240:38258 bh 8 len 120 wr 3/70. [D 20:45:15.539555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:45:15.539565] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:45:15.539574] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:46:00.620780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:46:00.620820] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:46:00.620831] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:46:00.620883] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 8423 [D 20:46:00.620894] element 0: offset: 0x661ad0, size: 104 [D 20:46:00.620907] openib_post_sr: 10.1.4.240:38258 bh 9 len 120 wr 4/70. [D 20:46:00.620954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:46:00.620965] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:46:00.620973] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:46:45.647339] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:46:45.647412] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:46:45.647437] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:46:45.647519] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 8426 [D 20:46:45.647548] element 0: offset: 0x661c80, size: 104 [D 20:46:45.647565] openib_post_sr: 10.1.4.240:38258 bh 10 len 120 wr 5/70. [D 20:46:45.650753] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:46:45.650823] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:46:45.650834] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:47:30.676215] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:47:30.676277] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:47:30.676288] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:47:30.676346] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 8429 [D 20:47:30.676357] element 0: offset: 0x620cc0, size: 104 [D 20:47:30.676371] openib_post_sr: 10.1.4.240:38258 bh 11 len 120 wr 6/70. [D 20:47:30.678637] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:47:30.678648] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:47:30.678657] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:48:15.703573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:48:15.703647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:48:15.703662] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:48:15.703811] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 8432 [D 20:48:15.703827] element 0: offset: 0x655ca0, size: 104 [D 20:48:15.703844] openib_post_sr: 10.1.4.240:38258 bh 12 len 120 wr 7/70. [D 20:48:15.707125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:48:15.707151] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:48:15.707165] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:49:00.731597] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:49:00.731661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:49:00.731673] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:49:00.731734] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 8435 [D 20:49:00.731746] element 0: offset: 0x655ca0, size: 104 [D 20:49:00.731760] openib_post_sr: 10.1.4.240:38258 bh 13 len 120 wr 8/70. [D 20:49:00.734024] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:49:00.734035] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:49:00.734044] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:49:45.756658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:49:45.756720] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:49:45.756731] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:49:45.756792] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 8438 [D 20:49:45.756802] element 0: offset: 0x655ca0, size: 104 [D 20:49:45.756816] openib_post_sr: 10.1.4.240:38258 bh 14 len 120 wr 9/70. [D 20:49:45.759064] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:49:45.759076] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:49:45.759084] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0